[go: up one dir, main page]

CN120161957A - Active pen and interactive system - Google Patents

Active pen and interactive system Download PDF

Info

Publication number
CN120161957A
CN120161957A CN202510220239.8A CN202510220239A CN120161957A CN 120161957 A CN120161957 A CN 120161957A CN 202510220239 A CN202510220239 A CN 202510220239A CN 120161957 A CN120161957 A CN 120161957A
Authority
CN
China
Prior art keywords
active pen
display device
module
uwb
pen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202510220239.8A
Other languages
Chinese (zh)
Inventor
请求不公布姓名
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Qianfenyi Intelligent Technology Co Ltd
Original Assignee
Shenzhen Qianfenyi Intelligent Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Qianfenyi Intelligent Technology Co Ltd filed Critical Shenzhen Qianfenyi Intelligent Technology Co Ltd
Priority to CN202510220239.8A priority Critical patent/CN120161957A/en
Publication of CN120161957A publication Critical patent/CN120161957A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0386Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry for light pen
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/038Control and interface arrangements therefor, e.g. drivers or device-embedded control circuitry
    • G06F3/0383Signal control means within the pointing device
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04812Interaction techniques based on cursor appearance or behaviour, e.g. being affected by the presence of displayed objects
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04847Interaction techniques to control parameter settings, e.g. interaction with sliders or dials
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

本申请提供一种主动笔和交互系统,涉及智能笔技术领域。主动笔包括:UWB模块;多个天线,连接于UWB模块,多个天线用于与显示设备之间交互UWB信号,该UWB信号用于确定主动笔的位置和指向,以确定主动笔在显示设备的显示界面中对应的光标位置。通过该技术方案,在主动笔中设置UWB模块以及多个天线,可以对主动笔进行较为精准的定位,有利于提升主动笔对于显示设备的操作灵敏度,以提升主动笔的飞鼠操作性能,尤其是主动笔作为激光笔时的指示性能,实现所指即所达的效果。该技术方案能够较大程度的提升用户对主动笔的使用体验。

The present application provides an active pen and an interactive system, which relate to the field of smart pen technology. The active pen includes: a UWB module; multiple antennas, connected to the UWB module, and the multiple antennas are used to exchange UWB signals with the display device, and the UWB signal is used to determine the position and direction of the active pen, so as to determine the cursor position corresponding to the active pen in the display interface of the display device. Through this technical solution, the UWB module and multiple antennas are set in the active pen, so that the active pen can be positioned more accurately, which is conducive to improving the operating sensitivity of the active pen to the display device, so as to improve the flying mouse operation performance of the active pen, especially the indication performance when the active pen is used as a laser pen, so as to achieve the effect of pointing to the point. This technical solution can greatly improve the user experience of the active pen.

Description

Active pen and interactive system
Technical Field
The application relates to the technical field of intelligent pens, in particular to an active pen and an interaction system.
Background
With the continuous development of science and technology, an active pen is generated in order to realize convenient input to electronic equipment. Accurate and rapid handwriting input can be realized by continuously moving the pen point of the active pen on the display screen of the electronic equipment. At present, the active pen not only realizes the most basic writing function, but also adds more new technology and new functions into the active pen, and the active pen is added with the mouse function, which is an important new technology applied to host computer wireless screen-throwing control, document explanation and the like, and can replace a mouse to position and control a screen.
The existing mouse function implementation mode in the active pen mainly uses an inertial measurement unit (Inertial Measurement Unit, IMU) to identify the acceleration and angular velocity information of the user for controlling the active pen to move up, down, left and right or shake to move the cursor on the screen of the host computer in cooperation with an algorithm, but the IMU can only identify the relative motion quantity, can not identify the relative positions of the active pen and the host computer, and has the problem of low operation sensitivity and positioning accuracy, so that the user experience can be influenced.
Disclosure of Invention
The application provides the active pen and the interaction system, which are beneficial to improving the operation performance of the active pen and providing better use experience for users.
In a first aspect, an active pen is provided that includes a UWB module, and a plurality of antennas coupled to the UWB module for interacting with a display device with UWB signals used to determine a position and orientation of the active pen to determine a corresponding cursor position of the active pen in a display interface of the display device.
According to the technical scheme provided by the embodiment of the application, the UWB module and the plurality of antennas are arranged in the active pen, so that the active pen can be positioned and pointed more accurately, the operation sensitivity of the active pen to the display equipment is improved, the operation performance of the active pen on mice is improved, especially the indication performance of the active pen as a laser pen is improved, and the pointed effect is realized. The technical scheme can greatly improve the use experience of the user on the active pen.
In some possible embodiments, the plurality of antennas includes two antennas, the two antennas are disposed at the end of the active pen, and a connection line direction of the two antennas is perpendicular to a central axis direction of the active pen.
In this technical scheme, can set up two antennas side by side at the tip of initiative pen, these two antennas can satisfy the accurate location to initiative pen and discernment initiative pen's pointing direction. In addition, the two antennas do not occupy a larger longitudinal space of the active pen, can adapt to a compact inner space of the active pen, and is beneficial to position design of other parts in the active pen, so that the overall structural performance and application performance of the active pen are optimized.
In some possible implementations, two antennas in the active pen interact with two antennas in the display device, a phase difference of UWB signals between the two antennas in the active pen and a first antenna in the display device is used for determining a first included angle between a connecting line of the two antennas in the active pen and the first antenna, a time of flight of UWB signals between a third antenna in the active pen and the first antenna in the display device is used for determining a first distance between the active pen and the first antenna, a phase difference of UWB signals between the two antennas in the active pen and a second antenna in the display device is used for determining a second included angle between a connecting line of the two antennas in the active pen and the second antenna, a time of flight of UWB signals between the third antenna in the active pen and the second antenna in the display device is used for determining a second distance between the active pen and the second antenna, and the first and second included angles, the first and second distances are used for determining a position and a pointing direction of the active pen.
Through the technical scheme of the embodiment of the application, 2 antennas can be arranged in the display equipment and the active pen, so that the active pen can be positioned more accurately, and the operation precision and the operation sensitivity of the active pen as a mouse or a laser pen are improved. According to the technical scheme, the performance of the active pen is improved, the number of antennas in the active pen and the display equipment can be reduced, and the hardware cost of the active pen and the display equipment is reduced.
In some possible implementations, the UWB module and the plurality of antennas are configured to detect a position and a pointing direction of the active pen at a preset frequency to determine a corresponding cursor movement of the active pen in a display interface of the display device.
In some possible implementations, the active pen further includes an IMU module for detecting pose information of the active pen, the pose information being used to determine a corresponding cursor movement of the active pen in a display interface of the display device and/or to correct a position and orientation of the active pen.
In some possible implementations, the IMU module detects, at a preset frequency, a plurality of pose information of the active pen, the plurality of pose information being used to determine a corresponding cursor movement of the active pen in a display interface of the display device.
According to the technical scheme, the initial position and the pointing direction of the active pen can be accurately positioned based on the UWB module and the plurality of antennas of the active pen, based on the initial position and the pointing direction of the active pen, the position and the relative change of the pointing direction of the active pen can be detected according to the pose information of the active pen measured by the IMU module, and accordingly the corresponding cursor position of the active pen in a display interface of the display device can be adjusted, and the mouse function, the laser pen function and the like of the active pen are realized. The technical scheme has lower algorithm complexity, and is beneficial to improving the response speed and instantaneity of the active pen for cursor control.
In some possible embodiments, the IMU module detects a plurality of pose information of the active pen at a first preset frequency, the UWB module and the plurality of antennas are configured to detect a plurality of positions and orientations of the active pen at a second preset frequency, the plurality of pose information is configured to modify the plurality of positions and orientations, and the modified plurality of positions and orientations are configured to determine a corresponding cursor movement of the active pen in a display interface of the display device.
In the embodiment, real-time relative change of the active pen can be measured by utilizing the IMU module, real-time position change and pointing change of the active pen can also be measured by utilizing the UWB module and a plurality of antennas, the information measured by the UWB module is corrected by combining the information measured by the IMU module, drift errors of UWB measurement can be reduced, the limitation of a single sensor can be effectively overcome by fusing the data of the UWB and the IMU, a more accurate positioning result is realized, and therefore, the accuracy of cursor control of the active pen on display equipment can be improved, and the real-time performance and stability of a system are improved.
In some possible embodiments, the active pen further comprises a communication module for sending pose information of the active pen to a display device, the display device determining a position and orientation of the active pen according to the UWB signal, and displaying a cursor in a display interface according to the pose information and the position and orientation of the active pen.
In some possible embodiments, the active pen further comprises a communication module for determining the position and the orientation of the active pen according to the UWB signal, correcting the position and the orientation of the active pen according to the pose information of the active pen, and sending the corrected position and orientation of the active pen to the display device so that the display device displays a cursor in the display interface.
In some possible embodiments, the communication module is further configured to receive a switch control signal and control a switching state of the UWB module and/or the IMU module according to the switch control signal.
In some possible implementations, the communication module includes a bluetooth low energy module.
In some possible embodiments, the active pen further comprises a switch module for detecting a user operation and controlling a switch state of the UWB module and/or the IMU module according to the user operation.
According to the technical scheme provided by the embodiment of the application, the switch module, such as a key, is arranged on the active pen, so that the function of a flying mouse can be opened based on the requirement of a user to perform positioning detection of the active pen, and the UWB module and the IMU module can be in a closed state in other time periods to reduce the power consumption of the active pen. The use of initiative pen mice function is promoted to when promoting user experience, can also promote the duration of initiative pen.
In a second aspect, there is provided an interactive system comprising a display device, and an active pen in the first aspect or any of the possible implementation manners of the first aspect, the active pen being configured to control a cursor position in a display interface of the display device.
In some possible implementations, the display device includes a UWB module and a plurality of antennas.
Drawings
Fig. 1 shows an interaction schematic diagram of an active pen and a display device according to an embodiment of the present application.
Fig. 2 shows a schematic block diagram of an active pen according to an embodiment of the present application.
Fig. 3 shows a schematic structural diagram of an active pen according to an embodiment of the present application.
Fig. 4 shows a schematic diagram of positioning two antennas in an active pen according to an embodiment of the present application.
Fig. 5 shows another schematic block diagram of the active pen provided by the embodiment of the present application.
Fig. 6 shows another schematic structural diagram of the active pen according to the embodiment of the present application.
Fig. 7 shows a schematic diagram of an interactive system according to an embodiment of the present application.
Detailed Description
The technical scheme of the application will be described below with reference to the accompanying drawings.
Active styluses, also known as active styluses, are advanced electronic writing instruments that interact with a touch screen through built-in electronic components and sensors, providing a more accurate and fluent writing experience than traditional passive styluses. Along with the continuous development of technology, the functions and performances of the active pen are also continuously improved, and the active pen becomes one of indispensable accessories of intelligent equipment.
In some application scenarios, the active pen may be added with a mouse (or may be called an Air mouse) function in addition to the operation on the screen, so as to be used as an Air mouse to control various display devices such as a computer, a television, a mobile phone, a projector, and the like.
Fig. 1 shows an interaction schematic diagram of an active pen and a display device according to an embodiment of the present application.
As shown in fig. 1, the active pen 10 may be used as an air mouse to control a display device 11. The active pen 10 may be wirelessly connected with the display device 11, such that the relevant control signals of the active pen 10 may reach the display device 11 through wireless transmission, and the display device 11 may perform relevant operations according to the control signals of the active pen 10.
As an example, the active pen 10 in fig. 1 may have a laser pen function. Through information interaction between the active pen 10 and the display device 11, the display device 11 can be caused to recognize the movement condition of the active pen 10, thereby displaying a cursor corresponding to the active pen 10.
The active pen 10 shown in fig. 1 may be provided with an IMU 101, and motion data such as acceleration and angular velocity of the active pen 10 in various directions in space may be detected by the IMU 101. By the motion data detected by the IMU 101, the relative motion of the active pen 10 in space, for example, up-down, left-right movement, etc., can be identified by matching with an algorithm. Based on the relative movement, the display device 11 may display a cursor corresponding to the active pen 10, the movement of which coincides with the relative movement of the active pen 10, thereby implementing the laser pen function of the active pen 10.
In the case of implementing the laser pen function or other functions of the active pen 10 by using the IMU 101, the IMU 101 can only identify the relative movement amount of the active pen 10, and cannot implement the relative position between the active pen 10 and the display device 11, and cannot accurately determine whether the active pen 10 is operating on the display device 11. Therefore, in the technical scheme, the positioning accuracy of the display device 11 to the active pen 10 is poor, and the operation sensitivity of the active pen 10 to the display device 11 is correspondingly poor, so that the use experience of the active pen 10 by a user is easily affected.
In view of this, the embodiment of the application provides an improved active pen scheme, which can improve the operation performance of the active pen, such as the mouse operation performance of the active pen, so as to improve the use experience of a user.
Fig. 2 shows a schematic block diagram of an active pen according to an embodiment of the present application.
As shown in fig. 2, the active pen 200 includes an Ultra-Wide Band (UWB) module 210 and a plurality of antennas 220 (two antennas 220 are shown as an illustration in the figure). Wherein, a plurality of antennas 220 are connected with the UWB module 210, the plurality of antennas 220 are used for interacting UWB signals with the display device, and the UWB signals are used for determining the position and the pointing direction of the active pen 200, so as to determine the corresponding cursor position of the active pen 200 in the display interface of the display device.
In an embodiment of the present application, the active pen 200 may be provided with a UWB module 210, and the UWB module 210 may include, for example, a UWB chip. UWB technology is a wireless communication technology that transmits information by using a very wide frequency band, thereby realizing high-speed data transmission and accurate positioning functions. The UWB technology can provide centimeter-level positioning precision, so that the UWB technology can be better suitable for indoor positioning systems. The UWB module 210 is mounted on the active pen 200, so that the positioning accuracy of the active pen 200 can be improved.
In order to realize UWB interaction with the active pen 200, a UWB module and an antenna are correspondingly disposed in the display device. In the active pen 200, the UWB module 210 is connected with a plurality of antennas 220, so that the plurality of antennas 220 can implement interactive transmission of UWB signals, and the UWB module 210 and the plurality of antennas 220 can form a UWB module in the active pen 200. The UWB module formed by the UWB module and the antennas in the display device may interact with the UWB module in the active pen 200 to obtain, through an algorithm, a relative position between any one or more of the plurality of antennas 220 in the active pen 200 and the display device, and a relative direction between the plurality of antennas 220.
Further, knowing the position of the plurality of antennas 220 in the active pen 200, the relative position of the active pen 200 and the display device may be determined based on the relative positions of the plurality of antennas 220 and the display device, and the orientation of the active pen 200 relative to the display device may be determined based on the relative directions between the plurality of antennas 220. According to the relative position and the pointing direction of the active pen 200 and the display device, a cursor corresponding to the active pen 200 can be accurately displayed on the display interface of the display device. For convenience of description, in the following related embodiments, the relative position of the active pen 200 and the display device may also be simply referred to as the position of the active pen 200, and the relative position of the antenna 220 and the display device in the active pen 200 may also be simply referred to as the position of the antenna 220.
According to the technical scheme provided by the embodiment of the application, the UWB module and the plurality of antennas are arranged in the active pen, so that the active pen can be positioned more accurately, the operation sensitivity of the active pen to the display equipment is improved, the mouse operation performance of the active pen is improved, especially the indication performance of the active pen when the active pen is used as a laser pen, and the indicated effect is realized. The technical scheme can greatly improve the use experience of the user on the active pen.
In some embodiments, two antennas 220 may be disposed in the active pen 200, and the two antennas 220 may be disposed at the same end of the active pen 200. Fig. 3 shows a schematic structural diagram of an active pen according to an embodiment of the present application.
As shown in fig. 3, in the active pen 200, two antennas 220 may be disposed side by side at the tail end of the active pen 200, and the connection line direction of the two antennas 220 may be perpendicular to the central axis direction of the active pen 200.
The UWB module 210 may be disposed on a side of the two antennas 220 facing the inside of the active pen 200 and electrically connected to the two antennas 220, and the UWB module 210 and the two antennas 220 may together form a UWB module, which may be further electrically connected to the main circuit board 201 in the active pen 200. The control module (e.g., control chip), communication module (e.g., communication chip), or other functional module of the active pen 200 may be disposed on the main circuit board 201, and the control module may be used to control the operation of the UWB module 210, and may receive the detection signal of the UWB module 210 to further process the detection signal.
In this technical scheme, can set up two antennas side by side at the tip of initiative pen, these two antennas can satisfy the accurate location to initiative pen and discernment initiative pen's pointing direction. In addition, the two antennas do not occupy a larger longitudinal space of the active pen, can adapt to a compact inner space of the active pen, and is beneficial to position design of other parts in the active pen, so that the overall structural performance and application performance of the active pen are optimized.
In the following, an example is taken in which the active pen includes two antennas, and a related method for determining the position and the pointing direction of the active pen according to UWB signals of the two antennas provided in the embodiments of the present application is described.
Fig. 4 shows a schematic diagram of positioning two antennas in an active pen according to an embodiment of the present application.
As shown in fig. 4, two antennas in the active pen are shown as antennas a and B, and the display device may be correspondingly provided with a plurality of antennas, one of which is shown as antenna C. The positions of the plurality of antennas in the display device are not particularly limited in the embodiment of the present application, and the position of the antenna C shown in the drawing is only one type of illustration.
In some embodiments, antenna C may transmit UWB signals to antenna a and antenna B, and for ease of description, UWB signals received by antenna a may be referred to as first UWB signals and UWB signals received by antenna B may be referred to as second UWB signals. According to a signal Arrival phase difference (PHASE DIFFERENCE of Arrival, PDOA) algorithm or an Angle of Arrival (AOA) algorithm, the active pen can calculate the direction angles of the two UWB signals reaching the antenna A and the antenna B according to the phase difference of the first UWB signal and the second UWB signal. For example, the angle α at which antenna B receives the second UWB signal is shown. The angle α may be an angle between a line between the antenna a and the antenna B and the antenna C.
In the example shown in fig. 4, far field conditions may be present between antennas a, B and C. Where the distance difference between the far field and the near field is generally bounded by (2D 2/λ), where D is the size of the antenna and λ is the wavelength of the UWB signal. Taking d=2cm as an example, the distance between the transceiver antennas may be in far field condition above ten centimeters. In the interaction scene of the active pen and the display device according to the embodiment of the application, the distance between the active pen and the display device is generally in a far-field condition. Under far field conditions, the first UWB signal and the second UWB signal transmitted by antenna C to antennas a and B may be parallel waves as shown.
Under the far field condition, the angle α at which the antenna B receives the second UWB signal can be calculated by the following formula:
;
Where lambda is the wavelength of the UWB signal transmitted by antenna C, d is the distance between antenna a and antenna B, Is the phase difference of the first UWB signal received by antenna a and the second UWB signal received by antenna B. Further, the distance r between antenna B and antenna C may be calculated based on the Time of Flight (TOF) of the UWB signal between antenna B and antenna C.
In case the display device comprises a plurality of antennas, the distance and angle between the antenna and the active pen may also be calculated as described above based on another antenna of the display device than antenna C. As an example, the display device may further include an antenna D, which may transmit UWB signals to an antenna a and an antenna B in the active pen, and for convenience of description, the UWB signal received by the antenna a may be referred to as a third UWB signal and the UWB signal received by the antenna B may be referred to as a fourth UWB signal. Based on the similar method as described above, the angle α' at which the antenna B receives the fourth UWB signal may be calculated from the phase difference between the third UWB signal and the fourth UWB signal. The angle α 'may be an angle between a line between the antenna a and the antenna B and the antenna D, and the distance r' between the antenna B and the antenna D may be obtained according to a flight time between the antenna B and the antenna D. From the above-mentioned angle α, angle α ', distance r and distance r', the position of the antenna B in three-dimensional space and the relative direction of the line between the antennas a and B can be determined, and further, the position and pointing direction of the active pen can be determined.
Through the technical scheme of the embodiment of the application, 2 antennas can be arranged in the display equipment and the active pen, so that the active pen can be positioned more accurately, and the operation precision and the operation sensitivity of the active pen as a mouse or a laser pen are improved. According to the technical scheme, the performance of the active pen is improved, the number of antennas in the active pen and the display equipment can be reduced, and the hardware cost of the active pen and the display equipment is reduced.
Optionally, to improve positioning accuracy, the display device may also include more than 2 antennas, where each antenna may interact with 2 antennas in the active pen for UWB signals. For example, the display device includes 3 antennas that can more accurately position the active pen, and in some examples, the 3 antennas in the display device can determine the spatial position of any one of the antennas in the active pen, and thus the accurate position of the active pen. On the basis, based on two included angles between any two antennas in the display device and the connecting line of the antennas in the active pen, the connecting line direction of the two antennas in the active pen can be determined, so that the pointing direction of the active pen is determined.
In some embodiments, the UWB module and the plurality of antennas may be used to detect the position and orientation of the active pen at a preset frequency to determine a corresponding cursor movement of the active pen in a display interface of the display device.
In this embodiment, the active pen may perform real-time UWB communication with the display device, so as to detect real-time position changes and pointing changes of the active pen, and the display device may correspondingly adjust the position of the cursor in the display interface according to the real-time position changes and pointing changes of the active pen, so as to achieve the effect that the cursor follows the movement of the active pen.
Fig. 5 shows another schematic block diagram of the active pen provided by the embodiment of the present application.
As shown in fig. 5, in an embodiment of the present application, the active pen 200 may further include an IMU module 230 in addition to the UWB module 210 and the plurality of antennas 220, and the IMU module 230 may be configured to detect pose information of the active pen 200, where the pose information may be used to determine a corresponding cursor movement of the active pen 200 in a display interface of a display device and/or to correct a position and orientation of the active pen 200.
In the embodiment of the present application, the IMU module 230 may include a 3-axis gyroscope and a 3-axis accelerometer, so as to measure and obtain information such as acceleration and angular velocity of the active pen, where the acceleration information of the active pen may represent a relative position change of the active pen, and the angular velocity information of the active pen may represent a gesture and a gesture change of the active pen. In the embodiment of the application, the information such as the relative position change of the active pen, the gesture change and the like can be called as the gesture information of the active pen. Alternatively, the pose information of the active pen 200 may include acceleration as well as angular velocity information. In some embodiments, the IMU module 230 may detect the acceleration and angular velocity information of the active pen in real time, e.g., may detect the acceleration and angular velocity information of the active pen at a preset frequency. After determining the initial position and pointing direction of the active pen based on the UWB signal, the position movement and angle change of the active pen 200 may be determined according to the acceleration, angular speed, and other information of the active pen 200 detected by the IMU module 230, so as to correspondingly adjust the position of the cursor in the display interface of the display device, thereby realizing the effect that the cursor follows the movement of the active pen.
According to the technical scheme, the initial position and the pointing direction of the active pen can be accurately positioned based on the UWB module and the plurality of antennas of the active pen, based on the initial position and the pointing direction of the active pen, the position and the relative change of the pointing direction of the active pen can be detected according to the pose information of the active pen measured by the IMU module, and accordingly the corresponding cursor position of the active pen in a display interface of the display device can be adjusted, and the mouse function, the laser pen function and the like of the active pen are realized. The technical scheme has lower algorithm complexity, and is beneficial to improving the response speed and instantaneity of the active pen for cursor control.
In order to further improve the accuracy of the active pen in cursor control, in other embodiments, the position and the pointing direction of the active pen may be detected in real time in combination with the IMU and UWB. For example, the IMU module 230 detects a plurality of pose information of the active pen at a first preset frequency, the UWB module 210 and the plurality of antennas 220 are configured to detect a plurality of positions and orientations of the active pen 200 at a second preset frequency, and the plurality of pose information is configured to correct the plurality of positions and orientations, and the corrected plurality of positions and orientations are configured to determine a corresponding cursor movement of the active pen in a display interface of the display device.
In the embodiment, real-time relative change of the active pen can be measured by utilizing the IMU module, real-time position change and pointing change of the active pen can also be measured by utilizing the UWB module and a plurality of antennas, the information measured by the UWB module is corrected by combining the information measured by the IMU module, drift errors of UWB measurement can be reduced, the limitation of a single sensor can be effectively overcome by fusing the data of the UWB and the IMU, a more accurate positioning result is realized, and therefore, the accuracy of cursor control of the active pen on display equipment can be improved, and the real-time performance and stability of a system are improved.
Alternatively, the first preset frequency and the second preset frequency may be equal or unequal. For example, the first preset frequency and the second preset frequency may be equal, so as to synchronously detect the change condition of the position, the angle and other parameters of the active pen. For another example, the first preset frequency may be greater than the second preset frequency, so as to reduce the detection frequency of the UWB module, and reduce the power consumption of the UWB module and the active pen while taking into account positioning accuracy.
With continued reference to fig. 5, in some embodiments, the active pen 200 may further include a communication module, illustrated in fig. 5 as a bluetooth low energy (Bluetooth Low Energy, BLE) module 240, in addition to the UWB module 210, the plurality of antennas 220, and the IMU module 230, and in other examples, may be other types of wireless communication modules, as the embodiments of the application are not limited in this regard. The communication module may include a wireless communication chip. The BLE module 240 may include a BLE chip.
The BLE module 240 may be used for wireless communication between the active pen 200 and a display device. In some embodiments, the BLE module 240 may be configured to send the pose information of the active pen measured by the IMU module to the display device. And a BLE module can be correspondingly arranged in the display device so as to realize communication with the BLE module in the active pen.
In some embodiments, positioning of the active pen may be performed by the display device. For example, the BLE module in the active pen is configured to send pose information of the active pen detected by the IMU module to a display device, where the display device determines a position and an orientation of the active pen according to UWB signals interacting with multiple antennas in the active pen, and displays a cursor in a display interface according to the pose information and the position and the orientation of the active pen.
Alternatively, in other embodiments, the positioning of the active pen may be performed by the active pen. For example, the BLE module in the active pen is configured to determine a position and an orientation of the active pen according to a UWB signal interacted with the display device, correct the position and the orientation of the active pen according to pose information of the active pen, and send the corrected position and orientation of the active pen to the display device, so that the display device displays a cursor in the display interface.
Fig. 6 shows another schematic structural diagram of the active pen according to the embodiment of the present application.
As shown in fig. 6, in the embodiment of the present application, the BLE module 240 and the IMU module 230 may be disposed on the main circuit board 201, and the BLE module 240, the IMU module 230, and the UWB module 210 may perform signal transmission with each other through the main circuit board 201. Additionally, referring to fig. 6, a battery 203 may be included in the active pen 200, and the battery 203 may provide power to the main circuit board 201 as well as other electrical components in the active pen 200.
Optionally, in some embodiments, the active pen 200 may further be provided with a switch module, where the switch module may be, for example, a key 202 shown in fig. 6, or may also be a touch input module such as a capacitive film, and may also be, for example, a voice input recognition module, or may be. The switching module may be used to detect user operation on the active pen 200 and control the switching state of the UWB module 210 and/or IMU module 230 according to the user operation.
As an example, in the case where the switch module includes the key 202, if a target operation (e.g., pressing, long pressing, double clicking, etc.) of the key by the user is detected, indicating that the mouse function needs to be turned on, the wake-up UWB module 210 and the IMU module 230 may be controlled such that UWB ranging and positioning is performed between the UWB module 210 and the display device, and the IMU module 230 performs pose detection of the active pen 200. In the event that the user's target operation of the key is again detected, indicating that the mouse function can be turned off, the UWB module 210 and IMU module 230 can be controlled to be turned off to reduce the power consumption of the active pen 200.
In other examples, if the switch module includes a capacitive membrane or a voice input recognition module, specific operation gestures (e.g., long press, double click, swipe, etc.) or user voice input content on the capacitive membrane may be detected to turn on or off the squirrel function, thereby turning on or off the UWB module 210 and IMU module 230.
In some embodiments, the switch state of UWB module 210 and/or IMU module 230 may be controlled by a communication module, such as BLE module 240. For example, BLE module 240 may obtain user operation on a switch module of the active pen to control the switching of UWB module 210 and/or IMU module 230.
According to the technical scheme provided by the embodiment of the application, the switch module, such as a key, is arranged on the active pen, so that the function of a flying mouse can be opened based on the requirement of a user to perform positioning detection of the active pen, and the UWB module and the IMU module can be in a closed state in other time periods to reduce the power consumption of the active pen. The use of initiative pen mice function is promoted to when promoting user experience, can also promote the duration of initiative pen.
The application further provides an interaction system. Fig. 7 shows a schematic diagram of an interactive system according to an embodiment of the present application.
As shown in fig. 7, the interactive system 300 may include an active pen 200 and a display device 400. The active pen 200 may be the active pen 200 provided in any of the above embodiments. The active pen 200 may be used to control the position of a cursor in a display interface of the display device 400. The display device 400 may include, for example, a computer, a television, a mobile phone, a projector, etc., and the embodiment of the present application is not limited to the specific type thereof.
The display device 400 may include a UWB module 410, and the UWB module 410 may include a UWB module and a plurality of antennas. Alternatively, the UWB module 410 may be disposed in the vicinity of the display area of the display device 400. For example, in the example shown in fig. 7, the UWB module 410 may be disposed above a display area of the display device 400. Where the display device 400 includes a projector, the UWB module 410 may be disposed above the projector curtain or elsewhere around the curtain. Alternatively, the UWB module 410 may be integrated inside the display device 400 or may be separately provided from the main body of the display device 400, and the UWB module 410 may be fixed at a fixed position on the edge of the screen and connected to the main body of the display device 400 through an interface such as USB.
In the display device 400, the UWB module 410 may perform UWB communication with a UWB module including the UWB module 210 and the plurality of antennas 220 in the active pen 200, thereby implementing accurate positioning of the active pen 200.
In addition, the display device 400 further comprises a communication module, such as BLE module 420 shown in fig. 7, which BLE module 420 may communicate with BLE module 240 in the active pen 200 to enable signal transmission between the active pen 200 and the display device 400.
In the interactive system 700, after the receiving end (display device 400) and the active pen 200 are paired by bluetooth, the user can enter the mouse mode through a key operation (long press/double click, etc.) of the pen end. At this time, the pen end and the receiving end activate the UWB module and mutually send UWB radio frequency signals to measure the distance and the direction. Data frame signals for ranging are transmitted between the two UWB channels.
In an active pen, the UWB module and IMU module may be in an off state by default to reduce power consumption. And activating the UWB module and the IMU module after the BLE module detects the key operation, and entering a mouse mode. The IMU sends acceleration and angular velocity signals of the active pen to the BLE module in real time, the UWB module sends the measured distance and direction information to the BLE module, and the BLE module obtains pointing information of the active pen relative to the screen end after carrying out algorithm fusion on the data and sends the pointing information to the screen end through Bluetooth. The screen end comprises a UWB module and a BLE module. After receiving the pointing information of the pen end, the screen end is converted into coordinate information and displays a corresponding cursor in the screen in real time.
Or when the BLE module detects that the key operation activates the UWB module and the IMU module and enters a mouse mode, the UWB antenna array in the active pen transmits a specific pulse signal to the antenna matrix at the screen end, the screen end UWB receiving antenna array recognizes the position of the pen and the placement angle information of the pen by recording the time difference of the signal arrival, and after the information is processed by an algorithm, the absolute position of the pen pointing to the screen end is displayed at the screen end through a cursor. The IMU sends acceleration and angular velocity signals of the active pen to the BLE module in real time, and the signals are transmitted to the screen end BLE module through a BLE antenna. The screen end controls cursor movement through identifying acceleration and angular velocity information of the pen, so that accurate positioning control of the cursor is realized.
The directional terms appearing in the above description are all directions shown in the drawings and do not limit the specific structure of the application. In the description of the present application, it should also be noted that, unless explicitly specified and limited otherwise, the terms "mounted," "connected," and "connected" are to be construed broadly, and may be either fixedly connected, detachably connected, or integrally connected, or may be directly connected or indirectly connected via an intermediate medium, for example. The specific meaning of the above terms in the present application can be understood as appropriate by those of ordinary skill in the art.
The term "and/or" in the present application is merely an association relation describing the association object, and indicates that three kinds of relations may exist, for example, a and/or B may indicate that there are three cases of a, a and B, and B.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs, the terms used in the description of this application in this application are for the purpose of describing particular embodiments only and are not intended to be limiting of the application, and the terms "comprising" and "having" and any variations thereof in the description of this application and the claims and the above description of the drawings are intended to cover non-exclusive inclusions. The terms first, second and the like in the description and in the claims or in the above-described figures, are used for distinguishing between different objects and not necessarily for describing a particular sequential or chronological order.
Reference in the specification to "an embodiment" means that a particular feature, structure, or characteristic described in connection with the embodiment may be included in at least one embodiment of the application. The appearances of such phrases in various places in the specification are not necessarily all referring to the same embodiment, nor are separate or alternative embodiments mutually exclusive of other embodiments. Those of skill in the art will explicitly and implicitly appreciate that the described embodiments of the application may be combined with other embodiments.
Those of ordinary skill in the art will appreciate that the various illustrative elements, modules, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, or combinations of computer software and electronic hardware. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
In the several embodiments provided by the present application, it should be understood that the disclosed systems, devices, and methods may be implemented in other manners. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. Alternatively, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices or units, which may be in electrical, mechanical or other form.
The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.
In addition, each functional unit in the embodiments of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit.
The functions, if implemented in the form of software functional units and sold or used as a stand-alone product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solution of the present application may be embodied essentially or in a part contributing to the prior art or in a part of the technical solution, in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, a network device, etc.) to perform all or part of the steps of the method according to the embodiments of the present application. The storage medium includes a U disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (Random Access Memory, RAM), a magnetic disk, an optical disk, or other various media capable of storing program codes.
The foregoing is merely illustrative of the present application, and the present application is not limited thereto, and any person skilled in the art will readily recognize that variations or substitutions are within the scope of the present application. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims (14)

1. An active pen, comprising:
A UWB module;
The antenna is connected with the UWB module and is used for interacting UWB signals with the display equipment, and the UWB signals are used for determining the position and the direction of the active pen so as to determine the corresponding cursor position of the active pen in the display interface of the display equipment.
2. The active pen of claim 1, wherein the plurality of antennas comprises two antennas, the two antennas are disposed at the end of the active pen, and a connection line direction of the two antennas is perpendicular to a central axis direction of the active pen.
3. The active pen of claim 2, wherein the two antennas in the active pen interact with two antennas in the display device for UWB signals;
A phase difference of UWB signals between the two antennas in the active pen and a first antenna in the display device is used to determine a first angle between a line connecting the two antennas in the active pen and the first antenna, and a time of flight of UWB signals between a third antenna in the active pen and the first antenna in the display device is used to determine a first distance between the active pen and the first antenna;
A phase difference of UWB signals between the two antennas in the active pen and a second antenna in the display device is used to determine a second angle between a line connecting the two antennas in the active pen and the second antenna, and a time of flight of UWB signals between a third antenna in the active pen and the second antenna in the display device is used to determine a second distance between the active pen and the second antenna;
the first angle, the second angle, the first distance, and the second distance are used to determine a position and a pointing direction of the active pen.
4. A pen as claimed in any one of claims 1 to 3 wherein the UWB module and the plurality of antennas are adapted to detect the position and orientation of the pen at a predetermined frequency to determine a corresponding cursor movement of the pen in a display interface of the display device.
5. The active pen of any one of claims 1 to 3, further comprising an IMU module for detecting pose information of the active pen, the pose information being used for determining a corresponding cursor movement of the active pen in a display interface of the display device and/or correcting a position and a pointing direction of the active pen.
6. The active pen of claim 5, wherein the IMU module detects a plurality of pose information of the active pen at a preset frequency, the plurality of pose information being used to determine a corresponding cursor movement of the active pen in a display interface of the display device.
7. The active pen of claim 5, wherein the IMU module detects a plurality of pose information of the active pen at a first preset frequency, the UWB module and the plurality of antennas are configured to detect a plurality of positions and orientations of the active pen at a second preset frequency, the plurality of pose information is configured to correct the plurality of positions and orientations, and the corrected plurality of positions and orientations are configured to determine a corresponding cursor movement of the active pen in a display interface of the display device.
8. The active pen of claim 5, further comprising a communication module for transmitting pose information of the active pen to the display device, wherein the display device determines a position and orientation of the active pen based on the UWB signal, and wherein a cursor is displayed in a display interface based on the pose information and the position and orientation of the active pen.
9. The active pen of claim 5, further comprising a communication module for determining a position and an orientation of the active pen based on the UWB signal, correcting the position and the orientation of the active pen based on pose information of the active pen, and transmitting the corrected position and orientation of the active pen to the display device to cause the display device to display a cursor in a display interface.
10. The active pen of claim 9, wherein the communication module is further configured to receive a switch control signal and control a switch state of the UWB module and/or IMU module in accordance with the switch control signal.
11. The active pen of claim 9, wherein the communication module comprises a bluetooth low energy module.
12. The pen of any one of claims 1 to 3, further comprising a switch module for detecting a user operation and controlling a switch state of the UWB module and/or IMU module according to the user operation.
13. An interactive system, comprising a display device, and
An active pen as claimed in any one of claims 1 to 12 for controlling the position of a cursor in a display interface of the display device.
14. The interactive system of claim 13 wherein the display device comprises a UWB module and a plurality of antennas.
CN202510220239.8A 2025-02-25 2025-02-25 Active pen and interactive system Pending CN120161957A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202510220239.8A CN120161957A (en) 2025-02-25 2025-02-25 Active pen and interactive system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202510220239.8A CN120161957A (en) 2025-02-25 2025-02-25 Active pen and interactive system

Publications (1)

Publication Number Publication Date
CN120161957A true CN120161957A (en) 2025-06-17

Family

ID=95999205

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202510220239.8A Pending CN120161957A (en) 2025-02-25 2025-02-25 Active pen and interactive system

Country Status (1)

Country Link
CN (1) CN120161957A (en)

Similar Documents

Publication Publication Date Title
US11327577B2 (en) Multi-function stylus with sensor controller
US8878775B2 (en) Display device and control method thereof
KR101253451B1 (en) Mobile device capable of position detecting of sound source and control method thereof
US8150162B2 (en) Method and system for three-dimensional handwriting recognition
US9417714B2 (en) RFID-based input device
KR100465241B1 (en) Motion recognition system using a imaginary writing plane and method thereof
US9310896B2 (en) Input method and electronic device using pen input device
US20060125789A1 (en) Contactless input device
US20120268373A1 (en) Method for recognizing user's gesture in electronic device
CN101398720B (en) Pen interactive device
CN115686264B (en) A method and device for preventing false touches
EP2752831B1 (en) Input device, display device and method of controlling thereof
US11550421B2 (en) Electronic device control method and input device
US10281996B2 (en) Touch sensitive system and stylus for commanding by maneuvering and method thereof
CN101561708A (en) Method for determining input mode by using motion sensing and input device thereof
CN111610869B (en) Stylus pen, electronic device and control method
CN205050078U (en) A wearable apparatus
US11360589B2 (en) Electronic device including flexible display and method of operating same
KR102091710B1 (en) Coordinate sensing apparatus and method for controlling thereof
US20240427431A1 (en) Device display control method, electronic device, and communication system
US20240310963A1 (en) Devices and methods for remote control and annotation associated with an electronic device
US20140191967A1 (en) Electronic device for recognizing asynchronous digital pen and recognizing method thereof
US12164712B2 (en) Electronic device for controlling operation of electronic pen device, operation method in electronic device, and non-transitory storage medium
CN120161957A (en) Active pen and interactive system
EP3647908B1 (en) Input method and intelligent terminal device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination