TWI890414B - Briefing instruction method and briefing system - Google Patents

Abstract

A briefing instruction method and a briefing system are provided. The briefing instruction method includes: displaying a screen through a monitor, where the screen includes a layer; generating measurement data through an inertial measurement unit of a handheld device; generating coordinate information of the handheld device based on the measurement data; utilizing the coordinate information of the handheld device to determine whether a projection point of a laser luminescence module of the handheld device is within a layer range of the layer; when the projection point of the laser luminescence module is not within the layer range of the layer, the laser luminescent module is driven through a power management circuit to project a projection light to the projection point; and when the projection point of the laser luminescent module is located within the layer range of the layer, power supply to the laser luminescent module is stopped through the power management circuit.

Description

Presentation instruction method and presentation system

The present invention relates to an operating method, and more particularly to a presentation instruction method and a presentation system.

Handheld devices commonly used for presentations simply emit a laser projector, allowing the presenter to adjust the laser projector's position within or outside the screen by moving the handheld device. However, this functionality doesn't provide a good presentation effect in certain presentation scenarios. For example, if the presenter wants to operate the screen, they must switch to using a mouse or a laptop touch panel.

The present invention provides a presentation instruction method and a presentation system that can effectively project laser light from a handheld device or control a cursor on a display.

The presentation instruction method of the present invention includes the following steps: displaying a screen on a display, wherein the screen includes a layer; generating measurement data using an inertial measurement unit of a handheld device; generating coordinate information of the handheld device based on the measurement data; determining whether a projection point of a laser light emitting module of the handheld device is within a layer range of the layer based on the coordinate information of the handheld device; and, if the projection point of the laser light emitting module is not within the layer range of the layer, driving the laser light emitting module to project light to the projection point via a power management circuit.

The presentation system of the present invention includes a display, an electronic device, and a handheld device. The electronic device is coupled to the display and displays a screen on the display, wherein the screen includes layers. The handheld device includes a processing module, a power management circuit, a laser light module, an inertial measurement unit, and a communication module. The power management circuit is coupled to the processing module. The laser light module is coupled to the power management circuit. The inertial measurement unit is coupled to the processing module and is used to generate measurement data. The communication module is coupled to the processing module and is used to connect to the electronic device to transmit the measurement data to the electronic device. The electronic device generates coordinate information for the handheld device based on the measurement data and uses this coordinate information to determine whether the laser module's projection point is within the layer range. If the laser module's projection point is not within the layer range, the electronic device notifies the handheld device, causing the processing module to drive the laser module through the power management circuit to project light to the projection point processing module.

Based on the above, the presentation instruction method and presentation system of the present invention can automatically determine whether the projection point of the laser light emitting module is within the layer range of the image layer in the image displayed on the display, thereby determining whether to project the corresponding projection light to the projection point.

To make the above features and advantages of the present invention more clearly understood, the following examples are given and described in detail with reference to the accompanying drawings.

100: Presentation System

110: Handheld device

111: Processing Module

112: Communication Module

113: Inertia measurement unit

114: Power management circuit

115: Laser luminescence module

116: Functional Components

117: Projection Point

120: Electronic devices

130: Display

131: Screen

132: Layers

133: Functional Interface

134: Cursor

610: User

620: Physical Objects

D1, D2, X, Y, Z: Direction

S410~S460, S510~S550: Steps

Figure 1 is a schematic diagram of a presentation system according to an embodiment of the present invention.

Figure 2 is a schematic diagram of a handheld device according to an embodiment of the present invention.

Figure 3 is a schematic diagram of a screen displayed on a display according to an embodiment of the present invention.

Figure 4 is a flow chart of a presentation instruction method according to an embodiment of the present invention.

Figure 5 is a flow chart of determining the position of a projection point according to an embodiment of the present invention.

Figures 6 to 8 are schematic diagrams of the operation of a presentation system according to an embodiment of the present invention.

To make the contents of the present invention more clearly understood, the following embodiments are specifically cited as examples of how the present invention can be implemented. Furthermore, wherever possible, elements/components/steps with the same reference numerals in the drawings and embodiments represent the same or similar components.

Figure 1 is a schematic diagram of a presentation system according to an embodiment of the present invention. Referring to Figure 1 , presentation system 100 includes a handheld device 110, an electronic device 120, and a display 130. In this embodiment, handheld device 110 includes a processing module 111, a communication module 112, an inertial measurement unit (IMU) 113, a power management circuit 114, and a laser light emitting module 115. Processing module 111 is coupled to communication module 112, IMU 113, and power management circuit 114. Power management circuit 114 is also coupled to laser light emitting module 115.

In this embodiment, the processing module 111 may be a microcontroller (MCU), or other types of control circuits, computing circuits, or processing circuits capable of performing the same functions. In this embodiment, the communication module 112 may be a wireless communication module and may include a wireless communication interface such as a Bluetooth interface or a Wi-Fi interface. In one embodiment, the communication module 112 may also be a wired communication module. The handheld device 110 may connect to the electronic device 120 via the communication module 112 to implement communication functions and transmit relevant data. In this embodiment, the inertia measurement unit 113 may include, for example, at least one of a gyroscope, an accelerometer, and a magnetometer, but the present invention is not limited thereto. The inertia measurement unit 113 can be used to measure angular velocity, acceleration, and magnetic field changes. In this embodiment, the laser light emitting module 115 may include a laser diode, and the laser diode can be used to emit laser projection light, where the laser projection light can display, for example, a red projection dot on the projection target, but the present invention is not limited to this.

In this embodiment, the electronic device 120 may be a related computer device such as a laptop, tablet, or desktop computer, but the present invention is not limited thereto. The electronic device 120 may also include related computer components such as a central processing unit (CPU), memory, and a screen. In this embodiment, the electronic device 120 may be connected to an external display 130 via a wired or wireless connection, but the present invention is not limited thereto. The electronic device 120 may display a projected image, a synchronized display image, or an extended display image via the display 130. The display 130 may be, for example, a standalone display device or a projection device, and the present invention is not limited thereto. In one embodiment, the display 130 may also be provided on the electronic device 120.

In one embodiment, the handheld device 110 may further include other functional components. These other functional components may be coupled to the processing module 111 and may include, for example, a remote control, buttons (e.g., for implementing the left and right buttons of a mouse), or a touch interface.

FIG2 is a schematic diagram of a handheld device according to an embodiment of the present invention. Referring to FIG1 and FIG2 , in this embodiment, the handheld device 110 may have an appearance as shown in FIG2 , but the present invention is not limited thereto. The handheld device 110 may include a pen head, a pen body, and a pen tail. In this embodiment, one end of the pen body of the handheld device 110 (e.g., the pen tail) may include a laser light emitting module 115, and the laser light emitting module 115 may emit projection light, wherein the optical path of the projection light may be parallel to the pen body of the handheld device 110. In this embodiment, the pen body of the handheld device 110 may further include a functional element 116, wherein the functional element 116 may be a paddle switch. In this embodiment, the handheld device 110 may be a presentation pen, a laser pointer, a suspended mouse, etc., but the present invention is not limited thereto. In one embodiment, the handheld device 110 may also implement the functionality of a touch pen. For example, the pen tip may be used to provide touch and handwriting functions on a touch panel or tablet.

In this embodiment, the processing module 111 can measure the angular velocity, acceleration, and magnetic field changes of the handheld device 110 in real time via the inertia measurement unit 113. The communication module 112 transmits the measurement data to the electronic device 120, allowing the electronic device 120 to calculate the coordinates of the handheld device 110 in space, where the space is defined by the vertical direction Z and the horizontal directions X and Y.

Figure 3 is a schematic diagram of a screen displayed on a display according to an embodiment of the present invention. Referring to Figures 1 to 3, electronic device 120 can display screen 131, as shown in Figure 3, via display 130. Screen 131 can be a projected screen, a synchronized display screen, or an extended display screen. In this embodiment, electronic device 120 can display layer 132 on screen 131. Layer 132 can be a semi-transparent layer. Layer 132 can have a basic parameter setting of, for example, 1% opacity or pixel values of (R, G, B) = (255, 255, 255), but the present invention is not limited to this. In this embodiment, the layer range of layer 132 can be equal to the display range of screen 131, but the present invention is not limited to this. In one embodiment, the layer range of layer 132 may also be smaller than the display range of screen 131. In this embodiment, layer 132 is used to enable the operating system of electronic device 120 to determine whether the projection point of laser light emitting module 115 of handheld device 110 is not located on screen 131 of display 130.

In this embodiment, layer 132 may also include a function interface 133. Regarding the data display structure, layer 132 may overlay screen 131, and function interface 133 may be displayed on layer 132. Function interface 133 may include multiple function icons. In this embodiment, function interface 133 may display a toolbar, and the multiple function icons may be used to correspond to different applications or functions, such as handheld device functions, related editing functions, or cursor control functions, but the present invention is not limited to these. In this embodiment, the user can select and execute the multiple function icons in function interface 133 by operating function element 116 (dial switch).

In this embodiment, when electronic device 120 determines that the projection point of handheld device 110's laser module 115 is within the layer range of layer 132, electronic device 120 may display a cursor 134 on screen 131 at the location corresponding to the projection point of handheld device 110's laser module 115. In this embodiment, the position of cursor 134 on screen 131 is determined based on the coordinate information of handheld device 110. This coordinate information includes the displacement change of handheld device 110 in the vertical direction (X) and the horizontal direction (Y).

Specifically, the displacement change of cursor 134 in a first direction D1 on screen 131 (e.g., represented by ΔX) is the result of dividing the displacement change of handheld device 110 in the vertical direction X (e.g., represented by IMU_X) by a scaling factor (e.g., represented by Sf) (i.e., ΔX = IMU_X/Sf). Furthermore, the displacement change of cursor 134 in a second direction D2 on screen 131 (e.g., represented by ΔY) is the result of dividing the displacement change of handheld device 110 in the horizontal direction Y (e.g., represented by IMU_Y) by a scaling factor (i.e., ΔY = IMU_Y/Sf). The displacement change of handheld device 110 in the vertical direction X and the displacement change in the horizontal direction Y can be provided by the inertial measurement unit 113. In other words, the sensitivity of the cursor 134 moving within the screen 131 can be set according to the scale factor.

Furthermore, in one embodiment, the displacement change of the handheld device 110 in the vertical direction X in space is the result of dividing the vertical coordinate change in the X direction in the coordinate information (e.g., represented by X_MOV) by the angular velocity conversion parameter. The displacement change in the horizontal direction Y is the result of dividing the horizontal coordinate change in the Y direction in the coordinate information (e.g., represented by Y_MOV) by the angular velocity conversion parameter. The angular velocity conversion parameter can be the result of dividing the limit value of the original data by the maximum angular velocity.

Furthermore, in subsequent embodiments, electronic device 120 may determine whether the projection point of handheld device 110's laser module 115 touches the border of layer 132 based on the coordinates of cursor 134 within layer 132. For example, within layer 132's border, the bottom-left corner of the border may be set as the starting coordinates (0, 0), and the top-right corner of the border may be set as (1920, 1080). In other words, the maximum vertical X coordinate value of layer 132's border (i.e., the screen area of screen 131 displayed on display 130) is 1920, and the maximum horizontal Y coordinate value is 1080. If the X-value (or Y-value) of cursor 134 on layer 132 matches the X-value (or Y-value) of the four corners of layer 132, electronic device 120 determines that the projection point of handheld device 110's laser module 115 touches the border of layer 132. For example, if cursor 134's coordinates fall between (0,0-1080), (1920,0-1080), (0-1920,0), or (0-1920,1080), electronic device 120 determines that the projection point of handheld device 110 touches the border of layer 132.

FIG4 is a flow chart of a presentation instruction method according to an embodiment of the present invention. Referring to FIG1 through FIG4 , the presentation system 100 may execute steps S410 to S460 as follows. In step S410, the electronic device 120 may display a screen 131 on the display 130. In step S420, the electronic device 120 may generate measurement data using the inertial measurement unit 113 of the handheld device 110. In step S430, the electronic device 120 may generate coordinate information of the handheld device 110 based on the measurement data. In step S440, the electronic device 120 can determine whether the projection point of the laser module 115 of the handheld device 110 is within the layer range of the layer based on the coordinate information of the handheld device 110. In step S450, if the projection point of the laser module 115 is not within the layer range of the layer, the power management circuit 114 can drive the laser module 115 to project light at the projection point. In step S460, if the projection point of the laser module 115 is within the layer range of the layer, the power management circuit 114 stops supplying power to the laser module 115. Therefore, the presentation system 100 of this embodiment can automatically switch the handheld device 110 between handheld device mode and cursor control mode.

Specifically, Figure 5 is a flowchart for determining the projection point position according to an embodiment of the present invention. Figures 6 through 8 are schematic diagrams of the operation of a presentation system according to an embodiment of the present invention. Refer to Figures 1 and 5 through 8. In the usage scenario shown in Figures 6 through 8, for example, a user 610 holds a handheld device 110, and a physical object 620 is located next to the display 130. The electronic device 120 may execute the following steps S510 through S550. In step S510, the electronic device 120 may monitor the position of the projection point 117 of the laser light-emitting module 115 of the handheld device 110. In step S520, electronic device 120 determines whether projection point 117 of laser light emitting module 115 extends beyond the bounds of layer 132 and touches the bounds of the bounds. If not, step S530 is executed. If so, step S550 is executed. In other words, when projection point 117 of laser light emitting module 115 extends beyond the bounds of layer 132 and touches the bounds of the bounds, electronic device 120 determines that projection point 117 of laser light emitting module 115 is within the bounds of layer 132.

In step S530, electronic device 120 determines whether projection point 117 of laser light emitting module 115 touches the border of layer 132 from within the layer range. If not, step S510 is executed. If so, step S540 is executed. In other words, when projection point 117 of laser light emitting module 115 touches the border of layer 132 from within the layer range, electronic device 120 determines that projection point 117 of laser light emitting module 115 is not within the layer range of layer 132.

In step S540, electronic device 120 may notify processing module 111 to drive laser light module 115 to project light onto projection point 117 and hide the cursor. In step S550, electronic device 120 may notify processing module 111 to stop supplying power to laser light module 115 via power management circuit 114 and display cursor 134 on screen 131.

For example, as shown in FIG6 , electronic device 120 can operate handheld device 110 in cursor control mode. User 610 can control the position of cursor 134 on screen 131 by moving handheld device 110. This allows the user to conveniently operate handheld device 110 to provide instructions on screen 131 . Next, as shown in FIG7 , user 610 can move handheld device 110 so that projection point 117 of laser module 115 moves from within the layer range of layer 132 to touch the border of the layer range of layer 132 . At this point, electronic device 120 switches handheld device 110 to handheld device mode, enabling laser module 115 to emit projection light and hiding cursor 134 on screen 131. Next, as shown in FIG8 , if the user continues to move projection point 117 of handheld device 110 away from display 130, for example, onto physical object 620, the corresponding laser projection point will be displayed on physical object 620. This allows the user to conveniently operate handheld device 110 to indicate physical objects.

In summary, the presentation instruction method and system of the present invention provide both handheld device functionality and cursor control functionality. The present invention monitors the handheld device's position in real time to determine whether the handheld device's projection point is within the display screen, thereby determining whether the handheld device operates in handheld device mode or cursor control mode. When the handheld device operates in handheld device mode, it automatically emits projection light to display the projection point on the projection target, and the cursor image does not appear on the display screen. Conversely, when the handheld device operates in cursor control mode, the handheld device automatically turns off the laser light module, and a cursor appears on the display screen, with the cursor's position shifting accordingly with changes in the handheld device's position. Therefore, the presentation instruction method and presentation system of the present invention can have the handheld device function and cursor control function with good user experience.

Although the present invention has been disclosed above through embodiments, they are not intended to limit the present invention. Anyone with ordinary skill in the art may make minor modifications and improvements without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope of the attached patent application.

S410~S460: Steps

Claims (18)

A presentation instruction method includes: Displaying a screen on a display, wherein the screen includes a layer; Generating measurement data using an inertial measurement unit of a handheld device; Generating coordinate information of the handheld device based on the measurement data; Determining whether a projection point of a laser light emitting module of the handheld device is within a layer range of the layer based on the coordinate information of the handheld device; When the projection point of the laser light emitting module is not within the layer range of the layer, driving the laser light emitting module via a power management circuit to project a projection light toward the projection point; and When the projection point of the laser light emitting module is within the layer range of the layer, the power management circuit stops supplying power to the laser light emitting module. The presentation instruction method of claim 1, wherein the step of determining whether the projection point of the laser light emitting module of the handheld device is within the layer range of the layer comprises: When the projection point of the laser light emitting module touches a border of the layer range from within the layer range of the layer, determining that the projection point of the laser light emitting module is not within the layer range of the layer; and When the projection point of the laser light emitting module touches the border of the layer range from outside the layer range of the layer, determining that the projection point of the laser light emitting module is within the layer range of the layer. The presentation instruction method of claim 1 further comprises: When the projection point of the laser light emitting module is within the layer range of the layer, displaying a cursor on the screen via the display. A presentation indication method as described in claim 3, wherein the position of the cursor in the screen is determined based on the coordinate information of the handheld device. A presentation indication method as described in claim 4, wherein a displacement change of the cursor in a first direction in the screen is generated based on a displacement change in a vertical direction of the handheld device and a proportional factor, and a displacement change of the cursor in a second direction in the screen is generated based on a displacement change in a horizontal direction of the handheld device and the proportional factor. A presentation instruction method as described in claim 5, wherein the vertical displacement change is generated based on the vertical coordinate change and an angular velocity transformation parameter in the coordinate information, and the horizontal displacement change is generated based on the horizontal coordinate change and the angular velocity transformation parameter in the coordinate information. The presentation instruction method of claim 1, wherein the display further displays a functional interface, wherein the layer overlays the screen, and the functional interface is displayed on the layer. The presentation instruction method as described in claim 1, wherein the layer is a semi-transparent layer. In the presentation instruction method as described in claim 1, the screen displayed by the display is a projection screen, a synchronous display screen or an extended display screen. A presentation system includes: a display; an electronic device coupled to the display and configured to display a screen on the display, wherein the screen includes a layer; and a handheld device including: a processing module; a power management circuit coupled to the processing module; a laser light emitting module coupled to the power management circuit; an inertial measurement unit coupled to the processing module and configured to generate measurement data; and a communication module coupled to the processing module and configured to connect to the electronic device to transmit the measurement data to the electronic device. The electronic device generates coordinate information for the handheld device based on the measurement data and determines, based on the coordinate information of the handheld device, whether a projection point of the laser module is within a layer range of the layer. When the projection point of the laser module is not within the layer range of the layer, the electronic device notifies the handheld device to cause the processing module to drive the laser module via the power management circuit to project a projection light toward the projection point processing module. When the projection point of the laser module is within the layer range of the layer, the electronic device notifies the handheld device to cause the processing module to stop supplying power to the laser module via the power management circuit. The presentation system of claim 10, wherein when the projection point of the laser light emitting module touches a border of the layer range from within the layer range, the electronic device determines that the projection point of the laser light emitting module is not within the layer range of the layer. When the projection point of the laser light emitting module touches the border of the layer range from outside the layer range of the layer, the electronic device determines that the projection point of the laser light emitting module is within the layer range of the layer. The presentation system as described in claim 10, wherein when the projection point of the laser light emitting module is located within the layer range of the layer, the electronic device displays a cursor in the screen through the display. A presentation system as described in claim 12, wherein the electronic device determines the position of the cursor in the screen based on the coordinate information of the handheld device. A presentation system as described in claim 13, wherein the displacement change of the cursor in a first direction in the screen is the result of dividing the displacement change of the handheld device in a vertical direction by a proportional factor, and the displacement change of the cursor in a second direction in the screen is the result of dividing the displacement change of the handheld device in a horizontal direction by the proportional factor. A presentation system as described in claim 14, wherein the vertical displacement change is the result of dividing the vertical coordinate change in the coordinate information by an angular velocity transformation parameter, and the horizontal displacement change is the result of dividing the horizontal coordinate change in the coordinate information by the angular velocity transformation parameter. The presentation system of claim 10, wherein the display further displays a functional interface, wherein the layer overlays the screen, and the functional interface is displayed on the layer. The presentation system of claim 10, wherein the layer is a semi-transparent layer. A presentation system as described in claim 10, wherein the screen displayed by the display is a projection screen, a synchronous display screen or an extended display screen.