JP2018156466A - Display control device, display control method, display control program, and display control system - Google Patents

Abstract

An electronic board system capable of simultaneously scanning with a plurality of electronic pens is provided. A plurality of light emitting pens 200, 250 are assigned different light emission patterns to emit light. When either one is lit, the three-dimensional position coordinates of the light emitting pen that emits light are detected based on the imaging signal, and the position coordinates and the inclination received from the light emitting pen that emits light are detected. Based on the information, the marker is displayed by detecting the position on the display surface 22 indicated by the emitting pen. Further, when both are turned on or both are turned off, the three-dimensional position coordinates of the light-emitting pens 200 and 250 are predicted based on the writing locus so far, and the predicted position coordinates and the light-emitting pens 200, Based on the tilt information received from 250, the position on the display surface 22 indicated by each light-emitting pen 200, 250 is detected and a marker is displayed. [Selection] Figure 17

Description

  The present invention relates to a display control device, a display control method, a display control program, and a display control system.

  In recent years, an electronic board system in which a touch panel is provided on a flat panel display such as a liquid crystal display is used in a normal conference or a remote conference. This electronic board system detects a position on a display touched with a light-emitting pen or an operator's finger and displays a predetermined marker, line, character, symbol, or the like.

  In recent years, an electronic board that acquires a position on a display panel irradiated with a laser pointer based on a camera image is also known. Specifically, in Patent Document 1 (Japanese Patent Application Laid-Open No. 2005-63101), for the purpose of acquiring coordinates indicating the display from a distant position, the position irradiated with a laser on the display is determined by a camera on the user side. A configuration for taking an image and acquiring a designated position is disclosed. Further, in Patent Document 2 (Japanese Patent Laid-Open No. 8-249150), for the purpose of acquiring coordinates indicating the display from a remote position, the light irradiated by the laser pointer is detected using a light receiving sensor on the display. A configuration for acquiring the indicated position is disclosed.

  However, it has been difficult for conventional electronic board systems including the techniques of Patent Documents 1 and 2 to distinguish and detect the writing trajectories of a plurality of light emitting pens. For this reason, it is difficult for the conventional electronic board system to scan by a plurality of users having a light emitting pen.

  The present invention has been made in view of the above-described problems, and enables display control by allowing a plurality of users having a light-emitting pen to scan by distinguishing and detecting writing trajectories of the light-emitting pens. An object is to provide a device, a display control method, a display control program, and a display control system.

  In order to solve the above-described problems and achieve the object, the present invention includes a setting unit that sets different light emission patterns for a plurality of light-emitting pens that emit predetermined light, and at least a pair of camera devices. A three-dimensional position detection unit that detects a three-dimensional position of the light emitting pen based on an imaging signal obtained by imaging one of the light emitting pens at the timing of light emission, and provided in each light emitting pen Based on the acquisition unit that acquires the inclination information indicating the inclination of each light-emitting pen, which is detected and transmitted by the inclination sensor, and the detected three-dimensional position, and the inclination information acquired from the light-emitting pen A display position calculating unit that calculates an indicated position on the display unit that is pointed to by the light-emitting pen; and a display control unit that displays a predetermined object at the calculated indicated position on the display unit.

  According to the present invention, it is possible to distinguish and detect writing trajectories of a plurality of light emitting pens, and it is possible to scan the electronic board system with a plurality of users.

FIG. 1 is a diagram illustrating an appearance of a display control system according to the first embodiment. FIG. 2 is a side view of the light emitting pen. FIG. 3 is a front view of the display unit for explaining the detailed configuration of the display unit. FIG. 4 is a block diagram for explaining the hardware configuration of the display unit. FIG. 5 is a diagram for explaining the coordinate position detection operation of the light emitting pen in the writing detection mode in which the writing locus of the light emitting pen is detected on the display surface of the display unit. FIG. 6 is a diagram showing the level of infrared light corresponding to the tilt angle of the light-emitting pen detected by the light receiving unit. FIG. 7 is a diagram for explaining the coordinate position detection operation of the light emitting pen in the indicated position detection mode for detecting the indicated position when a single light emitting pen is designated on the display surface from a position away from the display surface. It is. FIG. 8 is a diagram for explaining the detection operation of the horizontal position (X coordinate) and the depth direction position (Z coordinate) of the pen tip of the light emitting pen in the first designated position detection mode. FIG. 9 is a diagram illustrating a signal level obtained from an imaging signal of a light emitting pen imaged by each stereo camera. FIG. 10 is a diagram for explaining the Y coordinate position detection operation of the light emitting pen. FIG. 11 is a diagram illustrating signal levels in the vertical direction of the stereo camera when the pen tip of the light emitting pen is lit. FIG. 12 is a diagram for explaining the operation of detecting the tilt angle of the light emitting pen. FIG. 13 is a diagram for explaining the operation of detecting the designated position on the surface of the light-emitting pen. FIG. 14 is a flowchart for explaining the operation in the first designated position detection mode of the electronic board system according to the first embodiment. FIG. 15 is a diagram for explaining the coordinate position detection operation of the light-emitting pen in the second designated position detection mode in which the writing trajectories of the plurality of light-emitting pens scanned at positions away from the display surface are three-dimensionally detected. is there. FIG. 16 is a diagram for explaining the Y coordinate position detection operation of a plurality of light emitting pens in the second designated position detection mode. FIG. 17 is a diagram for explaining the operation of detecting the tilt angles of a plurality of light-emitting pens in the second designated position detection mode. FIG. 18 is a diagram illustrating signal levels of imaging signals obtained by imaging two light-emitting pens that both emit light with each stereo camera. FIG. 19 is a diagram illustrating a signal level of an imaging signal obtained by imaging one of the two light emitting pens that emits light with each stereo camera. FIG. 20 is a diagram illustrating a signal level of an imaging signal obtained by imaging each of the two light emitting pens that emits light with the respective stereo cameras. FIG. 21 is a diagram for explaining a control operation for controlling blinking of two light emitting pens with different light emission patterns. FIG. 22 is a diagram showing specific examples of different light emission patterns of two light emitting pens. FIG. 23 is a flowchart for explaining the operation in the second designated position detection mode of the electronic board system according to the first embodiment. FIG. 24 is a diagram illustrating a system configuration of an electronic board system according to the second embodiment.

  Hereinafter, the electronic board system of the embodiment will be described.

(First embodiment)
(System configuration)
First, FIG. 1 is a diagram illustrating an appearance of the electronic board system according to the first embodiment. As shown in FIG. 1, the electronic board system includes a display unit 10, a stand 40, and a device storage unit 50. A front surface of the housing of the display unit 10 is a display surface 22 for displaying an image. The display surface 22 is a touch panel 24 formed by providing a touch sensor formed of a transparent electrode or the like on a flat panel such as a liquid crystal panel or a plasma panel.

  In such an electronic board system, when the touch panel 24 is touched with the light emitting pen 100, the coordinate position on the touch panel 24 touched is detected. The display unit 10 displays the locus of the detected coordinate position on the touch panel 24. Thereby, an object such as a character or a figure drawn by touching the display surface 22 with the light-emitting pen 100 can be displayed on the touch panel 24.

(Structure of luminous pen)
FIG. 2 is a side view of the light-emitting pen 100. As shown in FIG. 2, the light emitting pen 100 is provided with a light emitting unit 202 that emits infrared light at the pen tip 201. Further, the light emitting pen 100 is provided with a switch 204 for lighting the light emitting unit 202 of the pen tip 201 on the housing 200. The housing 200 of the light-emitting pen 100 is provided with an inclination sensor 205 such as an acceleration sensor or a ground axis sensor that detects the inclination of the light-emitting pen 100. Further, the light emitting pen 100 is provided with a communication control unit 203 at the end opposite to the end of the housing 200 where the pen tip 201 is provided.

  The light emitting unit 202 emits light and emits infrared light while the switch 204 is operated. The infrared light emitted from the light emitting unit 202 is detected based on the wavelength, intensity, and the like in the light receiving sensors 300a to 300d and the stereo cameras 700a to 700b of the display unit 10 which will be described later with reference to FIG. Further, the communication control unit 203 of the light-emitting pen 100 performs wireless communication (may be wired communication) with a control circuit 350 of the display unit 10 to be described later with reference to FIG. Tilt information indicating the tilt of the light-emitting pen 100 detected by the sensor 205 is transmitted. In addition, the light-emitting pen 100 can change the color and shape of the marker by operating the switch 204. Further, the communication control unit 203 controls the light emitting unit 202 to emit infrared light with a light emission pattern instructed from the control circuit 350 on the display unit 10 side in a second designated position detection mode described later. The control circuit 350 is an example of a display control device, and includes functions of a three-dimensional position detection unit, a display position calculation unit, and a display control unit.

(Appearance structure of display unit)
FIG. 3 is a front view of the display unit 10 for explaining the detailed configuration of the display unit 10. As shown in FIG. 3, the display unit 10 is provided with light receiving sensors 300 a to 300 d at the four corners of the display surface 22. In addition, stereo cameras 700a to 700b, which are two camera devices, are provided on the upper side of the display unit 10 in order to detect the position of the light-emitting pen 100 that is located away from the display surface 22.

(Hardware configuration of display unit)
FIG. 4 is a block diagram for explaining a hardware configuration of the display unit 10. As shown in FIG. 4, the light receiving sensors 300a to 300d are connected to the control circuit 350 of the display unit 10 together with the stereo cameras 700a and 700b described above. The control circuit 350 is connected to a receiving unit 352 (an example of an acquiring unit) for receiving tilt information wirelessly transmitted from the light-emitting pen 100 and a storage unit 351 in which a display control program is stored. The control circuit 350 operates based on the display control program stored in the storage unit 351, thereby displaying characters or figures corresponding to the operation locus of the light emitting pen 100 on the display surface 22 as described later.

(Light-emitting pen writing locus detection mode)
Next, the control circuit 350 detects the writing locus of the light emitting pen 100 two-dimensionally as a writing locus detection mode of the light emitting pen 100 and the writing locus of the light emitting pen 100 three-dimensionally. Has a three-dimensional detection mode. In addition, as a three-dimensional detection mode, the control circuit 350 three-dimensionally detects a writing locus of one light-emitting pen 100 that is scanned at a position away from the display surface 22, “first indicated position detection mode”, In addition, there is a “second indication position detection mode” that three-dimensionally detects the writing trajectories of the plurality of light emitting pens 100.

(Writing detection mode)
FIG. 5 is a diagram for explaining the coordinate position detection operation of the light emitting pen 100 in the writing detection mode in which the writing trajectory of the light emitting pen 100 is detected on the display surface 22 of the display unit 10. In the writing detection mode, the user operates the switch 204 at a timing when the pen tip 201 of the light-emitting pen 100 is brought into contact with the display surface 22. Thereby, only when the pen tip 201 of the light-emitting pen 100 comes into contact with the display surface 22, the light-emitting unit 202 of the light-emitting pen 100 is turned on. Infrared light emitted from the light emitting unit 202 is received by each of the light receiving units 300a to 300d. FIG. 5 shows a state in which the infrared light 480 and the infrared light 490 emitted from the light emitting unit 202 are received by the light receiving units 300a and 300c.

  The control circuit 350 calculates the inclination angles α and β with respect to the horizontal direction of the location where the infrared light is detected based on the detection signals of the infrared light from the respective light receiving units 300a and 300c. Is calculated and converted into XY coordinates. FIG. 6A is a diagram illustrating the level of infrared light detected by the light receiving unit 300a and corresponding to the inclination angle α of the light-emitting pen 100. FIG. FIG. 6B is a diagram illustrating the level of infrared light corresponding to the inclination angle β of the light-emitting pen 100 detected by the light receiving unit 300b. 6A and 6B, the horizontal axis represents the tilt angle (θ) of the light-emitting pen 100, and the vertical axis represents the signal level (I) of infrared light. The control circuit 350 controls the display surface 22 to display characters or figures corresponding to the writing trajectory of the light emitting pen 100 based on the converted XY coordinates.

(First indicated position detection mode)
Next, FIG. 7 illustrates the coordinate position detection operation of the light-emitting pen 100 in the indicated position detection mode for detecting the designated position when the light-emitting pen 100 is designated on the display surface 22 from a position away from the display surface 22. It is a figure for doing. In FIG. 7, the user points the light-emitting pen 100 to a desired position (a position where an instruction is desired) on the display surface 22 and operates the switch 204. As a result, the light emitting unit 202 of the nib 201 is turned on. Further, the communication control unit 203 of the light-emitting pen 100 wirelessly transmits operation information of the switch 204 and inclination information indicating the inclination of the light-emitting pen 100 detected by the inclination sensor 205 to the control circuit 350 of the display unit 10. .

  The stereo camera 700a and the stereo camera 700b capture the light-emitting pen 100, respectively. The control circuit 350 is a three-dimensional position corresponding to the indicated position on the display surface 22 of the light emitting pen 100 based on the signal level of the imaging signal of the light emitting unit 202 of the pen tip 201 captured by the stereo camera 700a and the stereo camera 700b. , And the tilt angle of the light-emitting pen 100 is detected based on the tilt information received from the light-emitting pen 100 via the receiving unit 352. Then, the control circuit 350 calculates the indicated position on the display surface 22 by the light-emitting pen 100 based on the three-dimensional position and the tilt angle of the light-emitting pen 100, and as shown in FIG. Display a given object.

(Details of the first designated position detection mode)
More specifically, the control circuit 350 uses an imaging signal obtained by imaging the light emitting pen 100 with the stereo camera 700a and the stereo camera 700b, respectively, and based on the principle of triangulation, as shown in FIG. A position 202 in the horizontal direction (X coordinate) and a position in the depth direction (Z coordinate) are detected.

  FIG. 9A is a diagram illustrating a signal level obtained from an imaging signal of the light-emitting pen 100 captured by the stereo camera 700a, and FIG. 9B is an image of the light-emitting pen 100 captured by the stereo camera 700b. It is a figure which shows the signal level (I) obtained from a signal. As can be seen from FIG. 9A, at an angle A formed by the X axis along the parallel direction of the stereo cameras 700a and 700b and a straight line connecting the light emitting unit 202 of the light emitting pen 100 and the stereo camera 700a. The signal level shows a peak. As can be seen from FIG. 9B, the signal level shows a peak at an angle B formed by the straight line connecting the light emitting unit 202 of the light emitting pen 100 and the stereo camera 700b and the X axis.

  The control circuit 350 detects the position of the light emitting unit 202 that is the position of the infrared light of the light emitting pen 100 based on the imaging signal of the light emitting pen 100 captured by the stereo cameras 700a and 700b. The control circuit 350 detects an angle Α and an angle が formed by a straight line connecting the centers of the stereo cameras 700a and 700b and the light emitting unit 202 and the X axis, and uses the triangulation formula to calculate the X coordinate and the light emitting unit 202. Calculate the Z coordinate.

  Next, the control circuit 350 detects the position (Y coordinate position) in the vertical direction of the light emitting unit 202 of the light emitting pen 100. FIG. 10 is a diagram for explaining the operation of detecting the position of the Y coordinate of the light emitting unit 202. FIG. 11 is a diagram showing the signal level (I) in the vertical direction of the stereo camera 700a or the stereo camera 700b when the light emitting unit 202 is lit. As can be seen from FIG. 11, the Z axis along a direction two-dimensionally orthogonal to the X axis direction, which is the parallel direction of the stereo cameras 700 a and 700 b, the light emitting unit 202 of the light emitting pen 100, and the stereo camera 700 a. At an angle Γ formed by the connecting straight line, the signal level shows a peak.

  The control circuit 350 has an angle formed by the Z axis and the straight line connecting the center of the stereo camera 700a and the light emitting unit 202 from the position where the infrared light is detected based on the imaging signal from the stereo camera 700a (or the stereo camera 700b). Γ is detected, and the Y coordinate of the light emitting unit 202 is calculated using the angle Γ and the Z coordinate calculated as described above.

  Next, FIG. 12 is a diagram for explaining the operation of detecting the tilt angle of the light emitting pen 100. As shown in FIG. 12, the tilt sensor 205 of the light emitting pen 100 detects the tilt angle “θ” in the horizontal direction and the tilt angle “φ” in the vertical direction. The communication control unit 203 of the light-emitting pen 100 performs wireless communication with the control circuit 350 of the display unit 10, and the tilt indicating the horizontal tilt angle “θ” and the vertical tilt angle “φ” detected by the tilt sensor 205. Send information.

  Next, as shown in FIG. 13, the control circuit 350 calculates the three-dimensional position (x, y, z) of the light emitting unit 202 of the light-emitting pen 100 calculated as described above and the inclination (θ, φ) of the light-emitting pen 100. ) Is used to calculate the coordinates (X, Y, Z) of the designated position on the display surface 22. The coordinates (X, Y, Z) of the designated position exist on an extension line in the direction of the inclination (θ, φ) of the light emitting pen 100 from the three-dimensional position (x, y, z) of the light emitting unit 202. For this reason, the following mathematical formula is established.

Z−z = tan θ (X−x)
Z−z = tanφ (Y−y)

  The display surface 22 of the display unit 10 is the same as the XY plane, and when the Z coordinate is 0, the indicated position (X, Y, Z) on the display surface 22 is calculated by the following mathematical formula.

  (XYZ) = (x-cot θz y-cot φz 0)

  The control circuit 350 displays a marker 710 or the like for the indicated position on the display surface 22 calculated in this way, and indicates the position on the display surface 22 pointed to by the user with the light-emitting pen 100.

(Operation in the first designated position detection mode)
The flowchart of FIG. 14 shows the flow of operations in the first designated position detection mode. The control circuit 350 of the display unit 10 operates based on the display control program stored in the storage unit 351 shown in FIG. 4 to execute the processing shown in the flowchart of FIG. In step S <b> 1, the control circuit 350 determines whether or not the switch 204 is operated based on the operation information of the switch 204 received from the light emitting pen 100 by the receiving unit 352. When the switch 204 is not operated (step S1: No), the control circuit 350 advances the process to step S8 and performs non-display control of the marker 710 displayed on the display surface 22 of the display unit 10.

  On the other hand, when the switch 204 is operated (step S1: Yes), the control circuit 350 advances the process to step S2, controls the imaging of the stereo cameras 700a and 700b, and emits light from the light emitting pen 100 that emits light. The unit 202 is imaged to obtain an imaging signal (see FIGS. 9A and 9B). In step S <b> 3, the control circuit 350 calculates the three-dimensional position coordinates of the pen tip 201 based on the imaging signal of the light emitting unit 202 acquired from each stereo camera.

  Next, in step S <b> 4, the control circuit 350 calculates the inclination of the light emitting pen 100 based on the inclination information detected by the inclination sensor 205 of the light emitting pen 100 and received via the receiving unit 352. In step S5, the control circuit 350 is instructed by the user with the light-emitting pen 100 based on the three-dimensional position coordinates of the pen tip 201 calculated in step S3 and the inclination of the light-emitting pen 100 calculated in step S4. The indicated position on the display surface 22 is calculated.

  Next, the control circuit 350 determines whether or not the calculated indicated position is within the range of the display surface 22 in step S6. When the calculated designated position is outside the range of the display surface 22 (step S6: No), the control circuit 350 hides the marker 710 in step S8. On the other hand, when the calculated designated position is within the range of the display surface 22 (step S6: Yes), the control circuit 350 controls to display the marker 710 at the calculated designated position on the display surface 22 in step S7. To do. By repeating such an operation, a line drawing or a character corresponding to the writing locus of the light emitting pen 100 is displayed on the display surface 22 of the display unit 10.

(Second designated position detection mode)
Next, FIG. 15 shows the coordinate position detection operation of the light emitting pen in the second designated position detection mode in which the writing trajectories of the plurality of light emitting pens 200 and 250 scanned at positions away from the display surface 22 are three-dimensionally detected. It is a figure for demonstrating. In the example of FIG. 15, scanning is performed with a total of two light emitting pens, that is, the light emitting pen 200 and the light emitting pen 250. As will be described later, each of the light-emitting pens 200 and 250 has “lighting only the light-emitting pen 200”, “lighting only the light-emitting pen 250”, “both light-emitting pens 200 and 250 light”, and “light-emitting pens 200 and 250 The flashing control is performed with different light emission patterns so as to form a total of four light emission patterns, both of which are turned off.

  The stereo cameras 700a and 700b image the light emitting pens 200 and 250 as shown in FIG. The control circuit 350 detects the indicated position of the light-emitting pen 200 based on the image-capturing signal when only the light-emitting pen 200 is emitting light among the image-capturing signals obtained by imaging the light-emitting pens 200 and 250. Further, the control circuit 350 detects the indicated position of the light-emitting pen 250 based on the image-capturing signal when only the light-emitting pen 250 emits light among the image-capturing signals obtained by imaging the light-emitting pens 200 and 250. To do. Further, the control circuit 350 predicts the current coordinate position of each light-emitting pen 200, 250 from the past coordinate position at the timing when both light-emitting pens 200, 250 are turned on or off.

  The principle of detecting the indicated position of each light-emitting pen 200, 250 is as described above. That is, in the example of FIG. 15, the control circuit 350 uses the imaging signals obtained by imaging the light-emitting pens 200 and 250 with the stereo camera 700a and the stereo camera 700b, respectively, and based on the principle of triangulation, X coordinates x0 and x1 which are horizontal positions of 200 and 250 and Z coordinates z0 and z1 which are positions in the depth direction are detected.

  In addition, the control circuit 350, as shown in FIG. 16, is based on a straight line connecting the centers of the light-emitting pen 200 and the stereo camera 700a based on the imaging signal of the light-emitting pen 200 imaged by the stereo camera 700a (or the stereo camera 700b). , An angle Γ0 formed by the Z axis is detected. Then, the control circuit 350 calculates the Y coordinate y0 of the light-emitting pen 200 using the angle Γ0 and the Z coordinate z0 calculated as described above. Similarly, on the basis of the imaging signal of the light emitting pen 250 captured by the stereo camera 700a (or the stereo camera 700b), the control circuit 350 has a straight line connecting the centers of the light emitting pen 250 and the stereo camera 700a and the Z axis. The formed angle Γ1 is detected. Then, the control circuit 350 calculates the Y coordinate y1 of the light emitting unit 202 using the angle Γ1 and the Z coordinate z1 calculated as described above.

  Specifically, in FIGS. 18A to 18C, each light-emitting pen 200, which is obtained from an imaging signal obtained by imaging each light-emitting pen 200, 250 at the timing when both the light-emitting pens 200, 250 emit light. The signal level corresponding to 250 light emission is shown. 18A shows a signal level of the light emitting pen 200 at an angle A0 between a straight line connecting the light emitting unit 202 of the light emitting pen 200 and the center of the stereo camera 700a shown in FIG. FIG. 16 is a diagram illustrating a signal level of the light-emitting pen 250 at an angle A1 between a straight line connecting the light-emitting unit 252 of the light-emitting pen 250 and the center of the stereo camera 700a and the x axis.

  FIG. 18B shows the signal level of the light-emitting pen 200 at an angle B0 between the straight line connecting the light-emitting portion 202 of the light-emitting pen 200 and the center of the stereo camera 700b shown in FIG. 15 is a diagram illustrating a signal level of the light-emitting pen 250 at an angle B1 between a straight line connecting the light-emitting unit 252 of the light-emitting pen 250 and the center of the stereo camera 700b and the x axis.

  18C shows the signal level of the light-emitting pen 200 at an angle Γ0 between the straight line connecting the light-emitting unit 202 of the light-emitting pen 200 and the center of the stereo camera 700a shown in FIG. 16 is a diagram illustrating a signal level of the light-emitting pen 250 at an angle Γ1 between a straight line connecting the light-emitting unit 252 of the light-emitting pen 250 and the center of the stereo camera 700a and the z-axis.

  19A to 19C show signal levels corresponding to light emission of the light-emitting pen 200, which are obtained from imaging signals obtained by imaging the light-emitting pens 200 and 250 at the timing when only the light-emitting pen 200 emits light. FIG. Among these, Fig.19 (a) is a figure which shows the signal level of the light emission pen 200 in the angle A0 shown in FIG. FIG. 19B is a diagram showing the signal level of the light-emitting pen 200 at the angle B0 shown in FIG. FIG. 19C shows the signal level of the light-emitting pen 200 at the angle Γ0 shown in FIG.

  20A to 20C show signal levels corresponding to light emission of the light-emitting pen 250, which are obtained from imaging signals obtained by imaging the light-emitting pens 200 and 250 at the timing when only the light-emitting pen 250 emits light. FIG. Among these, Fig.20 (a) is a figure which shows the signal level of the light emission pen 250 in the angle A1 shown in FIG. FIG. 20B is a diagram showing the signal level of the light emitting pen 200 at the angle B1 shown in FIG. FIG. 20C shows the signal level of the light-emitting pen 250 at the angle Γ1 shown in FIG.

  The control circuit 350 calculates the position coordinates (x0, y0, z0) and (x1, y1, z1) of each light-emitting pen 200, 250 based on the above-described imaging signal obtained with the controlled light emission pattern.

  FIG. 17 is a diagram for explaining the operation of detecting the tilt angle of each of the light emitting pens 200 and 250. As shown in FIG. 17, the inclination sensor 205 of each light-emitting pen 200, 250 detects the horizontal inclination angle “θ0, θ1” and the vertical inclination angle “φ0, φ1” of each light-emitting pen 200, 250. To do. The communication control unit 203 of each of the light emitting pens 200 and 250 performs wireless communication with the control circuit 350 of the display unit 10, and the horizontal inclination angles “θ0, θ1” and the vertical inclination angle “detected by the inclination sensor 205. Inclination information indicating “φ0, φ1” is transmitted.

  Next, the control circuit 350 calculates the three-dimensional coordinate positions (x0, y0, z0, x1, y1, z1) of the light emitting pens 200 and 250 calculated as described above and the inclinations of the light emitting pens 200 and 250. (Θ0, θ1, and φ0, φ1), and based on the above formula, the coordinates (X0, Y0, Z0, X1, Y1, etc.) of the indicated positions of the light-emitting pens 200 and 250 on the display surface 22 shown in FIG. Z1) is calculated. The control circuit 350 displays objects such as the markers 710 and 711 at the position on the display surface 22 calculated in this way, and the position on the display surface 22 indicated by the user with the light-emitting pens 200 and 250 or the writing locus. Indicates.

  FIG. 21 shows a control form of the light emission patterns of the light emitting pens 200 and 250 by the control circuit 350. The control circuit 350 (an example of a setting unit) supplies instruction signals for instructing different light emission patterns to the light emitting pens 200 and 250, respectively. The communication control units 203 and 253 of the light emitting pens 200 and 250 control the light emission units 202 and 252 to emit light with the light emission pattern instructed by the instruction signal.

  FIG. 22 shows an example of the light emission pattern set by the instruction signal for each of the light emitting pens 200 and 250. FIG. 22A shows a light emission pattern set in the light emitting pen 200, which is a light emission pattern that repeats on and off at equal intervals. FIG. 22B shows a light emission pattern set for the light emitting pen 250, and is a light emission pattern that repeats on / off at equal intervals similarly to the light emitting pen 200, but the on / off time is longer than the on / off time of the light emitting pen 200. It is a little longer. For this reason, as shown in FIGS. 22A and 22B, the A section in which both the light-emitting pens 200 and 250 are both turned off, the B section in which only the light-emitting pen 200 is lit, and both the light-emitting pens 200 and 250 are both in A total of four sections (light emission state of each of the light-emitting pens 200 and 250) are formed, ie, a section C that is lit and a section D in which only the light-emitting pen 250 is lit.

  The control circuit 350 calculates the position coordinates (x0, y0, z0) and (x1, y1, z1) of each light-emitting pen 200, 250 based on the above-described imaging signal obtained for each light emission pattern. Then, the control circuit 350 calculates the calculated three-dimensional coordinate position (x0, y0, z0, x1, y1, z1) of each light-emitting pen 200, 250 and the inclination (θ0, θ1, and φ0, φ1), and the coordinates (X0, Y0, Z0, X1, Y1, Z1) of the indicated positions of the light-emitting pens 200 and 250 on the display surface 22 shown in FIG. 16 are calculated based on the above formula. . The control circuit 350 displays objects such as the markers 710 and 711 at the position on the display surface 22 calculated in this way, and the position on the display surface 22 indicated by the user with the light-emitting pens 200 and 250 or the writing locus. Indicates.

(Operation flow until the marker is displayed in the second designated position detection mode)
The flowchart of FIG. 23 shows the flow of operations until the marker is displayed in the second designated position detection mode. The control circuit 350 of the display unit 10 operates based on the display control program stored in the storage unit 351 shown in FIG. 4, thereby executing the processing shown in the flowchart of FIG. In step S <b> 1, the control circuit 350 acquires operation information of the switch 204 received from the light emitting pens 200 and 250 by the receiving unit 352. In step S <b> 2, the control circuit 350 determines whether or not both switches 204 of the light emitting pens 200 and 250 are in an operating state based on the operation information of the switches 204 received from the light emitting pens 200 and 250. When it is determined that only one of the light emitting pens 200 and 250 is in the operating state (step S2: Yes), the control circuit 350 shifts to the first designated position detection mode described with reference to FIG. To do.

  On the other hand, if it is determined that both switches 204 are in the operating state, the control circuit 350 sets the different light emission patterns described with reference to FIG. 22, for example, to each of the light emitting pens 200 and 250 in step S3. An instruction signal is transmitted. This instruction signal is received by the communication control units 203 and 253 of the light emitting pens 200 and 250. The communication control units 203 and 253 of the light emitting pens 200 and 250 control the lighting of the light emitting unit 202 with the light emission pattern designated by the instruction signal (step S4).

  Each stereo camera 700a, 700b images each light-emitting pen 200, 250. Based on the imaging signals of the light-emitting pens 200 and 250, the control circuit 350 determines that the current light-emitting pattern is the A section where both the light-emitting pens 200 and 250 described with reference to FIG. It is determined which section corresponds to the light emission pattern among the B section to be lit, the C section in which both of the light emitting pens 200 and 250 are lit, and the D section in which only the light emitting pen 250 is lit (step S5). In step S6, the control circuit 350 first determines whether or not the light emitting pen 200, which is one of the light emitting pens 200, is turned on based on the imaging signals of the light emitting pens 200 and 250. Determine.

  If it is determined that only the light-emitting pen 200 is lit (step S16: Yes), the control circuit 350 determines the light-emitting pen 200 based on the imaging signals of the light-emitting pens 200 and 250 in step S17. Calculate three-dimensional position coordinates. In step S18, the control circuit 350 acquires the tilt information received from the tilt sensor 205 of the light-emitting pen 200. In step S19, the control circuit 350 calculates the indicated position on the display surface 22 by the light-emitting pen 200 based on the three-dimensional position coordinates of the light-emitting pen 200 and the inclination indicated by the inclination information.

  In step S20, the control circuit 350 determines whether or not the calculated indicated position is within the display surface 22 (whether or not it is within the display area). When it is determined that the calculated indication position is within the display surface 22 (step S20: Yes), the control circuit 350 controls display of the marker for the light emitting pen 200 on the display surface 22 in step S21. On the other hand, when it is determined that the calculated indicated position is outside the display surface 22 (step S20: No), the control circuit 350 performs non-display control of the marker for the light-emitting pen 200 (display surface) in step S22. 22 is erased from above).

  On the other hand, when it is determined in step S16 described above that only the light emitting pen 200 is not turned on (step S16: No), the control circuit 350 in step S23 is the light emitting pen 250 which is the other light emitting pen. Whether or not only the light emission pattern is lit is determined based on the imaging signals of the light emitting pens 200 and 250.

  When it is determined that only the light-emitting pen 250 is lit (step S23: Yes), the control circuit 350 determines the light-emitting pen 250 based on the imaging signals of the stereo cameras 700a and 700b in step S24. Three-dimensional position coordinates are calculated, and the process proceeds to step S18. In step S18, the control circuit 350 acquires the tilt information received from the tilt sensor 205 of the light-emitting pen 250, and in step S19, based on the three-dimensional position coordinates of the light-emitting pen 250 and the tilt indicated by the tilt information. The indicated position on the display surface 22 by the light emitting pen 250 is calculated. Then, when the calculated designated position is within the display surface 22 (step S20: Yes), the control circuit 350 places a marker for the light emitting pen 250 at the designated position on the display surface 22 designated by the light emitting pen 250. Control display.

  On the other hand, if it is determined in step S23 that only the light-emitting pen 250 is not a light-emitting pattern (step S23: No), both the light-emitting pens 200 and 250 are both turned off or both. Either it is lit. In this case, the control circuit 350 predicts the three-dimensional position coordinates of the light-emitting pens 200 and 250 based on the past writing trajectory in step S25, and advances the processing to step S18. That is, the control circuit 350 sequentially stores coordinate information corresponding to the writing trajectories of the light emitting pens 200 and 250 in the storage unit 351. The control circuit 350 predicts the scanning direction and the scanning distance based on the coordinate information corresponding to the writing locus of each light-emitting pen 200, 250. And the three-dimensional position coordinate which becomes this prediction result is estimated as a position coordinate of each light emitting pen 200,250.

  In this example, the three-dimensional position coordinates are predicted when the light emitting pens 200 and 250 are both turned on or off. However, when the light-emitting pens 200 and 250 are both turned on or off, the three-dimensional position coordinates may not be detected. In this case, when any one of the light emitting pens 200 and 250 is lit, the three-dimensional position coordinates are detected.

  In step S18, the control circuit 350 acquires the tilt information received from the tilt sensor 205 of each light-emitting pen 200, 250. In step S19, the control circuit 350 indicates the three-dimensional position coordinates and tilt information of each light-emitting pen 200, 250. The indicated position on the display surface 22 by each of the light emitting pens 200 and 250 is calculated based on the tilt. Then, when the calculated designated position is within the display surface 22 (step S20: Yes), the control circuit 350 uses the light emitting pen 200 for the designated position on the display surface 22 designated by the light emitting pens 200 and 250. Display control of the marker or the marker for the light-emitting pen 250 is performed.

(Effects of the first embodiment)
As is clear from the above description, the electronic board system according to the first embodiment assigns different light emission patterns to the light emitting pens 200 and 250 to emit light. When either one is lit, the three-dimensional position coordinates of the light emitting pen that emits light are detected based on the imaging signal, and the position coordinates and the inclination received from the light emitting pen that emits light are detected. Based on the information, the marker is displayed by detecting the position on the display surface 22 indicated by the emitting pen.

  Further, when both are turned on or both are turned off, the three-dimensional position coordinates of the light-emitting pens 200 and 250 are predicted based on the writing locus so far, and the predicted position coordinates and the light-emitting pens 200, Based on the tilt information received from 250, the position on the display surface 22 indicated by each light-emitting pen 200, 250 is detected and a marker is displayed.

  Thereby, the writing locus | trajectory of each light emission pen 200,250 can be distinguished and detected, and it can be made to scan an electronic board system by a some user. Further, when one of the light emitting pens 200 and 250 is operated, the switch 204 of both the light emitting pens 200 and 250 operates together in the first designated position detection mode. When operated, it operates in the second designated position detection mode. That is, the control circuit 350 operates by switching between the first designated position detection mode and the second designated position detection mode according to the operation state of the switches of the light emitting pens 200 and 250. For this reason, a plurality of users can scan the same display surface 22 using the same light emitting pen. It can be realized with the same kind of hardware and software.

(Second Embodiment)
Next, an electronic board system according to a second embodiment will be described. The electronic board system according to the second embodiment communicates between two electronic board systems, and displays a plurality of light emitting pen markers on the other side as well as a plurality of light emitting pen markers on the other side. This is an example that can be displayed. Note that only the above point is different between the above-described first embodiment and the second embodiment described below. For this reason, only the difference between the two will be described below, and redundant description will be omitted.

  FIG. 24 is a diagram illustrating a system configuration of an electronic board system according to the second embodiment. The electronic board system of the second embodiment is configured by connecting a plurality of electronic board systems to each other via a predetermined network. As the network, an external network such as the Internet or an internal network such as a LAN (Local Area Network) can be used. The example of FIG. 24 shows an example in which two electronic board systems are connected to each other via a network. Each electronic board system has the same configuration and operation as the electronic board system described in the first embodiment.

  In such an electronic board system according to the second embodiment, the control circuits 350a and 350b of the electronic board systems are positioned on the display surface 22 (=) indicated by the light emitting pens 200a and 250a on the own device side. Display position information indicating the display position of the marker is transmitted to the electronic board system on the counterpart device side via the network. That is, the control circuit 350a of the electronic board system on the display unit 10a side displays the markers 710a and 910a as described above at the position on the display surface 22a indicated by the light emitting pens 200a and 250a on the own unit side. At the same time, the display position information indicating the display positions of the markers 710a and 910a is transmitted to the electronic board system on the display unit 10b side serving as the counterpart device side via the network.

  The electronic board system on the display unit 10b side, which is the counterpart device, receives the display position information of the markers 710a and 910a by the network reception unit 355b and supplies it to the control circuit 350b. The control circuit 350b displays the markers 810a and 950a as described above at the position on the display surface 22b pointed to by the light emitting pens 200b and 250b on the own device side, and the display position information received from the control circuit 350a. Markers 710b and 910b are displayed at positions on the display surface 22b.

  In addition, the control circuit 350b of the electronic board system of the counterpart device displays the display position information of the markers 810a and 950a indicating the position on the display surface 22b indicated by the light emitting pens 200b and 250b on the own device side, on the display unit 10a side. Send to the electronic board system via the network. In the electronic board system on the display unit 10a side, the display position information of the markers 810a and 950a is received by the network reception unit 355a and supplied to the control circuit 350b. The control circuit 350a displays the markers 710a and 910a as described above at the position on the display surface 22a pointed to by the light emitting pens 200a and 250a on the own device side, and receives from the electronic board system on the display unit 10b side. Markers 810b and 950b are displayed at positions on the display surface 22a indicated by the display position information.

  Accordingly, a plurality of markers of the electronic device system on the partner device side can be displayed on the display surfaces 22a and 22b on the own device side, and the same effect as that of the first embodiment described above can be obtained.

(Modification of the embodiment)
Each of the above-described embodiments has been presented as an example, and is not intended to limit the scope of the present invention. The novel embodiment can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the spirit of the invention.

(First modification)
For example, although the stereo cameras 700a and 700b are provided on the upper side of the display unit 10, they may be provided at any of the lower side, right side, and left side of the display unit 10.

(Second modification)
In addition, the stereo cameras 700a and 700b may be arranged in the vertical direction instead of the horizontal arrangement. In this case, the arrangement of the stereo cameras 700a and 700b is rotated by 90 degrees. Therefore, in the vertical arrangement, the position coordinate of the y coordinate is calculated by the position coordinate calculation method described using FIG. 8, and the position coordinate of the x coordinate is calculated by the position coordinate calculation method described using FIG. Calculated.

(Third Modification)
Moreover, while providing in the upper side part or lower side part of the display part 10, you may provide in the right side part or left side part of the display part 10. FIG. In this case, the control circuit 350 acquires an imaging signal obtained by imaging the light emitting pen 100 with a stereo camera provided on the upper side of the display unit 10, for example. In addition, the control circuit 350 acquires an imaging signal obtained by imaging the light emitting pen 100 with a stereo camera device provided on the right side of the display unit 10, for example. Then, the control circuit 350 comprehensively calculates the indicated position of the light-emitting pen 100 based on each acquired imaging signal. Thereby, the indicated position of the light emitting pen 100 can be detected with high accuracy.

(Fourth modification)
Alternatively, a plurality of sets of stereo cameras may capture different light-emitting pens 200 and 250 and display predetermined objects at positions on the screen surface 22 pointed to by the light-emitting pens 200 and 250. In this case, a pair of stereo cameras 700 a and 700 b is set as one set, and a plurality of pairs of stereo cameras 700 a and 700 b are provided for one display unit 10. Then, different sets of light emitting pens 200 and 250 are imaged by each pair of stereo cameras 700a and 700b.

  Based on each imaging signal obtained by imaging each light-emitting pen 200, 250 with each pair of stereo cameras 700a, 700b and the tilt information received from each light-emitting pen 200, 250, the control circuit 350 Each position on the display surface 22 pointed to by the light-emitting pens 200 and 250 is calculated to display a predetermined object. Even in this case, it is possible to distinguish and detect the writing trajectory of each of the light emitting pens 200 and 250 to enable the electronic board system to be scanned by a plurality of users. Can be obtained.

  For example, the marker display operation described with reference to the flowchart of FIG. 14 or FIG. 23 is performed by software using a display control program. However, some or all of the operations described using the flowchart of FIG. 14 or FIG. 23 may be realized by hardware.

  The display control program may be provided by being recorded in a recording medium that can be read by a computer device such as a CD-ROM or a flexible disk (FD) in a file in an installable or executable format. Further, the program may be provided by being recorded on a recording medium readable by a computer device such as a CD-R, a DVD (Digital Versatile Disk), a Blu-ray Disc (registered trademark), or a semiconductor memory. The display control program may be provided by being installed via a network such as the Internet. The display control program may be provided by being incorporated in advance in a ROM or the like in the device.

  Such modifications of the embodiments are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 10 Display part 22 Display surface 24 Touch panel 100 Light emitting pen 200 Light emitting pen 201 Pen tip 202 Infrared light emitting part 203 Communication control part 204 Switch 205 Inclination sensor 250 Light emitting pen 252 Infrared light emitting part 253 Communication control part 300a Light receiving sensor 300b Light receiving Sensor 300c Light receiving sensor 300d Light receiving sensor 350 Control circuit 351 Storage unit 352 Receiving unit 480 Infrared light 490 Infrared light 700a Stereo camera 700b Stereo camera

JP-A-2005-63101 JP-A-8-249150

Claims (17)

A setting unit for setting different light emission patterns for a plurality of light emitting pens that emit predetermined light;
A three-dimensional position detection unit that detects a three-dimensional position of the light-emitting pen that emits light based on an imaging signal obtained by imaging at least one of the light-emitting pens at the timing when the light-emitting pen emits light. When,
An acquisition unit that acquires inclination information indicating the inclination of each light-emitting pen, which is detected and transmitted by an inclination sensor provided in each light-emitting pen;
Based on the detected three-dimensional position and the tilt information acquired from the emitted light emitting pen, a display position calculating unit that calculates an indicated position on the display unit indicated by the emitted light emitting pen;
A display control device comprising: a display control unit that displays a predetermined object at the calculated indicated position on the display unit. The three-dimensional position detection unit, when an imaging signal imaged at the timing when each of the light emitting pens is turned on or off is obtained by the camera device, the writing locus of each light emitting pen stored in the storage unit Based on the coordinate information corresponding to the three-dimensional position of each light-emitting pen,
The display position calculation unit calculates an indicated position on the display unit indicated by each light-emitting pen based on the predicted three-dimensional position and the tilt information acquired from each light-emitting pen. The display control apparatus according to claim 1, wherein: The pair of the camera devices are provided at any one of the locations of the upper side, the lower side, the right side, and the left side of the display unit. The display control apparatus described. The pair of camera devices are provided at any of the locations on the upper side or the lower side of the display unit, and at any of the locations on the right side or the left side of the display unit. It is provided in
The three-dimensional position detection unit detects a three-dimensional position of each light-emitting pen based on each imaging signal obtained by the pair of camera devices at each location imaging each light-emitting pen. The display control device according to claim 1, wherein the display control device is a display control device. A pair of camera devices as a set, and having a plurality of sets of camera devices,
The three-dimensional position detection unit detects the three-dimensional position of each of the light emitting pens based on an imaging signal obtained by each set of camera devices imaging different light emitting pens,
The acquisition unit respectively acquires inclination information indicating the inclination of the light emitting pen, which is detected and transmitted by an inclination sensor provided in each light emitting pen,
The display position calculation unit is configured to determine an indication position on the display unit indicated by each light-emitting pen based on the detected three-dimensional position of each light-emitting pen and the acquired tilt information of each light-emitting pen. Calculate
The display control apparatus according to claim 1, wherein the display control unit displays a predetermined object corresponding to each of the light emitting pens at a calculated indication position on the display unit. A network that receives display position information respectively indicating the display positions on the display unit of a plurality of objects displayed on the display unit by another display control device, transmitted from another display control device via a predetermined network A receiving unit;
The display control unit is configured to place the other objects on one display unit at predetermined positions corresponding to the light emitting pens on the own device side, and at each position indicated by the display position information received by the network reception unit. The display control device according to claim 1 or 2, wherein a predetermined object corresponding to each light emitting pen on the display control device side is displayed. Each of the light-emitting pens emits infrared light. The display control device according to any one of claims 1 to 6, wherein the light-emitting pen emits infrared light. A setting step in which the setting unit sets different light emission patterns for a plurality of light emitting pens that emit predetermined light; and
The three-dimensional position detection unit determines the three-dimensional position of the light emitting pen that has emitted light based on an imaging signal obtained by imaging at least one pair of the light emitting pens at the timing when the light emitting pen emits light. A three-dimensional position detecting step to detect;
An acquisition step of acquiring an inclination information indicating an inclination of each light emitting pen, which is detected and transmitted by an inclination sensor provided in each light emitting pen, and
A display position at which the display position calculation unit calculates an indicated position on the display unit that is indicated by the light emitting pen based on the detected three-dimensional position and the tilt information acquired from the light emitting pen that has emitted light. A calculation step;
A display control method, comprising: a display control step in which the display control unit displays a predetermined object at the calculated indicated position on the display unit. Computer
A setting unit for setting different light emission patterns for a plurality of light emitting pens that emit predetermined light;
A three-dimensional position detection unit that detects a three-dimensional position of the light-emitting pen that emits light based on an imaging signal obtained by imaging at least one of the light-emitting pens at the timing when the light-emitting pen emits light. When,
An acquisition unit that acquires inclination information indicating the inclination of each light-emitting pen, which is detected and transmitted by an inclination sensor provided in each light-emitting pen;
Based on the detected three-dimensional position and the tilt information acquired from the emitted light emitting pen, a display position calculating unit that calculates an indicated position on the display unit indicated by the emitted light emitting pen;
A display control program for causing a function to function as a display control unit for displaying a predetermined object at a calculated indicated position on a display unit. The three-dimensional position detection unit, when an imaging signal imaged at the timing when each of the light emitting pens is turned on or off is obtained by the camera device, the writing locus of each light emitting pen stored in the storage unit Based on the coordinate information corresponding to the three-dimensional position of each light-emitting pen,
The display position calculation unit calculates an indicated position on the display unit indicated by each light-emitting pen based on the predicted three-dimensional position and the tilt information acquired from each light-emitting pen. 10. The display control program according to claim 9, wherein The pair of the camera devices are provided at any one of the locations of the upper side, the lower side, the right side, and the left side of the display unit. The display control program described. The pair of camera devices are provided at any of the locations on the upper side or the lower side of the display unit, and at any of the locations on the right side or the left side of the display unit. It is provided in
The three-dimensional position detection unit detects a three-dimensional position of each light-emitting pen based on each imaging signal obtained by the pair of camera devices at each location imaging each light-emitting pen. The display control program according to claim 9 or 10, wherein: A pair of camera devices as a set, and having a plurality of sets of camera devices,
The three-dimensional position detection unit detects the three-dimensional position of each of the light emitting pens based on an imaging signal obtained by each set of camera devices imaging different light emitting pens,
The acquisition unit respectively acquires inclination information indicating the inclination of the light emitting pen, which is detected and transmitted by an inclination sensor provided in each light emitting pen,
The display position calculation unit is configured to determine an indication position on the display unit indicated by each light-emitting pen based on the detected three-dimensional position of each light-emitting pen and the acquired tilt information of each light-emitting pen. Calculate
The display control program according to claim 9 or 10, wherein the display control unit displays a predetermined object corresponding to each of the light-emitting pens at the calculated indicated position on the display unit. The computer,
A network that receives display position information respectively indicating the display positions on the display unit of a plurality of objects displayed on the display unit by another display control device, transmitted from another display control device via a predetermined network Let it function further as a receiver,
The display control unit is configured to place the other objects on one display unit at predetermined positions corresponding to the light emitting pens on the own device side, and at each position indicated by the display position information received by the network reception unit. The display control program according to claim 9 or 10, wherein a predetermined object corresponding to each light emitting pen on the display control device side is displayed. The display control program according to any one of claims 9 to 13, wherein each of the light emitting pens emits infrared light. A display unit for displaying a predetermined object;
At least a pair of camera devices provided in the display unit;
A plurality of light-emitting pens that emit predetermined light;
A setting unit for setting a different light emission pattern for each of the light emitting pens;
A three-dimensional position detection unit that detects a three-dimensional position of the light-emitting pen that emits light based on an imaging signal obtained by imaging one of the light-emitting pens at the timing of light emission;
An acquisition unit that acquires inclination information indicating the inclination of each light-emitting pen, which is detected and transmitted by an inclination sensor provided in each light-emitting pen;
Based on the detected three-dimensional position and the tilt information acquired from the emitted light emitting pen, a display position calculating unit that calculates an indicated position on the display unit indicated by the emitted light emitting pen;
A display control system comprising: a display control unit that displays a predetermined object at the calculated indicated position on the display unit. The three-dimensional position detection unit, when an imaging signal imaged at the timing when each of the light emitting pens is turned on or off is obtained by the camera device, the writing locus of each light emitting pen stored in the storage unit Based on the coordinate information corresponding to the three-dimensional position of each light-emitting pen,
The display position calculation unit calculates an indicated position on the display unit indicated by each light-emitting pen based on the predicted three-dimensional position and the tilt information acquired from each light-emitting pen. The display control system according to claim 16, wherein

Images