JP2011113191A - Information processing device and information processing system - Google Patents

Abstract

An information processing apparatus and an information processing system capable of detecting a position of an input device with a simple configuration and realizing handwriting input by performing input processing at the detected position.
An image of an information input surface PA irradiated with light from an input device 20 is captured, and the input device 20 is projected onto the information input surface PA based on a luminance distribution of the captured image on the information input surface PA. The position on the information input surface PA is detected, and the information is processed according to the detected position on the information input surface PA of the input device 20.
[Selection] Figure 1

Description

  The present invention relates to an information processing apparatus and an information processing system.

  2. Description of the Related Art Conventionally, an apparatus that performs input processing on information handwritten on an irradiated surface (information input surface) using light is known, and is further applied as an apparatus that displays a handwritten image (see, for example, Patent Documents 1 to 4). . In these devices, the coordinates of light irradiated on the information input surface are detected, and input processing is performed at the detected coordinates, so that the user detects and inputs information such as characters and figures written with light. . Such an apparatus is commercialized as a product such as an electronic blackboard.

  For example, Patent Documents 1 and 2 propose a device that arranges a plurality of light receiving elements in a two-dimensional matrix on an information input surface and detects an input portion and determines input / non-input by detecting light. Has been. Further, in Patent Documents 3 and 4, by using an input device that changes the state of light irradiation by pressing the vicinity of the light emission port against the information input surface, the coordinates of the irradiated light are imaged by the imaging device, An apparatus for detecting an input location on an information input surface has been proposed.

JP 63-151168 A Japanese Patent Application Laid-Open No. 11-119910 JP 2004-348444 A Japanese Patent Laying-Open No. 2005-135081

  However, the above configuration has the following problems. In other words, in the configurations of Patent Documents 1 and 2, it is difficult to increase the size of the information input surface because it is not possible to detect and input a portion where information is input unless an information input surface having a special configuration capable of detecting light is used. In addition, it tends to be expensive.

  In addition, in the configurations of Patent Documents 3 and 4, since it is necessary to press the input device against the information input surface for position detection and input processing, the impact at the time of contact on the information input surface, The input device is likely to be damaged due to friction.

  The present invention has been made in view of such circumstances, and is capable of detecting the position of the input device with a simple configuration and performing input processing at the detected position to realize handwritten input. An object is to provide a processing device and an information processing system.

In order to solve the above-described problem, the information processing apparatus of the present invention captures an image of an irradiated surface irradiated with light from a light emitting device, and the light based on a luminance distribution of the captured image on the irradiated surface. A position on the irradiated surface when the emitting device is projected onto the irradiated surface is detected, and information is processed according to the detected position on the irradiated surface of the light emitting device. .
According to this configuration, the position of the light emitting device can be detected from the luminance distribution on the irradiated surface. That is, since the luminance distribution on the irradiated surface changes depending on the posture of the light emitting device and the relative distance to the irradiated surface, detecting the luminance distribution causes the relative distance and the height of the light emitting device to be irradiated. The position in the vertical direction can be detected. Therefore, it is possible to provide an information processing apparatus capable of inputting information without any special device on the irradiated surface and capable of detecting a position with a simple configuration.

In the present invention, based on the luminance distribution of the captured image, a magnitude relationship between the height of the light emitting device in the normal direction of the irradiated surface and a predetermined threshold value related to the height is determined, and the height It is preferable that information is input at a position on the irradiated surface when the height is equal to or less than a predetermined threshold related to the height.
According to this configuration, the height of the light emitting device obtained by image processing can be used as a criterion for information input / non-input, and information can be input based on the detection result. Therefore, it is possible to provide an information processing apparatus capable of inputting information without any special contrivance on the irradiated surface and capable of realizing handwriting input with a simple configuration.

In the present invention, it is desirable to have a display device that displays the input information.
According to this configuration, it is possible to perform input processing while confirming input information.

In the present invention, it is desirable that the display device is a projection display device, and an image display surface on which a formed image is projected is set so as to overlap the irradiated surface.
According to this configuration, since the irradiated surface on which information is input is also an image display surface that simultaneously displays an image, input information can be displayed superimposed on the irradiated surface, and handwritten directly in the display image. A feeling of use as if input is being made can be obtained.

In this invention, it has an imaging device which images the said to-be-irradiated surface, The said display apparatus scans the laser beam inject | emitted from the light source device and the said light source device in the two-dimensional direction on the to-be-irradiated surface. A scanning projection display device having a scanning means for drawing an image, and in the information processing device, an optical path of light incident on the imaging device and the laser light emitted from the scanning projection display device The optical path is partially shared, and a separation optical system for guiding the light emitted from the light emitting device to the imaging device is provided on the optical path between the light source device and the scanning unit. It is desirable.
According to this configuration, since the optical system for the imaging device that images the irradiated surface and the optical system for image display are shared, the device configuration can be simplified.

An information processing system according to the present invention includes the information processing apparatus described above and a light emitting apparatus that emits light picked up by the information processing apparatus onto an irradiated surface.
According to this configuration, it is only necessary to emit light to the irradiated surface as a light emitting device, and an information processing system capable of realizing handwriting input with a simple configuration can be provided.

In the present invention, the light emission device includes a first emission port that emits light toward the irradiated surface, and light of light emitted from the first emission port adjacent to the first emission port. A second emission port that emits auxiliary light in a direction different from the axial direction, and the information processing apparatus takes an image of the irradiated surface and the second emission port together, and the first emission port The distance between the two luminance centers based on the luminance center of the luminance distribution based on the light emitted from the second emission port and the luminance center of the luminance distribution of the auxiliary light emitted from the second outlet. And a predetermined threshold value related to the distance, and when the distance is less than or equal to the predetermined threshold value related to the distance, an input process is performed at a position corresponding to the position of the light emitting device on the irradiated surface. It is desirable to do.
Here, “the optical axis of the emitted light” is the central axis of the light emitted from the first exit port. According to this configuration, in addition to the luminance distribution on the irradiated surface, the position in the height direction of the first outlet can be detected indirectly by detecting the second outlet. The accuracy can be increased, and an information processing system capable of performing input processing with high accuracy can be provided.

In the present invention, it is preferable that the auxiliary light is a color light having a different color from the light emitted to the irradiated surface.
According to this configuration, when the light emitting device is close to the irradiated surface, it is easy to distinguish between the light emitted from the irradiated surface and the auxiliary light in the captured image, and the threshold processing is facilitated.

In the present invention, it is desirable that the light emitted to the irradiated surface is infrared light, and the information processing apparatus performs input processing based on a luminance distribution of infrared light on the irradiated surface.
Since infrared light is invisible light, a good usability can be obtained without being visually recognized by the user.

In the present invention, it is desirable that the light emitted to the irradiated surface has a Gaussian distribution of luminance distribution in a cross section perpendicular to the optical axis direction of the light.
According to this configuration, since it is easy to detect from which direction the light emitted to the irradiated surface is emitted, the position of the light emitting device can be easily detected.

In the present invention, it is desirable that the light emitting device has a writing member having a tip in a light emitting direction of light emitted to the irradiated surface.
According to this configuration, it is possible to input information to the information input device at the same time while entering information to be actually handwritten on the irradiated surface. For example, while writing a sentence on paper, the written sentence can be input as character information.

1 is a schematic diagram of an information processing apparatus and an information processing system according to a first embodiment. It is a schematic explanatory drawing of the front-end | tip part of the input device which concerns on 1st Embodiment. It is a block diagram explaining the process performed with a control apparatus. It is explanatory drawing explaining the image taken in by information processing apparatus. It is explanatory drawing about the mode of the light inject | emitted from the input device of 1st Embodiment. It is a graph which shows the reference data used for the process performed with a control apparatus. It is a graph which shows the reference data used for the process performed with a control apparatus. It is a graph which shows the reference data used for the process performed with a control apparatus. It is explanatory drawing of the image processing unit which has a scanning projection display apparatus. It is the schematic of the information processing apparatus and information processing system which concern on 2nd Embodiment. It is a schematic explanatory drawing of the front-end | tip part of the input device which concerns on 2nd Embodiment. It is explanatory drawing about the mode of the light inject | emitted from the input device of 2nd Embodiment.

[First Embodiment]
The information processing apparatus and information processing system according to the first embodiment of the present invention will be described below with reference to FIGS. In all the drawings below, the dimensions and ratios of the constituent elements are appropriately changed in order to make the drawings easy to see.

  FIG. 1 is a schematic configuration diagram of an information processing device JE1 and an information processing system JS1 in the first embodiment. The information processing device JE1 captures handwritten information and projects an image formed by the image forming unit (display device) 10 that projects and displays it on the work desk DK. The image captured by the image forming unit 10 is processed to form image data of the image to be projected. The control unit 30 and the communication cable 40 that connects the image forming unit 10 and the control unit 30 are roughly configured.

  In addition, the information processing system JS1 of the present embodiment has a configuration in which a pen-type input device (light emitting device) 20 that emits light from the tip is added to the information processing device JE1 described above.

  The image forming unit 10 is installed at a predetermined height on the work desk DK, and is connected to an imaging device (not shown) that images an information input surface (illuminated surface) PA on the work desk DK and a communication cable 40. A projection display device (not shown) that projects and displays an image corresponding to the video signal input from the control device 30 connected to the upper surface of the work desk DK. As the projection display device, it is possible to adopt a generally known projector configuration having a light source device, a liquid crystal light valve, and a projection lens.

  In the image forming unit 10 of the present embodiment, the range of the image display surface WA on which an image is displayed by the projection display device is set so as to overlap the information input surface PA, and the image display surface WA is the information input surface PA. It is narrower than. The range of the information input surface PA and the range of the image display surface WA can be changed as appropriate according to the capability of the apparatus and the aperture.

  The input device 20 is a pointing device that is operated by the hand of the worker K on the image display surface WA, and has a pen shape.

  The control device 30 is a PC (Personal Computer) arranged at a predetermined position on the work desk DK. The control device 30 grasps the position of the input device 20 based on the image of the information input surface PA obtained from the image forming unit 10 via the communication cable 40 and acquires information to be input by handwriting using the input device 20. While performing input processing, a video signal representing an image to be displayed is generated and output to the image forming unit 10.

  Such an information processing system JS1 performs input processing of information handwritten by the operator K using the input device 20, and displays the input information in real time, so that it is directly written in the image display surface WA. It is a system that can get a feeling of use as if it were.

  FIG. 2 is a schematic explanatory diagram of the tip portion of the input device 20. The input device 20 includes a cylindrical tip chip 22 provided at the tip of a pen-shaped casing 21, a light source 23 accommodated in the casing 21, and light emitted from the light source 23 on the tip chip 22. And a lens 24 that leads from one end to the inside. A light source that emits light of various wavelengths can be used as the light source 23. For example, a light source that emits invisible infrared light such as an infrared LED or an infrared laser light source can be preferably used. . The input device 20 according to the present embodiment employs a light source 23 that emits infrared light.

  The tip chip 22 functions as a waveguide through which light passes. Light incident from one end of the tip chip 22 disposed on the inner side of the housing 21 passes through the tip chip 22 and is emitted from a tip portion (first exit port) 22a provided at the other end.

  The tip 22a is provided with a round shape that is convex in the light emission direction, and the light that reaches the tip 22a is refracted and emitted while spreading. In the input device 20 of the present embodiment, the light emitted from the distal end portion 22a is designed to have a Gaussian luminance distribution on a plane perpendicular to the optical axis L.

  Further, a notch (second emission port) 22b is provided in the vicinity of the tip 22a in the circumferential direction of the tip 22 and a part of the light transmitted through the tip 22 is notched 22b. To the tip tip 22 in the circumferential direction. The light emitted from the notch 22b is used as auxiliary light for detecting the tip of the input device 20 when detecting the position of the input device 20 described later.

  Next, information input processing performed in the information processing system will be described with reference to FIGS.

  FIG. 3 is a block diagram illustrating processing performed by the control device 30. FIG. 4 is an explanatory diagram illustrating an image captured by the image processing unit. FIG. 5 is an explanatory diagram for explaining the state of light emitted from the input device 20. 6 to 8 are graphs showing reference data used for various processes performed by the control device 30. FIG.

  As illustrated in FIG. 3, the control device 30 includes a coordinate conversion unit 31 that acquires the coordinates of an image captured by the camera (imaging device) 11 included in the image processing unit, and a feature value that calculates a luminance distribution for the captured image. The magnitude relationship between the calculation unit 32, the coordinate calculation unit 33 that calculates the position of the input device 20 using the calculation result, and the threshold value that is the reference for the height of the input device 20 calculated by the coordinate calculation unit 33. Based on the information input by the input processing unit 35, the input processing unit 35 that performs the input processing based on the determination unit 34 that performs determination and input determination, the input processing unit 35 that performs information input processing based on the results of the determination unit 34, And an image data generation unit 36 for creating image data for projection display by the image processing unit.

  First, as shown in FIG. 4, the coordinate conversion unit 31 converts the image captured by the camera 11 included in the image processing unit into luminance data to which the coordinates of the coordinate system set in the control device 30 are applied. For example, the brightness distribution of light (input light) emitted from the input device 20 to the information input surface PA is expressed using a coordinate system having the position of the image processing unit 10 on the work desk DK as an origin. As the camera 11, a camera capable of detecting and imaging light emitted from the input device 20 is used. In the present embodiment, the input device 20 emits infrared light. Also use an infrared camera.

  Depending on the arrangement of the image processing unit 10 when the image is captured by the camera 11, the captured image of the information input surface PA is wide and narrowly distorted on the image processing unit 10 side. The image data thus captured is subjected to image processing to eliminate distortion, and converted as data in coordinates in the absolute coordinate system set in the coordinate conversion unit 31.

  Next, in the feature value calculation unit 32, in order to calculate the position of the tip of the input device 20 based on the luminance distribution of the light irradiated from the input device 20 to the information input surface PA, Calculate how to distort.

  As shown in FIG. 5, the light emitted from the input device 20 is irradiated with a luminance distribution in the area AR on the information input surface PA. In the present embodiment, the luminance distribution of the input device 20 is a Gaussian distribution diagram, and the luminance distribution is darker as the inner side of the area AR becomes brighter and the outer side. In the figure, light and shade are shown by color shading in the area AR.

In the feature value calculation unit 32, first, the luminance data of the captured image is normalized using Equation 1, and then the luminance center (center of gravity) of the input light on the information input surface PA is obtained using Equation 2. Furthermore, the dispersion of the luminance of the input light on the information input surface PA is obtained using Equation 3, and the skewness of the input light on the information input surface PA is obtained using Equation 4. Further, the magnitude of the skewness is obtained from the obtained skewness. The magnitude of the skewness can be obtained by the root mean square value (√ (γ _x ² + γ _y ² )).

Since diffused light having a predetermined diffusion angle is emitted from the input device 20, the distance (σ from the tip of the input device 20 to the information input surface PA changes), and the dispersion (σ corresponding to how the light spreads) _x ² , σ _y ² ) changes. Therefore, the distance (height) from the tip of the input device 20 to the information input surface PA can be known by obtaining the variance of the luminance distribution.

Similarly, since light having a Gaussian distribution is emitted from the input device 20 in a plane perpendicular to the optical axis, the light is irradiated with the position of the center of gravity shifted from the center in a plane obliquely intersecting the optical axis. The Therefore, on the information input surface PA, knowing the direction in which the center of gravity of the irradiation light is decentered (distortion method, degree of distortion (γ _x , γ _y )), the incident direction of light from the input device 20 to the information input surface PA can be determined. I can know.

  Next, the coordinate calculation unit 33 obtains the position of the tip of the input device 20 using the center of gravity, dispersion, skewness, and skewness of the light on the information input surface PA obtained by the feature value computation unit 32.

  As shown in FIGS. 4 and 5, the position of the tip of the input device 20 is the incident angle ψ of light on the information input surface PA, and the XY plane (information input surface PA) in the coordinate system set in the control device 30. This can be known by obtaining the orientation β of the input device 20 and the height H from the information input surface PA to the tip of the input device 20. In the present embodiment, since the optical axis of the light emitted from the tip is set in the same direction as the axial direction of the pen-type input device 20, the incident angle ψ indicates the inclination angle of the input device 20. It has become.

  The coordinate calculation unit 33 calculates each value using the reference data shown in FIGS. 6 to 8 stored in a memory (not shown). Each reference data may be stored in the form of a calculation formula or a table.

FIG. 6 is a graph showing the relationship between the height H of the tip of the input device 20 and the variances σ _x ² and σ _y ² . Based on the figure, the height H shown in FIG. 5 can be obtained from the variance value obtained by the feature value calculation unit 32.

FIG. 7 is a graph showing the relationship between the orientation β of the input device 20 in which the optical axis L points to the center of gravity CG and the skewness γ _x and γ _y . Based on the figure, the orientation β shown in FIG. 5 can be obtained from the skewness value obtained by the feature value calculation unit 32.

  FIG. 8 is a graph showing the relationship between the incident angle ψ of light to the information input surface PA and the degree of distortion of the input device 20 in which the optical axis L points to the center of gravity CG. The degree of distortion with respect to the incident angle ψ varies depending on the direction β, and FIG. 8 shows data of β = 0 ° and β = −45 °. That is, the incident angle ψ shown in FIG. 5 can be obtained from the value of the degree of distortion obtained by the feature value computing unit 32 and the azimuth β obtained by the coordinate calculating unit 33.

  Further, the coordinate calculation unit 33 calculates the coordinates P on the information input surface PA at the tip of the input device 20 from the height H, the azimuth β, and the incident angle ψ.

  Further, the determination unit 34 determines the magnitude relationship between the height H obtained by the coordinate calculation unit 33 and a predetermined threshold value. For example, the input process is performed when the height H is equal to or less than the threshold value, and the input / non-input determination is performed by not performing the input process when the height H is greater than the threshold value.

  Next, the input processing unit 35 performs input processing at the coordinates P obtained by the coordinate calculation unit 33 in accordance with the input determination by the determination unit 34 and stores the input data in a storage device (not shown) as input data. For example, a point of color and size designated as input processing is input. When the input device 20 is moved so as to shift the position of the coordinate P while keeping the tip portion of the input device 20 at a height equal to or less than the threshold value, the above input processing is repeated continuously, and a line is formed as a series of points. You can enter a figure. Therefore, when the operator uses the input device 20 to handwrite characters and figures, the drawn characters and figures can be input by handwriting.

  Then, the image data generation unit 36 combines the input data and the image data of the image already displayed on the image display surface WA using the image processing unit 10 to generate new image data. Then, the new image data is output to the image processing unit 10 to display an image.

  Regardless of the input / non-input determination result in the determination unit 34, the image data generation unit 36 creates image data for displaying a pointer image such as an arrow at a position corresponding to the coordinate P, for example, The image is output to the image processing unit 10 and displayed. Such an image display makes it easy to perform handwriting input because the place where the input device 20 is currently pointing can be indicated in the image display surface WA regardless of input / non-input.

  In this way, information input processing using the information processing system JS1 of the present embodiment is performed to realize handwriting input.

  In the information processing device JE1 having the above configuration, the information input device JE1 can input information without any special contrivance on the information input surface PA, and can realize handwritten input with a simple configuration. be able to.

  Further, in the information processing system JS1 configured as described above, it is only necessary to emit light to the information input surface PA as the input device 20, and the information processing system JS1 capable of realizing handwriting input with a simple configuration. It can be.

  In addition, it is good also as providing a scanning projection display apparatus as an information processing apparatus of this embodiment.

  FIG. 9 is an explanatory diagram of an image processing unit 50 having a scanning projection display device. The image processing unit 50 includes a light source unit 12 that emits laser light, and a first scanning mirror 13 and a second scanning mirror 14 that scan the laser beam on the image display surface WA and draw an image. Yes. In such a projection display device, the modulated laser beam emitted from the light source unit 12 is raster-scanned on the image display surface WA using the first scanning mirror 13 and the second scanning mirror 14, thereby displaying an image. It is carried out.

  Further, a beam splitter (separation optical system) 15 that reflects infrared light and transmits visible light is provided between the light source unit 12 and the first scanning mirror 13, and the infrared light separated by the beam splitter 15 is provided. The light is guided to the camera 11.

  In the image processing unit 50, the optical path of the laser light emitted from the light source unit 12 and the optical path until the infrared light emitted from the input device 20 reaches the camera 11 are partially in common. The infrared light emitted from the input device 20 traces the optical path common to the laser light emitted from the light source unit 12 and reaches the beam splitter 15, and is then guided to the camera 11 side by the beam splitter 15. 11 is imaged. In the image processing unit 50 having such a configuration, since the optical system is shared, the apparatus configuration can be simplified.

  The camera 11 may use a pixel-type element such as a CMOS, or may use a light-receiving element such as an optical sensor based on the output from the light-receiving element and the position data of the first scanning mirror 13 and the second scanning mirror 14. A photographed image may be formed. When an optical sensor is used, an image can be obtained from the detection result of the optical sensor and scanning position information, so that the imaging device can be configured at low cost.

  Further, in the information processing device JE1 of the present embodiment, the image processing unit 10 has the projection display device. However, the present invention is not limited to this, and may have a display screen such as a liquid crystal display device.

  Further, in the information processing system JS1 of the present embodiment, the height H is calculated from the dispersion of the light applied to the information input surface PA, and the threshold processing is performed. However, the present invention is not limited to this.

  For example, auxiliary light that points to the tip of the input device 20 may be used for input determination. When the auxiliary light is used for input determination, when the information input surface PA is imaged by the camera 11, the auxiliary light at the tip of the input device 20 is also simultaneously imaged, and the center of gravity of the input light on the information input surface PA is obtained from the captured image. And the distance between the position of the notch 22b that emits auxiliary light (reference symbol D in FIG. 5). By setting a threshold value serving as a reference for this distance, it is possible to determine that input processing is to be performed if it is equal to or less than the threshold value, and to perform input determination. This distance can be obtained from the luminance distribution obtained by combining the input light and the auxiliary light.

  In this case, in the input device 20 of the present embodiment, the light emitted from the tip portion 22a and the light emitted from the notch portion 22b are light emitted from the same light source 23, but different light sources. It is good also as each radiate | emitting the light of a different wavelength inject | emitted from. In that case, it is preferable that the tip chip 22 has a concentric multi-layer structure and a portion for guiding light emitted from the tip portion 22a is different from a portion for guiding light emitted from the notch portion 22b.

  With such a configuration, the light used for information input emitted from the information input surface PA can be made different from the auxiliary light that points near the tip of the input device 20, so that the auxiliary light can be easily determined. The position of the tip of 20 can be easily detected.

  In addition, in the case of the configuration in which the wavelengths of the input light and the auxiliary light are different, the region where the two lights are mixed in the image captured by the camera 11 increases when the tip 22a is close to the information input surface PA. The color mixture may be used as auxiliary data for input determination at the tip.

  In the present embodiment, the light emitted from the input device 20 is diffused light having a Gaussian distribution in a plane perpendicular to the optical axis. However, the present invention is not limited to this and has a luminance distribution other than the Gaussian distribution. An input device that emits light can also be used. In that case, the coordinate calculation unit 33 uses the luminance distribution as reference data, and determines how the calculated center of gravity, variance, skewness, and degree of distortion change compared to the reference luminance distribution. Thus, it is preferable to detect the position of the input device.

  Further, the information processing apparatus JE1 of the present embodiment includes the camera 11 in the image processing unit 10. However, the information processing apparatus JE1 includes a plurality of cameras that can be arranged at a plurality of locations, and images the information input surface PA from various angles. It is also good to do. Depending on the posture of the operator, the operator may become a shadow, and the information processing surface PA may not be imaged well from the image processing unit 10, but with such a configuration, the blind spot is eliminated and the position is detected properly. It becomes possible to perform handwriting input.

[Second Embodiment]
10 to 12 are explanatory diagrams of an information processing apparatus and an information processing system according to the second embodiment of the present invention. The information processing device JE2 and the information processing system JS2 of this embodiment are partly in common with the information processing device JE1 and the information processing system JS1 of the first embodiment. The difference is that the image processing unit 70 does not include a display device. Therefore, in this embodiment, the same code | symbol is attached | subjected about the component which is common in 1st Embodiment, and detailed description is abbreviate | omitted.

  FIG. 10 is a schematic diagram of an information processing device JE2 and an information processing system JS2 according to the second embodiment. As shown in the figure, the image processing unit 70 included in the information processing apparatus JE2 has a camera (not shown) to capture an information input surface PA, and an operator K uses the input device (light emitting device) 60 to perform information. Input processing of information to be entered on the input surface PA is performed. Further, the information processing system JS2 of the present embodiment has a configuration in which an input device 60 is added to the information processing apparatus JE2 described above.

  FIG. 11 is a schematic explanatory diagram of the distal end portion of the input device 60. The input device 60 has a cylindrical tip 62 provided at the tip of the housing 61, and further has a core member (writing member) 63 that penetrates the tip 62. The core member 63 is a replaceable member such as a replacement core for a writing instrument such as an oil-based pen or a water-based pen, and an end portion 63 a is provided so as to protrude from the tip end portion 62 a of the tip tip 62.

  In the input device 60, light emitted from a light source (not shown) is emitted from the tip end portion 62a and the cutout portion 62b. Then, as shown in FIG. 12, the light-irradiated area AR shows a luminance distribution including a non-irradiated area B that is not irradiated with light corresponding to the core material 63. Even in such a luminance distribution, the tip of the input device 60 is calculated by calculating the center of gravity, variance, skewness, and degree of skewness of the area AR from the luminance distribution as in the first embodiment. Input processing can be performed. At the same time, since the core material 63 is provided, it is possible to fill in a medium such as paper on the information input surface PA.

  The preferred embodiments of the present invention have been described above with reference to the accompanying drawings, but it goes without saying that the present invention is not limited to such examples. Various shapes, combinations, and the like of the constituent members shown in the above-described examples are examples, and various modifications can be made based on design requirements and the like without departing from the gist of the present invention.

  For example, in the above-described embodiment, the information input surface PA is set on the work desk DK, and the position of the input device is detected by the imaging device capturing the input light reflected on the information input surface PA. However, it is not limited to this. For example, the information input surface PA is set on the transmissive screen, and the same processing is performed by imaging the input light that is irradiated on the transmissive screen and passes through the screen from the opposite side of the input device across the screen. You can also.

  DESCRIPTION OF SYMBOLS 10,50 ... Image processing unit (display apparatus), 11 ... Camera (imaging apparatus), 12 ... Light source part (light source apparatus), 13 ... 1st scanning mirror, 14 ... 2nd scanning mirror, 15 ... Beam splitter (separation optics) System), 20, 60 ... input device (light emitting device), 22a, 62a ... tip (first injection port), 22b, 62b ... notch (second injection port), 63 ... core material (writing member) , JE1, JE2 ... information processing device, JS1, JS2 ... information processing system, PA ... information input surface (irradiated surface), WA ... image display surface,

Claims (11)

  The irradiated surface when an image of the irradiated surface irradiated with light from the light emitting device is captured, and the light emitting device is projected onto the irradiated surface based on the luminance distribution of the captured image on the irradiated surface An information processing apparatus that detects an upper position and processes information according to the detected position on the irradiated surface of the light emitting apparatus.   Based on the brightness distribution of the captured image, a magnitude relationship between the height of the light emitting device in the normal direction of the irradiated surface and a predetermined threshold value related to the height is determined, and the height is the height. The information processing apparatus according to claim 1, wherein information processing is performed at a position on the irradiated surface when the threshold value is equal to or less than a predetermined threshold.   The information processing apparatus according to claim 1, further comprising a display device that displays the processed information. The display device is a projection display device;
The information processing apparatus according to claim 3, wherein an image display surface on which the formed image is projected is set so as to overlap the irradiated surface. An imaging device for imaging the irradiated surface;
The display device is a scanning projection display device having a light source device and scanning means for drawing an image by scanning laser light emitted from the light source device in a two-dimensional direction on the irradiated surface,
In the information processing apparatus, the optical path of the light incident on the imaging device and the optical path of the laser light emitted from the scanning projection display device are partially shared, and the light source device and the scanning The information processing apparatus according to claim 4, wherein a separation optical system that guides light emitted from the light emitting device to the imaging device is provided on an optical path to the device. An information processing apparatus according to any one of claims 1 to 5,
A light emitting device that emits light imaged by the information processing device to an irradiated surface. The light emission device is different from a first emission port that emits light toward the irradiated surface and an optical axis direction of light emitted from the first emission port adjacent to the first emission port. A second outlet for emitting auxiliary light in the direction,
The information processing apparatus captures an image of the irradiated surface and the second exit port together, a brightness center of a brightness distribution based on light emitted from the first exit port to the irradiated surface, and the second Based on the luminance center of the luminance distribution of the auxiliary light emitted from the emission port, a magnitude relationship between the distance between the two luminance centers and a predetermined threshold related to the distance is determined, and the distance is the distance. An information processing apparatus that performs input processing at a position corresponding to the position of the light emitting device on the irradiated surface when the predetermined threshold is not more than the predetermined threshold.   The information processing system according to claim 7, wherein the auxiliary light is light having a wavelength different from that of light emitted to the irradiated surface. The light emitted to the irradiated surface is infrared light,
The information processing system according to claim 6, wherein the information processing apparatus performs input processing based on a luminance distribution of infrared light on the irradiated surface.   10. The information processing system according to claim 6, wherein the light emitted to the irradiated surface has a Gaussian distribution of luminance distribution in a cross section perpendicular to the optical axis direction of the light. .   The information processing system according to any one of claims 6 to 10, wherein the light emitting device includes a writing member having a tip in an emission direction of light emitted to the irradiated surface.

Images