JP2017009664A - Image projection apparatus and interactive input / output system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image projection device that can improve convenience of users using an image projection device including an interactive type input/output function more than conventionally.SOLUTION: A projector 100 comprises: a projection screen 10; a camera 102 that photographs surrounds of the projection screen; and position coordinate calculation means 125 that calculates a position coordinate to be pointed by a pen 200 or finger from the image photographed by the camera, and a position coordinate of users inputting the position coordinate. The projector further comprises also input user direction detection means 126 that detects a user direction from the position coordinate of the user calculated by the location coordinate calculation means 125 with a position of a projection object such as a top surface of a desk 50 set as a reference. Furthermore, the projector comprises also screen rotation determination means 123 that determines whether the user points a position on the projection screen 10, and whether to cause the projection scree 10 to be rotated by video editing means 124 in accordance with the user direction.SELECTED DRAWING: Figure 6

Description

  The present invention relates to an image projection apparatus and an interactive input / output system (interactive system).

  Dialogs that input coordinate information on the coordinate position specifying means such as a pen and the position pointed by a finger on a projection screen projected by an image projection device such as a projector and write characters, or operate external devices such as computers A technique related to a type input / output (interactive) function is known.

For example, Patent Document 1 describes an image projection apparatus (projector) having the following interactive input / output function.
A projection unit (projection unit) that projects the input image, a detection unit that detects the orientation of the coordinate position specification unit (light emitting pen), and the input image is rotated based on the orientation of the coordinate position specification unit detected by the detection unit. And a rotating unit that projects the input image after rotation by the projecting means.
The detection unit detects the direction of the coordinate position specifying unit based on the light intensity distribution included in the image of the coordinate position specifying unit that emits light that is captured by the imaging unit (imaging unit). The image projection apparatus detects the user direction (direction from the projection screen to the user) from the detected direction of the coordinate position specifying means, and rotates the input image by the image processing means in accordance with the user direction. And projecting.

Thus, it is described in Patent Document 1 that the following effects can be achieved by configuring the image projection apparatus.
For example, when a projection image (projection image) is projected (projected) on a horizontal projection surface (projection surface) such as a desk, a user (user) may operate from various positions around the desk. By detecting the direction of the coordinate position specifying means, it is possible to rotate the direction of the projected image (output image) in a direction that is easy for the user to operate, thereby improving the convenience of the user when operating the projected image. be able to.

However, in a conventional image projection apparatus that rotates the direction of a projected image, a plurality of users, such as a user who surrounds the top surface, specify a coordinate position from different directions on a projection screen projected on the top surface (desktop) of a desk or table. When writing letters, etc. using means, there was the following fear.
Generally, when the coordinates on the projection screen are specified using a pen-shaped coordinate position specifying means such as a fluorescent pen, the direction of the coordinate position specifying means is determined by the position or heel of the user having the coordinate position specifying means. And the actual user direction is not the same direction, and an angle difference may occur by crossing.
In the configuration in which the user direction is detected from the direction of the coordinate position specifying means based on this angle difference, the user direction cannot be detected with high accuracy depending on the position and wrinkle of the user using the coordinate position specifying means, The projection screen may be rotated in the direction of the screen.
If the projected image is rotated in the wrong direction in this way, the convenience of the user who uses the image projection apparatus having the interactive input / output function is significantly reduced.

  In order to solve the above-described problem, the invention according to claim 1 is an image processing unit that processes an image signal to convert it into a projection signal, and a projection unit that projects the projection signal converted by the image processing unit. In an image projection apparatus having an interactive input / output function using a coordinate position specifying means and a position coordinate calculation means for calculating a position coordinate pointed by a finger on the projection screen projected by the projection means, the periphery of the projection screen is An image capturing unit configured to capture an image; and the position coordinate calculating unit calculates a position coordinate of a user who inputs the position coordinate using the coordinate position specifying unit and a finger from the image information captured by the image capturing unit, User direction detection means for detecting the user direction of the user based on the position of the projection target projecting the projection screen from the position coordinates of the user calculated by the position coordinate calculation means; and Whether the projection screen is rotated by the image processing unit according to whether the user is pointing to a position on the projection screen and the user direction of the user detected by the user direction detection unit Projection screen rotation judging means for judging whether or not.

  According to the present invention, it is possible to provide an image projection apparatus capable of improving the convenience of a user who uses an image projection apparatus having an interactive input / output function.

A schematic configuration diagram of an image projection system according to an embodiment. FIG. 3 is an explanatory diagram illustrating an outline when a projected image projected on a desk such as a desk is used by a plurality of users. The figure created in order to use for description of the image projector described in patent document 2. FIG. FIG. 3 is an explanatory diagram of a method of detecting position coordinates on a projection screen pointed by a pen or a finger in the image projection system according to the first embodiment. 1 is a functional block diagram of an image projection system according to Embodiment 1. FIG. FIG. 3 is an explanatory diagram of a method for detecting a position coordinate of a user who inputs a pen and coordinates in the image projection system according to the first embodiment. FIG. 3 is a flowchart for rotating the projection screen of the image projection system according to the first embodiment. FIG. 3 is an explanatory diagram of a method for detecting a position coordinate where a user is present in the image projection system according to the first embodiment. FIG. 5 is an explanatory diagram of coordinate areas stored in a user direction determination table used when detecting (determining) a user direction in the image projection system according to the first embodiment. FIG. 3 is an explanatory diagram about rotation of a projection screen in the image projection system according to the first embodiment. FIG. 9 is an explanatory diagram relating to the rotation center when rotating the projection screen of the image projection system according to the second embodiment. FIG. 10 is a flowchart of rotation of the projection screen of the image projection system according to the third embodiment. Explanatory drawing of the rotation amount which rotates a projection screen, when there are two users who use the pen of Example 3. FIG. FIG. 10 is an example of a schematic configuration diagram of an image projection system according to a fourth embodiment. Explanatory drawing of the problem at the time of using an infrared remote control for an image projection system. FIG. 10 is an example of a functional block diagram of an image projection system according to a fourth embodiment. Explanatory drawing of the example of the recognition method of the infrared light irradiated toward the projection screen with the infrared remote control. Explanatory drawing of the example of the recognition method of the infrared light irradiated toward the projection screen with the electronic pen which irradiates (outputs) infrared light as a coordinate position specification means. FIG. 14 is an example of a flowchart of a method for determining infrared light irradiated on a projection screen in the image projection system according to the fourth embodiment. An example of a warning message that is displayed (projected) when it is determined that the user is operating an infrared remote control toward the projection screen.

Hereinafter, an embodiment of an image projection system employing an interactive input system (hereinafter referred to as an interactive system) including a projector (hereinafter referred to as a projector 100) that is an image projection apparatus to which the present invention is applied will be described.
First, the basic configuration and operation of the image projection system of this embodiment will be described with reference to the drawings.
FIG. 1 is a schematic configuration diagram of an image projection system 1 according to the present embodiment, in which FIG. 1A is a schematic configuration diagram when projecting onto a screen 60 with a ceiling-suspended projector 100, and FIG. FIG. 5 is a schematic configuration diagram in the case where projection is performed on a table by a projector 100 installed on 50. FIG. 2 is a schematic explanatory diagram when a projection screen 10 projected on a desk such as a desk 50 is used by a plurality of users. FIG. 3 is created for use in explaining the image projection apparatus described in Patent Document 2. FIG.

The image projection system 1 of the present embodiment is mainly configured as follows.
As shown in FIGS. 1A and 1B, a projector 100 including a pen 200 that is a coordinate position specifying unit, a camera 102 that captures a user's (user's) finger, and the like, and video (image) information to be projected. The computer 300 is an external device that inputs data to the projector. The computer 300 and the projector 100 are connected by a video cable 21 (for example, an HDMI (registered trademark) cable) and a USB wired cable or wirelessly (23). The projector 100 projects the image of the cursor on the display image of the computer 300 as necessary, and then superimposes the image of the cursor via the video cable 21.

Further, as shown in FIG. 1A, the position coordinates on the projection screen 10 projected onto the screen 60 pointed to by the pen 200 or the finger or the desk 50 pointed to by the pen 200 or the finger as shown in FIG. 1B. Is acquired using the camera 102 which is an imaging means provided in the projector 100.
Further, in the projector 100, as shown in FIG. 1A, when the projector 100 is placed on a ceiling or placed on the floor and projected onto a substantially vertical surface such as the screen 60, the image is directly obtained from the projection lens provided in the apparatus main body. Project. On the other hand, when projection is performed on a substantially horizontal surface such as the upper surface of the desk 50, a retractable curved mirror 103 is set on the front surface of the projection lens, and an image is projected via the curved mirror 103.

2. In recent years, as shown in FIG. 2, a projector 100 or the like is used to project a pen 200 or the like on a projection screen 10 projected by a plurality of users such as users L, R, and C surrounding the desk 50 on a desk such as the desk 50. There is an increasing number of meetings such as meetings while writing letters and the like.
By conducting a conference using the projector 100 or the like having an interactive function as described above, the understanding among a plurality of users can be deepened and the efficiency of the conference can be improved.
In addition, by using the projector 100 and the like that have been miniaturized in recent years, a portable image projection apparatus can be used on a desktop such as a desk placed anywhere, even if it is not a conference room or the like provided with dedicated facilities. Since the projection image can be projected, the mobility and cost performance are high.

However, in a conventional image projection apparatus having a general interactive input / output function, a projected image is projected onto a projection screen on a desk such as a desk, and a plurality of users such as writers have different directions on the projection screen. When inputting (writing) characters and the like by using the coordinate position specifying means, there are the following problems.
For example, if multiple users try to input coordinates to write characters etc. from different directions on the desktop projection screen while changing, the angle of the characters displayed on the projection screen is different or the orientation of the projection screen is changed. It is a problem that it is very difficult to input coordinates together.
To solve this problem, ask each of the users surrounding the desk, etc., to have a switch that rotates the projection screen that is projected on the desktop, and rotate the projection screen that writes characters and so on according to the operation of the switch. Although the structure to make it conceivable is also considered, a user's convenience will fall.

As a conventional image projection apparatus for rotating the direction of a projected image, Patent Document 1 describes an image projection apparatus having the following interactive input / output function.
A projection unit (projection unit) that projects the input image, a detection unit that detects the orientation of the coordinate position specification unit (light emitting pen), and the input image is rotated based on the orientation of the coordinate position specification unit detected by the detection unit. And a rotating unit that projects the input image after rotation by the projecting means.
The detection unit detects the direction of the coordinate position specifying unit based on the light intensity distribution included in the image of the coordinate position specifying unit that emits light that is captured by the imaging unit (imaging unit). Then, the image projection device detects the direction from the projection screen to the user from the detected direction of the coordinate position specifying means, and projects the input image by the image processing means in accordance with the user direction. Is.

  By configuring the image projection device in this way, Patent Document 1 describes as follows. For example, when a projection image (projection image) is projected (projected) on a horizontal projection surface (projection surface) such as a desk, a user (user) may operate from various positions around the desk. By detecting the direction of the coordinate position specifying means, it is possible to rotate the direction of the projected image (output image) in a direction that is easy for the user to operate, thereby improving the convenience of the user when operating the projected image. be able to.

However, in a conventional image projection apparatus that rotates the direction of a projected image, a plurality of users, such as a user who surrounds the top surface, specify a coordinate position from different directions on a projection screen projected on the top surface (desktop) of a desk or table. When writing letters, etc. using means, there was the following fear.
Generally, when the coordinates on the projection screen are specified using a pen-shaped coordinate position specifying means such as a fluorescent pen, the direction of the coordinate position specifying means is determined by the position or heel of the user having the coordinate position specifying means. And the actual user direction is not the same direction, and an angle difference may occur by crossing. In the configuration in which the user direction is detected from the direction of the coordinate position specifying means based on this angle difference, the user direction cannot be detected with high accuracy depending on the position and wrinkle of the user using the coordinate position specifying means, The projection screen may be rotated in the direction of the screen.
If the projected image is rotated in the wrong direction in this way, the convenience of the user who uses the image projection apparatus having the interactive input / output function is significantly reduced.

In addition, as a related technique, an image projection apparatus (projector display) that displays information to be input by handwriting on an image projected (displayed) using the following interactive input / output function (pen tablet input method) is disclosed in Patent Document 2. Device). Here, FIG. 3 is a diagram created for use in the description of the image projection apparatus described in Patent Document 2 as described above, and the names and symbols in the diagram are appropriately changed.
As shown in FIG. 3, on the display unit 510 (sub-screen) of a tablet 500 (pen tablet input device) placed on a table such as a desk surrounded by a plurality of users (input users), and the projection screen 410 ( The position coordinates on the main screen) are related.
Then, the point where the pen that writes characters or the like touches the tablet 500 and the shadow of the hand formed on the display unit 510 are detected, and the line connecting the point farthest from the contact point of the pen is used. The screen (display information) displayed on the display unit 510 is rotated by determining the direction in which the person is present.

  However, the image projection apparatus 400 is not configured to rotate the projection screen (display screen) projected on the desktop, and it is necessary to prepare the tablet 500 including the display unit 510 separately from the image projection apparatus 400. For this reason, depending on the size of the projection screen, there is a high possibility that the mobility and cost performance will be significantly reduced.

In view of this, the inventor examined whether or not the following image projection apparatus provided with an interactive function capable of inputting (writing) characters or the like on the projection screen projected on the desktop could be provided.
Even when a plurality of users write characters or the like using coordinate position specifying means such as the pen 200 or a finger from different directions on the projection screen projected on the desktop while changing, it is easy for other users to write. This is an image projection device that can project characters written in an easy-to-see direction.
An image projection apparatus that can detect the user direction with high accuracy, can reduce the possibility of rotating the projection screen in the wrong direction, and can rotate the projection screen in the direction corresponding to the user direction. It is.
In other words, the image projection apparatus can improve the convenience of the user who uses the image projection apparatus having the interactive input / output function.

More specifically, the projection screen 10 is rotated in the direction of the user at the timing when the user on the front left and right of the projector 100 inputs a character or the like with the pen 200, and when the input is finished, the projection screen 10 becomes a normal front direction. The projector 100 can return the screen to its original state.
The projector 100 can detect the user direction with high accuracy, can reduce the possibility of rotating the projection screen 10 in the wrong direction, and can rotate the projection screen in the direction corresponding to the user direction. .
That is, the projector 100 can improve the convenience of the user who uses the image projection apparatus having the interactive function as compared with the conventional projector.

Next, the features of the image projection system 1 of the present embodiment will be described with reference to a plurality of examples.
Example 1
Example 1 of the image projection system 1 of this embodiment will be described with reference to the drawings.
FIG. 4 is an explanatory diagram of a method of detecting position coordinates on the projection screen 10 pointed to by the pen 200 or a finger in the image projection system 1 according to the present embodiment, and FIG. 5 is a diagram of the image projection system 1 according to the present embodiment. It is a functional block diagram.

  FIG. 6 is an explanatory diagram of a method of detecting the position coordinates of the pen 200 and the user who inputs coordinates in the image projection system 1 according to the present embodiment. 6A shows a state before detection, FIG. 6B shows a state when the user's position coordinates are detected, and FIG. 6C shows a state when the position coordinates of the pen 200 are detected. Indicates the state. FIG. 7 is a flowchart when the projection screen 10 is rotated in the image projection system 1 according to the present embodiment. FIG. 8 is a diagram illustrating a method for detecting a position coordinate where the user is present in the image projection system 1 according to the present embodiment. It is explanatory drawing.

  FIG. 9 is an explanatory diagram of the coordinate areas stored in the user direction determination table used when detecting (determining) the user direction of the image projection system 1 according to the present embodiment. FIG. 10 is an explanatory diagram of the rotation of the projection screen 10 in the image projection system 1 according to the present embodiment. FIG. 10A shows a state before the user screen is detected and the projection screen 10 is rotated. ing. FIG. 10B shows a state after the projection screen 10 is rotated based on the detected user direction, and FIG. 10B ends the coordinate input by the user R and projects it to the original rotation position. The state which returned the screen 10 is shown.

  In the image projection system 1 of this embodiment, in order to detect the position coordinates on the projection screen 10 pointed by the pen 200 or a finger, a laser module 250 which is a light irradiation means for outputting a laser beam as shown in FIG. The feature is that it is equipped. Although details will be described later, for example, the position coordinates on the projection screen 10 pointed by the pen 200 or the finger can be detected by capturing (imaging) the reflected light of the laser light output from the laser module 250 with the camera 102. It becomes possible.

First, the basic configuration of the image projection system 1 of this example and the function of each unit will be described with reference to FIG.
(Projector 100)
The video input unit 121 is a unit that receives a video (image) signal input via the HDMI or VGA video cable 21 or the network.
The video editing unit 124 is a unit that performs an editing process of an image to be projected, such as scaling or rotation, on the video signal received by the video input unit 121 and converts it into a projection signal.
The projection unit 122 is a unit that projects the projection signal that has been subjected to the editing process by the video editing unit 124 and converted to the outside.

The position information measuring unit 181 is a unit that acquires the position coordinates of the pen 200 and the finger from the screen 60, and includes the camera 102.
The position coordinate calculation means 125 calculates position coordinates on the projection screen 10 pointed to by the pen 200 or the finger from image information (measurement information) captured by the camera 102 constituting the position information measurement means 181.

The interactive communication unit 129 transmits and receives information related to the interactive function with the computer 300 and the laser module 250.
The PC operation information conversion unit 127 converts the position coordinates on the projection screen 10 pointed by the pen 200 or the finger calculated by the position coordinate calculation unit 125 into operation information of the computer 300. Then, the converted information is sent to the computer 300 using the interactive communication means 129.

The input user direction detection means 126 is a user who is a user direction in which there is a user who inputs position coordinates with reference to the projection target projecting the projection screen 10 of the user pointing (specifying) with the pen 200 or a finger. The direction is detected.
The screen rotation determining unit 123 determines whether or not the projection screen 10 is rotated by the video editing unit 124 according to whether or not the user is performing an operation such as character input and the user direction detected by the input user direction detecting unit 126. Is determined (determined). If it is determined to rotate, the projection screen 10 is rotated by the video editing unit 124.
When the projection screen 10 is rotated, the screen rotation position determination means 128 determines an arbitrary position coordinate on the projection screen 10 input with the pen 200 as a rotation center position when the projection screen is rotated.

(Laser module 250)
The laser module 250 which is a light irradiation means includes a first laser output means 251 and a second laser output means 252 for outputting (irradiating) laser light.
The first laser output means 251 outputs the first laser beam: R1 for the purpose of acquiring the position coordinates of the pen and finger.
The second laser output means 252 outputs the second laser beam: R2 for the purpose of acquiring the user's position coordinates.
As a result, a plurality of (two) laser beams are scanned out.
Interactive communication means 259 transmits and receives information to and from projector 100.

(Computer 300)
The interactive communication unit 329 transmits and receives information related to the interactive function with the projector 100.
The video output means 322 outputs the video of the computer to an external display device such as a display or the projector 100.
The operation means 323 implements the operation of the computer 300 itself according to the operation keys of the computer 300 and the PC operation information received from the projector 100.

In the image projection system 1 (interactive system) of the present embodiment, as shown in FIG. 6, a projector 100 is installed on a desk 50 and projection is performed on the upper surface of the desk 50, that is, desktop projection is performed.
As shown in FIG. 6A, the projector 100 has a built-in camera 102, and the laser module 250 is connected to the projector 100 by a laser wired cable 253. In the laser module 250, the first laser light: R 1 is emitted from the first laser output means 251, and the second laser light: R 2 is emitted from the second laser output means 252, and the first laser light: R 1 is installed at the end of the desk 50. Is absorbed by the blocking material 254. On the other hand, the second laser beam R2 propagates outside the top plate (upper plate) of the desk 50.

As shown in FIG. 6B, when the user is positioned near the desk, the second laser beam R2 is reflected on the user's body at that position, and the reflected light is captured by the camera 102 provided in the projector 100. Thus, the user position (user position coordinates) is detected.
Further, as shown in FIG. 6C, when the position coordinates of the pen 200 being drawn are detected, the pen 200 is touched at a certain position on the image projection surface, and the first laser beam: R1 is emitted at that position. reflect. Then, the drawing position (pen position coordinates) is detected by capturing the reflected light with the camera 102 provided in the projector 100.

Next, a method of rotating the projection screen 10 in the image projection system 1 of the present embodiment will be described using the flowchart of FIG.
After the camera 102 constituting the position information measuring unit 181 measures (images) the second laser beam R2 reflected by the user's torso and acquires the user position information (S101), the position coordinate calculating unit 125 performs the measurement. Based on the information, position coordinates where the user is located are calculated (S102).

  Next, based on the position coordinates calculated by the position coordinate calculation means 125, the input user direction detection means 126 calculates the direction in which the user is present. Thereafter, it is determined whether the user is a new user who has not detected the user direction (S103). Here, when the user's position coordinate is detected for the first time after the use of the function is started, or when the user's position coordinate is detected after a predetermined time or more, it is determined that a new user has started to use it.

In the case of a new user (Yes in S103), the input user direction detection unit 126 calculates the direction in which the user is present (S104). Thereafter, in order to determine whether the user has started drawing, it is determined whether or not the camera 102 has captured (captured) the first laser beam R1 (S105).
On the other hand, if the user is not a new user (No in S103), the camera 102 uses the first laser beam to determine whether the user has started drawing without newly calculating the user's direction using the input user direction detection unit 126. : It is determined whether or not R1 has been captured (S105).

When the first laser beam: R1 is captured (Yes in S105), it is determined that the user is about to write a character with the pen 200 or a finger, and the screen rotation determination unit 123 determines the projection screen 10 as the user. Rotate in the direction (S106).
On the other hand, if the first laser beam: R1 has not been captured (No in S105) and the projection screen 10 has already been rotated (Yes in S107), it is determined that the user has finished writing and the screen The rotating means returns the projection screen to the original direction (S108).
Further, when the first laser beam R1 is not captured (No in S105) and the projection screen 10 is not rotated (No in S107), the state is maintained as it is.

Next, a method for detecting position coordinates where the user is located will be described with reference to FIG.
For example, as shown in FIG. 8, when the user R on the right side of the projection screen 10 in FIG. 8 starts to write on the projection screen 10 with a pen 200 or a finger, the body of the user R is usually surrounded by diagonal lines. It is located in the laser propagation / camera capture region 70 on the right side in the figure. Therefore, the user direction, which is the user direction, can be specified by determining which region corresponding to the left / right / front (lower side in the figure) the position coordinates detected as a new user are included.

Here, FIG. 9 shows an example of a coordinate area table used when the input user direction detecting means 126 calculates the user direction.
The table shown in FIG. 9 includes a user direction (user direction) and X / Y coordinates in the laser propagation / camera capture area 70. That is, the table shown in FIG. 9 is a table indicating the association between the designated X and Y coordinate areas and the direction. Then, the input user direction detection unit 126 detects (determines) the user direction depending on which region the position coordinate calculated by the position coordinate calculation unit 125, that is, the detected position coordinate enters.

Next, rotation of the projection screen 10 of the image projection system 1 according to the present embodiment will be described with reference to FIG.
For example, as shown in FIG. 10A, at the timing when the user on the right side of the drawing starts to write using the pen 200, the projection screen 10 is rotated as shown in FIG. The input image is rotated 90 degrees to the left and projected). Since the projection screen 10 faces the direction of confidence, the user can easily write. When the user's writing is completed, as shown in FIG. 10C, the display is easy to see from anyone in the original front direction.

By configuring the projector 100 included in the image projection system 1 as described above, the following effects can be achieved.
Based on the position coordinates of the user who performs the coordinate input acquired by the position information measuring means 181 and the position coordinate calculating means 125, an input user direction detecting means 126 for detecting the user direction is provided. In addition, screen rotation determining means 123 is also provided for determining whether or not the user is pointing to a position on the projection screen 10 and whether or not the image editing means 124 is to rotate the projection screen 10 according to the user direction. Yes. With these configurations, it is easy for a plurality of users to write characters or the like using a pen 200 or a finger from different directions on the projection screen 10 projected on a table such as the upper surface of the desk 50 while being changed. It is possible to project characters written in a direction that is easy for the user to see.

Then, the position coordinate calculation means 125 calculates the position coordinate of the user from the image information of the user who is imaged by the camera 102 and points around the projection screen 10 with the pen 200 or the finger, and the calculated position. The user direction is detected by the input user direction detection means 126 from the coordinates. Unlike the conventional configuration in which the user direction is detected from the direction of the coordinate position specifying means in order to detect the user direction in this way, regardless of the position of the user using the pen 200 or the finger or the wrinkle when holding the pen 200. The user direction can be detected with high accuracy by the input user direction detection means 126.
Therefore, the possibility of rotating the projection screen 10 in the wrong direction can be reduced, and the projection screen 10 can be rotated in the direction corresponding to the user direction.
Therefore, it is possible to provide the projector 100 that can improve the convenience of the user who uses the image projection apparatus having the interactive function as compared with the conventional art.

Further, the reflected light of the first laser beam R1 and the second laser beam R2 output (irradiated) from the laser module 250 can be accurately identified from the image captured by the camera 102. Therefore, it is possible to improve the detection accuracy of the position coordinates and further reduce the possibility of erroneous detection of the user direction.
In this embodiment, the pen 102 on the projection screen 10 and the camera 102 that captures the position coordinates pointed by the finger are input around the projection screen 10 using the pen 200 and the finger on the projection screen 10. A configuration that also serves as an image capturing unit that captures an image of a user is described. However, the projector 100 according to the present embodiment is not limited to such a configuration, and for example, as an imaging unit that captures an image of a user who inputs position coordinates using the pen 200 or a finger on the projection screen 10. The present invention can also be applied to a configuration having another camera.

(Example 2)
Next, Example 2 of the image projection system 1 according to the present embodiment will be described with reference to the drawings.
FIG. 11 is an explanatory diagram relating to the rotation center of the image projection system 1 according to the present embodiment when the projection screen 10 is rotated. FIG. 11 (a) shows a state before rotation, and FIG. 11 (b) shows a case where the image to be projected is rotated by changing the magnification so as to fit the whole without specifying the rotation center. 11 (c) shows a case where the rotation center is designated and rotated without changing the magnification of the image.

The image projection system 1 (projector 100) according to the present embodiment is different from the above-described first embodiment in that the present embodiment designates the rotation center when rotating the projection screen 10 and does not change the magnification of the image. The only difference is that of
Therefore, the same configuration as the image projection system of the first embodiment and the operation and effect thereof will be omitted as appropriate, and the same or similar members will be denoted by the same reference signs unless otherwise distinguished. And a description will be given.

In the first embodiment, no particular description has been given regarding the designation of the rotation center when rotating the projection screen 10 and whether or not the magnification of the image when projecting is changed.
Here, for example, as shown in FIG. 11 (a), the entire projection screen 10 can be projected around the centroid of the projection screen 10 projected on substantially the entire area of a rectangular desk having an aspect ratio of not 1: 1. When rotated 90 [°] to the left / right in this manner, the image is reduced and reduced as shown in FIG. In other words, when the screen is rotated left and right so that the entire screen can be entered, the projected image is reduced in size and may be difficult to write.
On the other hand, if the image is rotated by 90 [°] without changing the projection magnification, there is a possibility that the image portion that the user wants to input characters will protrude from the rectangular desk.

Therefore, in the image projection system 1 (projector 100) of the present embodiment, the screen rotation position determination means 128 that determines an arbitrary position coordinate pointed by the pen 200 or the finger as the rotation center position when rotating the projection screen 10 is provided. Prepared.
By configuring in this way, the following effects can be achieved.
By determining the center of the image portion where the user wants to input the position coordinates as the rotation center position when the projection screen 10 is rotated by the screen rotation position determining means 128, the image portion desired to be input can be projected largely, and the interactive function functions Improves.
That is, with the configuration described above, the projection screen is rotated with the position input with the pen 200 or the like as the rotation center position so that the projection image is not reduced. As a result, a part of the screen is cut off, but it is not reduced and it is difficult to write.

(Example 3)
Next, Example 3 of the image projection system 1 according to the present embodiment will be described with reference to the drawings.
FIG. 12 is a flowchart of rotation of the projection screen of the image projection system 1 according to the present embodiment. FIG. 13 is an explanatory diagram of a rotation amount for rotating the projection screen 10 when there are two users using the pen 200 of this embodiment. 13A shows an example of the rotation state of the projection screen 10 when the previous character input is performed, and FIG. 13B shows an example of the rotation state of the projection screen 10 when the later character input is performed. .

The image projection system 1 (projector 100) of the present embodiment and the first and second embodiments described above are only related to the amount of rotation by which the present embodiment rotates the projection screen 10 when the projection screen 10 is rotated. Different.
Therefore, the same configuration as the image projection system of the first embodiment and the operation and effect thereof will be omitted as appropriate, and the same or similar members will be denoted by the same reference signs unless otherwise distinguished. And a description will be given.

In the processing flow of the projector 100 of the present embodiment, it is determined that the camera 102 shown in FIG. 7 used in the description of the first embodiment is taking reflected light of the first laser beam: R1 (Yes in S105). Immediately after that, a determination is made as to whether or not it has been rotated in the direction of another user.
That is, as shown in FIG. 12, immediately after it is determined that the camera 102 has taken the reflected light of the first laser beam: R1 (Yes in S205), it is determined whether or not it has been rotated in the direction of another user. (S210) is added.
If it is determined that the rotation has not been completed (No in S210), the video editing unit 124 performs an editing process for rotating the projection screen 10 on the video signal to convert the projection signal into a projection signal in the same manner as in the first embodiment. 10 is rotated in the user direction (S216).
On the other hand, when it is determined that the rotation has been completed (Yes in S210), the screen rotation determination unit 123 performs the following process. The video editing means 124 performs an editing process for rotating the projection screen 10 on the video signal in an intermediate direction which is the middle of the two users' direction, converts it to a projection signal, and rotates the projection screen 10 in the user direction (S217). ).

Thus, by rotating the projection screen 10 in the intermediate direction, for example, the rotation state of the projection screen 10 when the user on the right side in FIG. As shown to a), the projection screen 10 rotates so that the base direction of a character may turn into the right side in the figure.
In the figure, the rotation state of the projection screen 10 when the user on the front side (lower side) inputs characters later is the intermediate direction of the user direction of each user as shown in FIG. Rotate so that the bottom of the character intersects the front side of the desk 50 at 45 [°].
By rotating the projection screen 10 to such a rotation position, it becomes a screen position where characters can be easily written by any user.

As described above, in the projector 100 according to the present embodiment, the screen rotation determination unit 123, when the pen 200 is used by two users having different user directions, is positioned in the middle position direction of the user direction where the two users are present. The projection screen 10 is rotated.
By rotating in this way, when the pen 200 is used by two users having different user directions, the projection screen 10 is rotated to an intermediate position in the user direction where the two users are present. The screen position is easy to write characters and the like, and the usability is improved.

  That is, when trying to rotate the projection screen 10 in the user direction, if the projection screen 10 has already been rotated, it can be considered that another user has rotated for writing. Therefore, by rotating the screen in an intermediate direction with the user, the screen position is easy for two people to write.

Example 4
Next, Example 4 of the image projection system 1 according to the present embodiment will be described with reference to the drawings.
FIG. 14 is an example of a schematic configuration diagram of the image projection system 1 according to the present embodiment. FIG. 14A is an explanatory diagram when the user inputs coordinates using the electronic pen 210 as an interactive pen. It is. FIG. 14B is an explanatory diagram when the user operates the projector 100 using the remote controller 280. FIG. 15 is an explanatory diagram of problems when the infrared remote control 280 is used in the image projection system 1. FIG. 15 (a) shows a correct operation method of the infrared remote control 280, and FIG. Indicates an incorrect operation method. FIG. 16 is an example of a functional block diagram of the image projection system 1 according to the present embodiment.

  FIG. 17 is an explanatory diagram of an example of a method for recognizing infrared light irradiated toward the projection screen 10 by the infrared remote controller 280, FIG. 17 (a) is a perspective explanatory diagram, and FIG. 3 is an explanatory diagram of a state on a projection screen 10. FIG. FIG. 18 is an explanatory diagram of an example of a method of recognizing infrared light emitted toward the projection screen 10 by the electronic pen 210 that is an interactive pen that irradiates infrared light as coordinate position specifying means. FIG. 18A is a perspective explanatory view, and FIG. 18B is an explanatory view of a state on the projection screen 10. FIG. 19 is an example of a flowchart of a method for determining the infrared light irradiated on the projection screen 10 in the image projection system 1 according to the present embodiment, and FIG. 20 is an infrared method for the user toward the projection screen 10. It is an example of a warning text displayed (projected) when it is determined that the remote controller 280 is operated.

The image projection system 1 (projector 100) of this embodiment is different from the above-described first to third embodiments only in the following two points.
The most different point is that the present embodiment is provided with a remote controller 280 which is an infrared remote control device. In the image projection system 1 of the present embodiment, the configuration points related to the coordinate input by the electronic pen 210 that is the coordinate position specifying means can also be different.
Therefore, the same configuration as in the image projection systems of Embodiments 1 to 3 and the operation and effect thereof will be omitted as appropriate, and the same or similar members will be the same unless otherwise distinguished. A description will be given with reference numerals and names.

First, a problem when an infrared remote control is used for the image projection system 1 will be described with reference to the drawings.
The image projection system 1 of this embodiment has an interactive function using an electronic pen 210 as shown in FIG. In addition, an infrared remote control 280 is also provided as a remote control device for remotely operating the projector 100 main body. For these reasons, the projector 100 includes a camera 102 that is an imaging unit for performing an interactive function, and an infrared signal receiving unit 108 that receives an infrared light signal from the remote controller 280.

In order to remotely operate the projector 100 with the remote controller 280, as shown in FIG. 15A, an infrared light signal is emitted from the remote controller 280 toward the infrared signal receiver 108 provided in the projector 100 ( Output).
Conventionally, however, as shown in FIG. 15B, the user sends an infrared light signal from the remote control 280 of the projector 100 toward the screen 60 (projection screen 10) to be projected, like a TV remote control. There were many cases of operation to irradiate. In such a case, there is a problem that the infrared signal reception unit 108 provided in the projector 100 cannot receive the infrared light signal of the remote controller 280, and the projector 100 does not respond to the operation of the remote controller 280.
As shown in FIGS. 15A and 15B, when the projector 100 is suspended from the ceiling, it is necessary to operate the remote controller 280 toward the projector 100. This is because there is a preconception and it tends to be operated toward the screen 60.

When the remote controller 280 is operated in the wrong direction, that is, toward the screen 60, the projector 100 does not respond, so that the user mistakes the remote controller 280 or the projector 100 for a failure or the remote controller 280 has run out of battery. Things happen.
If such a situation occurs, the convenience of the user who uses the projector 100 may be significantly increased.

Incidentally, as a problem relating to a problem that may occur in an infrared remote controller, Patent Document 3 describes the following projector.
A light-shielding plate having two through-holes at different positions in the horizontal direction is attached to the light-introducing portion of the remote control light-receiving portion of the projector. When used for ceiling suspension, the light shielding plate is moved to the left to receive light from the through hole. When used for flooring, the light-shielding plate is slid to the right so as to receive light from the remote control through a through hole opened upward.

By configuring in this way, it is possible to reduce the light of fluorescent lamps often used for indoor lighting from reaching the remote control light receiving unit, regardless of whether the projector is suspended from the ceiling or placed on the floor. It is described that interference with the reception of infrared light signals can be reduced.
However, this is not a solution when the user accidentally operates the remote control toward the screen 60 or the like instead of the main body of the projector 100, which is a problem in the image projection system 1 of the present embodiment.

Therefore, the inventor considers whether or not the user can be notified of the incorrect operation quickly if the user accidentally operates the remote control toward the screen 60 or the like, and An image projection system 1 (projector 100) having a simple configuration has been found.
For example, when the remote controller 280 is operated toward the screen 60 instead of the infrared signal receiving unit 191 of the projector 100 by the camera 102 which is an imaging unit provided in the projector 100, the infrared light signal which is an optical signal is reflected. The light is captured by the camera 102. The infrared light determination unit 192 is configured as a light determination unit that determines whether the infrared light signal captured by the camera 102 is an infrared light signal emitted (transmitted or output) from the remote controller 280. It is.

By configuring the projector 100 in this way, the following effects can be achieved.
If the user accidentally operates the infrared remote control 280 toward the screen 60 instead of the infrared signal receiving means 191 of the projector 100, the camera 102 can capture the infrared light signal. Then, it is determined whether the captured infrared light signal is from the remote controller 280. If the transmission destination is incorrect, the fact that the transmission destination is incorrect is projected on the projection screen 10 to notify the user. It becomes possible.
Therefore, when the user operates the infrared remote control 280 toward the screen 60 or the like, a warning is displayed (projected) on the projection screen 10, and the user mistakes that the projector 100 or the remote control 280 is broken or the remote control 280 is out of battery. Can be prevented.

As described above, the image projection system 1 according to the present embodiment is most different in that it includes the remote controller 280 that is an infrared remote control device, and also relates to coordinate input by the electronic pen 210 that is a coordinate position specifying unit. The point can also take a different configuration.
For these reasons, next, the electronic pen 210 that irradiates infrared light and the reflected light reflected by the infrared light reflected on the projection screen 10 are captured by the camera 102 as coordinate position specifying means using each figure. A configuration example for acquiring position coordinates indicated by the electronic pen 210 will be described.

First, the basic configuration and the function of each part of the above-described configuration example of the image projection system 1 of this example will be described with reference to FIG.
(Projector 100)
The video input unit 121 is a unit that receives a video (image) signal input via the HDMI or VGA video cable 21 or the network.
The video editing unit 124 is a unit that performs an editing process of an image to be projected, such as scaling or rotation, on the video signal received by the video input unit 121 and converts it into a projection signal.
The projection unit 122 is a unit that projects the projection signal that has been subjected to the editing process by the video editing unit 124 and converted to the outside.

The infrared signal receiving unit 191 is a unit that receives an infrared signal transmitted from the infrared remote controller 280.
The infrared light position measuring unit 193 is a unit that images infrared light on the screen and measures position information and size (unit: pixel), and is configured from the camera 102.
The infrared light determination unit 192 is a unit that determines whether the infrared light captured by the infrared light position measurement unit 193 (camera 102) is from the electronic pen 210 or the remote controller 280.
The position coordinate calculation means 125 calculates position coordinates pointed by the electronic pen 210 on the projection screen 10 from the acquired measurement information.

The PC operation information conversion means converts the calculated position coordinates and button status information of the pen tip switch 226 of the remote controller 280 into operation information of the computer 300 and sends the information to the computer 300 using the interactive communication means 129.
The interactive communication means 129 transmits and receives information related to the interactive function with the computer 300.

(Electronic pen 210)
The infrared light transmitting unit 231 is a unit that outputs infrared light for the purpose of transmitting drawing information.
The pen tip switch 226 is a means for determining whether or not the user is drawing with the electronic pen 210.
(Remote control 280)
The infrared signal transmission unit 281 is a unit that outputs an infrared light signal for the purpose of transmitting operation information.
The remote control operation key 282 is means for the user to select and confirm a desired operation.

(Computer 300)
The interactive communication unit 329 transmits and receives information related to the interactive function with the projector 100.
The video output means 322 outputs the video of the computer to an external display device such as a display or the projector 100.
The operation means 323 implements the operation of the computer 300 itself according to the operation keys of the computer 300 and the PC operation information received from the projector 100.

Next, a method for recognizing infrared light transmitted to the screen 60 will be described with reference to FIGS. 17 and 18.
As shown in FIG. 17A, when the user transmits an infrared light signal to the screen 60 with the remote controller 280, the infrared light is reflected by the screen 60 and captured by the camera 102 of the projector 100.
As shown in FIG. 17A, when the user starts drawing with the electronic pen 210, infrared light is emitted by pressing the pen tip switch 226, and the image is also captured by the camera 102 of the projector 100. .

The discrimination between the two is made by using the fact that the infrared light from the remote controller 280 is smaller than that of the electronic pen 210, and the discrimination is based on the diameter of the captured infrared light. The judgment formula is shown below.
(Judgment formula)
If the diameter of the infrared light imaged by the camera is Ei (unit is pixel) and the determination threshold is R,
As shown in FIG.
When Ei <R, it is determined that the infrared light is from the remote controller 280.
As shown in FIG.
When R <= Ei, it is determined that the infrared light is from the electronic pen 210.

Next, an infrared light determination flow in the above configuration example will be described with reference to FIG.
When the camera 102 that is the imaging device of the projector 100 captures infrared light having a diameter of Ei (S301), the diameter of the captured infrared light: Ei is compared with a determination threshold value: R, and the diameter: Ei is determined as a determination threshold value. : It is determined whether it is smaller than R (S302).
When Ei <R (Yes in S302), it is determined that the infrared remote control 280 is used, and a warning is displayed on the projection screen 10 (S303).
On the other hand, when R <= Ei (No in S302), it is determined that the infrared light is from the electronic pen 210, and the interactive function is started (S304).

  When Ei <R (Yes in S302), as a warning displayed on the projection screen 10 (S303), “Warning Please operate the remote control toward the projector body, not the projection screen” shown in FIG. Warning sentences such as This warning message is a warning message displayed when it is determined that the user is operating the remote controller 280 toward the screen 60 (projection screen).

By configuring as described above, the following effects can be obtained.
Even when infrared pens are used as the electronic pen 210 and the remote controller 280, the infrared light determining means 192 uses the infrared light irradiated from the electronic pen 210 and the infrared light irradiated from the remote controller 280. It can be determined with high accuracy.
Therefore, even when an infrared pen is used as the electronic pen 210 and the remote controller 280, if the user accidentally operates the remote controller 280 toward the screen 60 or the like, the projector 100 warns the projection screen 10 Can be displayed properly.

In the functional block diagram of FIG. 16 described in the above configuration example, an infrared electronic pen 210 that is a coordinate position specifying unit and reflected light reflected by the infrared light reflected on the projection screen 10 are captured by the camera 102. FIG. 5 is a functional block diagram of a configuration example for acquiring position coordinates indicated by the electronic pen 210.
However, the image projection system 1 of the present embodiment is not limited to such a configuration, and design changes and the like within a range not departing from the gist may be performed.
For example, the block (means) shown in FIG. 18 can be added to the block diagram of FIG. 7 used in the description of the first embodiment. An infrared signal receiving unit configured by the infrared signal receiving unit 108, an infrared light determining unit 192, and an infrared light position measuring unit configured by the camera 102 are added to the projector 100 in the block diagram of FIG. Then, each unit configured by the remote controller 280 is added while the respective units configured by the laser module 250 and the respective units configured by the pen 200 are kept as they are.

That is, the configuration for detecting the position of the pen 200 and the user and the user direction described in the first embodiment is a configuration in which a configuration (block) related to the remote controller 280 is added as it is.
With this configuration, the user direction can be detected with higher accuracy than the conventional configuration, as in the configuration described in the first embodiment.
Therefore, the possibility of rotating the projection screen in the wrong direction can be reduced, and the projection screen can be rotated in the direction corresponding to the user direction.
In addition, when the user operates the optical remote control device toward the projection surface, a warning is displayed on the projection screen, and the user malfunctions the image projection device or the remote control device, or the remote control device. It is possible to prevent a situation where the battery is mistaken for running out of battery.

  As described above, the present embodiment has been described with reference to the drawings. However, the specific configuration is not limited to the configuration including the projector 100 according to the present embodiment described above, and the design is within a range not departing from the gist. Changes may be made.

What was demonstrated above is an example, and there exists an effect peculiar for every following aspect.
(Aspect A)
Image processing means such as video editing means 124 that processes image signals such as video signals and converts them into projection signals, projection means such as projection means 122 that projects the projection signals converted by the image processing means, and projection An interactive input / output function using a coordinate position specifying means such as a pen 200 or a position coordinate calculating means 125 such as a position coordinate calculating means 125 for calculating a position coordinate pointed by a finger on a projection screen such as the projection screen 10 projected by the means. An image projection apparatus such as the projector 100 provided with imaging means such as a camera 102 (position information measurement means 181) that images the periphery of the projection screen, and the position coordinate calculation means is an image captured by the imaging means. From the information, the position coordinates of the user who inputs the position coordinates using the coordinate position specifying means and the finger are calculated, and the profit calculated by the position coordinate calculating means is calculated. Input user direction detection means 126 that detects a user direction such as a user direction of the user, based on the position of the projection target such as the upper surface of the desk 50 projecting the projection screen from the position coordinates of the user. And a projection screen depending on whether the user is pointing to a position on the projection screen and the user direction of the user detected by the user direction detection unit, Projection screen rotation determining means such as screen rotation determining means 123 for determining whether or not the image processing means rotates is provided.

According to this, as described in the present embodiment, the following effects can be achieved.
The position coordinates of this user are calculated by the coordinate position specifying means from the image information of the user who is picked up by the image pickup means and points around the projection screen with the coordinate position specifying means and the finger on the projection screen. The user direction is detected from the coordinates by the user direction detecting means. Unlike the conventional configuration in which the user direction is detected from the direction of the coordinate position specifying means in order to detect the user direction in this way, the user position using the coordinate position specifying means or the coordinate position specifying means is provided. Regardless of 癖, the user direction can be accurately detected by the user direction detection means.
Therefore, the possibility of rotating the projection screen in the wrong direction can be reduced, and the projection screen can be rotated in the direction corresponding to the user direction.
Therefore, it is possible to provide an image projection apparatus that can improve the convenience of a user who uses an image projection apparatus having an interactive input / output function as compared with the conventional art.

(Aspect B)
In (Aspect A), the imaging unit includes the coordinate position specifying unit and the finger pointing on the projection screen, and the first laser beam R1 of the light irradiation unit such as the laser module 250 irradiated to the user. Second laser beam: Captures reflected light of a plurality of lights such as R2, and the position coordinate calculation means determines the coordinate position from image information of the reflected lights of the light emitted from the light irradiation means captured by the imaging means. A position coordinate on the projection screen indicated by means or a finger and a position coordinate where the user is present are calculated.

According to this, as described in the present embodiment, the following effects can be achieved.
The reflected light of the light emitted from the light irradiation means can be accurately identified from the image picked up by the image pickup means. Therefore, it is possible to increase the detection accuracy of the position coordinates and further reduce the possibility of erroneously detecting the user direction.

(Aspect C)
In (Aspect A) or (Aspect B), the coordinate position specifying means or the screen rotation position determining means 128 for determining an arbitrary position coordinate pointed by a finger as the rotation center position when rotating the projection screen, etc. A screen rotation position determining means is provided.

According to this, as described in the present embodiment, the following effects can be achieved.
For example, a projection screen projected at the same aspect ratio on the entire tabletop surface such as a rectangular desk 50 having an aspect ratio of not 1: 1 is 90 [° so that the entire projection screen can be projected around the centroid of the projection screen. ] When rotated, the projected screen is reduced and made smaller. On the other hand, if the image is rotated by 90 [°] without changing the projection magnification, there is a possibility that the image portion where the user wants to input the position coordinates will protrude from the rectangular desktop.
Therefore, by determining the center of the image part where the user wants to input the position coordinates as the rotation center position when rotating the projected image with the screen rotation position determining means, the image part that the user wants to input can be projected greatly, interactive functions etc. The functionality of the interactive I / O function is improved.

(Aspect D)
In any one of (Aspect A) to (Aspect C), the projection screen rotation determining means determines whether the position coordinates on the projection screen are determined by the coordinate position specifying means or a finger by two users having different user directions. When pointing, the projection screen is rotated in an intermediate direction such as a direction intersecting the side on the front side at 45 [°] with respect to the user direction where the two users are present.

According to this, as described in the present embodiment, the following effects can be achieved.
When the coordinate position specifying means is used by two users with different user directions, the projection screen is rotated to an intermediate position in the user direction where the two users are present. Becomes an easy-to-write screen position, improving usability.

(Aspect E)
In any one of (Aspect A) to (Aspect D), a remote operation device such as an optical remote control 280 that remotely operates the image projection device, such as an infrared remote control device, and a light signal emitted from the remote operation device are received. From the image on the projection screen picked up by the optical signal receiving means such as the infrared signal receiving means 191 and the imaging means, the light emitted on the projection screen is an optical signal emitted from the remote control means. It is characterized by comprising light determination means such as infrared light determination means 192 for determining whether or not.

According to this, as described in the present embodiment, the following effects can be achieved.
If the user accidentally operates the optical remote control device toward the projection surface such as the screen 60 instead of the optical signal receiving unit of the image projection apparatus, the imaging unit can capture the optical signal. . Then, it can be determined whether the captured optical signal is from a remote control device, and if the transmission destination is incorrect, it can be projected on the projection screen to notify the user that the transmission destination is incorrect It becomes.
Therefore, when the user operates the optical remote control device toward the projection surface, a warning is displayed on the projection screen, and the user has a malfunction of the image projection device or the remote control device, or the remote control device has It is possible to prevent a misunderstanding that the battery has run out.

(Aspect F)
In (Aspect E), the coordinate position specifying unit such as the electronic pen 210 irradiates the projection screen with infrared light, the imaging unit images infrared light on the projection screen, and the position coordinate calculation unit includes: The center position and diameter: Ei of the light spot by infrared light on the projection screen imaged by the imaging unit is calculated, and the light determination unit is configured to calculate the light irradiated on the projection screen as the remote The infrared light signal emitted from the operating device or the infrared light emitted from the coordinate position specifying means is determined based on the size of the light spot.

According to this, as described in the present embodiment, the following effects can be achieved.
Even when the infrared coordinate system is used as the coordinate position specifying means and the remote operation device, the infrared light emitted from the coordinate position specification means and the infrared light emitted from the remote operation device are used as the light determination means. Can be determined with high accuracy.
Accordingly, even when the infrared position type is used as the coordinate position specifying means and the remote operation device, if the user accidentally operates the infrared type remote operation device toward the projection surface, the image projection device The warning can be displayed properly on the projection screen.

(Aspect G)
An image projection device that projects an image, an imaging unit that images a projection screen projected by the image projection device, and a position coordinate that calculates a coordinate position specifying unit and a position coordinate pointed by a finger from image information captured by the imaging unit An operation of the image projection device or the external device based on a calculation unit, an external device that outputs an image signal projected by the image projection device, and a position coordinate on the projection screen pointed to by the coordinate position specifying unit or a finger In an interactive input system having an interactive input / output function for performing image processing, the image projection apparatus includes an image projection apparatus such as the projector 100 of any one of (Aspect A) to (Aspect F). And

According to this, as described in the present embodiment, the following effects can be achieved.
It is possible to provide an interactive input system that can achieve the same effects as the image projection apparatus according to any one of (Aspect A) to (Aspect F).

1 Image projection system 10 Projection screen (projection area)
21 Video cable 23 Wireless 50 Desk 60 Screen 70 Laser propagation / camera capture area 100 Projector 102 Camera 103 Curved mirror 108 Infrared signal receiver 121 Video input means 122 Projection means 123 Screen rotation judgment means 124 Video editing means 125 Position coordinate calculation means 126 Input user direction detection means 127 PC operation information conversion means 128 Screen rotation position determination means 129 Interactive communication means (projector)
181 Position information measuring means 200 Pen 210 Electronic pen 225 Position information measuring means 229 Interactive communication means (electronic pen)
231 Infrared light transmission means 250 Laser module 251 First laser output means 252 Second laser output means 253 Laser wired cable 254 Blocking material 259 Interactive communication means (laser module)
280 Remote control 281 Infrared signal transmission means 282 Remote control operation key 300 Computer 322 Video output means 323 Operation means 329 Interactive communication means (computer)
400 Image Projector (Patent Document 2)
410 Projection screen (Patent Document 2)
500 tablets (Patent Document 2)
510 Display (Patent Document 2)
R1 First laser beam R2 Second laser beam

JP 2014-186203 A JP 2011-113128 A JP 2000-049364 A

Claims (7)

Image processing means for processing the image signal to convert it into a projection signal, projection means for projecting the projection signal converted by the image processing means, coordinate position specifying means and finger on the projection screen projected by the projection means In an image projection apparatus having an interactive input / output function using position coordinate calculation means for calculating position coordinates indicated by
Having imaging means for imaging the periphery of the projection screen;
The position coordinate calculating means calculates the position coordinates of the user who inputs the position coordinates using the coordinate position specifying means or a finger from the image information captured by the imaging means,
User direction detection means for detecting the user direction of the user based on the position of the projection target projecting the projection screen from the position coordinates of the user calculated by the position coordinate calculation means;
And whether the projection screen is rotated by the image processing unit according to whether the user is pointing to a position on the projection screen and the user direction of the user detected by the user direction detection unit. An image projection apparatus comprising: a projection screen rotation judging means for judging whether or not. The image projection apparatus according to claim 1,
The imaging unit captures reflected light of a plurality of light irradiation units irradiated to the coordinate position specifying unit and fingers pointing on the projection screen and the user,
The position coordinate calculation unit is configured to detect the position coordinate on the projection screen indicated by the coordinate position specifying unit or a finger from the image information of the reflected light of the plurality of lights of the light irradiation unit captured by the imaging unit, and the user An image projection device characterized by calculating a position coordinate where there is. In the image projection device according to claim 1 or 2,
An image projection apparatus comprising: a screen rotation position determination unit configured to determine an arbitrary position coordinate pointed by the coordinate position specifying unit or a finger as a rotation center position when rotating the projection screen. In the image projection device according to any one of claims 1 to 3,
The projection screen rotation determining means uses the two users when the position coordinates on the projection screen are pointed by the coordinate position specifying means or fingers by two users having different user directions. An image projection apparatus characterized in that a projection screen is rotated in an intermediate direction of a person's direction. In the image projection device according to any one of claims 1 to 4,
An optical remote control device for remotely operating the image projection device, an optical signal receiving means for receiving an optical signal emitted from the remote control device, and an image on the projection screen imaged by the imaging means. An image projection apparatus comprising: a light determination unit that determines whether or not the light emitted on the screen is an optical signal emitted from the remote control unit. The image projection device according to claim 5,
The coordinate position specifying means irradiates the projection screen with infrared light, the imaging means images infrared light on the projection screen, and the position coordinate calculation means is on the projection screen imaged by the imaging means. Calculate the center position and size of the light spot by infrared light,
The light determination means determines whether the light irradiated on the projection screen is an infrared light signal irradiated from the remote control device or infrared light irradiated from the coordinate position specifying means. An image projection apparatus characterized in that the determination is based on the size of the light spot. An image projecting device that projects an image, an image capturing unit that captures a projection screen projected by the image projecting device, and a position coordinate that calculates a coordinate position specifying unit and a position coordinate pointed by a finger from image information captured by the image capturing unit An operation of the image projection device or the external device based on a calculation unit, an external device that outputs an image signal projected by the image projection device, and a position coordinate on the projection screen pointed to by the coordinate position specifying unit or a finger In an interactive input system having an interactive input / output function for performing
An interactive input system comprising the image projection device according to any one of claims 1 to 6 as the image projection device.