JP2017208688A - Program, computer device, program execution method, and computer system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a program, computer device, program execution method, and system that allow a user to experience a virtual world with full of presence and are more entertaining.SOLUTION: A program is executed by a computer device capable of communication or connection with a projection device for projecting a projection image on a projection surface. The program causes the computer device to function as: designation point position change means for changing the position of a designation point to designate a projection image to be projected on the projection surface; and transmission means for transmitting an image corresponding to the position of the designation point to the projection device as a projection image.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a program, a computer apparatus, a program execution method, and a computer system.

  Conventionally, projection mapping is performed by projecting computer graphics (hereinafter referred to as CG) onto a building, an object, or a space (hereinafter referred to as a building) using a projection device capable of projecting an image onto a projection surface. A technique called video mapping or mapping projection is known.

  Further, a technique for changing the projected image as well as projecting the image on the projection surface is also known. For example, in Patent Document 1, when a guide image is projected by a projector onto the surface of sand in a container and a user creates a modeled object according to the guide image, an image changed according to the shape of the created modeled object is displayed. A system for projecting onto a model is described.

U.S. Pat. No. 8,388,139

  In general, projection mapping passively enjoys a projected image (hereinafter referred to as a projected image), and the user cannot change the image. Moreover, the technique described in Patent Document 1 merely measures real-world information (for example, the height of sand) and changes the projection image according to the measured information. I couldn't feel the presence of moving inside.

  An object of at least one embodiment of the present invention is to provide a more interesting program, computer apparatus, program execution method, and system that allow a user to experience a virtual world full of realism. Objective.

  According to a non-limiting aspect, the program is executed in a computer device that can communicate with or connect to a projection device that projects a projection image onto a projection surface, and the computer device identifies a projection image to be projected onto the projection surface. This is a program that causes a specific point position changing unit to change the position of a specific point for the purpose and a transmission unit that transmits an image corresponding to the position of the specific point as a projection image to the projection apparatus.

  According to a non-limiting aspect, the computer apparatus can communicate with or connect to a projection apparatus that projects a projection image onto a projection plane, and changes the position of a specific point for identifying the projection image projected onto the projection plane. The computer device includes specific point position changing means and transmission means for transmitting an image corresponding to the position of the specific point as a projection image to the projection apparatus.

  According to a non-limiting aspect, there is provided a program execution method executed in a computer device capable of communicating with or connecting to a projection device that projects a projection image onto a projection surface, for specifying the projection image to be projected onto the projection surface. A program execution method comprising: changing a position of a specific point; and transmitting an image according to the position of the specific point to a projection apparatus as a projection image.

  According to a non-limiting aspect, a computer system including a projection device that projects a projection image onto a projection surface, and a computer device that can communicate with or connect to the projection device, the computer device projects onto the projection surface. Specific point position changing means for changing the position of a specific point for specifying a projection image to be transmitted, and transmission means for transmitting an image corresponding to the position of the specific point to the projection apparatus as a projection image, the projection apparatus comprising: It is a computer system provided with the projection means which projects the received image on a projection surface.

  Each embodiment of the present invention solves one or more deficiencies.

It is a block diagram which shows the structure of the computer apparatus corresponding to at least 1 of embodiment of this invention. It is a flowchart of the program execution process corresponding to at least 1 of embodiment of this invention. It is a block diagram which shows the structure of the computer apparatus corresponding to at least 1 of embodiment of this invention. It is a flowchart of the program execution process corresponding to at least 1 of embodiment of this invention. It is a block diagram which shows the structure of the computer apparatus corresponding to at least 1 of embodiment of this invention. It is a flowchart of the program execution process corresponding to at least 1 of embodiment of this invention. It is a block diagram which shows the structure of the system corresponding to at least 1 of embodiment of this invention. It is a block diagram which shows the structure of the computer apparatus corresponding to at least 1 of embodiment of this invention. It is a block diagram showing a mode that the image was projected on the projection surface from the projection apparatus corresponding to at least 1 of embodiment of this invention. It is a figure showing the concept of the specific point, virtual camera, and virtual screen corresponding to at least 1 of embodiment of this invention. It is an example of a program execution screen corresponding to at least one of the embodiments of the present invention. It is a flowchart of the program execution process corresponding to at least 1 of embodiment of this invention.

  Embodiments of the present invention will be described below with reference to the accompanying drawings. Hereinafter, the description regarding the effect is one aspect of the effect of the embodiment of the present invention, and is not limited to what is described here. In addition, the order of the processes constituting the flowchart described below is out of order as long as no contradiction or inconsistency occurs in the process contents.

[First embodiment]
Next, the outline of the first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration of a computer apparatus corresponding to at least one of the embodiments of the present invention. The computer device 4 includes at least a specific point position changing unit 201 and a transmitting unit 202.

  The specific point position changing unit 201 has a function of changing the position of the specific point for specifying the projection image to be projected onto the projection plane. The transmission unit 202 has a function of transmitting an image corresponding to the position of the specific point as a projection image to the projection apparatus.

  The program execution process in the first embodiment of the present invention will be described. FIG. 2 is a flowchart of a program execution process corresponding to at least one of the embodiments of the present invention.

  The computer apparatus 4 changes the position of the specific point for specifying the projection image that the projection apparatus projects onto the projection plane (step S1). Next, an image corresponding to the position of the specific point changed in step S1 is transmitted as a projection image to the projection apparatus (step S2), and the process ends.

  As one aspect of the first embodiment, the user can have a realistic experience such as moving in the virtual world, and the user's preference can be enhanced.

  In the first embodiment, “projection” refers to, for example, projecting the appearance of an object on a flat surface or a curved surface. The “image” is, for example, a figure, a photograph, an image, graphics, etc., and may be a still image or a moving image. “Projection plane” refers to, for example, a plane or curved surface on which an image can be projected.

  “Projection device” refers to a device capable of projection, such as a projector. “Communication” refers to transmission / reception of data by, for example, wired or wireless communication. “Connecting” means enabling devices to communicate with each other via a transmission medium such as a cable. “Computer device” means, for example, a device that can process an operation according to execution of a program, and means a device that can be connected to another device by communication.

  “Specific point” refers to, for example, a point used for specifying a projection image to be projected onto the projection plane, and is a concept including the position of the user character in the virtual space. “Changing the position” means, for example, changing information related to the position to information different from the current information. “Transmission” refers to, for example, sending an electrical signal, and is a concept including converting electronic information into an electrical signal and sending it to another device.

[Second Embodiment]
Next, the outline of the second embodiment of the present invention will be described. FIG. 3 is a block diagram showing a configuration of a computer apparatus corresponding to at least one of the embodiments of the present invention. The computer device 4 includes at least a specific point position changing unit 211, a virtual camera position changing unit 212, an image generating unit 213, and a transmitting unit 214.

  The specific point position changing unit 211 has a function of changing the position of the specific point for specifying the projection image to be projected onto the projection plane. The virtual camera position changing unit 212 has a function of changing the position of the virtual camera in accordance with the change of the position of the specific point.

  The image generation unit 213 has a function of generating an image by performing perspective transformation on the virtual three-dimensional space from the virtual camera onto the virtual screen. The transmission unit 214 has a function of transmitting the generated image as a projection image to the projection apparatus.

  The program execution process in the second embodiment of the present invention will be described. FIG. 4 is a flowchart of the program execution process corresponding to at least one of the embodiments of the present invention.

  The computer apparatus 4 changes the position of the specific point for specifying the projection image that the projection apparatus projects onto the projection plane (step S11). Next, the position of the virtual camera is changed to the position of the specific point changed in step S11 (step S12).

  Further, the virtual three-dimensional space is perspective-transformed from the virtual camera onto the virtual screen to generate an image (step S13). Then, the image generated in step S13 is transmitted as a projection image to the projection apparatus (step S14), and the process ends.

  As one aspect of the second embodiment, the user changes the position of a specific point for specifying a projection image to be projected on the projection plane, and changes the position of the virtual camera according to the position of the specific point. This makes it possible to give a sense that the user is moving in the virtual world, can increase the sense of presence of the projected image, and can further enhance the user's preference.

  In the second embodiment, “projection”, “image”, “projection plane”, “projection device”, “communication”, “connection”, “computer device”, “specific point”, “change position”, “Transmission” is the same as the contents described in the first embodiment.

  In the second embodiment, the “virtual three-dimensional space” refers to, for example, a virtual space on a computer that is expressed in three dimensions. The “virtual camera” refers to, for example, a camera whose viewpoint or angle of view when drawing CG is compared. The “virtual screen” refers to, for example, a two-dimensional plane for projecting a scene in the virtual world photographed by a virtual camera as a planar image.

  In the second embodiment, “perspective transformation” refers to a method of taking a virtual three-dimensional space from an arbitrary viewpoint such as a virtual camera and converting it into a two-dimensional image with a sense of perspective. “Generate an image” means, for example, drawing an image based on information as a material.

[Third embodiment]
Next, the outline of the third embodiment of the present invention will be described. In the third embodiment, at least two projection surfaces are provided, and one projection surface and another projection surface are installed with a predetermined angle.

  FIG. 5 is a block diagram showing a configuration of a computer apparatus corresponding to at least one of the embodiments of the present invention. The computer device 4 includes at least a specific point position changing unit 221, a virtual camera position changing unit 222, an image generating unit 223, a first image generating unit 224, a second image generating unit 225, and a transmitting unit 226.

  The specific point position changing unit 221 has a function of changing the position of the specific point for specifying the projection image to be projected onto the projection plane. The virtual camera position changing unit 222 has a function of changing the position of the virtual camera in accordance with the change of the position of the specific point.

  The image generation unit 223 has a function of generating an image by performing a perspective transformation on a virtual three-dimensional space from a virtual camera onto a virtual screen. The first image generation unit 224 has a function of generating an image by performing perspective transformation on the first virtual screen from the first virtual camera corresponding to one projection plane. The second image generation unit 225 has a function of generating an image by performing perspective transformation on the second virtual screen from the second virtual camera corresponding to another projection plane. The transmission unit 226 has a function of transmitting the generated image as a projection image to the projection apparatus.

  The program execution process in the third embodiment of the present invention will be described. FIG. 6 is a flowchart of the program execution process corresponding to at least one of the embodiments of the present invention.

  The computer apparatus 4 changes the position of the specific point for specifying the projection image that the projection apparatus projects onto the projection plane (step S21). Next, the position of the virtual camera is changed to the position of the specific point changed in step S21 (step S22).

  Further, the virtual three-dimensional space is perspective-transformed on the first virtual screen from the first virtual camera corresponding to one projection plane to generate an image (step S23). Further, the second virtual camera corresponding to another projection plane is perspective-transformed on the second virtual screen to generate an image (step S24).

  Then, the image generated in step S23 and step S24 is transmitted to the projection apparatus as a projection image (step S25), and the process ends.

  In the third embodiment, the relative positional relationship of the first virtual screen with respect to the first virtual camera and the relative positional relationship of the second virtual screen with respect to the second virtual camera are the same, and the first virtual screen And the second virtual screen have the same angle as the predetermined angle.

  As one aspect of the third embodiment, two or more projection planes are installed at a predetermined angle, the relative positional relationship of the first virtual screen with respect to the first virtual camera, and the second virtual camera The relative positional relationship between the second virtual screens is the same, and the virtual screens have the same angle as the angle formed between the projection surfaces, so that the positional relationship between the real-world projection surfaces and the virtual Since the positional relationship between the virtual cameras in the world can be made to correspond, it is possible to project the state of the virtual world onto a plurality of projection surfaces without a sense of incongruity.

  In the third embodiment, “projection”, “image”, “projection plane”, “projection device”, “communication”, “connection”, “computer device”, “specific point”, “change position”, “Transmission” is the same as the contents described in the first embodiment.

  In the third embodiment, “virtual three-dimensional space”, “virtual camera”, “virtual screen”, “perspective transformation”, and “generate image” are described in the second embodiment. Is the same as

  In the third embodiment, “installation” means, for example, providing a projection plane. “Angle” refers to, for example, an angle formed by installed projection surfaces. The “relative positional relationship” refers to a relationship determined by, for example, a distance between two objects or a difference in height.

[Fourth embodiment]
Next, an outline of the fourth embodiment of the present invention will be described. The configuration of the computer apparatus according to the fourth embodiment can employ the same configuration as that shown in the block diagram of FIG. Furthermore, the same configuration as that shown in the flowchart of FIG. 4 can be adopted as the flow of the program execution process in the fourth embodiment.

  In the fourth embodiment, the virtual camera position changing unit 212 changes the position of the virtual camera while maintaining the relative positional relationship of the virtual camera with respect to the specific point.

  As one aspect of the fourth embodiment, the specific point is changed by a user operation instruction or a program command by changing the position of the virtual camera while maintaining the relative positional relationship of the virtual camera with respect to the specific point. In this case, the position of the virtual camera can be changed according to the position of the specific point. Since the projected image changes, the user can feel as if he is moving in the virtual world.

  In the fourth embodiment, “projection”, “image”, “projection plane”, “projection device”, “communication”, “connection”, “computer device”, “specific point”, “change position”, “Transmission” is the same as the contents described in the first embodiment.

  In the fourth embodiment, “virtual three-dimensional space”, “virtual camera”, “virtual screen”, “perspective transformation”, and “generate image” are described in the second embodiment, respectively. It is the same as the contents.

[Fifth embodiment]
Next, an outline of the fifth embodiment of the present invention will be described. In the fifth embodiment, at least two projection surfaces are provided, and one projection surface and another projection surface are installed with a predetermined angle.

  Next, an outline of the fifth embodiment of the present invention will be described. FIG. 7 is a block diagram showing a system configuration corresponding to at least one of the embodiments of the present invention. As shown in the figure, the system includes a plurality of light beam irradiation devices 1 (light beam irradiation devices 1a, 1b,... 1z), a projection surface 2 that emits light beams and projects an image from the projection device, and a light beam irradiation device. An imaging device 3 that captures a reflected light beam irradiated from 1 to the projection surface 2, a computer device 4 that performs processing based on information about the captured light beam, and an image processed by the computer device 4 is projected onto the projection surface 2. Projecting device 5.

  The light irradiation device 1 can be used independently without being connected to other devices or the like. However, the light irradiation device 1 may be communicable with the computer device 4 and inputs a user instruction provided in the light irradiation device 1. An input signal may be transmitted to the computer apparatus 4 by a mechanism. Moreover, the light irradiation apparatus 1 may irradiate invisible light, may irradiate visible light, or may irradiate both.

  The projection surface 2 is preferably made of a material that can reflect the light beam emitted from the light beam irradiation device 1. The imaging device 3 is connected to the computer device 4 via a wired or wireless communication line. The computer device 4 is connected to the photographing device 3 and the projection device 5 via a wired or wireless communication line. The projection device 5 is connected to the computer device 4 via a communication line. The imaging device 3, the computer device 4, and the projection device 5 may be devices independent of each other, or may be a single device that is combined.

  As an example of this embodiment, the light irradiation device 1 can be a device that can irradiate two types of light, visible light and invisible light (for example, infrared light). By irradiating visible light, the user can easily grasp the position irradiated by himself / herself. Further, by irradiating invisible light, the light irradiation device 1 can be identified without being affected by the projected image.

  As an example of this embodiment, an infrared ray can be used as the invisible ray of the light irradiation device 1, and an infrared sensor camera can be used as the photographing device 3. Here, a filter can be attached to the camera so that the infrared rays emitted from the player do not interfere with the operation. This is because the wavelength around 9 to 10 μm corresponding to the infrared rays emitted by the human body is cut. It is preferable that the wavelength of the infrared ray emitted from the light irradiation device 1 is set so as not to be included in the above-described range of wavelengths to be cut.

  FIG. 8 is a block diagram showing a configuration of a computer apparatus corresponding to at least one of the embodiments of the present invention. The computer device 4 includes a control unit 11, a RAM (Random Access Memory) 12, a storage unit 13, a graphics processing unit 14, a video memory 15, a communication interface 16, a peripheral device connection interface 17, and a peripheral device 18. Connected by bus.

  The control unit 11 includes a CPU (Central Processing Unit) and a ROM (Read Only Memory). The control unit 11 executes a program stored in the storage unit 13 and controls the computer device 4. The RAM 12 is a work area for the control unit 11. The storage unit 13 is a storage area for storing programs and data.

  The control unit 11 reads the program and data from the RAM 12 and performs processing. The control unit 11 processes the program and data loaded in the RAM 12 to output a drawing command to the graphics processing unit 14.

  The graphics processing unit 14 draws one image for each frame. One frame time of an image is, for example, 1/30 second. The graphics processing unit 14 is responsible for a part of arithmetic processing related to drawing and has a role of distributing the load of the entire system.

  A peripheral device 18 (for example, an SD card, a photographing camera, etc.) is connected to the peripheral device connection interface 17. Data read from the peripheral device 18 is loaded into the RAM 12 and arithmetic processing is executed by the control unit 11.

  The communication interface 16 can be connected to the communication line 6 wirelessly or by wire, and can receive data via the communication line 6. Data received via the communication interface 16 is loaded into the RAM 12 in the same manner as data read from the peripheral device 18, and arithmetic processing is performed by the control unit 11.

  A program execution process according to the fifth embodiment of the present invention will be described. As an example of the fifth embodiment of the present invention, there is a game program that represents a virtual world by hanging a projection device from a ceiling and projecting an image on a wall surface and a floor surface. The user can perform an input operation by irradiating the image projected on the wall surface with a light beam from the light beam irradiation device. An object such as a character that can be operated by the user may exist in the virtual world.

  FIG. 9 is a block diagram showing a state in which an image is projected from the projection apparatus onto the projection plane, corresponding to at least one of the embodiments of the invention. FIG. 9A is a plan view of a state in which an image is projected from the projection device 5 onto the projection plane 2 when viewed from the ceiling toward the floor.

  The projection surfaces 2a to 2d are installed so that the projection surfaces are perpendicular to each other so as to partition a substantially rectangular parallelepiped space. The projection device 5 is hung from the ceiling in the approximate center of the partitioned space, and is installed so as to be able to project images onto the projection surfaces 2 a to 2 d installed in four directions.

  FIG. 9B is a plan view of a state in which an image is projected from the projection device 5 onto the projection plane 2 when viewed from the projection plane 2c toward the projection plane 2a. The projection device 5 projects an image not only on the projection surfaces 2 a to 2 d but also on the floor surface 7. That is, the projection device 5 projects an image on five surfaces.

  Next, the contents of the image projected from the projection device will be described. FIG. 10 is a diagram illustrating the concept of a specific point, a virtual camera, and a virtual screen corresponding to at least one of the embodiments of the invention.

FIG. 10A is a conceptual diagram illustrating photographing with a virtual camera in a virtual three-dimensional space. Figure 10 (a), the specific point 52a, the virtual camera 51a ₁ and 51a ₂ are taken from different directions. An image photographed by the virtual camera 51a ₁ is perspective-transformed on the virtual screen 50a ₁ . Further, the image photographed by the virtual camera 51a ₂ is perspective-transformed on the virtual screen 50a ₂ .

Here, the relative positional relationship between the virtual camera 51a ₁ and the virtual screen 50a _1, is preferably the same as the relative positional relationship between the virtual camera 51a ₂ and the virtual screen 50a _2. Moreover, just as the projection surface is placed so as to be perpendicular to each other, and the virtual screen 50a ₁ and the virtual screen 50a _2, is provided so as to be perpendicular to each other. By designing in this way, the state of the virtual world can be projected onto a plurality of projection surfaces without a sense of incongruity.

  Next, a change in the position of the specific point will be described. The position of the virtual camera is preferably changed while maintaining a relative positional relationship with respect to the specific point. FIG. 10B is a conceptual diagram illustrating changes in the positions of the virtual camera and the virtual screen when the position of the specific point changes.

When the position of the specific point 52a is changed to the position of the specific point 52b by the user's input operation or program processing, etc., the position of the virtual camera maintains the relative positional relationship with respect to the specific point. position of the virtual camera 51a ₂ is a front of the virtual camera 51a _2, it is changed to the position of the virtual camera 51b _2. Similarly, the position of the virtual camera 51a ₁ is right side of the virtual camera 51a _1, is changed to the position of the virtual camera 51b _1.

Further, the position of the virtual screen is also changed with the change of the position of the virtual camera. When the position of the virtual camera 51a ₁ is changed to the position of the virtual camera 51b ₁ , the position of the virtual screen 50a ₁ is changed to the position of the virtual screen 50b _{1 in} the same plane. When the position of the virtual camera 51a ₂ is changed to the position of the virtual camera 51b ₂ , the position of the virtual screen 50a ₂ is changed to the position of the virtual screen 50b _{2 in} the same plane.

  Note that the virtual screen corresponds to the projection plane 2, and the image that is perspective-transformed on the virtual screen is the same as the image projected from the projection device 5.

  FIG. 11 is an example of a program execution screen corresponding to at least one of the embodiments of the present invention. In the figure, an image is projected from a projection device (not shown) to the front projection surface 2a, the right projection surface 2b toward the projection surface 2a, the left projection surface 2d toward the projection surface 2a, and the floor surface 7, respectively. Is projected. In addition, a photographing device (not shown) for photographing each projection plane 2 is installed.

  Further, as an example, it is assumed that the user stands directly under the projection apparatus and is surrounded by four projection planes. In the image, the state of the cave passage is displayed as shown.

  The front projection surface 2a displays a state in which the passage extends in the depth direction of the front so that it can proceed. Similarly, the left projection surface 2d displays a state in which the passage extends in the direction to be placed on the left side so as to be able to proceed. The user can understand from the front projection surface 2a how he can proceed to the left side.

  On the other hand, the right projection surface 2b displays a state in which the wall surfaces are connected so as not to proceed. The user can visually understand that he cannot proceed beyond the wall.

  The instruction display image 8 may be displayed in order to easily determine whether or not the vehicle can pass. For example, in FIG. 11, the instruction display image 8a displayed on the front projection surface 2a is projected onto the projection surface so as to indicate that the user can further proceed in the front direction.

  Similarly, the instruction display image 8d displayed on the left projection surface 2d is displayed on the projection surface so as to indicate that the user can further proceed in the left direction.

  The user can instruct the traveling direction using the light irradiation device 1. The imaging device 3 captures an image of the light beam irradiated from the light irradiation device 1 onto the projection plane 2, and the computer device 4 can recognize the instructed direction based on the captured information. Instead of using the light irradiation device 1, the photographing device 3 may photograph a part of the user's hand or foot so that the direction is indicated.

  When the instruction display image 8a is displayed and the front direction is instructed by the light beam irradiation device, the user proceeds in the front direction. In this case, the position of the virtual camera is also moved in the front direction, and an image corresponding to the position of the user is projected on the projection plane.

  When the instruction display image 8d is displayed, if the left direction is instructed by the light beam irradiation device, the user proceeds in the left direction. In this case, the position of the virtual camera also moves to the left, and an image corresponding to the position of the user is projected on the projection plane.

  The program may be designed to end when the user satisfies a predetermined condition. For example, when the search for the virtual world is completed, the program may be terminated. Moreover, if it is a program of a game which performs a virtual battle with an enemy character, you may make it complete | finish a program, if an enemy character is won or defeated. Further, if the game program has a time limit, the program may be terminated when a predetermined time is reached.

  Next, a program execution process according to the fifth embodiment of this invention will be described. FIG. 12 is a flowchart of the program execution process corresponding to at least one of the embodiments of the present invention.

  First, when the program is executed, an image is generated in the graphics processing unit 14 of the computer device 4 (step S101). Until the game is over, the processes from step S102 to step S110 described later are repeated.

  Next, an image is transmitted to the projection apparatus 5 via the communication interface 16 (step S102). Here, the communication line may be wired or wireless, and the type of the line is not limited. However, in order to perform the processing in the computer device 4 quickly, a facility capable of high-speed communication with little time lag is preferable.

  When the projection device 5 receives the image transmitted from the computer device 4 in step S102 (step S103), the projection device 5 projects the image onto the projection surface 2 (step S104).

  When the user irradiates the projected image with a light beam using the light beam irradiation device 1, the imaging device 3 captures the irradiated light beam (step S105). The imaging device 3 repeatedly executes imaging of the projection surface 2 at predetermined time intervals in order to determine whether or not the projection surface 2 has been irradiated with light rays.

  The imaging device 3 transmits information regarding the light beam captured in step S105 to the computer device 4 (step S106). The computer device 4 receives the information regarding the light beam transmitted from the imaging device 3 in step S106 (step S107), and proceeds with the program processing using the information regarding the light beam (hereinafter referred to as light beam information) as operation input information.

  When the light beam information is the operation input information, for example, it can be assumed that an input is made in the irradiated direction based on the direction in which the light beam is irradiated. Alternatively, it can be designed so that it is determined that an input operation has been performed when the position irradiated with the light beam is within a predetermined region of the projection surface 2.

  The user can also use a plurality of light irradiation devices 1. As a method for identifying the irradiated light beam, there is a method of designing the shape of the emitted light beam, the color of the emitted light beam, or the blinking pattern of the emitted light beam to be different for each light irradiation device.

  The computer apparatus 4 determines the operation input information from the light ray information received in step S107, and changes the position of the specific point according to the operation input information (step S108). Here, the position of the specific point may correspond to the position of a character operated by the user (hereinafter referred to as a user character).

  Here, the change of the position of the specific point will be further described. When the position of the specific point corresponds to the position of the user character, for example, the position of the user character changes according to the user's input operation, and the position for specifying the projection image changes. On the other hand, the case where the specific position does not correspond to the position of the user character means, for example, a case where the viewpoint of the virtual camera is switched by a user input operation.

  Further, the computer apparatus 4 changes the position of the virtual camera in accordance with the position of the specific point changed in step S108 (step S109). The position of the virtual camera may be a position corresponding to the viewpoint of the user character, or may be a position where the user character can be objectively viewed. By linking the position of the virtual camera and the position of the specific point, it is possible to move freely in the virtual world in accordance with a user operation instruction.

  The computer device 4 performs perspective transformation on the virtual screen from the position of the virtual camera changed in step S110, and generates an image to be projected (step S110). At this time, the position of the virtual camera corresponding to each projection plane 2 is changed according to the position of the specific point changed in step S108.

  For example, in FIG. 11, when the position of the virtual camera is changed so that the character moves forward by a distance of two steps with respect to the front projection plane 2a, the image projected on the left projection plane 2d is projected. From the position that has been set, the projection is changed and projected in the direction of the front projection plane 2a by the distance of two steps of the character so as to be linked to the forward movement of the projection image on the front projection plane 2a. Similarly, the projection image on the right projection surface 2b and the projection image on the floor surface 7 are projected while being changed in conjunction with each other.

  When the projection image is generated in step S110, the computer apparatus 4 transmits the generated projection image to the projection apparatus 5 (step S102).

  As a game to which the fifth embodiment can be applied, for example, a game that a plurality of players advance in cooperation or a game for one person can be assumed. Examples of the type of game include a role playing game (RPG), an escape game that escapes from a closed space, a racing game, and an action game. It is also possible to use a live video of an artist to create a simulation program like being in a live venue.

  As a program used to realize the fifth embodiment, for example, Flash (registered trademark) ActionScript, JavaScript (registered trademark), or Unity is preferably used. The language may be a language similar to this, and can also be realized by a conventional C language or the like.

  In the fifth embodiment, visible light and invisible light can be emitted from the light irradiation device 1, but only invisible light may be emitted. In this case, for example, the irradiation position of the invisible light is recognized by the computer device 4 based on the photographing data of the photographing device 3 that photographed the invisible light. Then, when the projection image on the projection device 5 is generated, a projection image obtained by synthesizing the aiming image may be generated.

  As one aspect of the fifth embodiment, the user can experience a realistic experience as if he / she is moving in the virtual world, and can enhance the user's preference.

  As one aspect of the fifth embodiment, the user changes the position of a specific point for specifying a projection image to be projected on the projection plane, and changes the position of the virtual camera in accordance with the position of the specific point. This makes it possible to give a sense that the user is moving in the virtual world, can increase the sense of presence of the projected image, and can further enhance the user's preference.

  As one aspect of the fifth embodiment, two or more projection planes are installed at a predetermined angle, the relative positional relationship of the first virtual screen with respect to the first virtual camera, and the second virtual camera The relative positional relationship between the second virtual screens is the same, and the virtual screens have the same angle as the angle formed between the projection surfaces, so that the positional relationship between the real-world projection surfaces and the virtual Since the positional relationship between virtual cameras in the world can be made to correspond, it is possible to project the state of the virtual world onto a plurality of projection surfaces without a sense of incongruity.

  As one aspect of the fifth embodiment, by changing the position of the virtual camera while maintaining the relative positional relationship of the virtual camera with respect to the specific point, the virtual point can be changed by changing the specific point according to a user operation instruction. The position of the camera can be changed, it is possible to give the user a sense of moving in the virtual world, the presence of the projected image can be enhanced, and the user's preference can be further enhanced .

  As one aspect of the fifth embodiment, by moving the user character in the virtual three-dimensional space according to the user's operation input, the user can experience a realistic virtual world, and the user's preference The sex can be increased.

  As one aspect of the fifth embodiment, by accepting a light beam photographed by the photographing device as an operation input, the user can apply any place as long as the photographing device can photograph the light beam. You can easily experience a virtual world full of realism and enhance your preferences.

  As one aspect of the fifth embodiment, by changing the position of a specific point in a direction perpendicular to the virtual screen corresponding to the projection plane irradiated with the light beam, the user uses the system with an intuitive operation. You can experience a virtual world full of realism more easily.

  As one aspect of the fifth embodiment, the projection planes are installed in four directions so that one projection plane and another projection plane are perpendicular to each other, that is, so as to surround the user. By projecting an image onto the surface, the user can experience a virtual world full of realism, and the user's preference can be further enhanced.

  In the fifth embodiment, “projection”, “image”, “projection plane”, “projection device”, “communication”, “connection”, “computer device”, “specific point”, “change position”, “Transmission” is the same as the contents described in the first embodiment.

  In the fifth embodiment, “virtual three-dimensional space”, “virtual camera”, “virtual screen”, “perspective transformation”, and “generate image” are described in the second embodiment, respectively. It is the same as the contents.

  In the fifth embodiment, “operation input” refers to input performed on a projected image, for example. The “user character” refers to, for example, a character that exists as a substitute for the user or a sub character that follows the character, and includes an object that acts together with the character.

  In the fifth embodiment, the “light irradiation device” refers to, for example, a device that emits light, and includes a portable device and a device that is installed and used. The “photographing device” refers to a device capable of photographing such as a video camera or an infrared sensor camera. The “game program” refers to a program for executing a game, for example, and is executed on a computer device.

[Sixth embodiment]
Next, an outline of the sixth embodiment of the present invention will be described. In the sixth embodiment, as in the fifth embodiment, there are at least two projection surfaces, and one projection surface and another projection surface have a predetermined angle. It is installed.

  Next, an outline of the sixth embodiment of the present invention will be described. The system configuration in the sixth embodiment can employ the same configuration as that shown in the block diagram of FIG.

  Here, the light irradiation device 1 may include at least either an acceleration sensor or an optical sensor. Further, information measured by the sensor may be transmitted to the computer apparatus 4 by communication.

  Alternatively, instead of the light irradiation device 1, a VR (Virtual Reality) controller including at least one of an acceleration sensor and an optical sensor may be used.

  The configuration of the computer apparatus according to the sixth embodiment of the present invention can employ the same configuration as that shown in the block diagram of FIG. Moreover, the concept which projects an image on a projection surface from a projection apparatus can employ | adopt the same concept as what is shown by the block diagram of FIG. Furthermore, the concept of the specific point, the virtual camera, and the virtual screen in the sixth embodiment can adopt the same configuration as that shown in the conceptual diagram of FIG.

  Subsequently, a program execution process according to the sixth embodiment of the present invention will be described. The flow of program execution processing in the sixth embodiment can employ the same configuration as that shown in the flowchart of FIG.

  By the way, in step S105, in place of the light beam irradiation device 1, for example, when a VR controller including an acceleration sensor or a light sensor is used as the input device, the VR is performed without photographing the light beam by the photographing device 3. Information measured by the sensor of the controller may be used as operation input information. In this case, in step S106, operation input information from the VR controller is transmitted to the computer apparatus 4 by communication.

  For example, when the acceleration sensor detects that the user has moved the controller from the front direction to the right side direction, when a specific point is advanced in the right direction and the controller is swung down from top to bottom, The character may be jumped forward, or a plurality of controllers may be used to determine the operation input information based on the relative positional relationship between the position of one controller and the position of the other controller. .

  Further, the operation input information can be determined based on a relative positional relationship of the controller with respect to a reference position (hereinafter referred to as a reference position). For example, when the center point of the image projected on the floor surface is used as the reference position, the relative position relationship between the reference position and the position of the controller in the same plane as the floor surface on which the image is projected is used. The operation input information can be determined.

  For example, the direction from the reference position to the position of the controller projected on the same plane as the floor can be set as the input direction. Further, when it is detected that the position of the controller has moved within a predetermined speed range, the movement information can be used as operation input information. Alternatively, for example, the distance between the position of the controller projected on the same plane as the floor and the reference position may be used as the input amount.

  The relative positional relationship with the reference position is not limited to plane position information. For example, specific operation input information may be determined when the position of the controller is relatively lower than the height of the reference position. More specifically, the photographing device 3 can specify the position of the user's head as the reference position, and can determine the operation input information based on the positional relationship with the controller held by the user.

  As one aspect of the sixth embodiment, by using a controller that allows operation input according to the position and movement of the controller, the user can experience a virtual world full of realism, and the user's preference is more Can be increased.

[Appendix]
The above description of the embodiments described the following invention so that a person having ordinary knowledge in the field to which the invention belongs can carry out the invention.

[1] A program executed in a computer device capable of communicating with or connecting to a projection device that projects a projection image onto a projection surface,
Computer equipment,
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected onto the projection plane;
A program that causes an image corresponding to the position of a specific point to function as a transmission unit that transmits an image as a projection image to a projection apparatus.

[2] A computer device,
Virtual camera position changing means for changing the position of the virtual camera in accordance with the change of the position of the specific point;
The virtual three-dimensional space is made to function as an image generation means for generating an image by performing perspective transformation from a virtual camera onto a virtual screen,
A transmission unit transmits the generated image to the projection apparatus as a projection image;
The program according to [1].

[3] having at least two or more projection planes;
One projection plane and the other projection plane are installed with a predetermined angle,
Image generating means
First image generation means for generating a perspective image on the first virtual screen from a first virtual camera corresponding to one projection plane;
Including second image generation means for generating a perspective image on the second virtual screen from a second virtual camera corresponding to another projection plane,
The relative positional relationship of the first virtual screen with respect to the first virtual camera and the relative positional relationship of the second virtual screen with respect to the second virtual camera are the same,
The first virtual screen and the second virtual screen have the same angle as the predetermined angle;
The program according to [2].

[4] The program according to [2], wherein the virtual camera position changing unit changes the position of the virtual camera while maintaining a relative positional relationship of the virtual camera with respect to the specific point.

[5] A computer apparatus,
Operation input accepting means for accepting user operation input,
In response to the received operation input, the user character in the virtual three-dimensional space functions as a character moving means that moves,
The position of the specific point is corresponding to the position of the user character.
The program according to any one of [1] to [4].

[6] A photographing device for photographing a light beam irradiated on the projection surface from the light beam irradiation device,
The operation input accepting unit accepts a light beam photographed by the photographing device as an operation input.
The program according to any one of [1] to [5].

[7] having at least two projection planes;
The specific point position changing means changes the position of the specific point in a direction perpendicular to the virtual screen corresponding to the projection plane irradiated with the light beam;
The program according to [6].

[8] The program according to any one of [3] to [7], wherein one projection plane and another projection plane are installed so as to be perpendicular to each other.

[9] A computer apparatus capable of communicating with or connecting to a projection apparatus that projects a projection image onto a projection plane,
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected on the projection plane;
A computer apparatus comprising: a transmission unit that transmits an image corresponding to the position of a specific point to a projection apparatus as a projection image.

[10] A program execution method executed in a computer device capable of communication or connection with a projection device that projects a projection image onto a projection surface,
Changing the position of a specific point for specifying a projection image to be projected on the projection plane;
Transmitting the image corresponding to the position of the specific point to the projection apparatus as a projection image.

[11] A computer system including a projection device that projects a projection image onto a projection surface, and a computer device that can communicate with or connect to the projection device,
Computer equipment
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected on the projection plane;
A transmission unit that transmits an image according to the position of the specific point to the projection apparatus as a projection image;
Projector
A computer system comprising projection means for projecting a received image onto a projection plane.

DESCRIPTION OF SYMBOLS 1 Light irradiation apparatus 11 Control part 12 RAM
DESCRIPTION OF SYMBOLS 13 Storage part 14 Graphics processing part 15 Video memory 16 Communication interface 17 Peripheral device connection interface 18 Peripheral device 2 Projection surface 3 Imaging device 4 Computer device 5 Projection device 6 Communication line 7 Floor surface 8 Instruction display image

Claims (8)

A program executed in a computer device capable of communicating with or connecting to a projection device that projects a projection image onto a projection surface,
Computer equipment,
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected onto the projection plane;
A program that causes an image corresponding to the position of a specific point to function as a transmission unit that transmits an image as a projection image to a projection apparatus. A computer device,
Virtual camera position changing means for changing the position of the virtual camera in accordance with the change of the position of the specific point;
The virtual three-dimensional space is made to function as an image generation means for generating an image by performing perspective transformation from a virtual camera onto a virtual screen,
A transmission unit transmits the generated image to the projection apparatus as a projection image;
The program according to claim 1. Having at least two or more projection planes;
One projection plane and the other projection plane are installed with a predetermined angle,
Image generating means
First image generation means for generating a perspective image on the first virtual screen from a first virtual camera corresponding to one projection plane;
Including second image generation means for generating a perspective image on the second virtual screen from a second virtual camera corresponding to another projection plane,
The relative positional relationship of the first virtual screen with respect to the first virtual camera and the relative positional relationship of the second virtual screen with respect to the second virtual camera are the same,
The first virtual screen and the second virtual screen have the same angle as the predetermined angle;
The program according to claim 2. The program according to claim 2, wherein the virtual camera position changing means changes the position of the virtual camera while maintaining a relative positional relationship of the virtual camera with respect to the specific point. A computer device,
Operation input accepting means for accepting user operation input,
In response to the received operation input, the user character in the virtual three-dimensional space functions as a character moving means that moves,
The position of the specific point is corresponding to the position of the user character.
The program in any one of Claims 1-4. A computer device capable of communicating with or connecting to a projection device that projects a projection image onto a projection surface,
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected on the projection plane;
A computer apparatus comprising: a transmission unit that transmits an image corresponding to the position of a specific point to a projection apparatus as a projection image. A program execution method executed in a computer device capable of communication or connection with a projection device that projects a projection image onto a projection surface,
Changing the position of a specific point for specifying a projection image to be projected on the projection plane;
Transmitting the image corresponding to the position of the specific point to the projection apparatus as a projection image. A computer system comprising: a projection device that projects a projection image onto a projection surface; and a computer device that can communicate with or connect to the projection device,
Computer equipment
Specific point position changing means for changing the position of a specific point for specifying a projection image to be projected on the projection plane;
A transmission unit that transmits an image according to the position of the specific point to the projection apparatus as a projection image;
Projector
A computer system comprising projection means for projecting a received image onto a projection plane.

Images