JP2001162049A - Apparatus for shooting game, apparatus for position detection, and information storage medium - Google Patents

Abstract

(57) [Problem] To provide a shooting game device capable of accurately detecting the position of a spotlight based on an image pickup signal of a video camera. The shooting game apparatus scans, in at least one of a horizontal direction and a vertical direction, an image captured by a video camera that captures an image of a shooting area on which a spot light for landing position is projected, and projects the image on the shooting area. Of the spot light 26 to be detected. The position detection process, for each scan line of the captured image, based on the brightness from the point before n to the current scan position,
A pseudo-average value at a current scanning position for identifying a local change in luminance is obtained, a difference between the luminance at the current scanning position and the pseudo-average value is compared with a given reference value, and the position of the spot light is compared. This is performed by detecting

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a shooting game device, a position detecting device, and an information storage medium.

[0002]

2. Description of the Related Art Conventionally, there has been known a shooting game apparatus in which a player uses a light gun or the like to shoot a game screen on which a predetermined target appears. In such a conventional technique, a game screen is imaged by a video camera, the hit position of the light gun is detected based on a video signal output from the video camera, and a hit or miss is determined.

However, simply detecting the luminance change of the video signal with a predetermined reference value and detecting the spot light means that when the gradation is applied on the game screen, the position of the spot light cannot be accurately detected. Problems occur.

[0004] In particular, in the case of devices used in various environments, such as arcade game machines and home game machines, the influence of ambient light is easily reflected on the game screen. As in the related art, there is a problem in that the spot light cannot be accurately detected by simply comparing the video signal output from the camera with the reference value, eliminating the influence of ambient disturbance and the like.

The present invention has been made in view of such a problem, and has as its object to mix outside light and other noises into a detection target area, for example, a shooting area, which is picked up by an image pickup means. Even in such a case, an object of the present invention is to provide a device for a shooting game, a device for position detection, and an information storage medium that can accurately detect the position of a spotlight from an image captured by an imaging unit.

[0006]

(1) In order to achieve the above object, according to the present invention, there is provided a shooting area on which a spot light for specifying an impact position is projected, or a spot light which passes or is reflected by the shooting area. A shooting game device that scans a captured image of an imaging unit that captures an image of a spot light forming area in at least one of a horizontal direction and a vertical direction, and performs a position detection process of the spot light projected on the shooting area. For each scan line of the captured image, a pseudo-average value at a current scanning position for identifying a local change in luminance is calculated based on the luminance from the point n to the current scanning position, Position detection for performing position detection processing for comparing the difference between luminance and the pseudo average value with a given reference value and detecting the position of the spot light. Characterized in that it comprises a means.

[0007] The present invention is also directed to an image pickup apparatus for picking up an image of a detection target area on which a spotlight is projected or a spotlight forming area on which a spotlight passing or reflected by the detection target area is projected. Scanning in at least one direction of the vertical direction, and a device for performing position detection processing of the spot light projected on the detection target area,
For each scan line of the captured image, based on the luminance from the point before n to the current scan position, determine a pseudo average value at the current scan position to identify a local change in luminance, The image processing apparatus further includes a position detection unit that performs a position detection process of comparing a difference from the pseudo average value with a given reference value to detect a position of the spot light.

The information stored in the computer-readable or computer-usable information storage medium according to the present invention may include a position detection area where a spot light for specifying a landing position is projected, or a light passing or reflecting through the position detection area. An image picked up by an image pickup means for picking up an image of the spot light forming area on which the spot light is projected is scanned in at least one of a horizontal direction and a vertical direction, and a position detection process of the spot light projected on the position detection area is performed. It is information for a shooting game, and for each scanning line of the captured image, based on the luminance from the point before n to the current scanning position,
A pseudo-average value at a current scanning position for identifying a local change in luminance is obtained, a difference between the luminance at the current scanning position and the pseudo-average value is compared with a given reference value, and the position of the spot light is compared. Characterized in that the information is information for realizing a position detecting means for performing a position detecting process for detecting a position.

Further, the information stored in the computer readable or usable information storage medium according to the present invention may be a detection target area on which a spot light is projected or a spot light passing or reflected through the detection target area. Information for performing a position detection process of a spot light projected on the detection target area by scanning an image captured by an imaging unit that captures the spot light formation area to be scanned in at least one of a horizontal direction and a vertical direction. For each scan line of the captured image, a pseudo-average value at a current scanning position for identifying a local change in luminance is calculated based on the luminance from the point n to the current scanning position, A position detection unit that performs a position detection process of comparing a difference between luminance and the pseudo average value with a given reference value and detecting a position of the spot light is realized. It is information for.

Here, the detection target area may be, for example, a shooting area where a target such as a target is displayed as an image when a shooting game is played, or a shooting area where an actual target or the like is installed. There may be. When a presentation or the like is performed, the detection target area may be, for example, a display area of a screen for presentation.
Various areas can be the detection target area depending on the application.

According to the present invention, the captured image is scanned in at least one of the horizontal direction and the vertical direction, and the position detection processing of the spot light projected on the detection target area is performed.

At this time, a pseudo-average value at a current scanning position for identifying a local change in luminance is obtained for each scanning line of the captured image on the basis of the luminance from the point n to the current scanning position. The position of the spot light is detected by comparing the difference between the luminance at the current scanning position and the pseudo average value with a given reference value.

As described above, according to the present invention, the concept of a pseudo-average value for identifying a local change in luminance, in other words, a pseudo-average value in consideration of gradation or the like, is introduced to detect the position of a spotlight. I do.

Thus, even when the area to be detected, for example, a shooting area or other areas is affected by external light or gradation caused by noise, for example, the position of the spot light can be accurately determined. Can be detected.

(2) In the present invention, the position detecting means scans the captured image in a horizontal direction, and compares a difference between the luminance at the current scanning position and the pseudo average value with a given reference value. By specifying the area of the spot light in the captured image by scanning the captured image in the vertical direction, the difference between the luminance of the current scanning position and the pseudo average value, and a given reference value Specifying the area of the spot light in the captured image by comparing, and performing position detection of the spot light based on the area of the spot light in the captured image specified by both the horizontal and vertical scanning. preferable.

By employing the above configuration, the position of the spot light can be detected more accurately even when the gradation is applied to the detection target area or when noise is mixed.

(3) In the present invention, the pseudo average value Iave of the t-th pixel on the scan line of the captured image is
(T) is the luminance I of the preceding (t-1) th pixel.
It is preferable to obtain (t-1) and the pseudo average value based on Iave (t-1).

Here, the pseudo average value Iave
(T) is Iave (t) = (n-1 / n) Iave (t-1) + (1 / n) I (t
It is more preferable to obtain the value based on the formula of -1).

Thus, the pseudo average value at the current scanning position for identifying the local change in the brightness of the captured image can be effectively obtained, and the position of the spot light can be detected more accurately.

(4) In the present invention, the detection means detects a spot light detection candidate pixel for each scanning line of the picked-up image, and the detection candidate group exists in an area near the same line and an adjacent line. In this case, it is preferable that the detection candidate group is specified as a spot light area in the captured image, and the position of the spot light is detected.

With the above configuration, the spot light can be detected as an aggregate of light and distinguished from other noises, so that the influence of the noise can be more effectively eliminated and the spot light can be more accurately detected. Position detection becomes possible.

For example, by using weighting data for detecting a spot light as an aggregate of lights having a certain level of brightness or more, spot light and noise are more clearly distinguished, and the position of the spot light is detected. It becomes possible.

(5) Preferably, the reference value changes with a predetermined correlation with the pseudo average value.

Here, it is preferable that the reference value is set so as to be set to a large value when the pseudo average value is small and to a small value when the pseudo average value is large.

In this manner, when the area to be detected is bright, the reference value can be reduced and the spot light can be detected. When the surrounding area is dark, the spot light is displayed with a luminance that can be distinguished from the surroundings. The position can be detected by increasing the reference value so as not to be affected by ambient noise.

This makes it possible to more accurately detect the position of the spot light, which is less affected by ambient noise.

(6) In the present invention, as the spot light, ordinary visible light may be used, or light in a wavelength band that can be separated from a display image, for example, infrared light may be used. When light in a band that can be separated from a normal image is used as spot light, the imaging unit is preferably formed as an imaging unit that selectively captures only light in the band of the spot light. When infrared light is used as the light, it is preferable to use an infrared light imaging unit. This makes it possible to capture only the spotlight from the display image and capture the image, and detect the position.

For example, an image is displayed in the position detection area, and light having a wavelength band that can be distinguished from the image is used as the spot light. May be imaged separately from the image, and the position detection area may be imaged.

Taking a device for a shooting game as an example, a shooting image is displayed in the shooting area, and light having a wavelength band that can be distinguished from the shooting area image is used as the spot light. The means captures light in the wavelength band of the spot light separately from the shooting image, and may be formed so as to capture the shooting area.

(7) In the present invention, the detection target area may be set as a shooting area included in an actual display image area.

In the present invention, the information storage medium may be formed so as to store information for performing a simulation for shooting instead of a shooting game.

In the present invention, the information stored in the information storage medium may be a program for realizing each of the above means, or may be a combination of program data. The information (for example, a program) for executing each of the means is information (for example, a program or the like) usable by a computer, and includes a processing routine for realizing (executing) the above means. Is also good.

[0033]

Next, embodiments of the present invention will be described in detail with reference to the drawings.

(1) Overall Description FIG. 1 shows a schematic configuration of a first embodiment of a shooting simulator to which the present invention is applied.

The simulator 10 of the present invention is formed as a game device for performing a shooting game, and includes a light gun 20 as a shooting device that emits an infrared beam in an aiming direction, a display 30 for displaying a shooting game screen. , An infrared video camera 40 for imaging the game screen, and a game device body 5
0.

The shooting game screen displayed on the display 30 includes various images such as a target image, a background image, and a hit effect image.

The light gun 20 is connected to the game apparatus main body 50, and an infrared beam is projected in an aiming direction from an infrared projection unit (for example, an infrared LED) 22 provided at the tip of the light gun 20, and the infrared ray is projected on the display 30. Is projected.

The video camera 40 corresponds to an infrared image pickup means, and picks up an image displayed on the display 30, in particular, a shooting area which is an area to be detected. Here, an infrared video camera 40 is installed so as to image the display 30 from below at a predetermined tilt angle.

The game apparatus main body 50 includes the simulator 10
Various controls and processes are performed.

FIG. 2 is a block diagram showing a schematic configuration for realizing the functions of the game device main body.

The game device main body 50 includes a processing unit 100,
RAM 140, ROM 150, image generation unit 160
, A sound generation unit 170, a sound output unit 180, and a control unit 200.

The processing section 100 controls the entire apparatus, gives instructions to each block in the apparatus, and performs various processing of game calculation. Its functions are performed by a CPU (CISC type,
(RISC type), DSP, ASIC (gate array or the like), or a given program (game program).

The RAM 140 serves as a work area for the processing section 100, the image generation section 160, the sound generation section 170, and the control section 200.

Information can be read by a computer,
ROM1, which is an information storage medium usable by a computer
Reference numeral 50 stores information such as various programs and data. In the present embodiment, information for playing a shooting game is stored. The information for playing this shooting game includes at least the processing section 100 functioning as the game calculation section 110 and the control section 200 as the position detection section 210 and the gun control section 220.
The information for functioning as is stored. The shooting game image data, the shooting game audio data, the shooting game execution program, the hit determination program, the calculation program, and the like other than those described above are also stored in the ROM 150 as information for performing the shooting game.

The image generating section 160 is for generating various images, for example, a game image for shooting according to an instruction from the processing section 100 and displaying the same on the display 30. The function thereof is as follows. ASIC,
It can be realized by hardware such as a CPU and a DSP, a given program (image generation program), and image data. The image generated by the image generation unit 160 is displayed on the display 30.

The sound generation section 170 generates various sounds in accordance with instructions from the processing section 100 and outputs the generated sounds to the sound output section 180. The function of the sound generation section 170 is as follows.
It can be realized by hardware such as U and DSP, a given program (sound generation program), and audio data (waveform data).

The control section 200 controls the camera 40 and the light gun 20 and exchanges information between them, and further functions as a position detection section 210 and a gun control section 220. The functions can be realized by, for example, a CPU, a ROM, a RAM, and given programs and data.

The gun control section 220 controls the light gun 20 and constantly emits an infrared beam from the infrared light projecting section 22 of the light gun 20 in the aiming direction. Is received, the trigger scanning signal is received, and by receiving this trigger signal, it is configured to recognize that the bullet is emitted from the light gun 20 as an infrared beam.

(2) Next, a configuration for detecting the position of the spot light 26 projected from the light gun 20 onto the display 30 will be described in detail.

The position detecting section 210 is a video camera 4
The captured image output from 0 is temporarily stored in a RAM (not shown). Then, the captured image is scanned in at least one of the horizontal direction and the vertical direction, and the position of the spot light 26 displayed on the display 30 is detected. Scanning for position detection with respect to the captured image may be performed in only one of the horizontal and vertical directions, but in the present embodiment, in order to further increase the detection accuracy, scanning for position detection is performed in both the horizontal and vertical directions. It is carried out.

In this embodiment, the position detector 210
Are the pseudo average value calculation unit 212 and the threshold data storage unit 21
4. It functions as the position detection processing unit 216.

FIG. 3 shows a schematic flowchart of the position detecting process.

Here, it is assumed that the image shown in FIG. 5A is obtained as a captured image of the display 30. Here, 26 represents a spot light included in the captured image, 27 represents noise, and 28 represents the display 3.
A value of 0 indicates an external light irradiation area having a high luminance irradiated with external light as noise.

First, at step S 1,
As shown at 0, a horizontal scanning process for position detection is performed. This processing is performed by scanning the captured image for one screen written in the RAM line by line from the upper part to the lower part of the screen, similarly to the normal horizontal scanning.

FIG. 5B shows the luminance on a horizontal scanning line intersecting with the spot light 26. As shown in the figure, the image has gradation, and the brightness gradually increases from left to right of the image, and the external light irradiation area 28
Then the increase becomes sharp.

In the present embodiment, as will be described later, a concept of a pseudo average value at a current scanning position (current scanning pixel position) is introduced to identify a local change in luminance. Then, by comparing the difference between the luminance of the pixel at the current scanning position and the pseudo average value with a given reference value, a detection candidate in which the pixel constitutes the spotlight 26 is obtained for each pixel that is horizontally scanned. It is determined whether or not it is a pixel.

Such processing is performed for each horizontal scanning line constituting the captured image, and as shown in FIG. 5C, detection candidate pixels (possibility of being recognized as spot light) included in the display 30 are displayed. A process of extracting and specifying a certain pixel is performed.

Next, in step S20, a vertical scanning process for scanning the captured image stored in the RAM in the vertical direction for position detection as shown in FIG. 6A is performed. Here, from the vertical scanning line on the left side of the captured image,
Scan sequentially in the right direction. FIG. 6B shows a spot light 2.
6 represents the luminance of a vertical scanning line that intersects with the vertical scanning line 6. Then, according to the same method as the horizontal scanning process, as shown in FIG.
A process of extracting and specifying a pixel as a detection candidate of is performed.

Here, as shown in FIGS. 5C and 6C, a pixel corresponding to the spot light 26 and a pixel corresponding to the noise 27 are detected by horizontal and vertical scanning processing for position detection. It has been extracted as a candidate pixel.

Next, in step S30, a common detection candidate pixel specified by both the horizontal scanning process and the vertical scanning process is specified, and the specified pixel is recognized as a pixel corresponding to the spot light 26. . In the horizontal scanning process, an extracted image containing noise is obtained at the lower right of the screen as shown in FIG. 5C, and in the vertical scanning, an extracted image containing noise is obtained at the upper portion of the screen as shown in FIG. 6C. An image is obtained.
Therefore, by finding a detection candidate pixel common to both FIG. 5 (C) and FIG. 6 (C), the components of the noise 27 contained in these extracted images are satisfactorily removed, and the spot light 26
Will be extracted.

In particular, when the image displayed on the display 30 is uniformly shaded by the influence of external light or the like on the display 30 and further depending on the type of the image displayed on the display 30, In some cases, only a part of the area is displayed brightly, and in many cases, noise is locally mixed. On the other hand, according to the present invention, by introducing the concept of a pseudo average value described later and extracting the spot light, it is possible to effectively eliminate the influence of the above-mentioned gradation and noise. By performing the process of scanning the captured image in both the horizontal and vertical directions and specifying the detection target to be the spot light 26 as shown in, the local noise included in the captured image is more properly eliminated, Only the spot light 26 can be specified more reliably.

Then, in the next step S40, the position detection processing section 216 obtains the position coordinates of the spot light 26 on the display 30 based on the data of the pixels constituting the spot light 26 specified in the captured image. The detected position data is transmitted to the game calculation unit 110.

In the present embodiment, such a step S
A series of processes from 10 to S40 is repeated each time the video camera 40 captures an image.

The game calculation section 110 performs a process of displaying an aiming display mark indicating the aiming direction of the light gun 20 on the game screen based on the detected data. And ray gun 2
The signal that the zero trigger 24 is operated is transmitted to the gun control unit 220.
The hit determination unit 116 compares the detected position of the spotlight with the display position of the target displayed on the display, performs the hit determination, and performs various game effect processing. It is configured.

FIG. 4 shows a flowchart of the horizontal scanning processing S10 for position detection and the vertical scanning processing S20 for position detection. Since both the horizontal and vertical scanning processes are performed by the same method, FIG.
An example in which a horizontal scanning process for position detection is performed on a captured image as shown in FIG.

First, in step S100, k = 1
Set to. Here, k represents the number of horizontal scanning lines counted from above, which form the captured image.

Next, in step S110, the horizontal scanning of the k-th line is started. Here, since k = 1 as described above, scanning of the first horizontal scanning line is started.

Next, the processing of steps S120 to S140 is performed. If it is determined in step S150 that the scanning of the k-th line has been completed, then in the next step S160, k = k + 1,
A process for incrementing the scanning line by one is performed.

The processing in steps S110 to S160 is repeated until it is determined in step S170 that the scanning of all the lines has been completed.

As described above, the position detecting section 210 stores the pseudo average value calculating section 212 for calculating the pseudo average value and the table data of the threshold value (reference value) corresponding to the pseudo average value as shown in FIG. It functions as a threshold data storage unit 214 and a city detection processing unit 216 that performs a spot light position detection process, and is configured to perform the processes of steps S120 to S140.

Next, the processing of steps S120 to S140 is performed, for example, as shown in FIG.
The following description focuses on the case where the operation is performed on a horizontal scanning line in which 6 exists.

FIG. 7 is an explanatory diagram schematically showing one scanning line. As shown in FIG. 7, in each line, a plurality of pixels constituting an image are arranged adjacently. Horizontal scanning of this line is performed in order from the first pixel toward the right in the figure. Let the luminance of the t-th pixel be I
Assuming that (t), and the average of the _n luminances before the pixel including the t-th pixel is I _n (t), the value of I _n (t) is obtained by the following equation. I _n (t) = {I (t−1) + I (t−2) +... + I (t−n)} / n (1) Similarly, the average I _n of the (t−1) -th pixel t-1)
Is given by the following equation. _{I n (t-1) =} {I (t-2) + I (t-3) + ... + I (t-1-n)} / n ... (2) (1) from equation (2) values Subtracting gives the following equation: When _{I n (t) -I n (} t-1) = {I (t-1) -I (t-1-n)} / n ... (3), where, I (t-1-n _{) / n ≒ I n (t} -1) When _{/ n, I n (t)} ≒ I n (t-1) + {I (t-1) / n-I n (t-1) / n} _{= I n (t-1)} * (n-1) / n + I (t-1) / n ... is (4). Assuming that the average using this approximation is Iave (t), Iave (t) = Iave (t-1) ^* (n-1) / n + I (t-1) / n (5)

The pseudo average Iave (t) means approximation of the average of n points.

The actual video image is a 360 × 248 image, and the size of the spotlight 26 is about 4 to 10 pixels. In this case, n = 4 in consideration of the easiness of calculation. It is preferable that The value of n needs to be changed depending on the size of the image and the size of the spot.

Then, the pseudo average value calculating section 212 calculates the pseudo average value Iave (t) of the t-th pixel (the pixel at the current scanning position) based on the above equation (5). Such calculation of the pseudo average value is performed every time the horizontal scanning advances by one pixel.

The pseudo average value Iave thus obtained is
(T) is a pseudo average value for identifying a local change in the luminance based on the luminance from the point n points before to the current scanning position, and is a completely new concept that has not existed in the past. Specifically, the pseudo average value of the luminance at the current position t is determined in consideration of the pseudo average value of the immediately preceding (t−1) -th pixel and the actual luminance. That is, by calculating according to the equation (5), a pseudo average value in consideration of gradation can be obtained.

In this embodiment, the difference between the pseudo average value and the actual luminance is compared with a predetermined reference value S represented by the following equation. When the difference between the luminance and the pseudo average value at the t-th pixel exceeds a predetermined reference value,
It is specified as a detection candidate pixel. I (t) -Iave (t)> S (Iave (t)) (6) Pixels satisfying the condition of the above expression (6) constitute a spot light which is a local brightness to be detected. It is determined that the pixel is a detection candidate pixel that may be detected.

In this way, even if the real image screen has gradation, the spotlight area can be accurately extracted from the captured image.

In the present embodiment, the reference value S in the above equation (6) is stored in the threshold data storage unit 214 as a threshold value that changes with a predetermined correlation with the pseudo average value.
FIG. 8 is an explanatory diagram of the threshold data, and the value of the threshold S is set so as to decrease as the pseudo average value Iave increases.

The position detection processing unit 216 selects a threshold value S corresponding to the value of the pseudo average value obtained by the above equation (5) each time with reference to the data of FIG. Using the threshold value S shown in the equation, the authorization processing of the equation (6) is performed. Then, the pixels satisfying the expression (6) are identified as spot light 2
6 are selected as detection candidate pixels.

With the above configuration, when the surroundings are bright, that is, when the pseudo average value is high, the threshold value is set low, and when the pseudo average value is low, the threshold value is set high. In this way, when the surroundings are bright, the threshold value becomes low, and the spotlight can be extracted. When the surroundings are dark, the threshold value is made high, and the spotlight is extracted so as not to include noise. it can.

In this manner, the pixels constituting the spot light 26 can be accurately detected without being affected by the surrounding noise.

FIG. 5B shows a change in luminance on a horizontal scanning line intersecting with the spot light 26. Here, gradation is applied so that the luminance increases from the left direction to the right direction of the screen, and when the scanning position approaches the external light irradiation area 28, the luminance sharply increases. Even in such a case, according to the present embodiment, the pseudo average value for identifying a local change in luminance in the detection candidate pixel is obtained by the above equation (5), and the pseudo average value thus obtained is obtained. The threshold value corresponding to the value is selected from FIG. 8 and whether or not the pixel is a detection candidate pixel is determined based on the above equation (6). Image is spotlight 2
6 can be satisfactorily extracted.

The position detecting section 210 of the present embodiment
Performs vertical scanning processing for position detection on the captured image in step S20. This processing is also basically performed according to the flowchart shown in FIG. Where k
Means the k-th vertical scanning line counted from the left of the captured image shown in FIG.

FIG. 6B shows a change in luminance of a vertical scanning line intersecting with the spot light 26.

By performing vertical scanning processing for position detection in accordance with the flowchart shown in FIG. 4 on the captured image shown in FIG. 6A, the spot light 2 shown in FIG.
Six detection candidate pixels can be extracted and specified.

In the present embodiment, as described in the processing in step S30, the common portion of the detection candidate pixels obtained by the horizontal and vertical scanning is obtained, so that the noise 27 component is reliably removed. Only the detection candidate pixels constituting the spot light 26 can be accurately extracted. That is, noise that cannot be removed by one scan depending on the direction in which gradation is applied can also be removed by the other scan. Thus, step S10,
By extracting the AND component of the pixel obtained by the processing in S20, noise can be effectively removed, and only the spot light 26 can be accurately extracted.

In addition, the position detection processing unit 21 of the embodiment
6 detects a spot light detection candidate pixel for each scanning line of the captured image, and when the detection candidate pixels are present as a group in an adjacent area of the same line and an adjacent line, the detection candidate pixel group A process for specifying a spot light area is performed. In this way, by recognizing the spot light as a group of lights, the spot light 26 can be more reliably distinguished from other noises and detected.

FIG. 9 shows an example of a pixel specified as a spot light by horizontal and vertical scanning. Pixels indicated by a circle in the figure are pixels that have been identified as candidates for forming a spotlight. As shown in the drawing, when the detection candidate pixels exist in the same line and the adjacent line as an area having a predetermined spread adjacent to or adjacent to each other, this can be recognized as a spot light. And
The center position of these detection candidate pixel groups is determined as the position of the spot light.

With the above arrangement, it is possible to accurately detect the position of the spot light from the captured image on the display 30 without being affected by noise or the like.

(3) Other Embodiments A configuration as shown in FIG. 10 may be employed instead of the configuration shown in FIG. FIG. 10 is a schematic explanatory view showing another example of the simulator according to the present invention. Members corresponding to those of the above-described embodiment are denoted by the same reference numerals, and description thereof is omitted.

The game apparatus body 30 includes a housing 351, a display 316 provided on the surface of the housing on the light gun 20 side, and a spotlight formed inside the housing 351 at a position corresponding to the display 316. Forming area 312 and a half mirror 314 disposed between the spot light forming area 312 and the display 316
And a CRT 32 installed below the half mirror 314 with the display screen facing upward, and an infrared video camera 40 for imaging the spot light forming area 312. In addition, a circuit board (not shown) is incorporated inside the game apparatus main body, and is configured to realize the same function as the function shown in the block diagram of FIG.

[0093] The display 316 is formed of a transparent member such as a glass plate or a plastic plate so that the image projected by the half mirror 314 can be viewed from the outside.

The half mirror 314 transmits a part of the incident light and reflects the other part, and corresponds to a separating means. The half mirror 314 is installed at a predetermined angle with respect to the direction of the light gun 20, here 45 °. The spot light forming area 312 is formed in a direction in which light incident from the direction of the light gun 20 is transmitted by the half mirror 314, and the CRT 32 is installed in a direction in which light incident from the direction of the light gun 20 is reflected by the half mirror 314. Is done. As a result, the image of the CRT 32 installed below can be reflected and displayed in the direction of the player, and the image can be shown to the player holding the light gun 20. In addition, the infrared beam emitted from the light gun 20 passes through the half mirror 314 and is formed as spot light in the spot light forming area 312.

The video camera 40 has the same functions as those of the above-described embodiment. Based on the image data captured by the video camera 40, the impact position detection of the spotlight and the hit determination are performed. The half mirror 314
, The positional relationship between the spot light forming region 312 and the CRT 32 can be reversed.

Further, the present invention can be formed as a simple spot light position detecting system. By irradiating a predetermined image displayed on the display 30 with light, for example, the device of the present invention can also be used as a position detection system for an optical pointing device pointing to the image, for example.

Further, the present invention is not limited to the above-described embodiment, and may be used as a simulator for shooting, for example, a device for a landing simulator for military training or weapons, in addition to a shooting game. it can.

In the above-described embodiment, an example has been described in which the video camera 40 employs an infrared imaging means for capturing only an image in the infrared wavelength region. However, spot light may be detected from an image signal. If possible, a normal video camera may be used. For example, when the position of a spot light is detected by irradiation with a laser beam, since the brightness of the light is extremely strong, the position of the spot light is detected in the same manner as in the above-described embodiment even with a normal video camera. be able to.

Further, in the above-described embodiment, the case where the infrared spot light is used has been described as an example. However, in addition to this, the pointing device of the light gun 20 in another wavelength band, for example, another wavelength band invisible to the player. And irradiate it on the display. In this case, it may be formed so as to capture an image in the display 30 or the spot light forming area via a filter that transmits only light in the wavelength band. Action and effect can be obtained.

[Brief description of the drawings]

FIG. 1 is a schematic explanatory diagram of a first embodiment of a simulator to which the present invention has been applied.

FIG. 2 is a block diagram showing a schematic configuration for realizing the functions of the game device main body.

FIG. 3 is a flowchart illustrating an example of an operation according to the exemplary embodiment;

FIG. 4 is a flowchart illustrating an example of horizontal and vertical scanning processing for position detection.

5A and 5B are explanatory diagrams of a horizontal scanning process for position detection, in which FIG. 5A is a diagram for explaining predetermined horizontal scanning, and FIG. 5B is a diagram for explaining a change in luminance on a horizontal scanning line; (C) is an explanatory diagram of detection candidate pixels specified by the horizontal scanning process.

6A and 6B are explanatory diagrams of a vertical scanning process for position detection, FIG. 6A is an explanatory diagram of a vertical scanning process, and FIG. 6B is an explanatory diagram of a change in luminance on a vertical scanning line. FIG. 4C is an explanatory diagram of the target candidate pixel specified by the vertical scanning process.

FIG. 7 is an explanatory diagram of a process for obtaining a pseudo average value of a t-th target pixel on a scanning line.

FIG. 8 is an explanatory diagram showing a correspondence between a pseudo average value and a threshold.

FIG. 9 is an explanatory diagram of a spotlight detection candidate pixel group specified by the position detection scanning process.

FIG. 10 is an explanatory diagram showing another example of the present embodiment.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 10 Simulator 20 Ray gun 22 Infrared light emitting part 26 Spot light 30 Display 40 Video camera 50 Game device main body 100 Processing part 110 Game calculating part 116 Command judging part 150 ROM 160 Image generating part 200 Control part 210 Position detecting part 212 Pseudo average value calculation Section 214 threshold data storage section 216 position detection processing section

────────────────────────────────────────────────── ───

[Procedure amendment]

[Submission date] December 9, 1999 (1999.12.
9)

[Procedure amendment 1]

[Document name to be amended] Statement

[Correction target item name] Claims

[Correction method] Change

[Correction contents]

[Claims]

[Procedure amendment 2]

[Document name to be amended] Statement

[Correction target item name] 0018

[Correction method] Change

[Correction contents]

Here, the pseudo average value Iave
(T) is: Iave (t) = Iave (t-1) ^* (n-1) / n + I
More preferably, it is determined based on the equation (t-1) / n .

Claims (19)

[Claims] 1. An image pickup means for picking up an image of a shooting area on which a spot light for projecting a landing position is projected or a spot light forming area on which a spot light passing or reflected by the shooting area is projected, is taken in a horizontal direction and An apparatus for a shooting game that scans in at least one direction in a vertical direction and performs a position detection process of a spot light projected on the shooting area, wherein each scan line of the captured image is currently scanned from n points before. Based on the luminance up to the position, a pseudo average value at the current scanning position for identifying a local change in luminance is obtained, and a difference between the luminance at the current scanning position and the pseudo average value and a given reference value are calculated. And a position detecting means for performing a position detecting process for comparing and detecting the position of the spot light. . 2. The method according to claim 1, wherein the position detection unit scans the captured image in a horizontal direction, and compares a difference between the luminance at the current scanning position and the pseudo average value with a given reference value. By specifying the area of the spot light in the captured image by scanning the captured image in the vertical direction, the difference between the luminance of the current scanning position and the pseudo average value, and a given reference value By specifying the area of the spot light in the captured image by comparing, based on the area of the spot light in the captured image specified by both the horizontal and vertical scanning, to perform position detection of the spot light Characteristic shooting game device. 3. The method according to claim 1, wherein the pseudo average value Iave (t) of the t-th pixel on the scan line of the captured image is the luminance of the (t−1) -th pixel before the pixel. I (t-1) and the pseudo average value Iave (t-
An apparatus for a shooting game, which is obtained based on 1). 4. The method according to claim 3, wherein the pseudo average value Iave (t) is: Iave (t) = (n−1 / n) Iave (t−1) + (1 / n) I (t
-1) An apparatus for a shooting game, which is obtained based on the following equation: 5. The shooting game device according to claim 1, wherein the reference value changes with a predetermined correlation with the pseudo average value. 6. The shooting game device according to claim 5, wherein the reference value is set to a large value when the pseudo average value is small, and is set to a small value when the pseudo average value is large. 7. The method according to claim 1, wherein the detecting unit detects a spot light detection candidate pixel for each scan line of the captured image, and detects the detection candidate pixel in an adjacent area of the same line and an adjacent line. An apparatus for a shooting game, wherein when a group exists, the detection candidate group is specified as a spotlight area in the captured image, and the position of the spotlight is detected. 8. The shooting area according to any one of claims 1 to 6, wherein a shooting image is displayed in the shooting area, and light having a wavelength band that can be distinguished from the shooting area image is used as the spot light. An image pickup means for picking up an image of the light in the wavelength band of the spot light separately from a shooting image, and picking up an image of the shooting area. 9. The method according to claim 1, wherein an image of the detection target area on which the spot light is projected or a spot light forming area on which the spot light passing or reflected by the detection target area is projected is taken by the imaging means in the horizontal direction and the vertical direction. An apparatus that scans in at least one direction and performs a position detection process of spot light projected on the detection target area, for each scanning line of the captured image, based on luminance from a point n points before to a current scanning position. Calculating a pseudo average value at the current scanning position for identifying a local change in luminance, comparing a difference between the luminance at the current scanning position and the pseudo average value with a given reference value, An apparatus for position detection, comprising: a position detecting means for performing a position detecting process for detecting a position. 10. An image picked up by an image pickup means for picking up an image of a position detection area on which a spot light for landing position identification is projected or a spot light forming area on which a spot light passing or reflected by the position detection area is projected. Information for a shooting game that scans in at least one of a direction and a vertical direction, and performs a position detection process of a spotlight projected on the position detection area, and for each scanning line of the captured image, n points before A pseudo average value at the current scanning position for identifying a local change in luminance based on the luminance from the current scanning position to the current scanning position, and calculating a difference between the luminance at the current scanning position and the pseudo average value and a given reference. Computer-readable information for realizing a position detecting means for performing a position detecting process of comparing the value with a spot value and detecting a position of the spot light. Ri possible information storage medium. 11. An image pickup means for picking up an image of a detection target area onto which a spot light is projected or a spot light forming area onto which a spot light passing or reflected by the detection target area is projected, in a horizontal direction and a vertical direction. The information for performing position detection processing of spot light that scans in at least one direction and is projected on the detection target area, and for each scanning line of the captured image, the luminance from the point n points before to the current scanning position A pseudo-average value at a current scanning position for identifying a local change in luminance is calculated based on the difference between the luminance at the current scanning position and the pseudo-average value, and a given reference value. An information storage medium readable by a computer, wherein information for realizing position detection means for performing position detection processing for detecting a position of light is stored. 12. The method according to claim 10, wherein the position detecting unit scans the captured image in a horizontal direction, and calculates a difference between a luminance of the current scanning position and the pseudo average value, and a given value. While identifying the area of the spot light in the captured image by comparing with a reference value, scanning the captured image in the vertical direction, the difference between the luminance of the current scanning position and the pseudo average value, given Identifying the area of the spot light in the captured image by comparing with the reference value of the position of the spot light based on the area of the spot light in the captured image specified by both the horizontal and vertical scanning An information storage medium for performing detection. 13. The method according to claim 10, wherein the pseudo average value Iave (t) of the t-th pixel on the scan line of the captured image is the luminance of the (t−1) -th pixel before the pixel. I (t-1) and the pseudo average value Iave (t-
An information storage medium characterized by being obtained based on 1). 14. The pseudo average value Iave (t) according to claim 13, wherein Iave (t) = (n−1 / n) Iave (t−1) + (1 / n) I (t)
-1) An information storage medium which is obtained based on the following formula: 15. The information storage medium according to claim 11, wherein the reference value changes with a predetermined correlation with the pseudo average value. 16. The information storage medium according to claim 15, wherein the reference value is set to a large value when the pseudo average value is small, and is set to a small value when the pseudo average value is large. 17. The apparatus according to claim 11, wherein the detecting unit detects a spot light detection candidate pixel for each scanning line of the captured image, and detects the detection candidate pixel in an adjacent area of the same line and an adjacent line. An information storage medium characterized in that when a group exists, the detection candidate group is specified as a spotlight area in the captured image, and the position of the spotlight is detected. 18. The imaging device according to claim 11, wherein an image is displayed in the position detection area, and light having a wavelength band that can be distinguished from the image is used as the spot light. An information storage medium for capturing light in the wavelength band of the spot light separately from the image, and capturing the position detection area. 19. The information storage medium according to claim 10, wherein information for performing a simulation for shooting is stored in place of the shooting game.