TW201220108A - Display device, game system, and game process method - Google Patents

Abstract

A game system includes a home-console type game device, a controller device, and a portable display device. The portable display device includes an infrared light-emitting portion capable of emitting infrared light. The controller device wirelessly transmits to the game device operation data including data representing a detection result by an image-capturing section, data representing a detection result by an inertia sensor, and data representing an operation performed on an operation button. The game device receives the operation data from the controller device, and performs a game process based on the operation data. Moreover, the game device successively compresses a first game image, which is successively generated based on the game process, to generate compressed image data. The compressed image data is successively wirelessly transmitted to the portable display device. The portable display device successively receives the compressed image data from the game device, successively expands the compressed image data to obtain the game image, and successively displays the game image.

Description

201220108 VI. Description of the Invention: The present invention relates to a display device for displaying a game image or the like, and a portable display device that can be carried by a user, and a game system using the display device And game processing methods. [Prior Art] A game system in which the mobile operation device itself is used to perform a game operation (see, for example, the transcript of the license (invention patent) No. 4265814). For example, the game system described in the specification of Japanese Patent No. 4265814 uses the photographing means provided in the operating device to display the label (the coffee machine), and then the image to be photographed (the photograph is used as the game input, that is, it can be performed Specifically, since the position of the operating device and the position of the device and/or the device are determined from the inside of the photographic image, the pointing device is obtained: The game is a game corresponding to the position of the pointing device. The information is displayed, and the setting place of the pointing device is the voice ρ. The game system is placed facing the display game image. In the case of the operation, there is no sense of discomfort. Therefore, the method of wearing is generally used for the user. The invention is provided on the display device. (Problems to be solved by the invention) As described above, The direction of the display device is used in the game system. * The test device is oriented and, in the aforementioned game system, 'General 323304 4 201220108 is used to set the TV as set. Therefore, the photographic image is used as the display device provided in the wheel & the display device that is fixedly disposed, the user must constantly cut off, and in the aforementioned game system, the operation is swayed. The device is also in the case of the operation, and there is room for the operation: the operator can use the operating device. The improvement of the degree of freedom of operation is to provide the display device. Therefore, the device of the present invention is free to operate. Method for improving the game system and the game processor (means for solving the problem) The following (1) to (14) are used to solve the above problems. The present invention adopts the configuration. (1) Example of the present invention The game system includes a fixed game device, an operation device, and a portable display device. The game game (four) has money: operation data, department, processing unit, game image generation unit, game image compression unit, data The operation unit receives the operation data from the operation device, and the game processing unit carries the game process based on the operation amount = the game image generation unit is based on the game. The first image is generated successively by the processing. The fourth image of the first image is compressed successively by the image (4), and the compressed image data is successively transmitted by the data transfer unit. The data transfer unit sequentially transmits the compressed image data to the portable display. The device is equipped with a camera unit, an inertial detector, at least one operation button, and an operation data transmission unit. The camera department is capable of measuring infrared rays 5 323304 201220108. The operation data transmission unit is wireless. The method transmits operation data to the game device, and the operation data includes: data indicating a detection result by the photographing unit, data indicating a detection result of the inertial sensor, and information indicating an operation of the operation button. The transport type display device includes an infrared light emitting unit, a game image receiving unit, a game image decompressing unit, and a display unit. The infrared ray emitting unit is capable of emitting infrared light. The game image receiving unit sequentially receives the compressed image data from the game device. The game image decompressing unit decompresses the compressed image data one by one to obtain a first game image. The display unit sequentially displays the first game image obtained by decompression. The "game device" may be any device as long as it is an information processing device that executes game processing and generates an image based on game processing. The aforementioned game device may be a game-specific information processing device or a multi-purpose information processing device such as a general personal computer. The "operating device" described above may have other configurations in addition to the above-described configuration. For example, the operation device may be provided with display means and/or sound output means. Further, the above-mentioned "detection result by the photographing unit" means an image itself which can be photographed by the photographing unit; and information obtained from the image (for example, a logo coordinate to be described later). The above-mentioned "portable type" means the degree to which the user can hold the hand and move it, or change the arrangement at any position. However, the "transportable display device" is, for example, the first to fourth game examples described later, and can be moved and used in the game, and can be fixedly arranged in the game (for example, as in the fifth game example described later). )use. 6 323304 8 201220108 The above-mentioned "game system" may include a game device, an operation device, and a portable display device, and may not include or include an external display device that displays a second game image to be described later. That is, the gaming system can be provided in a form that does not include or includes the external display device. According to the configuration of the above (1), the portable display device includes the infrared light emitting unit and the display unit, and the operation device includes the imaging unit, and the game processing is executed based on the detection result by the imaging unit. Therefore, the user can perform the game operation in the direction in which the photographing unit of the operation device faces the infrared light-emitting portion of the portable display device. Here, since the display device is of a transportable type, the user can arrange the display device at a free position, whereby the operating device can be used in a free direction. As described above, according to the configuration of the above (1), the degree of freedom in the operation of the operating device can be improved as compared with the conventional game system in which the direction of the operating device can be restricted. Further, according to the configuration of the above (1), the portable display device may perform at least the decompression processing of the image data, and the game processing may be performed on the game device side. Even if the game processing is complicated, since only the processing on the game device side is increased, the processing amount of the image decompression processing on the portable display device is hardly affected, so even when complicated game processing is required, The processing load on the side of the portable display device can be suppressed to a predetermined range, and high information processing capability is not required for the portable display device. Therefore, the size and weight of the portable display device are reduced, and manufacturing is also easy. Further, according to the configuration of the above (1), since the first game image is compressed and transmitted from the game device to the portable display device, the game image can be transmitted at a high speed without the 7 323304 201220108 line method, so that the game image can be reduced. The delay from the progress of the game to the display of the game image. μ (2) The game system can include a marker that emits infrared light. In this case, the game image generating unit generates the second game image in accordance with the game processing. Further, the game device is provided with an image output unit and a light emission control unit. The image output unit sequentially outputs the second game image to an external display device different from the portable display device. The lighting control unit controls the lighting of the marking device. ^ "External display device" means that it is different from the portable display device, except that the television 2' of the embodiment to be described later can be displayed as long as the second game image generated by the game device can be displayed. Sound device. For example, the external display device can be formed integrally with the game device q = body). According to the configuration of the above (2), the game system includes an indicator device different from the infrared light-emitting portion of the portable display device, and is displayed on the external display device different from the portable display device that displays the first game image. The second game image. According to this, when the home marking device is located around the external display device, the user can use the operation|positioning toward either of the two display devices. In other words, since the user can operate the operation device toward which side of the two display devices, the degree of freedom of operation of the operation device is further improved. According to the configuration of the above (2), since the portable display device can be freely disposed, the positional relationship between the two display devices can be freely set. 323304 8 8 201220108 Therefore, by arranging two display devices in an appropriate position corresponding to the game content, it is possible to realize a more realistic operation using the operating device and realize a more interesting game (refer to the fifth game described later). example). Further, each time the positional relationship between the two display devices is changed, it is possible to form a game in which the two display devices can be placed in various positional relationships for use. Further, according to the configuration of the above (2), since the second game image can be displayed on the external display device, the player can be presented with two different game faces. Therefore, the game space can be displayed in various ways by the two game images. Therefore, according to the configuration of the above (2), the game player can be presented with a game image that is easier to see and that is easy to play. (3) The game system can also contain two operating devices. In this case, the game processing department executes the game processing based on the operation data received from the respective operating devices. According to the configuration of the above (3), one of the operating devices can be operated in the direction of the transportable display device, and the other operating device can be operated in the direction of the pointing device. Therefore, when a pointing device is provided around the external display device, in a game (for example, a fifth game example described later) in which the operating device and the display device are used as a group, the two players can simultaneously play the game. (4) The light emission control unit controls the light emission of the pointing device and the infrared light emitting portion in accordance with the content of the game processing. The above-mentioned "control according to the content of the game processing (indicator and red 9 323304 201220108 external light emitting portion)" means that the lighting is controlled in accordance with the type of the game program executed in the game device, or even if the same one is executed In the game program, the meaning of the lighting is also controlled in accordance with the game situation (the player's operation object and/or operation method, or the progress of the game). According to the configuration of the above (4), the game device can control whether or not any of the pointing device and the infrared light emitting portion is caused to emit light (or both light-emitting) in response to the game processing content. Among them, depending on the content of the game, there is a case where either one of the two light-emitting devices of the infrared light-emitting portion of the pointing device and the portable display device is used. Further, when both of the two light-emitting devices are caused to emit light, the game device cannot determine whether the imaging unit of the operation device is (4) to which infrared light is emitted from the device (four), and thus the operation device cannot be accurately operated. The situation of the operation. On the other hand, according to the configuration of the above (4), since the appropriate light-emitting device that can respond to the content of the game processing can be illuminated in the two light-emitting devices, it is possible to play various kinds of games for the A-wire T, and it is possible to prevent erroneous detection due to erroneous detection. Causes an operation that is incorrectly performed by the operating device. (5) ^ The light-emitting control unit may also indicate the control of the (four) day indicated by the infrared light-emitting unit in the light-emitting control unit. In this case, the data transfer unit wirelessly transmits the control data. The portable display device is useful for receiving the receiving unit from the swim (four). Infrared illuminating Qiu _ _ _ _ _ _ _ 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐 佐The "Transfer Department" may transmit the "Control Data" together with the image data, or may transmit it at a timing different from the transmission timing of the image data 323304 8 201220108. That is, 'when the image data is sequentially transferred, it is also possible to transmit 2 data only when necessary' without the need to transmit the image data n. According to the configuration of the above (5), the game device can easily control the light emission of the infrared light-emitting portion by transmitting the control data to the portable display device. (6) Further, an aspect of the present invention is a display device that can be wirelessly connected to a game device. The game device receives the bedding material indicating the result of the detection by the photographing unit from the operation device having the fingerprint measurement unit, and the money transfer is based on the tour executed according to the data:: [generated game map The image-to-display device that has been compressed is provided with an infrared light-emitting unit, a game image receiving unit, a play image decompressing unit, and a display unit. The infrared light emitting portion is capable of emitting about infrared light. _ _ like the receiving part of the charm _ device private access image data. The game image decompression unit compresses the compressed image to a game image. The display unit sequentially displays the game image by decompression =. τ According to the configuration of the above (6), the display device of the same type as the configuration of the above (1) includes the camera-side light-emitting unit and the display unit, and the imaging unit is provided, and the image is obtained by the imaging unit. It is placed in a free position, and the operation can be used from the past, and the operation of the operating device can be improved to freely produce the free side. Further, according to the configuration of the above (8), the configuration is the same as the above (1), 323304 11 201220108 = Yes: handling The display device is required to be manufactured at a high cost, and the game image is easily transferred according to the configuration of the above (6), and the delay of arbitrarily arranging the wireless image can be reduced. The game is processed to display the game map. (7) The game is equipped with: touch panel, inertial sensor, and drop data transmission department to wirelessly play the game. The output data of the t-control panel and inertial sensor during operation. The =, '2 devices perform game processing based on the operation data. Μ When the portable display device is also formed into a play system, such as when the display device is used in the display device: the side of the display is moved while operating, or the display device can be configured freely. According to the configuration of the above (7), the multi-purpose device that can be used as the display device can be provided as the display device in the direction of the display device. C8) The wireless method transmits the sound according to the game to the display. In this case, the display device is provided with (4) # (4) the device receives the sound, and the speaker 11 outputs the game sound received by the game sound receiving unit. 323304 8 12 201220108 In the above (8), the game sound transmitted wirelessly from the game device to the display device can be transmitted after being compressed as in the embodiment described later or transmitted without being compressed. According to the configuration of the above (8), the game sound can be output from the display device similarly to the game image. (9) The portable display device can also be equipped with a microphone. In this case, the operation data transmission unit wirelessly transmits the data of the sound detected by the microphone to the game device. In the above (9), the data of the voice transmitted wirelessly from the operating device to the game device can be transmitted after being compressed as in the embodiment described later or transmitted without being compressed. According to the configuration of the above (9), the sound (microphone sound) detected by the microphone of the operating device is transmitted to the game device. Therefore, the game device can use the microphone sound for the game sound, or use the result of the sound recognition processing of the microphone sound as the game input. (10) The display device can also be equipped with a camera and camera image compression unit. The camera image compression unit compresses the camera image captured by the camera to generate compressed photographic material. In this case, the operation data transmission unit wirelessly transmits the compressed photographic material to the game device. According to the configuration of the above (10), the camera image captured by the camera of the display device is transmitted to the game device. Therefore, the game device can use the camera image for the game image, or use the result of the image recognition of the camera image as a game input. Further, according to the configuration of the above (5), since the camera image is compressed and transmitted, the camera image can be wirelessly transmitted at high speed. (11) The display device may be provided with a plurality of surface operation buttons and a direction input portion capable of indicating directions. A plurality of surface operation keys are disposed on both sides of the side surface on which the display surface is provided and the surface of the touch panel. The direction input portion is disposed on both sides of the kneading surface in the table plane. In this case, the operational data includes information indicating the operation of the plurality of surface operation buttons and the direction input portion. . According to the configuration of the above (11), the operation button and the direction input portion are provided on both sides of the face of the display device. Therefore, since the player can operate the operation button and the direction input portion while holding the display device (typically with two hand fingers), the operation button and the direction can be easily operated even under the operation of the mobile display device. Input section. (12) The display device can also be equipped with: a plurality of back operation buttons and a plurality of side operation buttons. A plurality of back operation buttons are disposed on the back plane. The back plane is the opposite side of the surface of the display panel and the surface of the touch panel. A plurality of side operating buttons are disposed on the side between the planes of the back plane of the table. In this case, the operation data includes information indicating the operation of a plurality of back operation buttons and side operation buttons. According to the configuration of the above (10), the operation buttons are provided on the back plane and the side surface of the display. Therefore, since the player can operate the operation buttons by holding the display device in the state of 323304 8 14 201220108, (typically, one or two from the index finger or the middle finger), the gp button is used. Under the operation of the display device, the operation can be easily performed. (13) The display device can also be equipped with a magnetic sensor. In this case, the operational data is copied to the data containing the results of the magnetic sensor. According to the configuration of the description (13), the display device is provided with a magnetic sensor, and the output of the game device can be used for game processing. Therefore, the player can perform the game operation by moving the display device. In addition, since the game device can judge the absolute posture of the display device in the actual space from the output result of the magnetic sensor, it can be positively used, for example, by using the output result of the inertial sensor and the output of the magnetic sensor. The position of the display device is calculated on the dish. (14) The inertial sensor can be any inertial sensor, such as a 3-axis acceleration sensor and a 3-axis rotary sensor (gyr〇 sens〇r). According to the configuration of the above 04), by using two kinds of sensors of the acceleration sensor and the gyro sensor as the inertial sensors, the action or posture of the portable display device can be accurately calculated. Further, another example of the present invention can be implemented in the form of the game processing method performed by the game system + of the above (1) to (5). (Effects of the Invention) According to the present invention, it is possible to use the operation of the machine 15 323304 201220108 in a free direction by providing the infrared light-emitting material in the portable display device and the game image (four) on the display device. And increase the freedom of operation of the operating device. [Embodiment] [1. Overall configuration of game system] A game system 1 according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 is an external view of the game system 1. In the first embodiment, the game system 1 includes a fixed display device (hereinafter referred to as "television") represented by a television receiver or the like, a fixed game device 3, a compact disc 4, a controller 5, and a pointing device 6. And the terminal device 7. The game system is operated by the game of the controller 5, the game processing is executed in the game device 3, and the game image obtained by the game processing is displayed on the television 2 and/or the terminal device 7. In the game device 3, the optical disc 4, which is an example of a replaceable information storage medium, is detachably inserted into the game device 3. The disc 4 system has an information processing program (typically a game program) for execution in the game device 3. An insertion port of the optical disc 4 is provided in front of the game device 3. The game device 3 executes the game processing by reading and executing the information processing program stored in the optical disc 4 inserted in the insertion slot. The television 2 is connected to the game device 3 via a connection line. The television 2 displays a game image obtained by the game processing executed in the game device 3. The television 2 has a speaker 2a (Fig. 2), and the speaker 2a outputs a game sound obtained as a result of the game processing. In other embodiments, the game device 3 and the fixed display device may be integrally formed. In addition, the communication between the game device 3 and the television 2 can be wirelessly communicated. 323304 8 16 201220108 The display device 6 is provided on the periphery of the screen of the television 2 (the upper side in the first drawing). The details will be described in detail later, and the user (player) can perform the game operation of the mobile controller 5, and the display device 6 can be used to calculate the operation, position, posture, and the like of the controller 5. The marking device 6 has two marker garments and cymbals at its two ends. The display 6R (the same as the marker 6L), specifically! More than one infrared LED (Light Emitting Diode) outputs infrared light toward the front of the television 2. The pointing device 6 is connected to the game device 3, and the game device 3 can control the lighting of each of the infrared LEDs provided in the signing device 6. The marking device 6 is of a transportable type, and the user can set the marking device 6 in a free position. In Fig. 1, the type in which the indicator device 6 is placed above the television 2 is shown, but the position and orientation of the drum display device 6 can be arbitrary. The controller 5' displays the operation data indicating the contents of the operation performed by the own machine to the game device 3. Communication between the controller 5 and the game device 3 can be performed by wireless communication. In the present embodiment, wireless communication between the controller 5 and the game device 3 is performed by, for example, Bluetooth (registered trademark) technology. In other embodiments, the controller 5 and the game device 3 can be connected in a wired manner. Further, in the present embodiment, the controller 5 included in the game system 1 is one, but the game device 3 can communicate with a plurality of controllers 5, and by using a predetermined number of controllers at the same time, it is possible to Several users play the game. The details of the controller 5 will be detailed later. The terminal device 7' is a size that the user can hold. The user can move the terminal device 7 by hand or the terminal device 7 323304 201220108 can be used in a free position. The detailed configuration will be described in detail later, and the terminal device 7 includes an LCD (Liquid Crystal Display) 51 as a display means and an input means (a touch panel 52 or a rotary sensor 64 to be described later). Communication between the terminal device 7 and the game device 3 can be performed by wireless (or wired). The terminal device 7 receives the material of the circular image (e.g., game image) generated in the game device 3 from the game device 3, and teaches that the image is not displayed on the LCD 51. In the present embodiment, an LCD is used as the display device. However, the terminal device 7 may have any other display device such as a display device using EL (Electr® Luminescence). Further, the terminal device 7 transmits the operation data showing the content of the operation performed by the own device to the game device 3. [2. Internal Configuration of Game Device 3] Next, the internal configuration of the game device 3 will be described with reference to Fig. 2 . Fig. 2 is a block diagram showing the internal structure of the game device 3. Game device 3 series

It has: CPUCCentral Processing Unit: 1 〇 \ System LSI Η, external main memory 12, R〇m/RTc 13, CD player 14 and AV-IC 15. The 1S CPU 10 performs game processing by executing a game program stored in the disc 4, and has a function of a game processor. The CPU 10 is connected to the system 1 LSI U, and in addition to the CPU 10, an external main memory 12, a ROM/RTC 13, an optical disk drive 14, and an AV-IC 15 are connected. The system ° 11 performs processing such as generation of an image to be displayed by data transfer between the constituent elements connected thereto, and acquisition of data from an external t setting. The internal structure of the system LSI 11 will be described in detail later. Volatile external master recovery body 323304 18 201220108 12, is to memorize the game program read from CD 4 or a program such as a game program read from fast "* *5^^ 17, or to memorize various materials, β ^ is used as a work area or buffer for the rabbit CPU 10. The R0M/RTC 13 is a ROM having a program for starting up the device 3 (so-called R〇w, VR clock (RTC: Real Time Clock). The number of the CD player 14 is read from the disc 4 Data or material graphic data, etc., and the read information is written in the internal main memory lie or the external main memory 12 described later. In the system LSI 11, an output input processor (I/O processor) is provided. 11a, GPU (Graphics Processor Unit: continued 'image processing unit) lib, DSP (Digital Signal Processor) 11c, VRAM (Video RAM) lld, and internal main memory lle. Although omitted from the illustration, However, these components 11a to lie are connected to each other by internal bus bars. The GPU lib forms part of the drawing means and generates an image according to a drawing command (drawing command) from cPu 1(). VRAM lid, memory The data (polygon data or material graphic data, etc.) required for the GPU lib to execute the drawing command. When the image is generated, the GPU lib uses the data stored in the VRam lid to create the image data. In this embodiment, Game Jun 3 Series Both the game image displayed on the television 2 and the game image displayed on the terminal device 7 are generated. Hereinafter, the game image displayed on the television 2 is referred to as a "game image for television", and is displayed on the terminal device 7. The game image is called "terminal game image". 'DSP 11c has the function of audio processor, which uses the sound data or sound waveform stored in the internal main memory lie or the external main memory 12 323304 19 201220108 ( In the present embodiment, the game sound is the same as the game image, and both the game sound output from the television 2 and the game sound output from the terminal device 7 are generated. The game sound output from the speaker of the television 2 is referred to as "game sound for television", and the game sound output from the speaker of the terminal device 7 is referred to as "game sound for the terminal". As described above, it is generated in the game device 3. In the image and sound, the image and sound data outputted in the TV 2 are read by the AV-1C 15. The AV-IC 15 transmits the read image data via the AV connector 1 6 is output to the television 2, and the read sound material is output to the speaker 2a built in the television 2. Thereby, the image is displayed on the television 2, and the sound is output from the speaker 2a. Further, in the game device 3 Among the generated images and sounds, the images of the images and sounds outputted to the terminal device 7 are transmitted to the terminal device 7 by the output/output processor 11a, etc. The data is transmitted to the output processor 11a or the like. The transmission method of the terminal device 7 will be described in detail later. The output/input processor 11a performs reception and transmission of data between constituent elements connected thereto, or performs data download from an external device. The output input processor 11a is connected to the flash memory 17, the network communication module 18, the controller communication module 19, the expansion connector 20, the memory card connector 21, and the codec LSI 27. In addition, the network communication module 18 is connected to the antenna 22. The controller communication module 19 is connected to the antenna 23. The codec LSI 27 is connected to the terminal communication module 28, and the terminal communication module 28 is connected to the antenna 29. 20 323304 8 201220108 The game device 3 can be connected to a network such as the Internet to communicate with an external information processing device (for example, other game devices or various servers). That is, the output input processor 11a can be connected to a network such as the Internet via the network communication module 丨8 and the antenna 22, and communicates with an external information processing device connected to the network. The output input processing lla periodically accesses the flash memory 17 to detect whether there is data to be transmitted to the network. When the data is available, it is transmitted to the network via the network communication module 18 and the antenna 22. The external input/output processor 11a receives the data downloaded from the external information processing device or downloaded from the download server via the network, the antenna 22, and the network communication module 18, and memorizes the received data. For flash memory 17. Which one is used to read the data stored in the flash memory P by using the game program, f is used in the game program. In the flash memory 17, in addition to the (4) transmitted between the game device 3 and the external information processing device, the game device 3 can also store the game data (the game's (four) way data ^ In addition, The flash memory 17 can also be memorized, that is, the game device 3 can receive the operation data from the controller 5. : 9 = the input processor can be transmitted via the antenna _ 二 2 = the slave controller 5 From the operation data, and memorize (temporary, °:: memory... or external main memory 12 buffer. Receive transmission. Output input processor mountain: == terminal material image) transmitted to the terminal device? At the time, the data of the game image generated by G ^ kg is transmitted to the codec (3) 仏 323304 21 201220108 = S^27 The predetermined compression processing is performed on the image data from the output input processor m. The wireless communication is performed between the terminal and the final device 7. Therefore, the image data compressed by the codec LSI 27 is transmitted through the terminal multiplex group 28 via the antenna 29 in the terminal device 7. , transmitted from the game device 3 to the terminal device The image data of 7 is used for face-to-face shooting. If the image is delayed (4), the image will be delayed, which will adversely affect the operability of the game. Therefore, the image data from the game device 3 to the terminal device 7 is transmitted. Preferably, the delay is not generated as much as possible. Therefore, in the present embodiment, the codec LSi27 compresses image data using, for example, the H.264 high-efficiency compression technique. Other compression techniques can be used. It is also possible to transmit image data without compression. Further, the terminal communication module 28 is, for example, a communication module that accepts Wi-Fi authentication, and can use, for example, MIMCK Multiple Input Multiple Output which is used in the specification of the curry. The technology performs high-speed communication with the terminal device 7 or other communication methods. In addition, the game device 3 transmits the sound data to the terminal device 7 in addition to the image data. That is, the output input processing The m is used to output the sound data generated by the DSpUc to the terminal communication module 28 and the codec LSI 27 via the codec LSI 2? The compression processing is the same as the image data. The method of compressing the sound (4) may be any method, but it is preferably a method in which the compression ratio is high and the scale sound is less deteriorated. In addition, in other embodiments, the sound data can be about uncompressed. The terminal communication module 28 transmits the compressed image data and sound data to the terminal device 7 via the line 323304 8 22 201220108 line 29. Furthermore, the game device 3 is in addition to the image data and sound data described above. It is also possible to transmit various types of control data to the terminal device 7 as necessary. The control data: for indicating the components of the terminal device 7, the control information is, for example, a control indicator unit (the first figure is shown). The indication of the lighting of the indicator portion 55) or the instruction to control the shooting of the camera (the camera/machine 56 shown in Fig. 1) is performed. The output input processing transmits the control > material to the terminal device 7 in accordance with which/her private indication. In the present embodiment, the knapsack LSI 27 does not perform data compression processing, but in other embodiments, compression processing can be performed. The above-mentioned data transmitted from the game device to the terminal device 7 may or may not be encoded as necessary. Further, the game device 3 can receive various materials from the terminal device γ. The details will be described later. In the present embodiment, the terminal device 7 transmits the known data, the image data, and the sound data. The various data transmitted from the terminal device 7 are received by the terminal communication module 28 via the antenna 29. This image data and sound data from the final set 7 are also subjected to the same reduction processing as the relationship data and sound data of the game device 3 to the terminal device 7. Therefore, the image data and the sound data are transmitted from the terminal, communication module 28 to the codec LSI 27' by the codec LSI 7 and decompressed and output to the output input processor 丨 " ^ The other party =: Regarding the operation data from the terminal device 7, since the amount of data is smaller than that of the image or the sound, the compression processing may not be applied. Further, encoding may be performed or not performed as necessary. After receiving the data from the terminal 23 323304 201220108 terminal communication module 28, the data is output to the output input processor Ua via the codec H LSI 27. The output input processor is old, and the data received from the terminal device 7 is memorized ( Temporarily memorized in the buffer of the internal main memory lie or the external main memory 12. Further, the game device 3 can be connected to other machines or external memory media. That is, the expansion connector is connected to the wheel input processor 11a. 2 〇 and ^ memory card connector 2 expansion connector 20 for USB or SCSI; 1 side connector. By means of external media such as media, other controllers, etc. Connected to the wired communication connector, expand the connection H 20' to communicate with the network to replace the network communication mode 18 „It It card connector 21 is used to connect the external card or the like Reduce media connection 11. For example, the output input processing H 11a accesses the external memory medium via the expansion connection = 2G or # memorandum connector 21, and the data can be stored in an external memory medium or read from an external memory medium. In the game split 3, a power button 24, a reset button 25, and a pull-back _ are provided, and the power switch 24 and the reset button 25 are connected to the system LSI 11. When the source key 24 is turned on, power is supplied from the external power source to each component of the ageing setting 3 by an AC adapter (not shown). When the reset button 25 is pressed, the system LSH1 f newly starts the startup program of the game slot 3. The eject button 26 is connected to the disc player 14. When the eject button 26 is pressed, the correction 4 is discharged from the disc player U. In the other embodiments, some of the constituent elements included in the game teaching unit 3 may constitute an expansion machine different from the game device 3. At this time, the expansion machine can be connected to the game 323304 8 24 201220108 device 3 via the expansion connector 2, for example. Specifically, the expansion device includes, for example, the components of the codec LSI 27, the terminal communication module 28, and the antenna 29, and is attached to and detached from the expansion connector 20. According to this, the game device can be configured to communicate with the terminal device 7 by connecting the expansion device to a game device that does not have the above-described components. [3. Configuration of Controller 5] Next, the controller 5 will be described with reference to FIGS. 3 to 7. Fig. 3 is a perspective view showing the appearance of the controller 5. Fig. 4 is a perspective view showing the appearance of the controller '5. Fig. 3 is a perspective view as seen from the upper rear side of the controller 5, and Fig. 4 is a perspective view seen from the lower front side of the controller 5. In the third and fourth figures, the controller 5 is formed of, for example, plastic molded outer cover 3, and the outer cover 31 has a substantially rectangular parallelepiped shape in the longitudinal direction (the Z-axis direction shown in Fig. 3). The size that can be held by one hand of an adult or a child. The user can perform a game operation by pressing the key set on the controller 5 and moving the controller 5 itself to change its position or posture (inclination). A plurality of operation keys are provided on the material 31. As shown in Fig. 3, on the upper surface 'δ of the outer cover 31, there are: a cross key, a ^ key shift, a 2nd key 32c, an A key 32d, a minus key 32e, a home key 32f, a positive key _ And the power button Na. In the present specification, the upper surface of the outer cover 31 provided with the keys 32a to 32h is referred to as a "press key surface". On the other hand, as shown in Fig. 4, a concave portion is formed on the lower surface of the outer cover 31, and a B key 32i is provided on the inclined surface on the rear side of the concave portion. The functions of the information processing program executed by the game device 3 are assigned to the respective operation keys 32a to 36, and 323304 25 201220108. Further, the power key 32h is used to turn the power of the main body of the game device 3 to the close person in a remote manner. The upper surface of the home key 32f and the power key 32h is embedded in the upper surface of the outer cover 31. Thereby, the user can be prevented from accidentally pressing the first key 32f or the power key 32h. A connector 33 is provided behind the outer cover 31. Connector 33 is used to connect other machines (e.g., other sensor units or controllers) to controller 5. Further, on both sides of the connector 33 on the rear side of the outer cover 31, locking holes 33a for preventing the above-mentioned other devices from being easily detached are provided. A plurality of (four in FIG. 3) LEDs 34a to 34d are disposed behind the upper surface of the outer cover 31. Here, the controller 5 is given a controller type (number) in order to distinguish it from the other controllers 5. Each of the LEDs 34a to 34d is used for the purpose of notifying the user of the type of controller currently set in the controller 5 or notifying the user of the remaining amount of the battery of the controller 5. Specifically, when the game operation is performed using the controller 5, any one of the plurality of LEDs 34a to 34d is turned on in response to the type of the controller. Further, the controller 5 includes a photographing information computing unit 35 (Fig. 6). As shown in Fig. 4, the light incident surface 35a of the photographing information computing unit 35 is provided on the front surface of the outer cover 31. The light incident surface 35a is made of a material that allows at least infrared rays from the markers 6R and 6L to penetrate. Between the first key 32b on the upper surface of the outer cover 31 and the first key 32f, a sound emitting hole 31a for discharging the sound from the speaker 47 (Fig. 5) built in the controller 5 to the outside is formed. Next, the internal structure of the controller 5 will be described with reference to Figs. 5 and 6 to 323304 8 26 201220108. Figs. 5 and 6 show an internal structure of the controller 5, and Fig. 5 is a perspective view showing the upper frame of the controller 5 (a part of the cover 31). Fig. 6 is a perspective view showing a state in which the lower casing (the portion of the outer cover 31) of the controller 5 is removed. The perspective view shown in Fig. 6 is a perspective view of the substrate 30 shown in Fig. 5 as viewed from the back. > In Fig. 5, the substrate 30 is fixedly disposed inside the outer cover 31 on the upper main surface of the substrate 30, and is provided with respective operation keys 32a to 32h, LEDs 34a to 34d, acceleration sensors 37, and antennas. 45, and speaker 47 and so on. These are connected to a microcomputer (see Fig. 6) by wiring (not shown) formed on the substrate 30 or the like. In the present embodiment, the acceleration sensor 37 is disposed at a position deviated from the center of the controller 5 in the X-axis direction. Thereby, the operation of the controller 5 when the controller 5 is rotated about the Z axis can be easily calculated. Further, the acceleration sensor 37 is disposed at a position forward of the center of the controller 5 in the longitudinal direction (Z-axis direction). Further, the controller 5 has the function of the wireless mode controller by the wireless module 44 (Fig. 6) and the antenna 45'. On the other hand, in Fig. 6, a photographing information computing unit 35 is provided on the front end of the lower main surface of the substrate 30. The photographing information computing unit 35 is provided with an infrared filter 38, a lens 39, a photographing element 40, and an image processing circuit 41 in this order from the front of the controller 5. These members 38 to 41 are attached to the lower main faces of the substrate 30, respectively. Further, the microcomputer 42 and the vibrator 46 are provided on the lower main surface of the substrate 30. The vibrator 46 is, for example, a vibration motor or a solenoid, and is connected to the microcomputer 42 by wiring formed on the substrate 30 or the like. The vibrator 46 is actuated by the instruction of the computer 42 by micro 27 323304 201220108, whereby the controller 5 is caused to vibrate. Thereby, the vibration can be transmitted to the hand of the user holding the controller 5, and a so-called corresponding vibration game can be realized. In the present embodiment, the vibrator 46 is disposed slightly forward of the outer cover 31. That is, by arranging the vibrator 46 at the end side more than the center of the controller 5, the vibration of the vibrator 46 can cause greater vibration to the entire controller 5. Further, the connector 33 is mounted on the rear end edge of the lower main surface of the substrate 30. The controller 5 includes a crystal vibrating element that generates a basic clock of the microcomputer 42 and an amplifier that outputs an audio signal to the speaker 47, in addition to those shown in Figs. 5 and 6. The shape of the controller 5 shown in Figs. 3 to 6 and the number and arrangement positions of the operation key shape acceleration sensors or vibrators are merely examples, and may be other shapes, numbers, and setting positions. In addition, in the present embodiment, the photographing direction of the photographing means is the Z-axis positive direction, but the photographing direction can be any direction. In other words, the light human face 35a) of the bit 3 calculation unit 35 of the photographing information computing unit 35 in the controller 5 may not be taken from the outside of the outer cover 3 as long as it can be taken from the outside of the outer cover 31. The block diagram of the configuration of the controller 5 is shown in the other figure. The controller 5 commands ^5, , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , , The information of the old heart is called "_;:", ==, ', and shell; it is called "terminal operation data". 323304 8 28 201220108 The operation unit 32 includes the above-described operation keys 32a to 32i, and outputs operation key data indicating the input states of the operation keys 32a to 32i (whether or not the operation keys 32a to 32i are depressed) to the communication unit. 36 of the microcomputer 42. The photographing information calculation unit 35 is a system for analyzing image data photographed by the photographing means, discriminating a region having a high luminance, and calculating the position or size of the center of gravity of the region. Since the photographing information calculation unit 35 has, for example, a sampling period of at most 200 frames per second, even if the operation of the relatively high-speed controller 5 is performed, it can be analyzed. The photographing information calculation unit 35 includes an infrared filter 38, a lens 39, an imaging element 40, and an image processing circuit 41. The infrared filter 38 allows only infrared rays to pass through the light incident from the front of the controller 5. The lens 39 condenses the infrared rays penetrating the infrared ray filter 38 and enters the photographic element 40. The photographic element 40 is, for example, a solid-state photographic element such as a CMOS sensor or a CCD sensor, and illuminates the infrared ray collected by the lens 39 and outputs an image signal. Here, the indicator portion 55 and the pointing device 6 of the terminal device 7 to be imaged are constituted by a marker that outputs infrared rays. Therefore, by providing the infrared ray filter 38, the photographic element 40 can generate image data only by absorbing the infrared ray through the infrared ray filter 38, so that the photographic subject (the indicator portion 55 and/or the marking device 6) can be more accurately The image is taken. Hereinafter, an image photographed by the photographing element 40 is referred to as a photographed image. The image data generated by the photographic element 40 is processed in the image processing circuit 41. The image processing circuit 41 calculates the position of the photographic subject in the captured image. The image processing circuit 41 outputs the coordinates showing the calculated position to the microcomputer 42 of the communication unit 36. The coordinates of the coordinates, 29 323304 201220108 are transmitted to the game device 3β by the microcomputer 42 as operational data, and the coordinates are referred to as "marker coordinates". Since the marker coordinates change depending on the orientation (tilt angle) or position of the controller 5 itself, the game device 3 can use the marker coordinates to calculate the orientation or position of the controller 5. In other embodiments, the controller 5 may be configured not to include the image processing circuit 41, and the captured image itself may be transmitted from the controller 5 to the game device 3. At this time, the game device 3 may have a circuit or a program having the same function as the image processing circuit 41, and calculate the marker coordinates. The acceleration sensor 37 detects the acceleration of the controller 5 (including the acceleration of gravity), that is, the force applied to the controller 5 (including the gravity). The acceleration sensor 37 detects the value of the acceleration (linear acceleration) in the direction along the direction of the sensing axis in the acceleration applied to the detecting portion of the acceleration sensor 37. For example, in the case of a multi-axis acceleration sensor of two or more axes, the acceleration of the component along each axis is detected as the acceleration applied to the detecting portion of the acceleration sensor. The acceleration sensor 37 is, for example, a capacitive MEMS (Micro Electro Mechanical System) type acceleration sensor, but other types of acceleration sensors can also be used. In the present embodiment, the acceleration sensor 37 is oriented in the up-down direction (the Y-axis direction shown in FIG. 3), the left-right direction (the X-axis direction shown in FIG. 3), and the front-rear direction (the third direction shown in FIG. 3). The linear acceleration is detected in the three-axis directions of the Z-axis direction shown in Fig. 3, respectively. Since the acceleration sensor 37 detects the acceleration in the linear direction along the respective axes, the output of the acceleration sensor 37 shows the value of the linear acceleration of each of the three axes. That is, the 'acceleration measured by 30 323304 8 201220108' is shown as a 3-dimensional vector on the χγ coordinate system (controller coordinate system) set by the controller 5. The data (force speed data) indicating the acceleration detected by the acceleration sensor 37 is output to the communication unit 36. Since the acceleration detected by the acceleration sensor 37 changes in accordance with the orientation (tilt angle) or action of the controller 5 itself, the game device 3 can use the acquired acceleration data to calculate the orientation or action of the controller 5. In the present embodiment, the game device 3 calculates the posture or the tilt angle of the controller 5 based on the acquired acceleration data. It can be easily understood by the operator from the description of the present specification, based on the slave acceleration sensor 37 ( The signal of the acceleration outputted by the acceleration sensor 63 to be described later is also processed by a processor of the game device 3 (for example, the CPU 10) or a processor of the controller 5 (for example, the microcomputer 42). It is speculated or calculated (determined) about the further information about the controller 5. For example, when the computer side processing is performed on the premise that the controller 5 of the acceleration sensor 37 is in the stationary state, that is, when the acceleration generated by the acceleration sensing has only the gravitational acceleration, the execution is performed. 'When the controller 5 is substantially in a stationary state, it can be known from the detected acceleration whether the posture of the controller 5 is oblique or oblique to the direction of gravity. Specifically, when the state of the offset axis of the acceleration sensor is directly below the vertical direction, whether or not the force is applied to the reference is determined by whether or not the 1G force is applied to the reference. To what extent. In addition, when the acceleration sensor 37 of the ^ is used, the degree of inclination of the controller 5 with respect to the direction of gravity can be further determined by applying the acceleration signal to each axis 323304 31 201220108. . At this time, the processor can calculate the tilt angle of the controller 5 based on the output from the acceleration sensor 37, or calculate the tilt direction of the controller 5 without calculating the tilt angle. Thus, by using the acceleration sensor 37 in combination with the processor, the tilt angle or posture of the controller 5 can be determined. On the other hand, when the controller 5 is in the operating state (the controller 5 is in the moving state), the acceleration sensor 37 detects the acceleration of the action of the controller 5 in addition to the gravitational acceleration. The component of the gravitational acceleration is removed from the detected acceleration by a predetermined process, whereby the direction of operation of the controller 5 can be known. In addition, even when the controller 5 is in the operating state, the component of the acceleration of the motion sensor is removed from the detected acceleration by a predetermined process, thereby knowing that the controller 5 is relative to the controller 5 The slope of the direction of gravity. In other embodiments, the acceleration sensor 37 may further include: an integrated processing device for performing predetermined processing on the acceleration signal before outputting the acceleration signal detected by the built-in acceleration detecting means to the microcomputer 42. Or other kinds of special processing devices. An integrated or dedicated processing device, for example, when used to cause the acceleration sensor 37 to detect a static acceleration (e.g., gravitational acceleration), can convert the acceleration signal to a tilt angle (or other preferred parameter). The swing sensor 48 measures the angular velocity around the three axes (the XYZ axis in this embodiment). In the present specification, the direction of rotation about the X-axis is referred to as the pitch direction of the controller 5, and the direction of rotation about the Y-axis is referred to as yaw (yaw). The direction of rotation about the z-axis is called the roll direction. As long as the gyro sensor 48 can detect the angular velocity around the three axes by detecting 323304 201220108, the number and combination of the gyro sensors used can be arbitrary. For example, the swing sensor 48 can be a 3-axis swivel sensor or a combined 2-axis swivel sensor and a 1-axis swivel sensor to detect angular velocity about the 3 axes. The data showing the angular velocity detected by the swing sensor 48 is output to the communication unit 36. In addition, the swing sensor 48 can also detect angular velocities about 1 or 2 axes. The communication unit 36 includes a microcomputer 42, a memory 43, a wireless module 44, and an antenna 45. The microcomputer 42 controls the wireless mode module 44 so as to wirelessly transmit the data acquired by the microcomputer 42 to the game device 3 while using the memory unit 43 as a memory area during processing. The data output from the operation unit 32, the imaging information computing unit 35, the acceleration sensor 37, and the gyro sensor 48 to the microcomputer 42 is temporarily stored in the memory 43. These data are transmitted to the game device 3 as operation data (controller operation data). That is, the microcomputer 42 outputs the operation data stored in the memory 43 to the wireless mode module 44 when the transmission timing of the controller communication module 19 of the game device 3 comes. The wireless mode module 44, for example, uses Bluetooth (registered trademark) technology to modulate a transmission wave of a predetermined frequency with an operation data, and broadcasts the weak electric wave signal from the antenna 45. That is, the operational data is modulated into a weak electric wave signal by the wireless module 44 and transmitted from the controller 5. The weak electric wave signal is received by the controller communication module 19 on the side of the game device 3. The game device 3 can acquire the operation data by demodulating or decoding the received weak wave signal. In addition, the CPU 10 of the game device 3 uses the operation 33 323304 201220108 === obtained from the controller 5: the second communication Zou 36 to the controller communication module 19 processes the same as the predetermined cycle of the mother-in-law. The game is better to transmit ^M 1/6G seconds as a unit (1 frame time) to perform 'so the system sounds. Control unit (4) 5 communication unit 36 set 3 controller communication module under ^ ratio 'to operate the operation (4) out to the game equipment data such as the operation of the accelerometer operation ^ ΓΓ display the machine operation data as ', game device 3 series use the above

Week (4) is to perform the game processing I on the controller 5, the user is in addition to pressing, so the user can use the play operation, but also the mobile controller, 'the past-like tour control exercise (4) 5 Tilting for any position. For example, :::r (four) one, move: 3⁄4 display means. [4. Configuration of Terminal Device 7] Next, with reference to Figs. 8 to 10, t is shown in Fig. 8 showing the structure of the outer device _, 1 = respect 7 of the terminal device 7. (4) is a front view of the terminal device 7, (8) ^ Fig. 18 is a view, and (4) is a bottom view. Further, j_, (c) are diagrams showing the appearance of the final device 7. The system is provided with a user's grip. 34 323304 201220108 As shown in Fig. 8, the terminal device 7 is provided with a cover 50 having a square plate shape which is long in the horizontal direction. Since the outer cover 50 is of a size that can be gripped by the user, the user can hold the terminal device 7 by hand to move 'or change the arrangement position of the terminal device 7. The terminal device 7 has an LCD 51 on the surface of the cover 50. ixD 51 # is placed near the center of the surface of the outer cover 50. Therefore, as shown in Fig. 9, by holding the cover 50 on both sides of the LCD 51, the terminal device can be moved while viewing the side of the Lcd. In Fig. 9, the example in which the outer cover 50 is held by the one of the left and right sides of the LCD 51, and the terminal device 7 is held in the longitudinal direction by the lateral grip, but the vertical position can be grasped. The type (longitudinal orientation) holds the terminal device 7. As shown in (a) of Fig. 8, the terminal device 7 has a touch panel 52 as an operation means on the face of the LCD 51. In the present embodiment, the touch panel 52 is a resistive touch panel. However, the touch panel is not limited to the resistive film method, and for example, a touch panel of any type such as a capacitive method can be used. In addition, the touch panel 52 can be a single touch method or a multi-touch method. In the present embodiment, the touch panel 52 is applied to the same resolution (detection accuracy) as the resolution of the LCD 51. However, the resolution of the touch panel 52 does not have to be consistent with the resolution of the LCD 51. The input to the touch panel 52 is usually performed by a stylus, but it is not limited to the stylus, and can also be a user's finger. Input is made to the touch panel 52. The hood 5 is provided with a stylus for accommodating the touch panel 52: a accommodating hole. Thus, since the terminal device 7 has the touch panel 52, the user can operate the touch panel 52 while moving the terminal device 7. That is, using 323304 35 201220108, the screen can be directly input (by the touch panel 52) while moving the side of the LCD 51. As shown in Fig. 8, the terminal device 7 is provided with two analog rockers 53A and 53B and a plurality of operation keys 54A to 54L as operating means. The various types of rockers 53A and 53B are means for indicating the direction. The various types of rocker bars 53A and 53B' are configured such that the rocker portion operated by the user's finger can slide or tilt in any direction (any angle of up, down, left, right, and oblique directions) with respect to the surface of the outer cover 50. Further, the left analog stick 53A and the right analog stick 53B are respectively disposed on the left and right sides of the LCD 51 screen. Therefore, the user can use the analog joystick to enter the direction of the indication by either the left and right hands. Further, as shown in Fig. 9, the various types of rocker levers 53A and 53B are disposed at positions where the user can operate in the state where the left and right portions of the terminal device 7 are held, so that 'even if the user holds the terminal device 7 When moving, it is also easy to operate various types of joysticks 53A and 53B. Each of the operation keys 54A to 54L is an operation means for performing a predetermined input. As will be described below, each of the operation keys 54A to 54L is provided at a position where the user can operate while holding the left and right portions of the terminal device 7 (refer to Fig. 9). Therefore, even when the user holds the terminal device 7 to move, the operation means can be easily operated. As shown in Fig. 8(a), on the surface of the outer cover 50, a cross key among the operation keys 54A to 54L is provided. The input key 54A and the keys 54B to 54H are input. That is, the keys 54A to 54H are disposed at positions where the user's thumb can operate (refer to Fig. 9). The cross key 54A is disposed on the left side of the LCD 51 and is the lower side of the left analog stick 323304 8 36 201220108 53A. That is, the 'cross key 54A' is disposed at a position where the user's left hand can operate. The cross key 54A has a cross shape and is a key that can indicate the directions of up, down, left, and right. Further, keys 54B to 54D are provided on the lower side of the LCD 51. These three keys 54B to 54D are disposed at positions where the left and right hands can operate. Further, the 'four keys 54E to 54H' are disposed on the right side of the LCD 51 and are the lower side of the right analog rocker 53B. That is, the four keys 54E to 54H are disposed at positions where the user's right hand can operate. Further, the four keys 54E to 54H are arranged such that they are in a positional relationship of up, down, left, and right (with respect to the center positions of the four keys 54E to 54H). Therefore, the terminal device 7 can have the four keys 54E to 54H having a function for indicating the up, down, left and right directions to the user's keys. Further, as shown in Fig. 8(a), Fig. and Fig. 8, the first L key 541 and the first R key 54J are provided at obliquely upper portions (upper left portion and upper right portion) of the outer cover 5''. Specifically, the first L-key 541 is provided on the left side end of the upper side of the plate-shaped outer cover 50, and is exposed from the upper side and the left side. Further, the first R key 54J is provided on the right side end of the upper side of the outer cover 5A, and is exposed from the upper side and the right side surface. Thus, the first L^541 is placed at a position where the user's left index finger can be operated, and the first R key 54J is placed at a position where the user's right index finger can be operated (see Fig. 9). Further, as shown in Fig. 8 (b) and (c), the second L key 54K and the second R key 54L' are disposed on the surface of the back surface of the plate-like outer cover 5 (i.e., the lCE is provided) 51. On the opposite side, the prosthetic portions 59A and 59B are provided. ... body. The first key 54K is disposed slightly above the left side of the back cover 50 (the left side when viewed from the front side), and the first key 54L is disposed on the right side of the back cover of the cover 37 323304 201220108 50 (right when viewed from the front side) A little above the side). In other words, the 2nd L key 54K is disposed at a position substantially opposite to the left analog rocker 53A provided on the surface. The 2nd R key 54L is disposed at a position substantially opposite to the right analog rocker 53B provided on the surface. Thus, the first hole key 54K is disposed at a position where the user's left middle finger can be operated, and the second R key 54L is disposed at a position where the user's right middle finger can be operated (refer to Fig. 9). Further, as shown in Fig. 8(c), the second L key 54K and the second R key 54L' are provided on the obliquely upward faces of the leg portions 59A and 59B, and have buttons that are obliquely upward. surface. Since the middle finger is supposed to move in the up and down direction when the user holds the terminal device 7, the user can easily press the second L key 54K and the first search key 54L by pressing the button face upward. Further, by providing the foot portion on the back surface of the outer cover 50, the user can easily hold the outer cover 50, and by providing a key at the foot, it is easy to operate under the grip of the outer cover 5. In the terminal device 7 shown in FIG. 8, when the second L-key 54A and the second R-key 54L are provided on the back surface, when the terminal device 7 is downloaded with the top surface of the LCD 51 (the surface of the cover 50) facing upward, Sometimes the face is not completely level. Therefore, in other embodiments, three or more feet may be provided on the back surface of the outer cover 5A. According to this, the foot can be placed on the ground while the face of the LCD 51 is facing upward, and the foot can be placed horizontally on the terminal device 7. Further, the terminal device 7 can be placed horizontally by adding a detachable foot. Each of the operation keys 54A to 54L is appropriately assigned a function corresponding to the game program. For example, the 'cross key 54A and the keys 54E to 54H can be used to cancel the operation or the like in the direction finger 323304 8 201220108. Each of the keys 5 sen is available for decision operation or although not shown, but the terminal device 7 has a power button for guiding the power of the device 7. In addition, the terminal device widely turns on/off the key of the LCD display of the LCD 51, or the button for setting the connection (pairing) of the disk, and the adjustment speaker (the speaker 67 of the U-shaped figure) Volume button. As shown in Fig. 8(a), the terminal device 7 is provided with a marker portion (the first indication portion 55) including the marker 55A and the marker on the surface of the cover 5''. The indicator portion 55 is provided on the upper side of the curry. Each of the marker 55A and the marker 55B' is the same as each of the markers 6r and 6L of the indicator device 6, and is composed of the upper or lower infrared LEDs. The indicator unit 相同 is used in the same manner as the above-described indicator device 6, and is used to calculate the operation of the controller 5 and the like. Further, the game device 3 can control the lighting of the respective infrared LEDs provided in the indicator portion J. The terminal device 7 is provided with a camera 56 as a photographing means. Photograph; machine. The 56 series includes a photographic element having a predetermined resolution (for example, an image detector or a CCD image sensor, etc.) and a lens. As shown in the § diagram, in the form, the camera 56 is disposed on the surface of the outer cover 50. Therefore, the photographing and % can photograph the face of the user holding the terminal device 7, and the user can take a picture while watching the LCD 51 while playing the game. The terminal device 7' is provided with a microphone 69) as a microphone input means. A 6Q ° microphone 69 is disposed on the surface of the outer cover 5〇 in the outer hole 60 for the cover 39 323304 201220108. The microphone detects the sound of the user and the like, and the sound around the terminal device 7. The terminal device 7 includes a speaker as a sound output means (a speaker 67 shown in Fig. 10). As shown in FIG. 8(d), a speaker hole 57 is provided on the lower side surface of the outer cover 50. The output sound of the speaker 67 is output from the speaker hole 57. In the present embodiment, the terminal device 7 has two speakers, and speaker holes 57 are provided at respective positions of the left speaker and the right speaker. Further, the terminal device 7 is provided with an expansion connector 58 for connecting another device to the terminal device 7. In the present embodiment, as shown in Fig. 8(d), the expansion connector 58 is provided on the lower side surface of the outer cover 50. The other device connected to the expansion connector 58 may be any device such as a controller (gun type controller or the like) used in a specific game or an input device such as a keyboard. If there is no need to connect other devices, the expansion connector 58 may not be provided. Regarding the terminal device 7 shown in Fig. 8, the shape of each of the operation keys or the cover 50, the number of each component, the installation position, and the like are merely examples, and may be other shapes, numbers, and installation positions. Next, the internal configuration of the terminal device 7 will be described with reference to Fig. 10. Fig. 10 is a block diagram showing the internal configuration of the terminal device 7. As shown in Figure 10Λ. Terminal device 7 in addition to the first. 8 is also provided with: a touch panel controller 61, a magnetic sensor 62, an acceleration sensor 63, a gyro sensor 64, a user interface controller (UI controller) 65, Decoder LSI 66, speaker 67, sound 1C 68, microphone 69, wireless mode module 40 323304 8 201220108 group 70, antenna 71, infrared communication module 72, flash memory, power supply 1C 74, and battery 75. The electronic component is mounted on the electronic circuit board and housed in the housing 50. The UI controller 65' is a circuit for inputting and outputting control data to various wheel input units. The controller 65 is connected to the touch panel. The controller, the analog rocker 53 (analog rocker 53A and 53B), the operation key 54 (each operation key 54A to 54L), the indicator portion 55, the magnetic sensor 62, the acceleration sensor 63, and the rotation sensor 64 Further, the controller 65 is connected to the codec LSI 66 and the expansion connector 58. Further, the power source IC '74 is connected to the UI controller 65, and supplies power to each unit via the UI controller 65. Built-in The battery 75 is connected to the power source Ic 74 and supplied with electric power. A charger 76 that receives electric power from an external power source via a connector or the like is connected to the power source 1C 74, and the terminal device 7 can perform charging when the charger 76 or the cable is used to supply electric power from an external power source. The terminal device 7 is also The charging can be performed by attaching the terminal device 7 to a charging device having a charging peach (not shown). The touch panel controller 61 is connected to the touch panel and is a circuit for controlling the touch panel 52. The touch panel The controller 61 generates a predetermined form of touch position data according to the signal from the touch panel 52 and outputs the touch position data to the UI controller 65. The touch position data is displayed on the input surface of the touch panel 52. The position of the rear position. The touch panel controller 61 is configured to take the signal from the touch panel 52 and generate the touch position data at a ratio of i times every predetermined time. Further, the miscellaneous panel 52 is performed. The various control indications are output from the (four) controller 65 to the touch panel controller 323304 201220108 61 〇 analog rocker 5 3 ' will display the direction in which the user's finger rocker slides (or dumps) and |The missing (4) P gate and the amount of the rocker data are output to the υτ controller 65. In addition, the operation key 54 is the operation of the input state (whether or not) for each of the two keys. The key data is rotated out to the magnetic sensor 62' by detecting the magnitude and orientation of the magnetic field. The orientation data showing the prepared orientation is output to the heart. In addition, the control indication to the magnetic sensor 62 is The controller 65 outputs to the magnetic sensor 62. With respect to the magnetic sensor 62 I, an MI (magnetic impedance) element, a magnetic flux sensor, a Hall element = (major magnetoresistive) element, TMR (tunneling magnetic) are used. A sensor such as a resistor or a 3 MR (external magnetoresistive) component, but as long as it can be detected: It can be used. Strictly speaking, the position data of the sentence in the place where the magnetic field is generated other than geomagnetism does not show the orientation, but even in this case, the orientation data changes when the terminal is shaken 7 , so the paper can be calculated; The posture of 7 changes.嗔 The acceleration sensor 63 is placed inside the outer cover 50, and the detection j is out of the straight line in the direction of the three axes (the xyz axis shown in the figure (a) of Fig. 8). Specifically, the acceleration sensor 63 is in the longitudinal direction of the outer cover 50. For the X-axis, the short-side direction of the outer cover 5 is the y-axis, and the direction perpendicular to the surface of the outer cover is the ζ axis to detect the value of the linear acceleration of each axis. ^ The acceleration data of the detected acceleration is displayed. It is output to UI control 65. In addition, a control indication made by the acceleration sensor 63 is outputted to the acceleration sensor 63 by the 42^233〇4 201220108 UI controller 65. In the present embodiment, the acceleration sensor 63 is, for example, a capacitive MEMS type acceleration sensor. However, in other embodiments, other types of acceleration sensors may be used. In addition, the acceleration sensor 63 can also be an acceleration sensor that detects a 1-axis or 2-axis direction. The gyro sensor 64 is disposed inside the outer cover 50, and measures the angular velocity of the three axes around the X-axis, the y-axis, and the z-axis. The angular velocity data showing the detected angular velocity is output to the UI controller 65. Further, a control instruction to the swing sensor 64 is output from the UI controller 65 to the swing sensor 64. The number and combination of the slewing sensors for detecting the angular velocities of the three axes may be arbitrary, and the gyro sensor 64 is the same as the gyro sensor 48, and may be a 2-axis gyro sensor and a 1-axis gyro sensor. Composition. In addition, the gyro sensor 64 can also measure the 1-way or 2-axis direction of the slewing reducer UI controller 65, which includes the touch position data, the joystick data, and the operation received from the above components. The operation data of the key data, the orientation data, the acceleration data, and the angular velocity data are output to the codec LSI 66: When the other device and the terminal device are connected via the expansion connector 58? When connected, the above operation data may further include a codec LSI 66 that displays operations performed on the other devices to perform piezoelectric processing on the data transmitted to the game device 3: and decompress the data transmitted from the game device 3. 56 56#, 1 (: 68, wireless mode module 7 (), flashing external line communication module 72. In addition, the lying lsi 66 package and 323304 43 201220108 internal memory 78 are programmed. The terminal device 7 is configured not to perform The game process itself, but must execute the minimum level of management or communication for the terminal device 7. When the power is turned on, the program stored in the flash memory 73 is read to the internal memory 78 and executed by the CPU 77. In this case, the terminal device 7 is activated. Further, a part of the internal memory 78 is used as the VRAM of the LCD 51. The camera 56 photographs the image in accordance with an instruction from the game device 3, and outputs the image data after the shooting to the image. The codec LSI 66. The control instruction for the camera 56, such as an image shooting instruction, is output from the codec LSI 66 to the camera 56. The camera 56 can also be operated. That is, the camera 56 can perform repeated photography and repeatedly output image data to the codec LSI 66. The sound 1C 68 is connected to the speaker 67 and the microphone 69, and is used to control the sound data of the speaker 67 and the microphone 69. The circuit for outputting input, that is, when receiving sound data from the codec LSI 66, the sound 1C 68 outputs an audio signal obtained by D/A conversion of the sound data to the speaker 67, and outputs sound from the speaker 67. Further, the microphone 69 detects the sound transmitted to the terminal device 7 (the user's voice or the like), and outputs the sound data indicating the sound to the sound 1C 68. The sound 1C 68 performs A/D on the sound signal from the microphone 69. Converting and outputting the sound data of a predetermined form to the codec LSI 65.  The codec LSI 66 transmits image data from the camera 56, sound data from the microphone 69, and operation data from the UI controller 65 as terminal operation data to the game via the wireless module 70. 323304 8 201220108 Device 3. In the present embodiment, the codec LSI 66 performs the same compression processing on the image data and the sound data as the codec LSI 2. The terminal operation data and the compressed image data and sound data are output to the wireless mode module 70 as transmission data. An antenna 71 is connected to the wireless module 7A, and the wireless module 70 transmits the transmission data to the game device 3 via the antenna 71. The wireless mode module 70 has the same function as the terminal communication module 28 of the gaming device 3. That is, the wireless mode module 7 has, for example, by IEEE 802.  The function of the LLn specification to connect to the wireless LAN. The information transmitted may be browned or not encoded as necessary. As described above, the clothes that are sent to the game device 3 contain operation data (terminal operation data), image data, and sound data. When the other device is connected to the terminal I via the expansion connector 58, the above-mentioned transmission data may further include (d) the secondary material received by the other device. In addition, the infrared communication module 72 performs infrared communication with other devices, for example, following the leg specifications. Codec Further example It is necessary to transmit the value of the packet 6 received via infrared communication to the game device 3. Further, as described above, the compressed image game device 3 is transferred to the terminal device 7 as described above. These data ^^ > are encoded and decoded from the line mode module 70! uI66.  Line 7丨 and no image data and sound to be received;: Pressure: The material is output to LCD5! 'And the sound data after the LCD51 is shrunk is output to the sound map ^ In addition, 'Xie Zhuo' ic 68 from Yang t 323304 45 201220108 Sounder 67 outputs sound. Further, 'when the control data is included in the data received from the game device 3', the codec LSI 66 and the UI controller 65 control the respective units to follow the control data. As described above, the control data indicates that the terminal device 7 is displayed. The information of each of the components (in the present embodiment, the camera 56, the touch panel controller 61, the indicator unit 55, the sensors 62 to 64, and the red 72) is controlled. In the control instruction shown in the second embodiment, it is presumed that the above-described respective components are operated or the operation is stopped (i is not used in the stop-motion; the main is not the same. The power consumption can be stopped, and the data is transmitted to the game device 3 without transmission.  Information on the components of the rest. Since the indicator portion 55 is , . The line LED, so this control can be set only to turn on/off the power supply. As described above, the terminal device 7 includes the operation means of the touch panel 52, the analog rocker 53, and the operation key 54, but in other embodiments, it may be configured to provide other secrets to reduce the skew or " Have the same means of operation. Further, the terminal device 7 includes a magnetic sensor 62, an acceleration sensor 63, and a rotation sensor $64 as calculations for calculating the operation (including position or posture or position or posture change) of the terminal device 7. Sensor, but in other embodiments, - can. It is configured to include only one of these sensors +. Further, in the embodiment, the sensor may be provided with other sensors instead of or in combination with the sensors. Further, the terminating device 7 is provided with a camera 56 and a microphone 69, and is configured as 46 323304 8 201220108. However, in other embodiments, the camera 56 and the microphone 6 may not be provided or only one of them may be provided. Further, the terminal device 7 includes a marker 55 as a configuration for calculating the positional relationship between the terminal device 7 and the controller 5 (the position and/or posture of the terminal device 7 when viewed from the controller 5), but other embodiments In addition, the indicator 55 may not be provided. Further, in another embodiment, the terminal device 7 may include other means as a configuration for calculating the positional relationship. For example, in another embodiment, the controller 5 may be provided with an indicator portion and the terminal device 7 may be provided with an imaging element. Further, at this time, the indicator device 6 may be provided with a photographic element instead of the infrared LED. [5. Game Processing] Next, the details of the game processing executed in the game system will be described. First, various materials used in game processing will be described. Figure 11 shows a diagram of the various materials used in game processing. In Fig. 11, a diagram showing main data stored in the main memory (external main memory 12 or internal main memory lie) of the game device 3 is shown. As shown in Fig. 11, in the main memory of the game device 3, the game program 90, the received data 91, and the processing material 106 are stored. In addition to the information shown in Fig. 11, the main memory stores the information required for the game data such as the image data of various objects appearing in the game or the sound data used in the game. The game program 90 reads all or a portion of the game device 3 from the optical disc 4 and stores it in the main memory at an appropriate timing after the game device 3 is powered on. The game program 90 can also be retrieved from the flash memory 17 or an external device of the game device 3 (e.g., via the Internet) in place of the 47 323304 201220108 mode read from the disc 4. In addition, one part of the game program 90 is included (the routine is used to calculate the posture of the controller 5 and/or the terminal device 7 in the game device 3. The data 91 can be received in advance, and the slave controller 5 and The various materials received by the terminal device 7. The received data 91 includes: controller operation data q operation data 97, camera image data 104, and microphone sound data 105. When a plurality of controllers 5 are connected, the controller operates the data. θ , , there are multiple. When there are multiple terminals, the terminal operation: 97, camera image data 1〇4, and microphone sound data 1〇5, ', several. There are also complex controller operation data 92 In order to display the data of the operation performed by the user (the player) on the controller 5. The controller operation data 9 is transmitted from the controller 5 and acquired in the game m, and is memorized in the main memory. The controller operation data 92 includes: the first operation key data 93, the jth acceleration data 94, the i-th angular velocity data 95, and the marker coordinate data/remembered body towel' can be recorded from the latest (money acquisition) _ controller The data operation key 93 is used to display the data of the input state set to the controller 5: his to 321. Specifically, the i-th strike key data 93 displays the respective operations a32a to 32i. Whether it is pressed or not. The acceleration sense of the detector is the three-dimensional acceleration of each of the knives in the axial direction. However, in other embodiments, 323304 48 201220108, the acceleration can be displayed in any one direction or more. The first angular velocity data 95 is data showing the angular velocity detected by the rotation sensor 48 of the controller 5. Here, the first angular velocity data 95 shows the XYZ shown in FIG. The angular velocity in the three-axis direction, but in other embodiments, the angular velocity may be displayed around any of the 丨 axes. The erector 96 is displayed by the photographic information computing unit 35 = The coordinate calculated by the image processing circuit 41, that is, the information of the marker coordinates. The marker coordinates are represented by a 2-dimensional coordinate system for displaying the position on the plane corresponding to the photographic image, and the marker coordinate data is displayed. (10) shows the 2-dimensional coordinate system The controller operation data 92 can be displayed as long as the operator of the user operating the controller 5 can be displayed, or only one of the above-mentioned materials 93 to 96 can be included, and when the controller 5 has other When the input means (for example, the touch panel, the controller operation data 92 may also include (4) indicating that the means is performed. If the present embodiment is used in the game operation, the dry data 94, the first sth speed data 95 And the standard change can be included in response to the action of the controller 5 itself: = the data 97 is displayed to indicate that the user is on the terminal device 7 (6) is working on the data 97 is from the terminal device purchase 97 Passing 'and being remembered by the main memory. Terminal operation 1 323304 49 201220108 Funding # 100, 2nd acceleration data 1 (H, 2nd angular velocity data 1〇2, and orientation data. In the main memory, you can recall from the latest (final) The number of terminal operation data. The second operation key data 98 is for displaying information on the operation keys 54A to 54L that are set in the terminal device 7. Specifically, the operation key data 98 displays the operation keys 54A to 54L. Whether the rocker data 99 is used to display the direction and amount of sliding (or dumping) of the rocker portion of the analog rocker 53 (analog analog rocker analog rocker 53B), the above direction and amount, for example, The touch position data 100 is data for displaying the position (touch position) input on the wheel entry surface of the touch panel 52. In the embodiment, the touch position data 100 is displayed. The coordinate value of the 2-dimensional coordinate system for displaying the position on the input surface is displayed. When the touch panel 52 is in the multi-touch mode, the touch position data 1 〇〇 also displays a plurality of touch positions. The second acceleration data 101 is shown to be added by The data of the acceleration (acceleration vector) detected by the sensor 63. In the present embodiment, the second acceleration data 1〇1 shows that the accelerations in the three directions of the xyz shown in Fig. 8 are The three-dimensional acceleration of the component, but in other embodiments, the acceleration can be displayed in any one or more directions. The second angular velocity data 1 〇 2 is displayed by the rotation sensor 64. Data of angular velocity. In the present embodiment, the second angular velocity data i 〇 2 shows the angular velocities of the three axes around xyz shown in Fig. 8, but in other embodiments, it is possible to display any yaw axis around The above angular ambiguity is 0 50 323304 201220108. The orientation data 103 is data showing the orientation detected by the magnetic sensor 62. In the present embodiment, the orientation data 103 is displayed based on the terminal device 7. The orientation of the predetermined orientation (for example, the north). However, in the place where the magnetic field other than the geomagnetism is generated, the orientation data 103 does not strictly indicate the absolute orientation (north, etc.), but shows the terminal device 7 relative to the location. Since the direction of the magnetic field is opposite to each other, the posture change of the terminal device 7 can be calculated in this case. The terminal operation data 97 can be displayed only as long as the operator of the user operating the terminal device 7 can be displayed. Any one of the data 98 to 103. Further, when the terminal device 7 has other input means (for example, a touch pad or a photographing means of the controller 5, etc.), the terminal operation data 97 may also include the other input means. In the present embodiment, when the operation of the terminal device 7 itself is used in a game operation, the terminal operation data 97, such as the second acceleration data 101, the second angular velocity data 102, or the orientation data 103, may include The information of the value is changed by the action of the terminal device 7 itself. The camera image data 104 is data for displaying an image (camera image) captured by the camera 56 of the terminal device 7. The camera image data 104 is an image data obtained by decompressing the compressed image data from the terminal device 7 by the codec LSI 27, and is stored in the main memory by the output/output processor 11a. In the main memory, a predetermined number of camera image data can be memorized in order from the latest (final acquired). The microphone sound data 105 is data for displaying the sound (microphone sound) detected by the microphone 69 of the terminal device 7. The microphone sound is 51, which is the sound data decompressed from the compressed sound data transmitted from the terminal device 7 by the codec LSI 27, and is memorized in the main memory by the output input processor 11a. The processing material 106 is the material used in the game processing (Fig. 12) to be described later. The processing data 106 includes control data 107, controller posture data 108, terminal posture data 109, image recognition data 110, and sound recognition data 111. In addition to the data shown in Fig. 11, the processing material 106 also includes various materials used in the game which display information on various parameters set in various objects appearing in the game. The control data 107 is information for displaying a control instruction to the constituent elements included in the terminal device 7. The control data 107 displays, for example, an instruction to light the control indicator unit 55, or an instruction to control the shooting of the camera 56, and the like. The control data 107 is transmitted to the terminal device 7 at an appropriate timing. The controller posture data 108 is a material showing the posture of the controller 5. In the present embodiment, the controller posture data 108 is calculated based on the first acceleration data 94, the first angular velocity data 95, and the marker coordinate data 96 included in the controller operation data 92. The method of calculating the controller posture data 108 will be described in step S23. The terminal posture data 109 is a material for displaying the posture of the terminal device 7. In this embodiment. ,end. The end posture data 109 is calculated based on the second acceleration data 101, the second angular velocity data 102, and the orientation data 103 included in the terminal operation data 97. The method of calculating the terminal posture data 109 will be described in step S24. 52 323304 8 201220108 The image identification data 110 is for the result of the predetermined image recognition process, and the camera image is detected to detect a certain thin material from the camera image. The image recognition process can be arbitrarily processed, for example, the face or the mark of the user can be taken from the photographing feature and the result can be rotated, and the predetermined object can be calculated in the image (for example, the reason). The sound identification data 111 of the information related to the object is taken as the result of the predetermined sound touch processing for the ethnic group. 7 The sound of the upper secret wind is detected by the microphone sound, and only a random sound processing is performed, for example, _ ::=== The processing of the output volume. The processing of the magic one or only the reference to Fig. 12 illustrates the sacred content of the game played in the face device 3. The twelfth figure shows the game device 3 The main flowchart of the flow of the executed game processing. When the power of the game device 3 is turned on, the CPU H) of the game setting 3 executes the main memory, etc., which is stored in the boot program (not shown). The initial ^ of each unit then reads the game program stored in the disc 4 to the main memory, and starts executing the game program by cpu 1〇. In the game device 3, the game program stored in the disc 4 can be executed immediately after the power is turned on, or the built-in program for displaying the predetermined menu screen is first executed after the power is turned on, and then the user is instructed to indicate the start of the game. Then execute the game program stored on CD 4. The flowchart shown in Fig. 12 is a flowchart of the processing performed after the above processing is completed. The processing of each step of the flowchart shown in Fig. 12 is only an example, and as long as 53 323304 201220108 can obtain the same result, the processing order of each step can be replaced. In addition, the variable value or the threshold used in the judgment step is only an example, and other values may be used as necessary. Further, in the present embodiment, the processing of each step of the above-described flowchart is executed by the CPU 10. However, the processing of some of the above steps may be performed by a processor or a dedicated circuit other than the CPU 10. First, in step S1, the CPU 10 performs initial processing. The initial processing, for example, is to construct a virtual game space, and to arrange the items that appear in the game space at the initial position, or to set the initial values of various parameters used in the game processing. Further, in the present embodiment, in the initial processing, the CPU 10 controls the lighting of the pointing device 6 and the indicator portion 55 in accordance with the type of the game program. Here, the game system 1 has both the pointing device 6 and the indicator portion 55 of the terminal device 7 as the imaging target of the imaging means (photographing information computing unit 35) of the controller 5. Either or both of the display device 6 and the indicator portion 55 are used depending on the game content (game program type). The game program 90 includes information indicating whether or not the pointing device 6 and the indicator portion 55 are turned on. The CPU 10 reads the data and judges whether or not the lighting is to be performed. When the marking device 6 and/or the indicator portion 55 are turned on, the following processing is performed. That is, when the indicator device 6 is turned on, the CPU 10 transmits a control_signal for each winter infrared LEP lighting provided in the indicator device 6 to the indicator device 6. The transmission of the control signal can be a power supply only. In response to this, each of the infrared LEDs of the marking device 6 is lit. On the other hand, when the indicator portion 55 is turned on, the CPU 10 generates a control 54 323304 8 201220108 data indicating that the indicator portion 55 is turned on, and is stored in the main memory. The generated control data is transmitted to the terminal device 7 in step S10 which will be described later. The control data received by the wireless module 70 of the terminal device 7 is transmitted to the UI controller 65 via the codec LSI 66, and the UI controller 65 performs an instruction to turn on the indicator portion 55. Thereby, the infrared LED of the indicator portion 55 is turned on. In the above description, the marking device 6 and the indicator portion 55 are turned on, and the extinguishing of the indicator device 6 and the indicator portion 55 can be performed by the same processing as when lighting. After the above step S1, the processing of step S2 is performed. Hereinafter, the processing circuit constituted by the series of processes of steps S2 to S11 is repeatedly executed at a ratio of one predetermined time (1 frame time). In step S2, the CPU 10 acquires the controller operation data transmitted from the controller 5. Since the controller 5 repeatedly transmits the controller operation data to the game device 3, in the game device 3, the controller communication module 19 successively receives the controller operation data, and controls the reception by the output input processor 11a. The device operation data is memorized in the main memory. The interval at which the transmission is received is preferably shorter than the processing time of the game, for example, one second of the second. In step S2, the CPU 10 reads the latest controller operation data 92 from the main memory. The process of step S3 is performed after step S2. In step S3, the CPU 10 acquires various kinds of materials transmitted from the terminal device 7. The terminal device 7 repeatedly transmits the terminal operation data, the camera image data, and the microphone sound data to the game device 3, so that the game device 3 sequentially receives the data. In the game device 3, the terminal communication module 28 successively receives the data, and the codec LSI 27 sequentially applies decompression processing to the camera image data and the microphone sound data. In addition, the input processor lla will sequentially store the terminal operation data, the camera image data and the microphone sound data in the main memory. In step S3, the CPU 1 凟 retrieves the latest terminal operation data 9γ from the main § memory. The processing of step S4 is performed after step S3. In step S4, the CPU 10 executes game control processing. The game control process performs processing for moving the objects in the game space in accordance with the game operation of the user, so that the game is processed. In the present embodiment, the user can use the controller 5 and/or the terminal 7 to perform various types of games. The game control processing will be described below with reference to Fig. 13. Figure 13 is a flow chart of the process flow of the control processing material. In the same manner as in Fig. 13, the series of processes are various processes that can be performed when the controller 5 and the terminal device 7 are used as the operation device, but the process of the game 4 is not required to be executed. Or content and only perform a part of the processing. In the game control process, first of all, in the step milk, which one determines whether or not to change (4) privately. As described above, in the present embodiment, at the start of the game processing (step S1), the lighting point f of the control signing device 6 and the indicator portion 55 is executed here, and the amount of the game is 中, (4) the amount is in the middle of the game. The case where the object to be used (lighting) is used in the marking device 6 and the indicator portion 55 is changed. In addition, due to the difference between the play and the play (10), although the use of the mark is considered. Set. 6 and the indication part 55 both feelings jγ ^ .  There are 11 conditions, but when the two lights up, there will be a certain party's "missing debts measured as another."  ^ .  Α Wan’s ignorance is not a doubt. Therefore, in the game, it is better to use only one of the parties to favor the Q91 彳 lighting to switch the lighting. The process of step S21 is to determine whether or not the lighting object needs to be changed in the middle of the game 323304 56 201220108 in consideration of If μ μ % % '. The determination of the above step S21 can be performed, for example, by the following method. That is, the CPU 10 can perform the above determination in accordance with whether or not the game situation (the stage of the game, the operation target, and the like) changes. This is because it is possible to change the operation method between the operation method of operating the controller 5 toward the pointing device 6 and the operation method of operating the controller 5 toward the indicator portion 55, since it is considered that the game situation changes. Further, the CPU 10 can make the above determination based on the posture of the controller 5. That is, the above determination can be made by judging that the controller 5 faces the pointing device 6 or the pointing portion 55. The posture of the controller 5 can be calculated, for example, based on the detection results of the acceleration sensor 37 or the rotation sensor 48 (refer to step S23 described later). Further, the CPU 10 can also perform the above determination by judging whether or not there is a change instruction of the user. When the result of the determination in the above step S21 is affirmative, the processing of step S22 is performed. On the other hand, if the result of the determination in the above step S21 is negative, the processing of step S23 is executed while the processing of step S22 is skipped. In step S22, the CPU 10 controls the lighting of the marking device 6 and the indicator portion 55. That is, the lighting state of the marking device 6 and/or the indicator portion 55 is changed. The specific processing for turning on or off the marking device 6 and/or the indicator portion 55 can be performed in the same manner as in the above step S1. The processing of step S23 is performed after step S22. As described above, according to the present embodiment, by the processing of the above-described step S1, the light emission (lighting) of the pointing device 6 and the indicator portion 55 can be controlled in accordance with the type of the game program, and the processing of the above-described steps S21 and S22 can be performed. The illumination of the marking device 6 and the indicator portion 55 is controlled in response to the game condition (point 57 323304 201220108 lamp). In step S23, 'CPU io 0 calculates the posture of the controller 5. In the present embodiment, the posture of the controller 5 is calculated based on the first acceleration data %, the ι angular velocity data 95, and the standard 4 coordinates (four) 96. The method of calculating the posture of the controller 5 will be described below. First of all, the CPU 1 〇 according to! The posture of the controller 5 is calculated by recalling the i-th angular velocity data 95 of the main memory. The method of calculating the posture of the controller 5 from the angular velocity may be any method: the posture before use: the posture that is owed (the posture calculated in the previous time) and the angle of the current angle (the step in the processing loop of this time) The angular velocity obtained is calculated. Specifically, the CPU 10 calculates the posture by rotating the previous posture by a certain unit time portion by the angular velocity at this time. The posture of the first time is displayed by the control of the master money heart _ posture data (10), and the angular velocity of this time is displayed by the first angular velocity data 95 memorized in the main memory. Therefore, the CPU generates the posture of the controller 5 by reading and controlling the two posture data 108 and the first angle data from the main memory. The data of "posture based on angular velocity" calculated in the above manner is displayed and stored in the main memory. When the posture is calculated from the angular velocity, the initial posture can be determined in advance. That is, when the posture of the controller 5 is calculated from the angular velocity, the Gpu 1Q can first calculate the initial posture of the controller ^. The initial posture of the controller 5 can be calculated from the acceleration data. Alternatively, the player is caused to perform a predetermined operation while the controller 5 is in the predetermined posture, and a specific one of the points at which the predetermined operation is performed is used as the initial posture. When the posture of the controller 5 is calculated as an absolute posture based on a predetermined direction in space, the initial posture 323304 8 58 201220108 potential can be calculated, and when the posture of the controller 5 is calculated as, for example, control at the time when the game starts When the posture of the device 5 is the relative posture of the reference, the initial posture may not be counted. Next, the CPU 10 corrects the posture of the controller 5 calculated by the angular velocity using the first acceleration data 94. Specifically, the CPU 1 first reads the first acceleration data 94 from the main memory, and calculates the posture of the controller 5 based on the first ambiguous data 94. Here, in the state where the controller $ is stationary, the acceleration applied to the controller 5 means that the acceleration is the acceleration. Therefore, in this state, the direction (gravity direction) of the gravitational acceleration can be calculated using the first acceleration data 94 of the acceleration sensor 37 & w, so that the first acceleration data 94 can be calculated based on the first acceleration data 94. The orientation (posture) of the controller 5 in the heavy direction. The data of "posture based on acceleration" calculated in the above manner is displayed and stored in the main memory. When calculating the posture according to the acceleration, the CPU 10 then corrects the posture according to the angular velocity using the posture according to the acceleration. Specifically, the cpui system reads data showing the posture according to the angular velocity and data showing the posture according to the acceleration from the main memory, and corrects the posture according to the angular velocity close to the posture according to the acceleration at a predetermined ratio. . The predetermined ratio may be a predetermined fixed value or may be set in accordance with an acceleration that is not displayed by the i-th acceleration data 94. Further, regarding the posture according to the acceleration, since the posture cannot be calculated for the direction of rotation in which the direction of gravity is the axis, the cpu 1 亦可 may not be corrected for the direction of rotation. In the present embodiment, the data showing the corrected posture obtained as described above is stored in the main memory 0 323304 59 201220108. After the posture according to the angular velocity is corrected as described above, the CPU 10 further uses the marker coordinate data 96. Corrected posture to correct. First, the CPU 10 calculates the posture of the controller 5 based on the marker coordinate data 96 (in accordance with the posture of the indicator holder). The marker coordinate data 96, which shows the position of the H 6R and 6L in the photographic image, can be calculated from these positions in relation to the roll (ro (1) direction (rotation direction around the z axis)) In the photographic image, the posture of the control 45 related to the roll direction can be calculated from the slope of the line connecting the position of the marker 6R and the position of the erector 6L. When the position of the controller 5 relative to the pointing device 6 can be specified (assuming, for example, the controller 5 is located at the timing of the pointing device 6), the direction of the longitudinal deflection can be calculated from the position of the pointing device 6 in the photographic image. The posture of the controller 5 is related. For example, when the position of the photographic number 5: L6R and 6L is moved to the left, it can be determined that the controller 5 is turned to the right (posture) to the right. Thus, the marker can be set: 'Calculating the controller 5 related to the pitch direction and the yaw direction; System 2: ^ mode' can be calculated according to the marker coordinate data 96 to calculate the posture according to the marker coordinates, the CPU 10 then by means of the coordinates Posture to correct the corrected posture potential Perform the corrected posture). That is, (10) 1Q is closer to the posture according to the coordinate of the marker according to the posture of the predetermined U-positive posture, and may be a predetermined mosquito value of 1 except for the correction according to the posture of the target. It is performed in any of the lateral direction, the pitch direction, and the deflection direction, or in two directions. For example, when the marker coordinates data 96 is used for the 323304 8 201220108, the posture can be accurately calculated in the pan direction, so the CPU 10 can correct only the pan direction using the posture according to the marker coordinate data 96. Further, when the pointing device 6 or the indicator portion 55 is not photographed by the photographing element 40 of the controller 5, the posture according to the marker coordinate data 96 cannot be calculated, and therefore the correction processing can be performed without using the marker coordinate data 96 at this time. According to the above, the CPU 10 corrects the posture of the controller 5 calculated based on the first angular velocity data 95 by using the first acceleration data 94 and the marker coordinate data 96. Here, in the method of calculating the posture of the controller 5, in the method of using the angular velocity, the posture can be calculated regardless of how the controller 5 operates. On the other hand, in the method of using the angular velocity, since the posture is calculated by the angular velocity detected by the cumulative addition, the accuracy is deteriorated due to the accumulation of errors or the like, or the rotary sensor is caused by the so-called temperature drift problem. The doubt that the accuracy is deteriorating. Further, in the method of using the acceleration, the error is not accumulated, but in the state in which the controller 5 is in a state of intense operation, the posture cannot be accurately calculated (the direction of gravity cannot be accurately detected). Further, in the method using the marker coordinates, the posture can be accurately calculated (especially in the pan direction), but the posture cannot be calculated when the indicator portion 55 cannot be photographed. On the other hand, according to the present embodiment, since the three methods of different characteristics are used as described above, the posture of the controller 5 can be accurately calculated. In other embodiments, the posture may be calculated using either or both of the above three methods. Further, when the lighting control of the indicator is performed in the processing of the above step S1 or step S22, the CPU 10 preferably calculates the posture of the controller 5 using at least the marker coordinates. 61 323304 201220108 After the above step S23, the treatment of the η rpii iii in the vanadium vanadium step S24 is carried out. In step S24, it is taken: the posture of the device 7. That is, since the terminal operation data 1〇1 - 〇 + 97 taken from the terminal device 7 includes the second acceleration data m Q2, * azimuth _, the cPU 1 〇 can be based on the material

The amount of change in the posture per unit time of the terminal device 7 can be known by the second angular velocity data 1 〇 L隹1U pe. 〇2. Further, in the case where the terminal device 7 is almost downward, the acceleration applied to the terminal 7 indicates that the acceleration is 'relevant', so that it can be known by the second 铋, * λ: the second knives and the knives. The direction of gravity applied to the terminal device 7 (i.e., the terminal device posture based on the direction of gravity). In addition, the predetermined orientation of the secret device (ie, the terminal device and the posture based on the predetermined orientation) can be known by the orientation data 1Q3. Even when the ferromagnetic phase magnetic field is produced, the amount of rotation of the final creep can be known. Therefore, the CPU 10 can calculate the posture of the terminal device 7 based on the second acceleration data ^the second angular velocity data 1G2 and the orientation data 1Q3. In the present embodiment, the posture of the terminal device 7 is calculated based on the above three types of data. However, in another embodiment, the posture may be calculated using either or both of the above 3' types of data. The specific calculation method of the posture of the terminal device 7 may be any method. For example, the second acceleration data ιοί and the orientation data 1〇3 may be used to correct the posture calculated based on the angular velocity displayed by the second angular velocity data 丨(10). The method. Specifically, the CPU 10 first calculates the posture of the terminal device 7 based on the second angular velocity data 1〇2. The method of calculating the posture based on the angular velocity can be the same as the method in the above step S23. Then, cpu 1 〇 is in the timing of 323304 62 201220108 (for example, when the terminal device 7 is close to the stationary state), the posture calculated based on the second acceleration data 101 and/or the posture calculated from the orientation data 103, To correct the posture calculated from the angular velocity. The method of correcting the posture according to the angular velocity in accordance with the posture of the acceleration can be performed in the same manner as the above-described calculation of the posture of the controller 5. Further, when the posture according to the angular velocity is corrected in accordance with the posture of the orientation data, the CPU 1 can correct the posture according to the angular velocity close to the posture according to the orientation information at a predetermined ratio. Based on the above, the posture of the terminal device 7 can be accurately calculated. Since the controller 5 is provided with the photographic information operation unit 35 as an infrared ray detecting means, the game device 3 can acquire the marker coordinate data 96. Therefore, regarding the controller 5', the game device 3 can know the absolute posture in the real space from the marker coordinate data 96 (in the coordinate system set in the real space, the posture of the thief 5 is controlled). On the other hand, the terminal device 7 does not have, for example, a camera information. Infrared detection means such as 卩35. Therefore, the game device has learned from the second acceleration data 1〇1 and the second angular velocity data 1〇2 that the absolute posture in the real space is known in the direction of rotation about the axis of the Caesar knife. Therefore, in the present embodiment, the terminal device 7 is configured to include the magnetic sensor ^Z' to cause the game device 3 to acquire the orientation data 103. According to this, in the game _ stomach and summer 3, the absolute direction in the real space can be calculated from the azimuth; 1 〇 3 for the direction of rotation with the direction of gravity as the axis, and the posture of the terminal 7 can be accurately calculated. In the specific processing of the above step S24, the CPU 1 purchases the second acceleration data 101, the second angular velocity data 1〇2, and the orientation 63 323304 201220108 data 103 from the main memory, and calculates based on the data. The posture of the terminal device 7. The data of the calculated posture of the terminal device 7 is displayed, and the terminal posture data 109 is stored in the main memory. The processing of step S25 is executed after step S24. In step S25, the CPU 10 performs recognition processing of the camera image. That is, the CPU 10 performs predetermined identification processing on the camera image data 104. The identification processing can be arbitrary as long as a certain feature can be detected from the camera image and the result is output. For example, when the player's face is included in the camera image, the processing of the face can be recognized. Specifically, it is possible to recognize the treatment of a part of the face (eye or nose or mouth, etc.) or to detect the appearance of the face. Further, the data showing the result of the identification processing is stored as the image identification data 110 in the main memory. The process of step S26 is performed after step S25. In step S26, the CPU 1 performs the recognition of the microphone sound, and the result can be any processing for the sound side of a certain type of lotus player, or only for the sound of the microphone. Travel out. In addition, the 4th (4) processing of the volume of the gram sound is recognized in the main memory of the memory. The data of the fruit is treated as a sound. . After step S26, step S27 is executed. In step S27, the CPU 10 is hot. Here, the so-called game input is a game process in which the game is input by the player. The data technology sent from the data control (4) 5 or the information transmitted by the terminal device 7 can be used. Specifically, the 323304 201220108 game input may be data obtained from the data (controller posture data 108, terminal posture data 109) in addition to various materials included in the controller operation data 92 and the terminal operation data 97. , image identification data 110, and voice recognition data 111). Further, the content of the game processing in step S27 may be any content, for example, processing for moving an object (character) appearing in the game, controlling the processing of the virtual camera, or moving the cursor displayed on the face. Further, the camera image (or the portion) is used as a process for processing a game image or a process for using a microphone sound as a game sound. An example of the above game processing will be described later. In step S27, for example, the data of various parameters set in the character (object) appearing in the game, or the data of the parameter related to the virtual camera arranged in the game space, the data of the score, etc., show the result of the game control processing. The data is stored in the main memory. After the step S27, the CPU 10 ends the game control processing of the step S4. Returning to the description of Fig. 12, in step S5, the television game image for display on the television 2 is generated by the CPU 10 and the GPU lib. That is, the CPU 10 and the GPU lib read the data showing the result of the game control process of step S4 from the main memory, and read the data necessary for generating the game image from the VRAM lid to generate Game image. The game image may be displayed as long as the result of the game control processing of step S4 can be displayed, and can be generated by any method. For example, the method of generating the game image may be a method of generating a 3-dimensional CG image by arranging the virtual camera in a virtual game space and calculating a game space viewed from the virtual camera, or (without using virtual Camera) A method of producing a 2-dimensional image. The resulting TV tour 65 323304 201220108 The play image is memorized in the VRAM lid. The processing of step S6 is performed after the above step S5. In step S6, the game image for the terminal to be displayed on the terminal device 7 is generated by the CPU 10 and the GPU lib. The game image for the terminal is also the same as the game image for the television described above, and may be generated by any method as long as the result of the game control process of step S4 can be displayed. Further, the game image for the terminal can be generated by the same method as the above-described game image for the television, or can be generated by a different method. The generated game image for the terminal is memorized in the VRAM lid. The game image for the television and the game image for the terminal may be the same depending on the content of the game. In this case, the process of generating the game image may not be executed in step S6. The processing of step S7 is performed after the above step S6. In step S7, a game sound for television for outputting to the speaker 2a of the television 2 is generated. That is, the CPU 10 is caused by the DSP 11c to generate a game sound in accordance with the result of the game control processing of the step S4. The generated game sounds are, for example, sound effects of the game, sounds of characters appearing in the game, or BGM (background music). The processing of step S8 is performed after the above step S7. In step S8, a terminal game sound for outputting to the speaker 67 of the terminal device 7 is generated. That is, the CPU 10 is caused by the DSP 11c to generate a game sound in accordance with the result of the game control processing of the step S4. The game sound for the terminal can be the same as or different from the game sound for the above television. In addition, for example, the effect sounds are different, but the BGM can be different only in part. When the television game sound is the same as the terminal game sound, the game sound generation processing may not be executed in step S8. The processing of step S9 66 323304 8 201220108 is performed after the above step S8. In step S9, the CPU 10 outputs the game image and the game sound to the television 2. Specifically, the CPU 10 transmits the data of the television game image stored in the VRAM lid and the data of the television game sound generated by the DSP 11c in step S7 to the AV-IC 15. In response to this, the AV-IC 15 outputs the image and sound data to the television 2 via the AV connector 16. Thereby, the television game image is displayed on the television, and the television game sound is output from the speaker 2a. The process of step S10 is performed after step S9. In step S10, the CPU 10 transmits the game image and the game sound to the terminal device 7. Specifically, the image data of the game image for the terminal stored in the VRAM lid and the data of the sound generated by the DSP 11c in step S8 are transmitted to the codec LSI 27 by the CPU 10, and by The codec LSI 27 performs predetermined compression processing. Further, the image and sound data subjected to the compression processing are transmitted to the terminal device 7 via the antenna 29 via the terminal communication module 28. The terminal device 7 receives the image and audio data transmitted from the game device 3 by the wireless module 70, and performs predetermined decompression processing by the codec LSI 66. The image data subjected to the decompression processing is output to the LCD 51, and the sound data subjected to the decompression processing is output to the sound 1C 68. Thereby, the terminal game image is displayed on the LCD 51, and the terminal game sound is output from the speaker 67. The process of step S11 is performed after step S10. In step S11, the CPU 10 determines whether or not to end the game. The determination in step S11 is performed, for example, by whether or not the game is over or the user gives an instruction to terminate the game. When the result of the determination in step S11 is negative, the step 67 323304 201220108 is executed again; step S2, in. On the other hand, the determination of the step su of the CPU 10 ends the game processing shown in Fig. 12. If it is determined that the game is finished, the process is repeated until the step S11 is performed. The series of the 芏b11 is as described above. In the present embodiment, the terminal dream board 52 and the acceleration sensor 63 or the slewing unit 17 are provided with the output of the touch surface touch panel 52 and the inertial sensor: the wide game device 3 And (4) is the input of the game (step ^作#枓 is transmitted to the end device 7 with a display device like!) 51). Further, the final movie image is displayed on the LCD 51 (steps S6, S10). The user can use the touch panel 52 to directly touch the viewing image. The action can be detected by the inertial sensor, and the LCD 51 itself will be scared to display the game image.乂) In the operation 'to perform the game directly on the game image = the game is booked, so that a game such as the ninth sense of the operation described later can be provided. Further, in the second game example, in the present embodiment, the analog stick 53 and the operation are operated in the state in which the terminal device 7 is in the state of the end device 7, and the grip is finally the game round (steps S3 and S4). Therefore, oh... do not use bamboo ffl « ^ , ^ ^ ^ for detailed game operations. ', 3 joystick operation, in the present embodiment, the data of the camera image of the terminal device 7 microphone 69, camera 56, /, camera, camera 56 and camera 56 And the wheat will enter the game wheel with the analog rocker 53 and the operation key 54 (steps S3, S4). Because Park,,... Fantasy action 323304 68 201220108 : Sound game device 克 克 风 sound is used as a finder, ^ pin camera image and / or 麦 56 will be stupid, so the user can also borrow It is performed by the operation of the game operation and the input of the cut sound to the microphone 69 by the photographic operation. These operations can be performed by holding the terminal device 7 by performing these two operations on the game image as described above.游戏 'When the user makes a more profitable game operation (the display is displayed on the LCD 51 of the portable type device 7 (step 邡, sl〇), the user can customize the end device 7. Therefore, 'when the controller 5 is made to be positioned toward the marker', by arranging the terminal split 7 in the free position, the control H 5 is made to face the free direction, and the operation of the control 5 can be improved. In addition, since the terminal device 7 can be placed at any position as in the fifth game example described later, a game with a more realistic feeling can be provided by arranging the terminal device at a position suitable for the game content. According to the present embodiment, the game device 3 can acquire the operation data and the like from the controller 5 and the terminal device 7 (steps S2 and S3). Therefore, the user can use the two devices of the controller 5 and the terminal device 7 as the operation means. In the game system 1, a plurality of individuals can be used to play games by using a plurality of households, and one user can use two devices to play the game. Further, according to the present embodiment, the game is played. Device 3 produces 2 The game image (steps S5, S6), and the game image can be displayed on the television 2 and the terminal 323304 69 201220108 device 7 (steps S9, S10). Thus by "displaying two kinds of game images on different devices" Providing a game image that is easier for the user to view, and improving the operability of the game. For example, when two people play the game, for example, the third or fourth game example described later will be for a certain user. The game image for the viewpoint of easy viewing is displayed on the television 2, and the game image of the other user's viewpoint for easy viewing is displayed on the terminal device 7, whereby the player can easily view the viewpoint. In addition, even if the game is played for one person, for example, the second, second, or fifth game examples described later can display two kinds of game images in different viewpoints, thereby making it easier for the player to grasp. The game space is improved to improve the operability of the game. [6. Game example] Next, a specific example of the game played in the game system 1 will be described. In the game example described below, there are also devices that do not use the game system. In the composition In some cases, there is a case in which some of the series of processes in the 12th and 13th drawings are not executed. That is, the game system 1 may not have all of the above configurations, and the game device 3 may not be executed. A part of the series of processing shown in Fig. 12 and Fig. 13. (First game example) The first game example is a game player who shoots an object (dart) in the game space by operating the terminal device 7, By changing the posture of the terminal device 7, the operation, and the operation of drawing the line on the touch panel 52, the direction of the dart can be displayed. _ a Figure 14 shows the TV 2 in the first game example. The figure of the face and the terminal device 7. In the figure, on the television 2 and the terminal device 7, (10) 51 323304 70 201220108, a game image representing the game space is displayed. On TV 2 display m, control surface 122, and standard (4) 3. In the coffee 51 (four) out of control = face 122 (and Lin 121). In the first game, the player performs the game by using the operation of the terminal device 7 (4) scale 121 to the middle county 123. When the game is launched, the player first changes the virtual game space by operating the terminal to set the posture. The posture of the control surface 122 disposed therein becomes a desired posture. That is, the CPU 1G calculates the posture of the terminal device 7 based on the outputs of the inertial sensors (the acceleration sensor 63 and the rotation sensor 64) and the magnetic sensor 62 (step S24), and based on the calculated posture. The posture of the control plane 122 is changed (step S27). In the i-th game example, the posture of the control plane 122 is controlled to correspond to the posture of the terminal device 7 in the actual space. That is, the player can change the posture of the control plane 122 in the game space by changing the posture of the terminal device 7 (displayed on the control plane 122 of the terminal device 7). In the first game example, the position of the control plane 122 is fixed at a predetermined position in the game space. Next, the player performs an operation of drawing a line on the touch panel 52 using the stylus pen 124 or the like (refer to an arrow shown in Fig. 14). Here, in the i-th game example, the control unit 122 is displayed on the LCD 51 of the terminal device 7 such that the input surface of the touch panel 52 corresponds to the control surface 122. Therefore, by drawing the line on the touch panel 52, the direction on the control surface 122 (the direction in which the line is displayed) can be calculated. ^ The dart 121 is shot in the direction thus determined. From the above, the CPU 10 calculates the direction on the control surface 122 from the touch position data 100 of the touch panel 52, and performs a process of moving the darts 323304 201220108 121 to the calculated direction (step S27). The CPU 10, for example, can control the speed of the darts 121 in response to the length of the line or the speed at which the line is drawn. As described above, according to the first game example, the game device 3 can use the output of the inertial sensor as the game input, and can move the control surface 122 in response to the movement (posture) of the terminal device 7 by using the touch panel. The output of 52 is used as the game input 'specifically on the control plane 122. According to this, the player can move the game image (image of the control plane 122) displayed on the terminal device 7 or perform a touch operation on the game image, thereby enabling a novel operation feeling of directly operating the game image. Come play the game. Further, in the first game example, the three-dimensional space 2 direction can be easily instructed by using the sensor output of the inertial sensor and the touch panel 52 as a game input. That is, the player actually adjusts the terminal device 7 with the hand of the side, and uses the hand line of the other side to input the direction to the intuitive operation of the direction of the touch panel, and is easy to operate and correct = 7:: Since the operation of the orientation of the terminal device 7 in the three-dimensional space is performed, the finger can be quickly moved. Further, according to the first game example, the operation of the touch input is performed, so that the control surface 122 can be easily performed. The control surface is another--, the system is set to ^; in the 'display on the whole screen and easy to hide the 123 easy to grip control surface 122 posture.

The body control surface 122 and the stem 123: 'display on the television 2 command include the full picture). That is, the image of the game space in the above step S27 (refer to the UY, 72 323304 201220108 first virtual camera for generating the game image for the television, so that the entire control surface 122 and the target 123 are included in the field of view. The second virtual camera for generating the game image for the terminal is set such that the face of the LCD 51 (the input face of the touch panel 52) and the control surface 122 are aligned on the face. Therefore, in the first game example, the game operation can be performed more easily by displaying the image of the game space viewed from different viewpoints on the television 2 and the terminal device 7. (Second game example) The inertial sensor is used. The game output of the touch panel 52 is used as a game input game, and is not limited to the first game example described above, and various game examples can be considered. The second game example is the same as the first game example, and is operated by the terminal device. 7. A game in which an object (cannonball) is fired in the game space. The player, by operating the posture of the terminal device 7, and specifying the position on the touch panel 52, can indicate the direction in which the projectile is fired. 5 shows a view of the facet and terminal device 7 of the television 2 in the second game example. In Fig. 15, the cannon 131, the projectile 132, and the target 133 are displayed on the television 2. The terminal device 7 displays The projectile 132 and the target 133 are displayed. The terminal game image displayed on the terminal device 7 is an image of the game space viewed from the position of the cannon 131. In the second game example, the player operates the posture of the terminal device 7, The display range of the terminal device 7 can be changed as the terminal game image. That is, the CPU 10 outputs the output of the inertial sensor (the acceleration sensor 63 and the rotation sensor 64) and the magnetic sensor 62. The posture of the terminal device 7 is calculated (step S24), and the position and posture of the second virtual camera for producing the game image for the terminal of 73 323304 201220108 are controlled based on the calculated posture (step S27). Specifically, The second virtual camera is placed at the position of the cannon 131, and controls the orientation (posture) in response to the posture of the terminal device 7. Thus, the player can change the game displayed on the terminal device 7 by changing the posture of the terminal device 7. Further, in the second game example, the player performs an operation of inputting a point (touch operation) on the touch panel 52, thereby specifying the emission direction of the projectile 132. Specifically, the processing of the above step S27 is performed. The CPU 10 calculates a position (control position) in the game space corresponding to the touch position, and calculates the direction from the predetermined position in the game space (for example, the position of the cannon 131) to the control position as the emission direction. In the first game example, the player performs an operation of drawing a line on the touch panel 52. However, in the second game example, the designated touch panel 52 is performed. The operation of the point above. The control position can be calculated by setting the same control surface as the first game example (but the control surface is not displayed in the second game example). In other words, the control surface is disposed in accordance with the posture of the second virtual camera in accordance with the display range in the terminal device 7 (specifically, the control surface is centered on the position of the cannon 131, and the posture of the terminal device 7 is changed in response to the position of the cannon 131. To rotate the movement, the position on the control surface corresponding to the touch position can be calculated as the control position. According to the above policy 2 game example. , the game device 3 by means of inertial sensors.  The output is used as a game input, and the display range of the game image for the terminal can be changed in response to the movement (posture) of the terminal device 7, and the touch input specifying the position within the display range can be specified as a game input. The game is empty 74 323304 © 201220108 The direction in between (the direction in which the projectile 132 is fired). Therefore, in the second game example, as in the first game example, the player can move the game image displayed on the terminal device 7 or perform a touch operation on the game image, so that the game image can be directly played. The novel operation of the operation feels to play the game. Further, in the second game example, as in the first game example, the player actually adjusts the posture of the terminal device 7 with one hand and touch input the touch panel 52 with the other hand. The direction is intuitively operated by intuitively operating the direction of the actual input in the space. Further, the player can simultaneously perform the operation of the posture of the terminal device 7 and the input operation to the touch panel 52, so that the operation of instructing the direction in the three-dimensional space can be quickly performed. Further, the image displayed on the television 2 in the second game example may be an image viewed from the same viewpoint as the terminal device 7, but in FIG. 15, the game device 3 displays a view viewed from a different viewpoint. image. In other words, the second virtual camera for generating the game image for the terminal is set at the position of the cannon 131. On the other hand, the first virtual camera for generating the game image for the television is set behind the cannon 131. position. Here, for example, a range that cannot be seen in the face of the terminal device 7 is displayed on the television 2, whereby a player can view the screen of the television 2 to aim at a target that cannot be seen in the face of the terminal device 7. 13 3 gameplay. Thus, by setting the display range of the television 2 and the terminal device 7 differently, it is not only easier to grasp the appearance in the game space, but also to enhance the fun of the game. As described above, according to the present embodiment, since the terminal device 7 including the touch panel 52 and the inertial sensor can be used as the operation device, it is possible to implement the first and second game examples as described above. A game in which the game image is directly manipulated to operate. (Third Game Example) A third game example will be described below with reference to Figs. 16 and 17 . The third game example is a baseball game in the form of a two-player game. That is, the first player uses the controller 5 to operate the hitter, and the second player uses the terminal device 7 to operate the pitcher. Further, in the television 2 and the terminal device 7, a game image which is easy for each player to perform a game operation is displayed. Fig. 16 is a view showing an example of a television game image displayed on the television 2 in the third game example. The video game image for television shown in Fig. 16 is mainly used for the image of the first player. In other words, the game image for the television shows the game space of the pitcher (pitcher object) 142 of the operation target belonging to the second player from the hitter (the hitter object) 141 side of the operation target of the first player. . The first virtual camera for generating the game image for the television is placed at the rear position of the hitter 141, and is disposed from the beater 141 toward the direction of the shooter 142. On the other hand, Fig. 17 is a view showing an example of a terminal game image displayed on the terminal device 7 in the third game example. The terminal game image shown in Fig. 17 is mainly used for the image of the second player. In other words, the game video for the terminal is displayed as the game space of the hitter 141 that is the operation target of the first player from the pitcher 142 side of the operation target of the second player. Specifically, in the above-described step S27, the CPU 10 controls the second virtual camera for generating the game image for the terminal based on the posture of the terminal device 7. The second virtual. The posture of the camera is calculated in the same manner as in the second game example described above, and 76 323304 201220108 i = f is calculated in the manner of the posture of the terminal device 7. In addition, the second game image includes the preview position using (4). Terminal cursor (4). The method of operating the hitter 141 controlled by the player who is not throwing the ball in the direction of the pitcher 142 and the second place = the kilogram: the operation method of the pitcher 142 can be any method. For example, the output data of the inertial sensor of the control unit 5 is measured, and the flapping operation of the third and second squadrons is detected, and the wave swing operation is performed to swing == _. In addition, 仃# is used to move the label (4), and when the middle button of the operation button 5 is pressed, the pitcher 142 is caused to pitch toward the cursor 143 (4). In addition, the movement of the 栌η straight (4) can also be performed by the movement of the secret end device 7 instead of the operation of the analog rocker 53. As described above, in the third game example, the game image is generated in which the television 2 and the terminal are placed 7 to generate mutually different viewpoints, thereby providing a game image that is easy to view and easy to operate for each. In the third game example, the game is set up in a single game space, and two game images are displayed from each virtual camera (Figures 16 and 17). ). Therefore, it is almost common for the two kinds of game images generated in the playroom to be processed (the control of the objects in the game space) (the control of the objects in the game space) is almost common, and the game space of the game can be rendered twice. When the image processing is performed, the processing efficiency is better than that when the game processing is performed separately. 323304 77 201220108 In addition, in the third game example, the pitching party is displayed and displayed on the terminal device 7 side. 143 is only the indicated position. Therefore, the (four) direction is not generated. When the cursor 143 is known and the game is unfavorable to the second player, the game player is in the form of a game. When the player sees the shot ^, if the other player's game is not suitable for the game, the icon will be displayed on the shirt 7 when the screen is played. This can prevent the game map from being missing. In the real state, the game image of the terminal is reduced by the first player by the strategically reduced game image of the game_ (for example, 'even if only') the game device 3 can also generate the above-mentioned game image*. Missing is displayed on TV 2. Viewing game image (Fourth Game Example) Hereinafter, a game example in which the game player is a form of game in which two players cooperate with each other will be described with reference to FIGS. 18 and 19. The fourth game player makes the machine 5 to move the aircraft 3 Also, the player causes the material end device 7 to perform the operation of the launcher of the controllary cannon. The fourth game example is also displayed on the television 2 and the terminal device 7 in the same manner as the third game example. A game image that is easy for a game operation for each player. Fig. 18 is a view showing an example of a television game image displayed on the television 2 in the fourth game example. outer,. Fig. 19 is a view showing an example of a terminal game image displayed on the terminal device 7 in the fourth game example. As shown in Fig. 18, in the fourth game example, the aircraft (aircraft object) 151 and the target (balloon object) 153 appear in the virtual game space. In addition, aircraft 151 has a cannon (large 78 323304 201220108 gun object) 152. As shown in Fig. 18, the image of the game space including the airplane 151 is displayed as a game image for television. The first virtual camera for generating a game image for television is set such that an image of the game space of the aircraft 151 is viewed from the rear. In other words, the first virtual camera is disposed at a rear position of the aircraft 151 in a posture in which the aircraft 151 is included in the imaging range (field of view). Further, the first virtual camera is controlled to move along with the movement of the airplane ΐ5ι. That is, the CPU 10 controls the movement of the aircraft 151 based on the controller operation data in the processing of the above-described step S27, and controls the position and posture of the first virtual camera. Thus, the position and posture of the second virtual camera are controlled in accordance with the operation of the first player. On the other hand, as shown in Fig. 19, the image of the game space viewed from the aircraft 151 (more specifically, the cannon 152) is displayed as a terminal game image. Therefore, the second virtual camera for generating the game image for the terminal is disposed at the position of the aircraft 151 (more specifically, the position of the cannon 152). The CPU 1 is in the process of the above-described step S27, and operates according to the controller. The movement of the aircraft 151 is controlled to control the position of the second virtual camera. The second virtual camera may also be placed at a position around the aircraft 151 or the cannon 152 (for example, a position slightly behind the cannon 152). As described above, the second virtual The position of the camera is controlled by the operation of the i-th player (operating the movement of the aircraft 151). Therefore, in the fourth game example, the second virtual camera and the second virtual camera are moved in conjunction with each other. The image of the game space viewed in the direction of emission of the sufficiency 152 is displayed as a game image for the terminal. Here, the direction of emission of the cannon 152, 79 323304 201220108 is controlled to correspond to the posture of the terminal device 7. That is, In the present embodiment, the posture of the second virtual camera is controlled such that the line of sight direction of the second virtual camera coincides with the direction of emission of the cannon 152. The processing of the above step S27 is cpu 1 The orientation of the cannon 152 and the posture of the second virtual camera are controlled in response to the posture of the terminal device γ calculated in the above step S24. Thus, the posture of the second virtual camera is controlled by the operation of the second player. Further, the second player can change the direction of the launch of the cannon 152 by changing the posture of the terminal device 7. When the projectile is fired from the cannon 152, the second player presses the predetermined key of the terminal device 7. Pressing the predetermined button At the time, the projectile is fired from the direction of the cannon 152. In the game image for the terminal, the crosshair 154 is displayed in the center of the face of the LCD 51, and the projectile is fired in the direction indicated by the crosshair 154. As described above, in the fourth game example, The game player (mainly watching the TV game image (Fig. 18) which shows the space of the aircraft 151 to the viewing space, (for example, the manner in which the direction of the target 153 is desired to be moved in the past) - the operation In the case of the aircraft, the second player, while watching the terminal game image (Fig. 19) showing the game space viewed in the direction in which the cannon 152 is emitted, operates the cannon 152. In the fourth game example, in a game in which two players cooperate with each other, the knife = a game image that is easy to view and easy to operate for each player, respectively, is displayed in the electric-view 2 and terminal. Device 7. Further, in the fourth game shot, the positions of the first virtual camera and the second virtual camera are controlled by the operation of the third player, and the posture of the second virtual camera is controlled by the operation of the second player. In other words, in the form 323304 8 80 201220108 = in the form, the virtual camera 置t is set or the posture is changed in response to each game operation of each player, and as a result, the display range displayed on the display of each display device can be generated. Variety. Since the display range of the game two displayed on the display device changes depending on the operation of each player, the player can actually reflect the game to his or her own game operation, and can fully reflect the progress of the game. Enjoy the game. In the fourth game example, the game image displayed on the television 2 showing the rear view from the airplane 151 is displayed on the terminal split 7 to display the game image viewed from the position of the airplane (5). Here, in the other game ages, the game set 3 may also display the game image viewed from the rear of the aircraft 151 in the terminal device 7 'the game picture displayed on the television 2 from the position of the cannon 152 of the aircraft 151. image. At this time, the work of each player is replaced with the fourth game example described above, and the first player can use the controller 5 to perform the operation of the cannon 152, and the second player uses the terminal device 7 to carry out the aircraft. 151 operation. (Fifth Game Example) The fifth game example will be described below with reference to FIG. In the fifth game example, the player uses the controller 5 to operate the game, and the terminal device 7 is not used as a display device. Specifically, the fifth game example is a golf game, and in response to the player's operation of swinging the controller 5 like a golf club (swing operation), the game device 3 performs the player character in the virtual game space. The swing of the golf ball. Figure 20 is a view showing the use of the game system in the fifth game example. Figure 20 shows the player character (the 323304 81 201220108 object) 161 and the high club in the face of the TV 2. In the game space map of 162, although the golf club 162 is hidden and the 20th ball is not displayed (the object 63 is also displayed on the TV 2. The other three faces are placed in the game space diagram, and the terminal device 7 is The top surface of the LCD 51 is placed on the floor of the front side of the television 2. The terminal device 7 displays an image of the ball 163 and a head 162a of the high club that displays the high club 162. When the image, the ^^ body and the picture of the terminal are in the light, the player 16〇 stands in the terminal, and the controller 5 swings like a high ball. At this time, in the processing of the above step S27, the high ball in the game space is controlled in response to the above-mentioned steps, and the posture is controlled. Specifically, the high club 162, when the hill control direction (the positive Z-axis direction shown in FIG. 3) is oriented toward the coffee 51; the image of the dry:: is controlled as the high club (10) in the game. Output = In addition, when the front end direction of the controller 5 faces the coffee maker 51 = 51, an image of a part of the high club 162 is displayed (head image (10) ^ according to Fig. 20 regarding the game image for the terminal, in order to increase the sense of presence This is enough to display the image of the ball 163 in a large object, or to display the rotation of the oil controller 5 around the z-axis to rotate the orientation of the head image 164. In addition, the game image of the terminal can also be used. It is generated by the virtual camera of Lai, or by using the image data prepared in advance. When using the image data prepared in advance, it is not necessary to construct the map of the golf course 323304 82 201220108 in detail. Small processing ^ ^ by the player 160, 隹" real image. 162, the result is high-two swing operation to swing the high-ball out). That is, when the CPU Γ〇〇 63, the ball 163 will move (whether or not the flying ball (10) contacts the step milk, the high club 162 is in contact with the private circle, and when the ball is touched, the ball 163 is moved. Here, the video game image The method includes the side of the ball 163 after the movement: view: that is, the method of "the coffee 10 is used to include the moving ball in the shooting" = the position and posture of the second virtual camera for controlling the game image for television In the other aspect, when the high club 162 is hit in the terminal device 7, the image of the ball 163 moves and immediately disappears outside the plane. Therefore, in the fifth game example, the appearance of the ball movement is mainly displayed on the TV 2, the game. _ The destination of the ball flying by the swing operation can be confirmed by the game image of the television. As described above, in the fifth game example, the player 16 can swing the golf ball by waving the controller 5. Rod 162 (to make the player character 161 swing high ball ^ 162). Here, in the fifth game example, when the controller. The front end of 5 is toward: When the image of the ball 163 displayed on the LCD 51 is controlled, the high ball 162 of the game space 2 is controlled to hit the ball 163. Therefore, the player can make the swing operation more realistic by "the actual feeling of swinging the high club." A fifth game example is when the front end direction of the controller 5 faces the terminal 7' The LCD 51 displays the head image 164. Therefore, the player takes the front end direction of the controller 5 toward the terminal device 7, and obtains the posture of the high club 162 in the middle and the controller 5 in the real space == 323304 83 201220108 The swing operation can be made more realistic. As described above, in the fifth game example, when the terminal device 7 is used as the display device, by appropriately arranging the position of the terminal device 7, Further, in the fifth game example described above, the terminal device 7 is disposed on the ground, and the terminal device 7 displays an image in which only the game space around the ball 163 is displayed. In the terminal device 7, the position and posture of the entire golf club 162 in the game space cannot be displayed, and the terminal device 7 cannot display the movement of the ball 163 after the swing operation. Therefore, in the fifth game example, On the ball 163 Before the movement, the whole golf club 162 is displayed on the television 2, and after the movement of the ball 163, the appearance of the movement of the ball 163 is displayed on the television 2. Thus, according to the fifth game example, a more realistic operation can be provided to the game. In addition, in the fifth game example, in order to calculate the posture of the controller 5, the terminal device 7 is used to display the game image that is easy to view using the two screens of the television 2 and the terminal device 7. The indicator portion 55. That is, the CPU 10 lights up the indicator portion 55 in the initial processing of the above-described step S1 (the pointing device 6 is not lit), and the CPU 10 calculates the controller based on the marker coordinate data 96 in the above-described step S23. According to this, it is possible to accurately determine whether or not the distal end direction of the controller 5 is the posture toward the indicator portion 55. In the fifth game example, the above steps S21 and S22 may not be performed, but in other game examples. It is also possible to change the marker to be turned on in the middle of the game by executing the processing of steps S21 and S22 described above. For example, in step S21, the CPU 10 determines whether the front end direction of the controller 5 is toward the direction of gravity of 84 323304 8 201220108 based on the first acceleration data 94, and in step S22, the control is to face the portion when facing the direction of gravity. The 55-point light 'lights the pointing device 6 when it is not facing the direction of gravity. According to this, when the front end direction of the controller 5 faces the gravity direction, the posture of the controller 5 can be accurately calculated by acquiring the marker coordinate data of the indicator portion 55, and when the front end direction of the controller 5 faces the television 2, The posture of the controller 5 is accurately calculated by acquiring the marker coordinate data of the pointing device 6. As described in the fifth game example described above, the game system 丨 can set the terminal device 7 to a free position and apply it as a display device. According to this, when the marker coordinate data is used as a game input, in addition to using the controller 5 toward the television 2, the control device H 5 can be oriented in the free direction by placing the terminal device 7 in the desired position 1. To use. That is, according to the present embodiment, the orientation in which the controller 5 can be used is not limited, so that the degree of freedom in operation of the controller 5 can be improved. Worker [7. Other Operation Examples of the Game System] The game system 1 described above can perform the above-described operations for performing various games. The terminal device 7 can also be used as a transportable display or a second display, and can also be used as a controller for performing touch input or wheeling according to actions. According to the game system and system i, various games can be implemented. . In addition, it also includes other uses beyond the game, and the following actions can also be performed. (Example of the operation of the player using only the terminal device 7 to play the game) In the present embodiment, the terminating device 7 has the function of the display device and also has the function of the operating device. Therefore, the terminal device 7 can be used only as the display means and the operation means without using the television and the controller 5, whereby the terminal device 7 can be used like the portable game device of 323304 85 201220108. According to the game processing shown in Fig. 12, the CPU 10 acquires the terminal operation material 97 from the terminal device 7 in step S3, and uses only the terminal operation material 97 as the game input in step S4 (without using the controller operation). Data) to perform game processing. The game image is then generated in step S6, and the game image is transmitted to the terminal device 7 in step S10. At this time, steps S2, S5, and S9 may not be performed. According to the above, the game processing is performed in response to the operation performed by the terminal device 7, and the game image showing the result of the game processing is displayed on the terminal device 7. According to this, (actually, although the game processing is executed in the game device), the terminal device 7 can also be applied as a portable game device. Therefore, according to the present embodiment, the user can use the terminal device 7 to play the game even if the game image cannot be displayed on the television 2 for reasons such as when the television 2 is used (for example, other people are watching television broadcasting). The CPU 10 is not limited to the game image, and the image may be transmitted to the terminal device 7 for display after the above-mentioned menu page displayed after the power is turned on. According to this, the player can play the game without using the TV 2 from the beginning, which is extremely convenient. Further, in the above, the display device displaying the game image may be changed from the terminal device 7 to the television 2 in the middle of the game. Specifically, the CPU 10 can further perform the above step S9 and play the game image. Output to TV 2. The image output to the television 2 in step S9 is the same as the game image transmitted to the terminal device 7 in step S10. According to this, the input of the television 2 is switched so as to display the input from the game device 3, and the game image similar to the terminal device 7 can be displayed on the television 2, and the display device is changed to the television 2. The face display of the closeable terminal 7 in which the game image is displayed can be displayed. It can be displayed in the game system 1 after the TV 2 is displayed. It can also be configured as the slave 6, the indicator 55, or the infrared communication module (infrared remote control signal 72 indicated by the device 2). According to this, the game device 3, by means of infrared means:::: Operate the remote control of the TV 2 to enable = to: 乍 = therefore switch TV 2 as described above The input is wide (an example of the operation of communicating with other devices via the network) C. Since the game device 3 has a function of connecting to the network, the game is displayed when the pure rm (four) network is connected to the external device, and the connection of each device of the λ is connected. Diagram of the relationship. The game device 3 as shown in Fig. 21 can be connected to the external device 2〇1 via the network 2〇〇. As described above, when the external device 201 and the game device 3 can be communicated, the game device 1 can use the terminal device 7 as an interface and communicate with the external device 201. For example, the game system 1 can be used as a videophone by receiving and transmitting images and sounds between the external device 1 and the terminal device 7. Specifically, the game device 3 receives the image and sound (image and sound of the telephone partner) from the external device 201 via the network 200, and transmits the received image and sound to the terminal device 7. Thereby, the terminal device 7 can display an image from the external device 201 on the LCD 51, 87 323304 201220108 and output a sound from the external device X from the speaker 67. In addition, the game device 3 receives the camera image captured by the camera 56 and the reference wind sound detected by the microphone (10) from the terminal device 7, and transmits the camera image and the microphone sound to the external material via the network_2. . The game system 3' can use the game system 1 as a videophone by repeating the above-described reception and transmission of images and sounds with the external device 2Q1. In the present embodiment, since the terminal device 7 is of a transportable type, the user can use the terminal terminal 7 L a L ^ % 褒 7 in a free position and direct the camera 56 in the free direction. In addition, in the second embodiment, the terminal device 7 is provided with the touch panel 52, and the second game device 3 can also transmit the input information (touch position information) input to the touch panel to the external device 2〇1. For example, when the image and sound from the external device 2G1 are output by H, and the text written on the touch panel % is transmitted to the external device 2G1, the game system (electronic learning system) can also be used. ). W (Degrees with the operation of the TV broadcast) In addition, the game system 1 can also operate with the TV when watching TV broadcasts on the TV 2. That is, the game system ^, when viewing the television program by the television 2, can output | to the terminal device 7. The following description of the game \ electric: see: the relevant information of the action and action winter action examples. The game system 1 is connected to the television system. In the above operation example, the game device 3 can communicate with the service via (4) (in other words, the external skirt 2〇1 shown in Fig. 21 is: the device).服 The device is used to record various channels related to TV broadcasts on each channel of TV broadcast. 323304 8 88 201220108 Information (TV information). Information (images), information, images, sounds, texts, or information related to the program, or information related to the EPg,,,,,,,,,,,,,,,, This kind of TV broadcast information can be used for the TV. In addition, the word server is equipped with a ship, and the mother's program of the age of 3 is set to output the electric__ server for communication in the TV 2. Set 3 to let the user enter the game when the terminal is used to sound. Then, via the singer, I will watch the TV information of the frequency channel broadcast on the TV in Beibei. In response to this U service, the data corresponding to the entered television information is transmitted. When the recipient receives the data corresponding to the channel game F Jin 3, and receives the data transmitted from the server, the data received by the patient is output to the terminal device 7. The image and text data of the terminal device 7 output =:! is displayed at 1^51. And from the sound of 7 ° ‘ enjoy the heart: fighting. By the above means, the user can use the information related to the television program in the terminal device and the like. As described above, the game system 1 communicates with an external device (server) via the network, whereby the information associated with the television broadcast can be provided to the user via the terminal device 7. In particular, in the present embodiment, since the terminal device 7 is of a transportable type, the user can use the terminal device 7' at a free position with high convenience. As described above, in the present embodiment, in addition to being used in games, the user can use the terminal device in various uses and forms. [8. [Modifications] The above-described embodiments are examples for carrying out the present invention, and in other embodiments, in the configuration of 89 323304 201220108, the present invention can be implemented, for example, in the configuration described below. (Modification of a plurality of terminal devices) In the above embodiment, the game system 1 is configured to have only one terminal device, but the game system 1 may be configured to have a plurality of terminal devices. That is, the game device 3 can communicate with a plurality of terminal devices in a wireless manner, and can transmit the data of the game image, the data of the game sound, and the control data to each terminal device, and receive the operation data and the camera map from each terminal device. Like data and microphone sound data. The game device 3 communicates with each of a plurality of terminal devices in a wireless manner. In this case, the game device 3 can perform wireless communication with each terminal device in a time division manner or divide the frequency band. When there are a plurality of terminal devices as described above, a game system can be used to perform a wider variety of games. For example, when the game system 1 has two terminal devices, since the game system 1 has three display devices, game images for three players can be generated and displayed on each display device. Further, when the game system 1 has two terminal devices, in a game in which the controller and the terminal device are used as one group (for example, the fifth game example described above), the two players can simultaneously play the game. Furthermore, when the game processing of the above step S27 is performed based on the marker coordinate data output from the two controllers, the two players can respectively perform the controller toward the marker (the pointing device 6 or the indicator portion 5_5). game. operating. that is,. The player of one of the players causes the controller to perform the game operation toward the pointing device 6, and the other player causes the controller to perform the game operation toward the indicator portion 55. (Modification of the function of the terminal device) 90 323304 8 201220108 In the above embodiment, the terminal device 7 has a function of a so-called compact terminal that does not execute game processing. Here, in another embodiment, a part of the series of game processing executed by the game device 3 in the above embodiment may be executed by another device such as the terminal device 7. For example, a part of the processing (e.g., generation processing of the game image for the terminal) is executed by the terminal device 7. Further, for example, in a game system having a plurality of information processing devices (game devices) that can communicate with each other, the plurality of information processing devices can share the execution of the game processing. (Industrial Applicability) As described above, the present invention is intended to allow a player to perform a novel game operation or the like, and can be applied to, for example, a terminal device used in a game system or a game system. BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is an external view of the game system 1. Fig. 2 is a block diagram showing the internal structure of the game device 3. Fig. 3 is a perspective view showing the appearance of the controller 5. Fig. 4 is a perspective view showing the appearance of the controller 5. Fig. 5 is a view showing the internal configuration of the controller 5. Fig. 6 is a view showing the internal configuration of the controller 5. Fig. 7 is a block diagram showing the configuration of the controller 5. Fig. 8 is a view showing the appearance of the terminal device 7. Fig. 9 is a view showing a state in which the user holds the terminal device 7. Fig. 10 is a block diagram showing the internal configuration of the terminal device 7. Figure 11 is a diagram showing various materials used in game processing. 91 323304 201220108 Fig. 12 is a main flowchart showing the flow of game processing executed in the game device 3. Figure 13 is a flow chart showing the detailed flow of the game control process. Fig. 14 is a view showing the face of the television 2 and the terminal device 7 in the first game example. Fig. 15 is a view showing the screen of the television 2 and the terminal device 7 in the second game example. Fig. 16 is a view showing an example of a television game image displayed on the television 2 in the third game example. The figure is a diagram showing an example of a terminal game image displayed on the terminal device 7 in the third game example. Fig. 18 is a view showing an example of a television game image displayed on the television 2 in the fourth game example. Fig. 19 is a view showing an example of a terminal game image displayed on the terminal device 7 in the fourth game example. Fig. 20 is a view showing the appearance of the game system 1 in the fifth game example. Fig. 21 is a view showing the connection relationship of the devices included in the game system 1 when connected to an external device via a network. [Main component symbol description] 1 Game system ··.  · .  · 2 .  TV. . . . .   2a Speaker 3 Game device 4 Disc 5 Controller 6 Marking device 6L, 6R marker 323304 8 92 201220108 7 Terminal device 10 CPU 11 System LSI 11a Output input processor (I/O processor) lib GPU 11c DSP lid VRAM lie Internal Main memory 12 External main memory 13 ROM/RTC 14 CD player 15 AV-IC15 17 Flash memory 18 Network communication module 19 Controller communication module 20 Expansion connector 21 Memory card connector 11, 23, 29Antenna 24 Power button 25 Reset button 26 Detach button 27 Codec LSI 28 Terminal communication module 30 Substrate 31 Cover 31a Sound hole 32 Operation unit 32a Cross key 32b 1st key 32c 2nd key 32d A key 32e minus Key 32f Home key 32g Positive key 32h Power key 32i B key 33 Connector 34a to 34d LED 35 Photographic information calculation unit 35a Light incident surface 36 Communication unit 37 Acceleration sensor 38 Infrared filter 39 Lens 40 Photographic element 41 Image processing circuit 93 323304 % 201220108 42 Microcomputer 43 Memory 44 Wireless mode module 45 Antenna 46 Vibrator 47 Speaker 48 Rotary sensor 50 Cover 51 LCD 52 Touch Panel 53 Analog Joystick 53A Left Analog Joystick 53B Right Analog Joystick 54 Operation Key 54A Cross Key (Direction Input Key) 54B to 54H Operation Key 541 1L Key 54J 1R Key 54K 2L Key 54L 2R button 55 Marking portion 55A, 55B marker 56 Camera 57 Speaker hole 58 Expansion connector 59A, 59B Foot 60 Microphone hole 61 Touch panel controller 62 Magnetic sensor 63 Acceleration sensor 64 Rotary sensor 65 User interface controller (UI controller) 66 Codec LSI 67 Speaker 68 Sound 1C 69 Microphone 70 Wireless mode 71 Antenna 72 Infrared green communication module 73 Flash memory 74 Power supply 1C 75 Battery 76 Charger 77 CPU 78 Internal memory 90 Controller operation data 94 323304 8 201220108 91 Receive data 92 Controller operation data 93 1st operation key data 94 1st acceleration data 95 1st angular velocity data 96 marker coordinate data 97 terminal operation data 98 camera image Data 99 microphone sound data 100 touch position data 101 second acceleration data 102 second angular speed data 103 Bit data 104 Camera image data 105 Microphone sound data 106 Processing data 107 Control data 108 Controller posture data 109 Terminal posture data 110 Image identification data 111 Sound identification data 121 Darts 122 Control surface 123 Target 131 Cannon 132 Cannonball 133 Target 141 Hitler (Hit Object) 142 Pitcher (Pitcher Object) 143 Cursor 151 Aircraft (aircraft object) 152 Cannon (Cannon Object) 153 Target (Balloon Object) 154 Crosshair 160 Player 161 Player Character 162 High Club 162a Head 163 ball 164 head image 200 network 201 external device 95 323304

Claims (1)

201220108 VII. Patent application scope: 1. A game system comprising a fixed game device, an operation device, and a transportable display device, wherein the game device is provided with: an operation data receiving unit, from the foregoing operation device ί receiving the operation data; the game processing unit executes the game processing based on the operation of the game; the game image generation unit sequentially generates the first game image based on the game processing; and the game image compression unit sequentially compresses the first game map For example, the compressed image data is generated; and the data transfer unit 'transports the compressed image data to the transportable display device in a wireless manner; the operating device is provided with:卩, can detect infrared light; inertial sensor; operation data transmission department, operation of the subject of the m times # line mode to the detection results of the game device 4, the main table of the information is not covered by the photographic department, and Table 亍: two shows the price measurement of the inertial sensor, before, ten, the operation of the operation button of the other operation, the line cut, can emit infrared light; the game image receiving part, from the aforementioned thumbnail Image data; the device receives the aforementioned, the traveling iron ring image decompression unit, decompresses the compressed image data one by one by 323304 8 201220108 to obtain the first game image; and the display portion, which is successively displayed by decompression The first game image described above. 2. The game system according to claim 1, wherein the game system further includes an indication device capable of emitting infrared light; and the game image generation unit generates a second game image according to the game processing; The game device further includes: an image output unit that sequentially outputs the second game image to an external display device different from the portable display device; and an emission control unit that controls illumination of the indicator device. 3. The game system according to claim 2, wherein the game system includes two operating devices; and the game processing unit executes game processing based on operation data received from each of the operating devices. 4. The game system according to claim 2, wherein the light emission control unit controls the light emission of the indicator device and the infrared light emitting unit in response to the content of the game processing. 5. The game system of claim 4, wherein the light emission control unit generates control data indicating a control instruction for light emitted by the infrared light emitting unit; and the data transfer unit is wireless. Transmitting the control data to the transportable display device; 2 323304 201220108 The transportable display device further includes a control data receiving unit that receives the control data from the game device; the infrared light emitting unit is based on the received control data Come to action. 6. A display device, which is a portable display device capable of wirelessly communicating with a game device, wherein the game device receives an indication from an operation device provided with a camera capable of detecting infrared light by the camera unit The detected information is detected, and the compressed image data compressed based on the game image generated by the game processing executed according to the data is sequentially transmitted to the display device; the display device is provided with: - infrared a light emitting unit capable of emitting infrared light; a game image receiving unit sequentially receiving the compressed image data from the game device; and a game image decompressing unit decompressing the compressed image data to obtain the game image; The display unit sequentially displays the game images obtained by decompression. 7. The display device according to claim 6, wherein the touch panel is provided on the screen of the display unit; the inertial sensor; and the operation data transmission unit wirelessly to the game The device transmits the operation data, and the operation data includes the touch panel and the output data of the inertia sensor of the inertia 3 8 323304 201220108; the game device performs the foregoing game processing according to the foregoing operation data. 8. The display device according to claim 6, wherein the game device wirelessly transmits a game sound generated according to the game processing to the display device, and is provided with a game sound receiving unit; The game device receives the game sound; and the speaker outputs a game sound received by the game sound receiving unit. 9. The display device according to claim 7, wherein the display device is further provided with a microphone; and the operation data transmission unit wirelessly transmits the data of the sound detected by the microphone to the game device. 10. The display device according to claim 7, wherein the camera comprises: a camera; and a camera image compression unit that compresses a camera image captured by the camera to generate compressed photographic data; The compressed photographic material is transmitted to the aforementioned game device in a wireless manner. 11. The display device according to claim 7, comprising: a plurality of surface operation buttons disposed on both sides of the surface of the surface of the surface on which the display portion is disposed; and 4 323304 201220108 The direction input unit is disposed on both sides of the facet surface on the front surface, and can indicate a direction; and the operation data includes information indicating an operation of the plurality of surface operation buttons and the direction input unit. 12. The display device according to claim 7, wherein the plurality of rear operation buttons are disposed on a back plane disposed on an opposite side of a surface plane on which the front surface of the display portion is disposed; and a plurality of sides The operation button is disposed on a side surface between the surface of the table and the back plane; and the operation data further includes information indicating an operation of the plurality of back operation buttons and side operation buttons. 13. The display device according to claim 7, wherein the magnetic sensor is provided with the magnetic sensor; and the operation data further includes the data of the detection result of the magnetic sensor. 14. The display device of claim 7, wherein the inertial sensor is a 3-axis acceleration sensor and a 3-axis rotary sensor. 15. A game processing method for a game processing method executed in a game system including a game device, a device, and a portable display device, wherein the portable display device is provided The infrared light emitting unit is capable of emitting infrared light; 201220108 The operating device is provided with: a photographing unit capable of detecting infrared light, an inertial sensor, and at least one operation button to perform wireless transmission of the operation data to the game device An operation data transmission step, the operation data includes: data indicating a detection result by the photographing unit, data indicating a detection result of the inertial sensor, and information indicating an operation of the operation button; The game device is configured to: receive an operation data receiving step of the operation data from the operation device; perform a game processing step of the game processing according to the operation data; and sequentially generate a game image generation step of the first game image according to the game processing; Compressing the aforementioned first game image one by one a game image compression step of generating compressed image data; and a data transfer step of sequentially transmitting the compressed image data to the transportable display device in a wireless manner; the portable display device is configured to: receive sequentially from the game device a game image receiving step of compressing image data; decompressing the compressed image data one by one to obtain a game image decompression step of the first game image; and sequentially displaying the first image obtained by decompressing The display step of the game image. 6 323304