JP2005143657A - Information presentation system, information presentation device, medium for information presentation device, information presentation method, and information presentation program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To perform dynamic information presentation full of diversity. <P>SOLUTION: A card 20 has: at least three or more feature parts whose relative arrangement to each other is known; and visible information written thereon. An image input part 11 photographs the card 20 which is placed in the photographing range 111 of an image input part 11. An image processing part 121 specifies the three or more feature parts in the image of the photographed card 20 and detects the relative position posture of the specified feature parts relative to the image input part 11. Then, a display image generation part 122 changes information relating to the visible information described on the card 20 and analyzed by a main control part 123 into a form based on the relative position posture detected by the image processing part 121 and prepares a display image by superimposing the resultant information on the image photographed by the image input part 11, and a display part 13 displays the obtained image. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to an information presenting system, an information presenting apparatus, a medium for an information presenting apparatus, and an information presenting information related to visible information described in the medium by processing an image obtained by photographing the medium. The present invention relates to a presentation method and an information presentation program.

Conventionally, as described in Patent Document 1 and the like, in a system in which a game card (medium) and a video game are combined, information stored in the game card (medium) on which a two-dimensional code or the like is printed is read out and the game is played. 2. Description of the Related Art A game system is known that outputs data (speech or feature information, etc.) representing character character described on a card (medium) on a display screen.
JP 2001-334012 A

  However, in the game system disclosed in Patent Document 1, the two-dimensional code on the game card (medium) is merely used as input means for the personality expression information, and the discretionary range of the operator Was limited to which card (medium) to choose and was not satisfactory in terms of diversity. In other words, the position of the presented card (medium) and related information of the card (medium) are presented in relation to the position of the card (medium), or the character characteristics, game, etc. There were no diverse and dynamic systems that could change the progression conditions.

  The present invention has been made in view of the above points. An information presentation system, an information presentation device, a medium for the information presentation device, an information presentation method, The purpose is to provide an information presentation program.

One aspect of the information presentation system of the present invention is:
Photographing means having a predetermined photographing range;
A medium (for example, a card) having at least three or more characteristic parts that can be photographed by the photographing means and whose relative arrangement is known, and in which visible information is described;
An image processing unit that identifies the three or more feature parts in the image of the medium photographed by the photographing unit and detects a relative position and orientation of the identified feature part with respect to the photographing unit;
Based on the relative position and orientation detected by the image processing unit, related information (for example, an object or content) related to the visible information described on the medium is superimposed on an image photographed by the photographing unit. A display image generation unit for generating the displayed image;
A display unit for displaying the display image generated by the display image generation unit;
A main control unit that controls the image processing unit and the display image generation unit;
It is characterized by comprising.

One aspect of the information presentation device of the present invention is:
Photographing means having a predetermined photographing range for photographing a medium (for example, a card) having at least three or more photographable feature parts whose relative positions are known and having visible information described therein;
An image processing unit that identifies the three or more characteristic parts in the image of the medium photographed by the photographing unit and detects a relative position and orientation of the identified characteristic part with respect to the photographing unit;
Based on the relative position and orientation detected by the image processing unit, related information (for example, an object or content) related to the visible information described on the medium is superimposed on an image photographed by the photographing unit. A display image generation unit for generating the displayed image;
A display unit for displaying the display image generated by the display image generation unit;
A main control unit that controls the image processing unit and the display image generation unit;
It is characterized by comprising.

  One aspect of the medium for the information presentation apparatus of the present invention is characterized by being used together with the information presentation apparatus of the present invention.

One aspect of the information presentation method of the present invention is:
Photographing a medium (for example, a card) having at least three or more photographable feature parts whose relative positions are known and in which visible information is described by photographing means having a predetermined photographing range;
Identifying the three or more characteristic parts in the image of the medium photographed by the photographing means, and detecting a relative position and orientation of the identified characteristic parts with respect to the photographing means;
Based on the detected relative position and orientation, a display image obtained by superimposing related information (for example, an object or content) related to the visible information described on the medium on an image photographed by the photographing means. Generate
Display the generated display image,
It is characterized by that.

The information presentation program of the present invention is
On the computer,
Obtained by photographing a medium (for example, a card) having at least three or more photographable feature parts whose relative positions are known and having visible information described therein by photographing means having a predetermined photographing range. A function for inputting an image of the medium;
A function of specifying the three or more feature portions in the input image of the medium and detecting a relative position and orientation of the specified feature portion with respect to the imaging unit;
Based on the detected relative position and orientation, a display image obtained by superimposing related information (for example, an object or content) related to the visible information described on the medium on an image photographed by the photographing means. The function to generate,
A function to display the generated display image;
It is a program for realizing.

Another aspect of the information presentation apparatus of the present invention is as follows.
Obtained by photographing a medium (for example, a card) having at least three or more photographable feature parts whose relative positions are known and having visible information described therein by photographing means having a predetermined photographing range. An image processing unit that inputs an image of the medium, identifies the three or more feature portions in the input medium image, and detects a relative position and orientation of the identified feature portion with respect to the imaging unit; ,
Based on the relative position and orientation detected by the image processing unit, related information (for example, an object or content) related to the visible information described on the medium is superimposed on an image photographed by the photographing unit. A display image generation unit that generates a display image and outputs the generated display image to the outside;
A main control unit that controls the image processing unit and the display image generation unit;
It is characterized by comprising.

  According to the present invention, it is possible to provide an information presenting system, an information presenting apparatus, a medium for the information presenting apparatus, an information presenting method, and an information presenting program that enable a variety of dynamic information presentation. .

  The best mode for carrying out the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1A is a diagram showing a configuration of an information presentation system according to the first embodiment of the present invention.

  The information presentation system according to the present embodiment includes an information presentation device 10 and a card 20.

  Here, the information presentation device 10 is obtained as an image input unit 11 such as a camera, an information processing unit 12 that processes an image input by the image input unit 11, and a processing result by the information processing unit 12. And a display unit 13 such as a display for displaying information. The image input unit 11 functions as a photographing unit having a predetermined photographing range 111. The information processing unit 12 is provided in the form of, for example, a game machine or a personal computer, and includes an image processing unit 121, a display image generation unit 122, and a main control unit 123.

  The card 20 has at least three or more characteristic parts (characteristic points of markers) that can be photographed by the image input unit 11 and whose relative positions are known, and in which visible information is described. It is. In the present specification, the “feature portion” is a portion that can be imaged and whose position can be specified from an image, and includes a feature region, a feature point, and a feature line segment. For example, in a card on which a character is drawn as visible information described at a predetermined position, if a square black frame surrounding the character is enclosed and this character and the black frame are used as markers, the vertexes of the four corners of the black frame and the black frame It can be a line segment.

  The image processing unit 121 of the information processing unit 12 specifies the three or more feature parts in the image of the card 20 photographed by the image input unit 11 and makes the specified feature parts relative to the image input unit 11. Target position and orientation are detected. As a method for calculating the position and orientation of the characteristic part (characteristic point of the marker), for example, a method described in Japanese Patent Application Laid-Open No. 2000-227309 or Japanese Patent Application Laid-Open No. 2001-126051 may be used. Accordingly, if three or more feature points of the marker can be specified, the relative position and orientation of the camera or the like which is the image input unit 11 and the marker can be estimated.

  In addition, the display image generation unit 122 of the information processing unit 12 displays related information related to the visible information described on the card 20 based on the relative position and orientation detected by the image processing unit 121. 11 is used to generate a display image superimposed on the image photographed in step 11. For example, if the visible information is a character, 3D model data of the character can be considered as related information. Thus, various objects and contents can be considered as related information depending on the contents of visible information.

  The main control unit 123 of the information processing unit 12 controls the image processing unit 121 and the display image generation unit 122. Although not particularly illustrated in FIG. And a parameter setting unit for setting parameters related to the related information (for example, information indicating the state of the object, content, or model).

  Next, operation | movement of the information presentation apparatus 10 in the information presentation system of such a structure is demonstrated with reference to the flowchart of FIG.

  That is, first, an image including the card 20 is taken by the image input unit 11 (step S11). For example, when using two cards 20-1 and 20-2 as shown in FIG. 3A, first the first card 20-1 is placed in the shooting range 111 of the image input unit 11, After that, the second card 20-2 is arranged. First, when the first card 20-1 is arranged and photographed, an input image 112 as shown in FIG. 1B is obtained. .

  Here, the main control unit 123 of the information processing unit 12 causes the image processing unit 121 to extract a marker from the card image 20-1a in the input image 112 (step S12), and the position of the marker, that is, the card 20-1. The posture is detected (step S13).

  Thereafter, the main control unit 123 analyzes a pattern and association information (marker ID), which are information for specifying related information, from the extracted marker (step S14). Then, related information corresponding to the analysis result, for example, 3D model data of the character, is read from a storage unit (not shown) provided in the interior, and similarly, a parameter related to the related information, for example, a model, is provided by a parameter setting unit (not shown) provided in the interior. The related information analysis process is executed to change the information indicating the state of the information based on the detected position and orientation (step S15). Of course, the related information may be obtained by inquiring, for example, a server provided outside by communication.

  Next, the main control unit 123 causes the display image generation unit 122 to generate the related information according to the changed parameter, for example, a 3D model of the character, and the input image 112 actually obtained from the image input unit 11. To generate output information that is a screen on which the 3D model is superimposed (step S16). The generated output information is displayed on the display unit 13 (step S17). That is, as shown in FIG. 1B, a 3D model 40-1 of a character according to the position and orientation of the card 20-1 is displayed on the display image 131 in the vicinity of the card image 20-1a. Will be. Note that the output information is not limited to images, and may be stimuli that can be recognized by the operator, such as voice and vibration. In the case of such output information, the voice output unit or the vibration output Are provided in the information presentation device 10.

  Thereafter, the main control unit 123 determines whether or not to continue (step S18). This determination can be made, for example, by determining the presence or absence of an end instruction from the operator. When continuing, it returns to said step S11.

  Here, when the operator places the second card 20-2 in the shooting range 111 of the image input unit 11 as shown in FIG. 3A, an input image 112 as shown in FIG. In the same manner as described above, the related information related to the visible information of the second card 20-2 is changed according to the position and orientation of the card 20-2 and displayed on the display unit 13. It will be. For example, if the related information is 3D model data of the tool, the 3D model 40-2 is not in the vicinity of the card image 20-2a, but is 3D of the character corresponding to the first card 20-1. A display image 131 in such a state that the model 40-1 grips it is displayed. At this time, the position or posture of the 3D model 40-2 of the tool is changed according to the position and posture of the second card 20-1. For example, as shown in FIG. 3B, when the position where the second card 20-2 is placed is below the shooting range 111, the direction of the 3D model 40-2 of the tool is set downward. Etc.

  Thus, the related information can be changed according to the position and orientation of the card. Therefore, if the operation of moving the second card 20-2 from the card arrangement of FIG. 3A to the card arrangement of FIG. 3B and returning to the original state is repeated, FIG. As shown in FIG. 1D, the card image 20-2a moves on the input image 112, whereas the 3D model 40- of the tool held by the character 3D model 40-1 on the display image 131. It is possible to perform animation display as if 2 swings up and down.

  Here, the description has been made assuming that a marker is extracted and the position and orientation are detected using the marker. However, the present invention is not limited to this, and a feature point or feature line such as the outer shape of the card 20 is used instead of the marker. A natural feature portion that is a minute may be extracted and used for position and orientation detection.

  Further, the main control unit 123 can further change the display image 131 by analyzing the environment information from the input image 112 as shown as step S19 in FIG. As the environmental information, the brightness of the input image 112, the average color, the color distribution bias, the number of natural feature parts, the amount of movement of the natural feature parts, and the like can be considered. For example, in the state shown in FIG. 3A and the state shown in FIG. 3C, the positions and orientations of the two cards 20-1 and 20-2 are the same, but the place where the cards are placed, that is, The background color and pattern are different. In such a case, there is a difference in average color and color distribution bias between the two. Therefore, according to this environmental information, in the state shown in FIG. 3A and the state shown in FIG. 3C, for example, the arm of the character 3D model 40-1 holding the tool 3D model 40-2 is held. Changes can be made such as changing the color of the 3D model 40-1 of the character or the 3D model 40-2 of the tool, for example, by reversing the left and right.

(Example 1)
As an example using the first embodiment as described above, for example, use in a card game is conceivable. That is, the information processing unit 12 is a game machine, and a camera as the image input unit 11 is connected to the game machine. The camera is installed so that the area around the place where the card 20 is taken out is the shooting range.

  A pattern that functions as a marker is printed on the card, and the meaning of the card changes depending on the position and posture of the card that the operator presents in the shooting range 111. For example, placing a card vertically means attack, and placing it sideways means defense. Alternatively, placing a card close to your opponent means an attack, and placing it near you means defending.

  It is also conceivable to change the action of the character associated with the card depending on the moving speed and posture changing speed of the card. For example, if the card is quickly removed, the character runs, if the card is slowly removed, the character moves forward so as to hide the character, and if the card is turned quickly, the character jumps. Or, if you hit a flame card down, it becomes a firewall, and if you throw a flame card at an opponent, it becomes a fireball.

  It is also conceivable to change the meaning of the card and the character state depending on the combination of cards presented simultaneously or in sequence. For example, by simultaneously presenting a character card and a weapon card, a model in which the character has a weapon is displayed. For example, by taking out a character card and a kick action card in order, an animation in which the character kicks is displayed. For example, by displaying a character card and a weapon card at the same time and moving the weapon card up and down, an animation in which the character swings the weapon up and down is displayed.

  It is also conceivable to change the output depending on the temporal continuity of the card. For example, if the time from when the card is taken out becomes long, the power of the card becomes small.

  Alternatively, the real time may be managed using an operation of taking out a card as a trigger. For example, if the next card is released within 1 second from the previous card, the power will be 120%. Of course, you may manage the time in the conventional game turn system.

  In addition to the card, a marker is placed on the “field” (the camera's shooting range 111, where the card is placed), and the output changes depending on the relative position, posture, and speed between the “field” and the card. It is possible to make it. For example, if you put a water monster card near the flame area in the “field”, the power of that monster will be 80%, or near the flame area in the “field”, When the card is removed, the flame displayed as the background of the screen becomes intense.

  Further, the output can be changed according to environmental information other than the card being photographed by the camera. For example, in a dark situation, if the power of all characters is 60%, or if there are many natural features in the screen, the movement of the characters becomes agile.

  In this way, by configuring the marker, the state of the system, the state of the system, and the information to be output depending on the position, posture, speed, and direction of the marker, the operator can change the marker (card). Since the game proceeds by direct operation, a high immersive feeling can be obtained.

  In addition, by configuring the model, system status, and output information to change according to the environment information obtained from the camera, the game progresses according to the environment of the operator, so a higher immersive feeling can be achieved. can get.

  In addition, when the cards 20 are overlapped, if a part of the cards that have been put out can be seen, the corresponding character can be displayed by tracking the natural feature part or by recognizing the pattern. it can. Further, even when the character is removed from the “field” after being overlaid, the corresponding character can be erased by tracking the natural feature portion or by recognizing the pattern.

[Second Embodiment]
Next, a second embodiment of the present invention will be described.

  In the information presentation system according to the present embodiment, as shown in FIG. 4, the information presentation apparatus 10 includes only an information processing unit 12 including an image processing unit 121, a display image generation unit 122, and a main control unit 123. As for the image input unit 11 and the display unit 13 in the first embodiment, the image input unit 51 and the display unit 52 provided in the controller 50 separate from the information presentation apparatus 10 are used. The controller 50 is provided in the form of a PDA or a portable game machine.

  Even with such a configuration, the same effect as in the first embodiment can be obtained. Further, in this case, there is an effect that the superimposed image displayed on the display unit 52 is that of the operator's viewpoint.

  Further, a usage form by a plurality of operators is conceivable in which a plurality of controllers 50 are connected to the information presentation device 10 and the main control unit 123 of the information processing unit 12 manages the progress of the game.

  Further, as shown in FIG. 5A, a controller 50 further including only a display unit 52 may be connected to the information presentation apparatus 10 similar to that in the first embodiment. Even in this case, a plurality of controllers 50 are connected to the information presentation apparatus 10 and a use form by a plurality of operators is also conceivable. In that case, as shown in FIG. 5 (B), the display image 131 as in the first embodiment is displayed on the display unit 13 of the information presentation device 10, and a superimposed image is presented to the audience or the like. A display image 521 including non-public information for each operator can be displayed on the display unit 52 of the controller 50. For example, the 3D model 40-1 of the character corresponding to the card put out in the “field” is displayed not only on the display unit 13 that everyone sees but also on the display unit 52 of the controller 50 of the operator, and the text 41 etc. It is possible to use an agent-like action such as explaining the compatibility with the opponent's character or giving advice on the strategy.

  Alternatively, the card 20 can be substituted by displaying a card image on the display unit 52 of the controller 50 and placing or moving the controller 50 in the photographing range 111 of the image input unit 11 of the information presentation device 10. It is. In this case, the operator can make corrections to the card image itself with so-called paint software, and the card information may be changed by the correction.

[Third Embodiment]
Next, a third embodiment of the present invention will be described.

  FIG. 6A is a diagram illustrating a configuration of the information presentation system according to the present embodiment. A plurality of information presentation apparatuses 10-1 and 10-2 as in the first embodiment described above are connected to the server 60 with the network 70. Is connected through the network.

  In such a configuration, as shown in FIGS. 6B and 6C, the input images 112-1 and 112-2 of the information presentation devices 10-1 and 10-2 are included in the configuration by the management of the server 60. Only the card images 20-1a and 20-2a issued by the operator of the information presentation device are included, whereas the display images 131-1 and 131-2 include the images of the cards issued by other operators. 20-2a and 20-1a and 3D models 40-2 and 40-1 which are related information are superimposed and displayed. That is, as shown in FIG. 7, the server 60 manages the “place” of each information presentation device, that is, each operator, and displays the superimposed image of each “place” as the display image 131 -A, each operator. It controls to display on 131-N simultaneously. In this case, it is displayed in such a manner that the opponent's card that is competing via the network 70 is displayed over the card that the player has put out. Of course, they may overlap.

  Of course, when there are a plurality of persons on the network 70 as described above, it is necessary to provide each information presentation apparatus with a function of selecting a partner.

(Example 2)
As an example using the third embodiment as described above, for example, a network game using cards can be considered. In this case, the output of the related information may be changed according to the statistical amount of the state of the cards issued by all the operators and the state of all the “places”. For example, when there are many water monsters, the power of water monsters will be 60%, or if there are many herbivores, the number of grasslands will decrease from the entire “place”. Further, for example, the meaning of the card may be changed depending on the ranking of the operator.

  The game content creator can specify how to change the parameter of the character with respect to the marker with the authoring tool.

  Further, in such a network game, an authentication process for a regular registered user is also required. This authentication can also use a card. That is, code information such as a numeric string or a two-dimensional code is written on a part of the card, and it can be used after registering the code information by holding it near the image input unit 11 of the information presentation device before starting the game. And In this case, the information presenting apparatus registers the card ID in the server 60 by the communication function and cannot use two cards at the same time, or has a use expiration date after registration. You can reduce your willingness to copy by making it less.

  Of course, forgery prevention means that does not depend on the communication network can also be used. For example, an RFID tag may be put in a card and the image input unit 11 may have an RFID reading function. Further, for example, a paint that reflects ultraviolet rays may be applied to the card as information that is invisible to the human eye but can be read by the image input unit 11.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described.

  When the card 20 is moved, a part of the marker may protrude outside the shooting range 111. Even in such a case, it is desirable to correctly detect the position and orientation and present related images according to the detected position and orientation.

  Therefore, in the present embodiment, as shown in FIG. 8, a pattern 21 that is visible information on a card 20, and a portion having a characteristic part that serves as a reference for pattern extraction of the pattern 21 (card reference marker 22) Are provided at different positions. By doing so, the marker ID can be recognized from only a part of the card pattern 21 (visible information) included in the range visible as an image. This is because the reference point as a marker is obtained from the reference marker 22 on the card, so that tracking is less likely to be interrupted even if the marker (card) moves relative to the shooting range 111.

  As described above, if the reference marker 22 on the card is used, the rectangular black frame on the card, which is a reference for pattern extraction, can be reduced, so that it is difficult to cut from the shooting range 111, that is, the input image 112. Even if only a part of the pattern is shown, the position and orientation of the image input unit 11 can be calculated. Therefore, the position and orientation can be calculated from moment to moment.

  As shown in FIG. 9, the “field” may be configured as a stadium 81 to which reference markers 80A and 80B are attached. In this case, the arrangement of the operator is recognized by the reference markers 80A and 80B.

  As shown in FIG. 10, for example, when the image input unit 11 is fixedly attached to the stadium 81 by the support pillar 82 and registration is performed, the stadium 81 does not have the reference marker 80. However, since the relative position between the stadium 81 and the card can be calculated, the reference marker 80 need not be provided.

[Fifth Embodiment]
Next, a fifth embodiment of the present invention will be described.

  As shown in FIGS. 11A and 11B, the marker on the card 20 can be configured by a pattern 21 and a two-dimensional code 23. In this case, code information such as a card ID and characteristics is encoded and recorded in the two-dimensional code 23. In particular, as shown in FIG. 11A, when the two-dimensional code 23 is arranged in a predetermined positional relationship with respect to the pattern 21, the direction of the pattern recognition pattern 21 can be indicated.

  When such a card 20 is photographed from a distance by the image input unit 11, the code information cannot be decoded because the image of the two-dimensional code 23 is crushed on the input image 112, and simply functions as a marker detection index. On the other hand, since the code information can be obtained by decoding the two-dimensional code 23 when the image is taken in the vicinity, the related information can be obtained by the code information even if the entire card is not shown. Therefore, for example, when the card 20 is held close to the image input unit 11, a display image 131 in which the character associated with the card 20 greets can be displayed on the display unit 13.

  Further, the pattern 21 (and the two-dimensional code 23) is printed on the card 20 in advance, but an additional character area 24 may be further provided as shown in FIG. The additional character area 24 is an area for attaching an additional sticker 25. By attaching the additional sticker 25, related information to be output can be changed.

  In this case, by using the additional seal 25 as a marker, that is, as an additional code, the parameters related to the related information may be changed not only by the pattern of the additional seal 25 but also by the position and direction of application. For example, the growth stage can be expressed by the additional seal 25, and the belongings can be expressed by the additional seal 25. Further, not only can this additional seal 25 be exchanged with a friend, but also the exchange itself, which can be further mated or evolved by the exchange, can be given added value.

  The additional seal 25 may be issued not only with or separately from the card 20 but also by providing or connecting a seal printer to the information presentation apparatus 10. In the case where such an issue function of the additional seal 25 is provided, for example, an application such as reading the monster obtained from the opponent by a battle game using a card to make the additional seal 25 can be considered. By sticking this additional sticker 25, you can power up your character. For example, if there is no history of fighting, no matter how much additional sticker 25 is pasted, the additional sticker 25 will be invalid and will change anything. It is preferable not to bring about.

  Further, the additional sticker 25 may be a handwritten sticker instead of a sticker printer.

  In this way, by adding the additional sticker 25 to the existing card 20 (marker), the related information associated with the card (marker) is changed so that the operator can use the additional sticker 25 to change the marker. Since information can be edited, a system (game) with a higher degree of freedom can be constructed.

  The pattern 21 may be a monochrome image, but in addition to the design reason, it is preferably a color image for the following reason. That is, as shown in FIG. 13, for example, the red image 26 is visible under white light and is captured by the image input unit 11, but is difficult to view and difficult to capture under red light. Accordingly, two types of patterns can be obtained with one card depending on the environment, and different related information can be provided to present more varied related information. Needless to say, the same effect can be obtained in a pseudo manner by appropriately attaching a color filter or the like to the image input unit 11.

  Although the present invention has been described above based on the embodiments, the present invention is not limited to the above-described embodiments, and various modifications and applications are naturally possible within the scope of the gist of the present invention.

  For example, the “medium” is not limited to the card as described in the above embodiment, but refers to an imaging target having a characteristic part, and includes an object on which a characteristic part or a marker such as a wall surface of a structure is formed. Moreover, what was imaged is included.

  Further, the display unit 13 is not limited to the monitor, and may be projected onto the “field” itself where the card is placed like a projector.

(A) is a figure which shows the structure of the information presentation system which concerns on 1st Embodiment of this invention, (B) is a figure which shows the input image and display image in the case of a single card, (C) is the case in the case of two cards It is a figure which shows an input image and a display image, (D) is a figure which shows an input image and a display image when one of two cards is moved to (C). It is a figure which shows the flowchart for demonstrating operation | movement of the information presentation apparatus in the information presentation system which concerns on 1st Embodiment. (A) thru | or (C) is a figure for demonstrating the positional relationship of two cards, and the relationship with a background, respectively. It is a figure which shows the structure of the information presentation system which concerns on 2nd Embodiment of this invention. (A) is a figure which shows the structure of the modification of the information presentation system which concerns on 2nd Embodiment, (B) is a figure which shows the example of a display of each of the two display parts in the modification of (A). (A) is a figure which shows the structure of the information presentation system which concerns on 3rd Embodiment of this invention, (B) shows the input image and display image in one information presentation apparatus in the information presentation system which concern on 3rd Embodiment. It is a figure, (C) is a figure which shows the input image and display image in the other information presentation apparatus. It is a figure for demonstrating the logical structure in the information presentation system which concerns on 3rd Embodiment. It is a figure which shows the state in which a part of card | curd went out of the imaging | photography range for demonstrating the marker detection method in 4th Embodiment of this invention. It is a figure which shows the stadium which has arrange | positioned the reference marker. It is a figure which shows the stadium where the relative position and orientation of the image input part were fixed. (A) And (B) is a figure which shows the example of the card | curd in 5th Embodiment of this invention, respectively. It is a figure which shows the card | curd which has the write-once character area which affixes an additional sticker, and an additional sticker as another example of the card | curd in 5th Embodiment. It is for demonstrating the red-type image as visible information which is not image | photographed with an image input device.

Explanation of symbols

    DESCRIPTION OF SYMBOLS 10, 10-1, 10-2 ... Information presentation apparatus 11, 51 ... Image input part, 12 ... Information processing part, 13, 52 ... Display part, 20, 20-1, 20-2 ... Card, 20-1a , 20-2a ... card image, 21 ... pattern, 22, 80A, 80B ... fiducial marker, 23 ... two-dimensional code, 24 ... additional character area, 25 ... additional sticker, 26 ... red image, 40-1, 40 -2 ... 3D model, 41 ... text, 50 ... controller, 60 ... server, 70 ... network, 81 ... stadium, 82 ... support pillar, 111 ... shooting range, 112, 112-1, 112-2 ... input image, 121 ... Image processing unit, 122 ... Display image generation unit, 123 ... Main control unit, 131, 131-1, 131-2, 131-A, 131-N, 521 ... Display image

Claims (22)

Photographing means having a predetermined photographing range;
A medium having at least three or more characteristic parts that can be photographed by the photographing means and whose relative positions are known, and in which visible information is described;
An image processing unit that identifies the three or more feature parts in the image of the medium photographed by the photographing unit, and detects a relative position and orientation of the identified feature part with respect to the photographing unit;
Based on the relative position and orientation detected by the image processing unit, a display that generates a display image in which related information related to the visible information described on the medium is superimposed on an image captured by the imaging unit An image generator;
A display unit for displaying the display image generated by the display image generation unit;
A main control unit for controlling the image processing unit and the display image generation unit;
An information presentation system comprising:   The information presenting system according to claim 1, wherein the characteristic part is included in a marker formed on the medium.   The information presentation system according to claim 1, wherein the characteristic part is included in a natural characteristic part including an outer shape of the medium.   The information presentation system according to claim 1, wherein the position and orientation of the related information change according to a change in the position and orientation of the characteristic part in the image captured by the imaging unit. The medium further includes a code in which information is encoded;
The information presentation system according to claim 1, wherein the related information is obtained by decoding the code. The main control unit has storage means for storing the related information,
The said related information is read from the said memory | storage part based on the information which shows the corresponding relationship between the said relevant information obtained by decoding the said code | cord | chord, and the said medium. Information presentation system described.   6. The information presentation system according to claim 5, wherein the related information is encoded in the code. The main control unit has parameter setting means for setting parameters relating to the related information,
The information presentation system according to claim 1, wherein the related information or the information related to the related information is changed based on a parameter set by the parameter setting unit.   The information presentation system according to claim 8, wherein the main control unit changes the related information or the parameter according to a position or posture of the characteristic part in an image photographed by the photographing unit.   The information presentation according to claim 8, wherein the main control unit changes the related information or the parameter according to a combination of media having the characteristic part that is reflected in an image photographed by the photographing unit. system.   The said main control part changes the said relevant information or the said parameter according to the order of appearance of the medium which has the said characteristic part in the some image image | photographed in time series by the said imaging | photography means. Information presentation system described.   The said main control part changes the said relevant information or the said parameter according to the change of the position or attitude | position per unit time of the medium which has the said characteristic part in the imaging | photography range of the said imaging means. Information presentation system.   The information presentation system according to claim 8, wherein the main control unit changes the related information or the parameter by an additional code attached to the medium having the characteristic part.   The information presentation according to claim 8, wherein the main control unit changes the related information or the parameter by detecting an environment when the image is captured from an image captured of the medium. apparatus.   The main control unit, in a plurality of images photographed in time series by the photographing unit, the related information or the time depending on the time from the appearance of one medium having the characteristic part to the appearance of the other medium. The information presentation system according to claim 8, wherein the parameter is changed.   The information presentation system according to claim 1, wherein the characteristic part is formed of an invisible material that can be imaged by the imaging unit.   The information presentation system according to claim 1, wherein the medium has an encoded code or character representing a unique ID on a surface thereof. An imaging means having a predetermined imaging range for imaging a medium having at least three or more imageable feature parts whose relative positions are known and having visible information described therein;
An image processing unit that identifies the three or more feature parts in the image of the medium photographed by the photographing unit, and detects a relative position and orientation of the identified feature part with respect to the photographing unit;
Based on the relative position and orientation detected by the image processing unit, a display that generates a display image in which related information related to the visible information described on the medium is superimposed on an image captured by the imaging unit An image generator;
A display unit for displaying the display image generated by the display image generation unit;
A main control unit for controlling the image processing unit and the display image generation unit;
An information presentation apparatus comprising:   A medium for an information presentation device, wherein the medium is used with the information presentation device according to claim 18. A medium having at least three or more imageable feature parts whose relative positions are known and having visible information described therein is imaged by an imaging means having a predetermined imaging range,
Identifying the three or more feature parts in the image of the medium photographed by the photographing means, and detecting a relative position and orientation of the identified feature part with respect to the photographing means;
Based on the detected relative position and orientation, a display image in which related information related to the visible information described in the medium is superimposed on an image photographed by the photographing unit is generated,
Display the generated display image,
An information presentation method characterized by that. On the computer,
An image of the medium obtained by imaging a medium having at least three or more imageable feature parts whose relative positions are known and imaged with visible information is recorded by an imaging unit having a predetermined imaging range. The ability to input images,
A function of specifying the three or more feature parts in the image of the input medium and detecting a relative position and orientation of the specified feature parts with respect to the imaging unit;
A function for generating a display image in which related information related to the visible information described in the medium is superimposed on an image photographed by the photographing unit based on the detected relative position and orientation;
A function to display the generated display image;
An information presentation program for realizing An image of the medium obtained by imaging a medium having at least three or more imageable feature parts whose relative positions are known and imaged with visible information is recorded by an imaging unit having a predetermined imaging range. An image processing unit that inputs an image, specifies the three or more feature parts in the input medium image, and detects a relative position and orientation of the specified feature part with respect to the imaging unit;
Based on the relative position and orientation detected by the image processing unit, generate a display image in which related information related to the visible information described in the medium is superimposed on an image captured by the imaging unit, A display image generation unit for outputting the generated display image to the outside;
A main control unit for controlling the image processing unit and the display image generation unit;
An information presentation apparatus comprising:

Images