HK1192031A - Mobile terminal device, control method, augmented reality system, and clothing - Google Patents

Abstract

The present invention relates to a mobile terminal device, a control method, an augmented reality system, and a character item such as clothing that can achieve more elaboration and the effects of promoting the character item by configuring a mechanism that easily reproduces an augmented reality image associated with the design of the character item purchased by a consumer. Moreover, a controller (27) performs image recognition of the design of at least part of a picture obtained by capturing, by an image capturing unit (21), an image of a character(s) printed on or attached to a character item (10), and generates an augmented reality image by combining a stagecraft image, prepared in association with each of image-recognized designs, with a subject image of a person wearing or having the character item (10), and then displays the augmented reality image on a display unit (22).

Description

Portable terminal device, control method, augmented reality system, and clothing

Technical Field

The present invention relates to a portable terminal device, a control method, an augmented reality system, and a character commodity such as clothing.

Background

The printed T-shirt is formed by printing images of patterns and themes as still images on the T-shirt by using a processing technique such as silk-screen printing. Recently, a commodity (also referred to as a character commodity) having a character, a bag, or a toy with a character, a character animation, or the like printed thereon has been popular in the market and is popular among children.

On the other hand, the portable terminal devices are becoming multifunctional, and recently, smart phones are becoming popular in which a network communication environment for connecting to the internet is strengthened instead of mobile phones. With a smartphone, it is possible to obtain an application program that is distributed in the market by downloading, and thus, the smartphone can be customized in various ways as a tool for an entity system for data management or mail creation, a practical system such as a weather forecast or transfer guide, a gourmet guide, or a navigation system using a satellite, a business system such as a memo tool or noun management, a communication system such as "Skype" (registered trademark) or "Twitter" (registered trademark), or an entertainment system such as an online game.

However, an AR (augmented Reality) technology for augmenting a real-world environment computer perceived by a human being with a computer has been known. For example, patent document 1 describes a technique of appropriately changing a target image to be combined with an image representing a real world situation in an augmented reality image.

[ background Art document ]

[ patent document ]

[ patent document 1] Japanese patent laid-open publication No. 2011-

Disclosure of Invention

[ problems to be solved by the invention ]

As disclosed in patent document 1, the AR technique is to arrange a pattern of a specific shape called a marker for three-dimensional position recognition in the real world and to image the real world including the marker with an imaging device. Therefore, the marker is arranged in the form of perspective-converted within the captured image. Then, a perspective conversion technique is applied to the target associated with the marker, and a target image obtained with the captured image as a background is synthesized, thereby generating an augmented reality image. With this AR technology, cg (computer graphics) reproduction of moving images or still images can be performed.

However, if an augmented reality image generated by linking the smartphone and the character merchandise such as a printed T-shirt and synthesizing the image for performance of the appearance of the character merchandise purchased by the consumer with the image for performance associated with the character merchandise can be reproduced, the character merchandise can be added with a value, and the interest can be increased and a sales promotion effect can be obtained. In order to achieve such an object, it is also desirable to reproduce an augmented reality image easily without using a high-level perspective conversion technique.

The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a mobile terminal device, a control method, an augmented reality system, and a character commodity, which are capable of enhancing interest and obtaining a sales promotion effect of a character commodity by constructing a structure for easily reproducing an augmented reality image associated with a model of the character commodity purchased by a consumer.

[ means for solving problems ]

The portable terminal device of the present invention includes at least an imaging unit and a display unit, wherein the imaging unit includes a control unit that performs image recognition on at least a part of a model of an image obtained by imaging a character printed or attached to clothing, and generates an augmented reality image by synthesizing a presentation image prepared in association with each of the models subjected to the image recognition and a subject image of a person wearing the clothing, and displays the augmented reality image on the display unit.

In the present invention, the control unit preferably changes the image size of the presentation image in accordance with the image size of the subject image.

In the present invention, it is preferable that the control unit further includes a sound output unit that generates an effect sound when the presentation image is displayed on the display unit, and outputs the generated effect sound to the sound output unit.

The control method of the present invention is a control method of a terminal device of a computer for controlling the portable terminal device in an augmented reality system, the augmented reality system including: printing or attaching clothes with specific roles; and a portable terminal device having at least an imaging unit and a display unit, generating an augmented reality image from at least a part of the model of the image imaged by the imaging unit, and displaying the augmented reality image on the display unit; the control method causes the computer to execute: recognizing at least a part of a model of an image obtained by imaging the character by the imaging unit; and synthesizing images for presentation prepared in association with the figures recognized by the images and an object image of a person wearing the clothing, thereby generating an augmented reality image and displaying the augmented reality image on the display unit.

The augmented reality system of the present invention includes: printing or attaching clothes with specific roles; and a portable terminal device having at least an imaging unit and a display unit, and having a control unit that performs image recognition on at least a part of a figure of a video obtained by imaging the character by the imaging unit, synthesizes a presentation image prepared in association with each of the figures subjected to the image recognition with a subject image of a person wearing the clothing, generates an augmented reality image, and displays the augmented reality image on the display unit.

The present invention relates to a augmented reality system including a portable terminal device for recognizing at least a part of a model of a video image obtained by capturing an image of a specific character, and combining a rendering image prepared in association with each recognized model with a subject image of a person wearing the clothing to generate and display an augmented reality image.

The present invention provides a portable terminal device for capturing an image of a person wearing clothing, wherein the portable terminal device includes a character printed or affixed with a specific character, the character printed or affixed includes at least one figure obtained by image-recognizing an image of the character included in the captured image of the person wearing clothing, the figure is prepared with a corresponding rendering image in the portable terminal device, and the rendering image is used for generating an augmented reality image by synthesizing the rendering image with the image of the person wearing clothing in the portable terminal device.

[ Effect of the invention ]

According to the present invention, it is possible to provide a mobile terminal device, a control method, an augmented reality system, and a character commodity, which can enhance the interest and can obtain the effect of promoting the sales of the character commodity by constructing an augmented reality image that is easily reproduced in association with the shape of the character commodity such as clothing purchased by a consumer.

Drawings

FIG. 1 is an image of an augmented reality system according to an embodiment of the present invention.

Fig. 2 is a block diagram showing an internal configuration of a mobile terminal device according to an embodiment of the present invention.

Fig. 3 is a flowchart showing the operation of the mobile terminal device according to the embodiment of the present invention.

Fig. 4(a) and (b) are diagrams showing operations of the mobile terminal device according to the embodiment of the present invention on a screen.

[ description of symbols ]

10 character commodity

20 Portable terminal device

30 goods label

21 imaging part

22 display part

23 operating part

24 sound output unit

25 communication part

26 storage unit

27 control part

100 augmented reality system

260 terminal program

270 main control part

271 image acquisition unit

272 image recognition unit

273 rendering control part

274 display control part

Detailed Description

(constitution of embodiment)

Hereinafter, embodiments for carrying out the present invention (hereinafter, simply referred to as the present embodiments) will be described in detail with reference to the drawings.

Fig. 1 shows an augmented reality system 100 according to the present embodiment. As shown in fig. 1, the augmented reality system 100 according to the present embodiment includes: a character merchandise 10 printed or attached with a specific character; and a mobile terminal device 20 such as a smartphone that performs image recognition of at least a part of a model of a video image obtained by capturing a character printed on the character commodity, synthesizes a presentation image prepared in association with each of the image-recognized models and a subject image of a person wearing the character commodity, generates an augmented reality image, and displays the augmented reality image on a screen.

Here, the character product 10 is exemplified by a T-shirt for children on which characters such as hero in the battle are printed. A consumer who purchases the T-shirt (in most cases, a parent of a child wearing the T-shirt) reads the QR code (registered trademark) attached to the product label using the portable terminal device 20, and downloads an application (terminal 260 described later) for reproducing the augmented reality image from a website such as a T-shirt sales manager or a manager who has a copyright of a character printed on the T-shirt, for free.

Then, the consumer starts the terminal program 260 acquired by downloading, thereby focusing on the front body figure of the child wearing the T-shirt and reading the figure of the character by shooting. Only by this shooting operation, although only children are actually present, for example, double shooting can be realized by using a simple AR technique in which a child and hero who have posed a fighting posture are present near the image for performance. At this time, the mobile terminal device 20 performs image recognition on at least a part of the image of the character product obtained by imaging, and generates an augmented reality image by synthesizing a presentation image prepared in advance in association with each image-recognized figure and a subject image of a child wearing a T-shirt, and displays the augmented reality image on the screen.

Fig. 2 shows an internal configuration of the mobile terminal device 20 according to the present embodiment. As shown in fig. 2, the portable terminal device 20 includes an imaging unit 21, a display unit 22, an operation unit 23, an audio output unit 24, a communication unit 25, a storage unit 26, and a control unit 27.

The imaging unit 21 is a camera including a photoelectric conversion element such as a CCD (Charge Coupled Device) or CMOS (Complementary Metal Oxide Semiconductor) image sensor, a control circuit thereof, and the like. The Display unit 22 is configured by using a plurality of pixels (a combination of light emitting elements of a plurality of colors) arranged in a vertical and horizontal direction, for example, an LCD (Liquid Crystal Display Device) or an organic EL (Electro-Luminescence), and displays Display information including an augmented reality image written in a specific region (VRAM region) of the storage unit 26, which is generated by the control unit 27.

The operation unit 23 includes, for example, a key switch to which various functions are assigned, such as a power key, a talk key, a numeric key, a character key, a direction key (up and down), a enter key, a send key, and a capture key, and when the operator operates these keys, a signal corresponding to the operation contents is generated and outputted to the control unit 27 as an instruction of the operator. The operation unit 23 may be implemented by a touch panel that inputs position information. In this case, the key switches and the augmented reality image are displayed on the touch panel.

The sound output unit 24 is a speaker that outputs sound including the sound effect generated by the control unit 27. The communication unit 25 captures a wireless communication system, performs wireless communication with a base station, not shown, connected to a communication network, and transmits and receives various data. Here, the various data include voice data during voice call, mail data during transmission and reception of mail, and Web page data during Web (worldwide Web) browsing. In the present invention, the data necessary for generating the augmented reality image corresponding to the character product 10 is downloaded and acquired from the website (server) of the operator through the communication unit 25. In this case, the communication unit 25 connects to a server (not shown) according to a Protocol based on TCP/IP (Transmission Control Protocol/Internet Protocol, Transmission Control Protocol/network communication Protocol), for example.

The storage unit 26 is allocated with a work area and a vram (video ram) area in addition to a program area for storing the terminal program 260 of the present embodiment. The augmented reality image generated by the control unit 27 or the augmented reality image acquired via the internet is stored in the work area as needed, and display information including the augmented reality image is drawn in the VRAM area. The storage unit 26 is mounted with a semiconductor memory element, a magnetic memory element, or an optical memory element, for example.

The control unit 27 has a function of recognizing at least a part of the figure of the image captured by the imaging unit 21, synthesizing the image for rendering prepared in association with each of the figures recognized by the image recognition and the subject image of the person wearing the character commodity, and generating and displaying an augmented reality image on the display unit 22. At this time, the control unit 27 may change the image size of the presentation image according to the image size of the subject image. Further, it is also possible to generate an effect sound when the presentation image is displayed on the display unit 22 and output the generated effect sound to the sound output unit 24.

Therefore, as shown in fig. 2, the configuration of the terminal program 260 executed by the control unit 27 is functionally divided, and includes a main control unit 270, an image acquisition unit 271, an image recognition unit 272, a rendering control unit 273, and a display control unit 274.

The image acquisition unit 271 acquires an image of the figure of the character printed or attached to the full-color product 10 such as a T-shirt captured by the imaging unit 21, and outputs the image to the image recognition unit 272. The image recognition unit 272 recognizes the model acquired by the image acquisition unit 271, and outputs the recognized model to the rendering control unit 273. The rendering control unit 273 generates an augmented reality image by synthesizing the rendering image prepared in association with each of the figures image-recognized by the image recognition unit 272 and the subject image of the person wearing the character commodity 10, and displays the augmented reality image on the display unit 22.

At this time, the rendering control section 273 may change the image size of the rendering image in accordance with the image size of the subject image obtained by actual shooting. Further, it is also possible to generate an effect sound when the presentation image is displayed on the display unit 22 and output the generated effect sound to the sound output unit 24.

The display control unit 274 draws the augmented reality image generated by the rendering control unit 273 in the VRAM region of the storage unit 26, reads the drawn display information in synchronization with the display timing, and displays the display information on the display unit 22.

In order for the control unit 27 to recognize the image of at least a part of the image captured by the imaging unit 21, the rendering image prepared in association with each of the recognized images and the subject image of the person wearing the character commodity are synthesized, and an augmented reality image is generated and displayed on the display unit 22, and the main control unit 270 controls the sequence of the image acquisition unit 271, the image recognition unit 272, the rendering control unit 273, and the display control unit 274.

(operation of the embodiment)

Hereinafter, the operation of the mobile terminal device 20 according to the present embodiment will be described in detail with reference to the screen configurations of fig. 1 and fig. 4(a) and (b) based on the flowchart of fig. 3.

First, when the control unit 27 (main control unit 270) of the portable terminal device 20 is powered on, it is determined whether or not the terminal program 260 is installed in the portable terminal device 20 (step S101). The main control unit 270 can determine whether or not to install by referring to an install application list (not shown) stored in a specific area of the storage unit 26. If it is determined that the terminal program is not installed (NO in step S101), the main control unit 270 generates a message indicating that the terminal program is not installed, displays the message on the display unit 22, and prompts the consumer to acquire the terminal program 260. In accordance with the message, the consumer reads the QR code (registered trademark) attached to the merchandise tag 30, for example, as shown in fig. 4(a) (step S102). In this way, the terminal program 260 is automatically downloaded to the portable terminal device 20 and is installed and stored in the program area of the storage unit 26 (step S103).

On the other hand, in step S101, if it is determined that the terminal program 260 has been installed in the portable terminal device 20 (YES in step S101), the consumer performs an operation for starting the terminal program 260. When the terminal program 260 is started (step S104), the image recognition of the figure of the character printed on the character product 10 and the generation of the augmented reality image based on the image recognition result can be performed as described later.

When the terminal program 260 is started, for example, as shown in fig. 4(b), the consumer focuses on the character printed on the front of the T-shirt worn by the child (step S105). Then, when the consumer turns ON the shooting key of the operation unit 23 or the shooting button assigned to the partial area of the display unit 22 (YES in step S106), the main control unit 270 detects this and switches control to the image acquisition unit 271. The image acquisition unit 271 transmits the character pose captured by the imaging unit 21 to the image recognition unit 272, and the image recognition unit 272 performs image recognition of the pose of the character (step S107).

The image recognition result of the model by the image recognition unit 272 is output to the rendering control unit 273. The rendering control unit 273 reads rendering images prepared in association with the respective image-recognized character poses (step S108). When the read rendering image is displayed on the display unit 22 by the display control unit 274, the rendering control unit 273 performs a process of changing the image size of the rendering image in accordance with the image size of the subject image, as indicated by a double-headed arrow in fig. 1, for example (step S109). That is, when the image size of the subject image is large, the rendering control unit 273 determines that the imaging distance d between the subject and the mobile terminal device 20 is short, and displays the rendering image in a relatively large image size. Conversely, when the image size of the subject image is made smaller, the image size of the presentation image is made relatively smaller, so that the image size of the presentation image can be matched with the subject image of the child wearing the T-shirt.

That is, if the distance between the child, which is the subject image, and the portable terminal device 20 is too short, the image for entertainment is displayed largely, and the entire image for entertainment cannot be displayed in the effective display screen area of the display unit 22. Therefore, the consumer reduces the image for presentation in the effective display area of the display unit 22 by adjusting the shooting distance d (backward shooting) at the time of shooting. In this case, the image size of the child is also reduced accordingly, and therefore the image size of the presentation image is also reduced, and the shooting position is adjusted at a position where the image sizes of the subject image and the presentation image are optimal. In this way, the image size feeling of the subject image and the presentation image is adjusted by the shooting distance d.

Further, the size determination of the subject image that changes according to the shooting distance is performed, for example, as shown in fig. 1, with reference to the image size when the shooting distance d is 2[ m ]. That is, the imaging distance d is preferably about 2[ m ] in accordance with the relationship between the body of the child as the object and the depth of field through the lens used as the imaging unit 21 of the portable terminal device 20.

Next, when the main control unit 270 detects that the consumer turns ON the shooting key (YES in step S110), the rendering control unit 273 synthesizes the rendering image at the shooting position and the subject image of the child wearing the T-shirt, generates an augmented reality image, and outputs the augmented reality image to the display control unit 274. The display control unit 274 draws the augmented reality image generated by the rendering control unit 273 in the VRAM region of the storage unit 26, reads the drawn augmented reality image in synchronization with the display timing of the display unit 22, and displays the read augmented reality image on the display unit 22 (step S111). That is, although only a child is actually a subject, a two-person image is displayed on the screen of the display unit 22 by a simple AR technique using an augmented reality image in which hero appears near the body, and an image as if a child wearing a T-shirt is partnered with a memorial image of hero is displayed.

In this case, the rendering control unit 273 may generate an effect sound when the rendering image is displayed on the display unit 22, and output the generated effect sound to the sound output unit 24. At this time, the sound output unit 24 outputs the effect sound to the outside to give a sense of heroic presence, and as a result, the effect of the presentation is enhanced (step S112).

As described above, according to the portable terminal device 20 of the present embodiment, the control unit 27 performs image recognition of the appearance of the image obtained by imaging the character printed or affixed to the character commodity 10 by the imaging unit 21, and generates and displays an augmented reality image on the display unit 22 by synthesizing the image for presentation prepared in association with each appearance and the subject image of the person wearing the character commodity. Therefore, an augmented reality image including the rendering image and the subject image can be easily generated without the need of the perspective conversion technique. In addition, by displaying the augmented reality image associated with the character of the character commodity purchased by the consumer, it is possible to enhance the interest and to obtain the effect of promoting the sales of the character commodity.

The terminal program 260 according to the present embodiment is, for example, a terminal program 260 controlled by a computer (control unit 27) used in the mobile terminal device 20 in the augmented reality system 100 including the character product 10 on which a specific character is printed or attached and the mobile terminal device 20 which has at least the imaging unit 21 and the display unit 22 and which generates an augmented reality image by modeling at least a part of the image imaged by the imaging unit 21 and displays the augmented reality image on the display unit 22, as shown in the block diagram of fig. 2. For example, as shown in the flowchart of fig. 3, the computer (control unit 27) is caused to execute the following processing: a process (S105-S107) of recognizing at least a part of the configuration of the image obtained by the imaging unit 21 imaging the character; and processing (S108 to S111) for generating an augmented reality image by synthesizing the rendering image prepared in association with each of the image-recognized figures and the subject image of the person wearing the character commodity and displaying the augmented reality image on the display unit 22.

According to the terminal program 260 of the present embodiment, the computer (control unit 27) can provide the terminal program 260 capable of generating and displaying an augmented reality image by recognizing the model of the video obtained by imaging the character printed or attached to the character commodity 10 and synthesizing the image for presentation prepared in association with each model and the subject image of the person wearing the character commodity by sequentially reading and executing the terminal program 260. Therefore, a simple augmented reality image including the rendering image and the subject image can be generated without the need for the perspective conversion technique. In addition, by displaying the augmented reality image associated with the character merchandise purchased by the consumer, the interest can be increased and the promotion effect of the character merchandise can be obtained.

As shown in fig. 1, the augmented reality system 100 according to the present embodiment includes, for example, a character product 10 on which a specific character is printed or attached, and a portable terminal device 20, the portable terminal device 20 including at least an imaging unit 21 and a display unit 22, and a control unit 27, the control unit 27 performing image recognition on at least a part of a character image obtained by imaging the character by the imaging unit 21, synthesizing a presentation image prepared in association with each image-recognized character and a subject image of a person wearing the character product, and displaying the resultant images on the display unit 22.

According to the augmented reality system 100 of the present embodiment, the portable terminal device 20 recognizes the model of the image obtained by imaging the character printed or attached to the character commodity 10, and generates and displays an augmented reality image by synthesizing the image for rendering prepared in association with each model and the subject image of the person wearing the character commodity. Therefore, an augmented reality image including the rendering image and the subject image can be easily generated without the need of the perspective conversion technique. As a result, by displaying the augmented reality image associated with the character merchandise purchased by the consumer, the interest can be increased and the sales promotion effect of the character merchandise can be obtained.

As shown in fig. 1 or fig. 4(a) and (b), for example, the character product 10 according to the present embodiment is a character product 10 to which a specific character is printed or attached. The character product 10 is used in the augmented reality system 100 implemented by the mobile terminal device 20, and the mobile terminal device 20 performs image recognition on at least a part of the image obtained by capturing the character, and combines and displays a rendering image prepared in association with each recognized character and a subject image of a person wearing the character product 10.

According to the character product 10 of the present embodiment, by printing or attaching the character product 10 of a specific character, the portable terminal device 20 can recognize at least a part of the image of the captured character, and synthesize the image for rendering prepared in association with each recognized character and the subject image of the person wearing the character product 10 to generate and display an augmented reality image. In the character product 10 according to the present embodiment, the character printed or affixed to the character product 10 includes a figure obtained by image-recognizing at least a part of an image of a character included in an image of a person wearing the character product 10, in the portable terminal device 20 that captures the person wearing the character product 10, and the corresponding image for rendering is prepared in the portable terminal device 20, and the image for rendering is synthesized with the image of the person wearing the character product 10 in the portable terminal device 20, whereby an augmented reality image can be generated. According to the character product 10 of the present embodiment, it is possible to obtain not only the effect of promoting the product but also the secondary effect of increasing the fun of the character product 10 while maintaining the clothing value of the character product 10, and naturally promoting the interaction between the child who likes the character product 10 and the parent who operates the portable terminal device 20.

The character product 10 of the present embodiment is described by way of example of a printed T-shirt, and may be applied to a bag, a brooch, and also to a product, a toy, a daily product, and the like that is worn or used by being worn, such as a garment (clothing) or a decorative article (ornament) to which a character is printed or attached. The presentation image generated by the portable terminal device 20 is a still image as an example, but may be a moving image such as an illustration or a two-dimensional or three-dimensional moving image CG. The presentation image is not particularly limited as long as it is an image related to a character, and is preferably an image in which a character is posed. Accordingly, the entertainment image and the image obtained by combining the image for the performance and the image of the object of the person wearing the character commodity are in the form of a commemorative photograph, and the interest can be improved. The character is not limited to a virtual character appearing in a cartoon, a moving image, or the like, and may be a real character such as a ghost or an actor. The mobile terminal device 20 is exemplified by a smartphone, but may be a mobile phone, a PDA (Personal digital assistant), or a PC (Personal Computer) having an imaging function and an internet connection environment.

Although the preferred embodiments of the present invention have been described in detail, it is needless to say that the technical scope of the present invention is not limited to the scope described in the above embodiments. It will be apparent to those skilled in the art that various changes and modifications can be made in the embodiments described above. Further, it is apparent from the description of the claims that the embodiments to which the various modifications and improvements are applied are also included in the technical scope of the present invention.

Claims (7)

1. A portable terminal device characterized in that:

at least comprises a shooting part and a display part,

and a control unit that performs image recognition of at least a part of a model of an image obtained by the imaging unit capturing an image of a character printed or affixed to clothing, synthesizes a presentation image prepared in association with each of the image-recognized models with a subject image of a person wearing the clothing, generates an augmented reality image, and displays the augmented reality image on the display unit.

2. The portable terminal device according to claim 1, wherein

The control unit changes the image size of the presentation image in accordance with the image size of the subject image.

3. The portable terminal device according to claim 1 or 2, wherein

Further comprises a voice output part for outputting voice,

and the control unit generates an effect sound when the presentation image is displayed on the display unit, and outputs the generated effect sound to the sound output unit.

4. A control method for controlling a terminal device of a computer used in a portable terminal device in an augmented reality system including a garment on which a specific character is printed or attached and the portable terminal device, wherein the portable terminal device has at least an imaging unit and a display unit, and an augmented reality image is generated by at least a part of a model of an image imaged by the imaging unit and displayed on the display unit,

the control method causes the computer to execute:

a process of recognizing an image of at least a part of a model of an image obtained by imaging the character by the imaging unit; and

and a process of synthesizing the rendering image prepared in association with each of the figures recognized by the image recognition and the subject image of the person wearing the clothing, thereby generating an augmented reality image and displaying the augmented reality image on the display unit.

5. An augmented reality system, comprising:

printing or attaching clothes with specific roles; and

the portable terminal device includes at least an imaging unit and a display unit, and a control unit that performs image recognition on at least a part of a model of a video obtained by imaging the character by the imaging unit, synthesizes a presentation image prepared in association with each of the models subjected to the image recognition with a subject image of a person wearing the clothing, generates an augmented reality image, and displays the augmented reality image on the display unit.

6. A clothing printed or attached with a specific character and used in an augmented reality system including a portable terminal device,

the portable terminal device recognizes at least a part of the figure of the character, and combines a rendering image prepared in association with each of the recognized figures with a subject image of a person wearing the clothing to generate and display an augmented reality image.

7. A garment, printed or attached with a specific character,

the printed or pasted character includes a figure obtained by at least partially recognizing an image of the character included in a captured subject image of a person wearing the clothing, in a portable terminal device for capturing an image of the person wearing the clothing,

the model is prepared in the portable terminal device as a corresponding rendering image, and the rendering image is synthesized with a subject image of a person wearing the clothing in the portable terminal device to be used for generating an augmented reality image.