JP2017010578A - Portable terminal device, terminal program, augmented reality system, and clothing - Google Patents

Abstract

A system for easily reproducing an augmented reality image associated with a design of a character product purchased by a consumer is constructed, thereby enhancing the taste and obtaining a sales promotion effect for the character product.
A control unit 27 image-recognizes at least a part of a design of an image obtained by photographing an image of a character printed or pasted on a character product 10 by an image capturing unit 21, and each of the image-recognized designs. The augmented reality image is generated by combining the effect image prepared in association with the subject image of the person wearing the character product 10 and displayed on the display unit 22.
[Selection] Figure 2

Description

  The present invention relates to a mobile terminal device, a terminal program, an augmented reality system, and character goods such as clothes.

  A printed T-shirt is a T-shirt printed with a still image of an image of a pattern or motif using a processing technique such as silk screen. Recently, character goods (also called character goods) such as T-shirts, bags, and toys that print popular characters and popular anime for children are popular in the market, and are well received by children.

  On the other hand, as mobile terminal devices have become more multifunctional, smartphones with enhanced network communication environment for connecting to the Internet have recently become widespread in place of mobile phones. According to smartphones, by acquiring application programs distributed in the market by downloading, utility systems such as data management, e-mail creation utilities, weather forecasts and transfer guides, gourmet guidance, navigation using satellites, memos, etc. Can be conveniently customized across a wide range of genres such as tools such as tools and noun management, communication tools such as “Skype” (registered trademark) and “Twitter” (registered trademark), and entertainment tools such as online games. it can.

  By the way, AR (Augment Reality) technology for extending a real environment perceived by humans with a computer has been known. For example, Patent Document 1 introduces a technique for appropriately changing an object image to be combined with an image representing the state of the real world in an augmented reality image.

JP 2011-204047 A

  As disclosed in Patent Document 1 described above, AR technology places a figure of a predetermined shape called a marker used for three-dimensional position recognition in the real world, and the imaging device includes the marker. Shoot the world. Therefore, the marker is arranged in a perspective-transformed form in the captured image. Then, the perspective transformation technique is applied to the object associated with the marker, and the object image obtained with the captured image as a background is synthesized to generate an augmented reality image. This AR technology enables CG (Computer Graphics) playback using moving images and still images.

  By the way, the augmented reality image generated by combining the above-described smartphone and a character product such as a print T-shirt, and the effect image related to the design of the character product purchased by the consumer and the consumer. Can be added to the character merchandise, it should be able to increase the taste and promote sales. In addition, there is a desire to easily reproduce an augmented reality image without using an advanced perspective transformation technique to realize this.

  The present invention has been made in order to solve the above-described problems. By constructing a mechanism for easily reproducing an augmented reality image related to the design of a character product purchased by a consumer, the taste is improved and the character is improved. An object of the present invention is to provide a mobile terminal device, a terminal program, an augmented reality system, and a character product capable of obtaining a product sales promotion effect.

  The mobile terminal device of the present invention includes at least an imaging unit and a display unit, and the imaging unit is a design of at least a part of an image obtained by photographing a character printed on or affixed to clothing. Image is recognized, and an augmented reality image is generated by synthesizing an effect image prepared corresponding to each of the image-recognized designs and a subject image of a person wearing the clothing to generate the display. A control unit for displaying on the unit.

  In the present invention, it is preferable that the control unit changes the image size of the effect image according to the image size of the subject image.

  In this invention, it further has an audio | voice output part, The said control part produces | generates a sound effect, if the said effect image is displayed on the said display part, The said produced | generated sound effect is output to the said audio | voice output part. Is preferred.

  The terminal program according to the present invention includes a garment on which a specific character is printed or affixed, at least an imaging unit and a display unit, and an augmented reality based on the design of at least a part of the video imaged by the imaging unit. In an augmented reality system having a mobile terminal device that generates an image and displays the image on the display unit, the terminal program is controlled by a computer used in the mobile terminal device, and the computer includes the imaging unit. A process for recognizing at least a part of a design of a video obtained by photographing the character, an effect image prepared in association with each of the designs recognized for the image, and a person wearing the clothing A process of generating an augmented reality image by combining the subject image and displaying it on the display unit is executed.

  The augmented reality system of the present invention includes a clothing on which a specific character is printed or affixed, at least an imaging unit, and a display unit, and the imaging unit captures the character. An augmented reality image by recognizing at least a part of the image and synthesizing a rendering image prepared in association with each of the image-recognized designs and a subject image of a person wearing the clothing And a portable terminal device including a control unit that generates and displays on the display unit.

  The garment of the present invention is a garment on which a specific character is printed or affixed, and recognizes at least a part of a design of an image obtained by photographing the character and corresponds to each of the recognized designs. It is used in an augmented reality system including a mobile terminal device that generates and displays an augmented reality image by synthesizing a presentation image prepared and a subject image of a person wearing the clothing.

The garment of the present invention is a garment on which a specific character is printed or affixed, and the printed or affixed character is photographed in a portable terminal device that photographs a person wearing the garment. At least partly includes a design that is image-recognized from the image of the character included in the subject image of the person wearing the clothing, and the design includes an effect image corresponding to the mobile terminal device. The effect image prepared is used for generating an augmented reality image by being combined with a subject image of a person wearing the clothing in the portable terminal device.

  According to the present invention, by constructing a mechanism for easily reproducing an augmented reality image associated with the design of a character product such as clothes purchased by a consumer, it is possible to enhance the taste and obtain the sales promotion effect of the character product. A portable terminal device, a terminal program, an augmented reality system, and a character product can be provided.

It is an image figure of the augmented reality system which concerns on embodiment of this invention. It is a block diagram which shows the internal structure of the portable terminal device which concerns on embodiment of this invention. It is a flowchart which shows operation | movement of the portable terminal device which concerns on embodiment of this invention. It is the figure which represented operation | movement of the portable terminal device which concerns on embodiment of this invention on a screen.

(Configuration of the embodiment)
Hereinafter, an embodiment for carrying out the present invention (hereinafter simply referred to as the present embodiment) will be described in detail with reference to the accompanying drawings.

  FIG. 1 shows an augmented reality system 100 according to the present embodiment. As shown in FIG. 1, the augmented reality system 100 according to the present embodiment is obtained by photographing a character product 10 on which a specific character is printed or pasted and a character printed on the character product. Augmented reality image by recognizing at least a part of the design of the image and combining the image for presentation prepared corresponding to each of the image-recognized design and the subject image of the person wearing the character product And a mobile terminal device 20 such as a smartphone that generates and displays on the screen.

  Here, as the character product 10, a T-shirt for children on which a character such as a hero of a squadron is printed is illustrated. Consumers who purchase these T-shirts (mostly parents of children who wear T-shirts) use the mobile terminal device 20 to read the QR code (registered trademark) attached to the product tag, thereby selling T-shirts. An application program (a terminal program 260 described later) for reproducing an augmented reality image is obtained free of charge from a site of a person who owns the copyright of the character printed on the T-shirt or the like.

  The consumer activates the terminal program 260 acquired by downloading, thereby focusing on the predecessor design of the child wearing the T-shirt and reading the character design by photographing. With this shooting operation alone, in reality, there are only children, but, for example, a two-shot shooting using a simple AR technology by a child and a hero, where a hero in a fighting pose appears next as a directing image, is possible. become. At this time, the mobile terminal device 20 recognizes at least a part of the design of the video of the character merchandise obtained by shooting, and displays an effect image prepared in advance in association with each of the image-recognized designs and a T-shirt. An augmented reality image is generated by synthesizing a subject image of a worn child and displayed on the screen.

  FIG. 2 shows an internal configuration of the mobile terminal device 20 according to the present embodiment. As shown in FIG. 2, the mobile terminal device 20 includes an imaging unit 21, a display unit 22, an operation unit 23, an audio output unit 24, a communication unit 25, a storage unit 26, a control unit 27, It is comprised including.

  The imaging unit 21 is a camera configured by a photoelectric conversion element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor) image sensor, a control circuit thereof, and the like. The display unit 22 is configured using, for example, an LCD (Liquid Crystal Display Device) or an organic EL (Electro-Luminescence), which is configured by arranging a large number of pixels (a combination of light emitting elements of a plurality of colors) vertically and horizontally. The display information including the augmented reality image generated by the control unit 27 and written in a predetermined area (VRAM area) of the storage unit 26 is displayed.

  The operation unit 23 includes a key switch to which various functions are assigned, such as a power key, a call key, a numeric key, a character key, a direction key (left / right / up / down), a determination key, a call key, and an imaging key. When these keys are operated by the operator, a signal corresponding to the operation content is generated and output to the control unit 27 as an instruction from the operator. The operation unit 23 may be realized by a touch panel for inputting position information. In this case, the above key switches and augmented reality image are displayed on the touch panel.

  The sound output unit 24 is a speaker that outputs sound including sound effects generated by the control unit 27. The communication unit 25 captures a wireless communication system, performs wireless communication with a base station (not shown) connected to the communication network, and transmits and receives various data. Here, the various data includes voice data at the time of voice call, mail data at the time of mail transmission / reception, Web page data at the time of browsing the Web (World Wide Web), and the like. In connection with the present invention, the communication unit 25 obtains data necessary for generating an augmented reality image corresponding to the character product 10 from the operator's site (server) by downloading. At this time, the communication unit 25 connects to a server (not shown) according to a protocol compliant with TCP / IP (Transmission Control Protocol / Internet Protocol), for example.

  The storage unit 26 is assigned a work area and a VRAM (Video RAM) area in addition to a program area in which the terminal program 260 according to the present embodiment is stored. An augmented reality image generated by the control unit 27 or an augmented reality image acquired via the Internet is stored in the work area each time, and display information including the augmented reality image is drawn in the VRAM area. As the storage unit 26, for example, a semiconductor storage element, magnetism, or an optical storage element is mounted.

  The control unit 27 recognizes at least a part of the design of the video captured by the imaging unit 21, and wears a production image and a character product prepared in association with each of the image-recognized designs. A function of generating an augmented reality image by combining the subject image of the person and displaying it on the display unit 22 is provided. At this time, the control unit 27 may change the image size of the effect image according to the image size of the subject image. Further, when the effect image is displayed on the display unit 22, a sound effect may be generated, and the generated sound effect may be output to the sound output unit 24.

  For this reason, if the structure of the terminal program 260 executed by the control unit 27 is functionally disassembled and illustrated, as shown in FIG. 2, a main control unit 270, an image acquisition unit 271, an image recognition unit 272, An effect control unit 273 and a display control unit 274 are included.

  The image acquisition unit 271 captures an image obtained by photographing the design of the character printed or pasted on the character commodity 10 such as a T-shirt, and outputs the image to the image recognition unit 272. The image recognition unit 272 recognizes the design captured by the image acquisition unit 271 and outputs the design to the effect control unit 273. The effect control unit 273 combines the effect image prepared in association with each of the designs recognized by the image recognition unit 272 and the subject image of the person wearing the character product 10 to augment the reality image. Is generated and displayed on the display unit 22.

  At this time, the effect control unit 273 can change the image size of the effect image according to the image size of the subject image obtained by actual shooting. Further, when the effect image is displayed on the display unit 22, a sound effect may be generated, and the generated sound effect may be output to the sound output unit 24.

  The display control unit 274 draws the augmented reality image generated by the effect control unit 273 in the VRAM area of the storage unit 26, reads the drawn display information in synchronization with the display timing, and displays it on the display unit 22.

  The main control unit 270 performs image recognition on at least a part of the design of the video obtained by the control unit 27 taken by the imaging unit 21, and for the effects prepared in association with each of the image-recognized designs. In order to generate an augmented reality image by combining the image and the subject image of the person wearing the character product and display it on the display unit 22, the above-described image acquisition unit 271, image recognition unit 272, and production It controls the sequence control of each part of the control unit 273 and the display control unit 274.

(Operation of the embodiment)
Hereinafter, the operation of the mobile terminal device 20 of the present embodiment will be described in detail based on the flowchart of FIG. 3 and further referring to the screen configurations of FIGS. 1 and 4A and 4B.

  First, when the power is turned on, the control unit 27 (main control unit 270) of the mobile terminal device 20 determines whether or not the terminal program 260 has been installed in the mobile terminal device 20 (step S101). The main control unit 270 can determine the presence or absence of installation by referring to a list of installed applications (not shown) allocated and stored in a predetermined area of the storage unit 26. Here, if it is determined that it has not been installed yet (step S101 “NO”), the main control unit 270 generates a message to that effect and displays it on the display unit 22 to the terminal program for the consumer. 260 is obtained. In accordance with this message, for example, the consumer reads the QR code (registered trademark) attached to the product tag 30 as shown in FIG. 4A (step S102). As a result, the terminal program 260 is automatically downloaded to the portable terminal device 20 and further stored in the program area of the storage unit 26 by being installed (step S103).

  On the other hand, if it is determined in step S101 that the terminal program 260 is already installed in the mobile terminal device 20 (step S101 “YES”), the consumer performs an operation for starting up the terminal program 260. . When the terminal program 260 is activated (step S104), as described later, it is possible to perform image recognition of the character design printed on the character product 10 and generation of an augmented reality image based on the image recognition result.

  When the terminal program 260 is activated, as shown in FIG. 4B, for example, the consumer focuses on the character printed on the front of the T-shirt worn by the child (step S105). When the consumer turns on the imaging key of the operation unit 23 or the imaging button assigned to a partial area of the display unit 22 (step S106 “YES”), the main control unit 270 detects this and detects an image. Control is passed to the acquisition unit 271. The image acquisition unit 271 delivers the character design captured by the photographing unit 21 to the image recognition unit 272, and the image recognition unit 272 performs image recognition of the character design (step S107).

  The image recognition result of the design by the image recognition unit 272 is output to the effect control unit 273. The effect control unit 273 reads an effect image prepared in association with each of the character designs recognized as images (step S108). When the effect control unit 273 displays the read effect image on the display unit 22 via the display control unit 274, for example, as shown by a double-headed arrow in FIG. 1, the effect image depends on the image size of the subject image. A process of changing the image size is executed (step S109). That is, when the image size of the subject image is large, the effect control unit 273 determines that the shooting distance d between the subject and the mobile terminal device 20 is short and displays the effect image with a relatively large image size. . Conversely, when the image size of the subject image is decreasing, the image size of the effect image is reduced to the image of the child image wearing the T-shirt by relatively reducing the image size of the effect image. Can be matched.

  That is, if the distance between the child, which is the subject image, and the mobile terminal device 20 is too close, the effect image is displayed large, and the effect image is not entirely reflected in the effective display screen area of the display unit 22. Therefore, the consumer adjusts the shooting distance d at the time of shooting (back imaging) to store the effect image in the effective display area of the display unit 22. In this case, since the child image size is also reduced, the image size of the effect image is also reduced, and the shooting position is adjusted where the image size of the subject image and the effect image is optimal. Thus, the image size feeling between the subject image and the effect image is adjusted by the shooting distance d.

  Note that the size of the subject image that changes in accordance with the shooting distance is determined by, for example, comparing on the basis of the image size when the shooting distance d is 2 [m] as shown in FIG. That is, a distance of about 2 [m] is optimal as the shooting distance d from the relationship between the physique of the child as the subject and the depth of field of the lens normally used as the imaging unit 21 of the mobile terminal device 20.

  Subsequently, when the imaging key is turned on by the consumer and the main control unit 270 detects this (step S110 “YES”), the effect control unit 273 wears the effect image and the T-shirt whose shooting position has been adjusted first. The augmented reality image is generated by combining the child's subject image and output to the display control unit 274. The display control unit 274 draws the augmented reality image generated by the effect control unit 273 in the VRAM area of the storage unit 26, reads the rendered augmented reality image in synchronization with the display timing of the display unit 22, and displays it on the display unit 22. It is displayed (step S111). That is, although the subject is actually only a child, a two-shot image based on an augmented reality image in which a hero appears next to the screen of the display unit 22 by a simple AR technique is displayed as if the child is wearing a T-shirt. An image appears as if he was taking a commemorative photo with the hero.

  At this time, the effect control unit 273 may generate a sound effect when the effect image is displayed on the display unit 22, and output the generated sound effect to the sound output unit 24. At this time, the sound output unit 24 outputs the sound effect to the outside world, thereby making it possible to produce a hero appearance, and as a result, the effect is enhanced (step S112).

  As described above, according to the mobile terminal device 20 according to the present embodiment, the control unit 27 recognizes the image design obtained by photographing the character printed or pasted on the character product 10 by the imaging unit 21. Then, an augmented reality image is generated by combining the effect image prepared in association with each design and the subject image of the person wearing the character product, and displayed on the display unit 22. For this reason, an augmented reality image composed of an effect image and a subject image can be easily generated without requiring a perspective conversion technique. Further, by displaying an augmented reality image related to the character of the character product purchased by the consumer, it is possible to enhance the taste and obtain the sales promotion effect of the character product.

  The terminal program 260 according to the present embodiment includes, for example, a character product 10 on which a specific character is printed or pasted, and at least the imaging unit 21 and the display unit 22 as illustrated in the block diagram of FIG. In the augmented reality system 100 including the mobile terminal device 20 that generates an augmented reality image from at least a part of the design of the video captured by the imaging unit 21 and displays it on the display unit 22, the mobile terminal device 20 It is the terminal program 260 controlled by the computer (control part 27) used for the. For example, as shown in the flowchart of FIG. 3, processing (S105 to S107) for recognizing at least a part of the design of the video obtained by the imaging unit 21 capturing a character on the computer (control unit 27). A process of generating an augmented reality image by synthesizing an effect image prepared in association with each of the image-recognized designs and a subject image of a person wearing a character product and displaying the augmented reality image on the display unit 22 ( S108 to S111).

  According to the terminal program 260 according to the present embodiment, the computer (control unit 27) sequentially reads out and executes the terminal program 260, so that the design of the video obtained by photographing the character printed or pasted on the character product 10 is obtained. A terminal program 260 capable of generating and displaying an augmented reality image by synthesizing a rendering image prepared in association with each design and a subject image of a person wearing a character product. Can be provided. Therefore, it is possible to generate a simple augmented reality image composed of an effect image and a subject image without requiring a perspective conversion technique. Further, by displaying the augmented reality image related to the character product purchased by the consumer, it is possible to enhance the taste and obtain the sales promotion effect of the character product.

  Further, the augmented reality system 100 according to the present embodiment includes, for example, as shown in FIG. 1, a character product 10 on which a specific character is printed or pasted, at least an imaging unit 21, a display unit 22, and the like. The imaging unit 21 recognizes an image of at least a part of a video image obtained by photographing a character, and creates an effect image prepared in association with each of the image-recognized designs and a character product. The mobile terminal device 20 includes a control unit 27 that synthesizes the subject image of the person attached to the mobile phone and displays it on the display unit 22.

  According to the augmented reality system 100 according to the present embodiment, the mobile terminal device 20 recognizes an image of a video image obtained by photographing a character printed or pasted on the character product 10 and associates it with each design. It is possible to provide the augmented reality system 100 that generates and displays an augmented reality image by synthesizing the effect image prepared in advance and the subject image of a person wearing a character product. For this reason, an augmented reality image composed of an effect image and a subject image can be easily generated without requiring a perspective conversion technique. As a result, by displaying the augmented reality image related to the character product purchased by the consumer, it is possible to enhance the taste and obtain the sales promotion effect of the character product.

  Further, the character product 10 according to the present embodiment is a character product 10 on which a specific character is printed or pasted as shown in FIG. 1 or FIGS. 4 (a) and 4 (b), for example. This character product 10 image-recognizes at least a part of the design of a video obtained by photographing the character, and a person wearing the character product 10 and an effect image prepared in association with each recognized design. It is used for the augmented reality system 100 realized by using the portable terminal device 20 that synthesizes and displays the subject image.

  According to the character product 10 according to the present embodiment, an image of at least a part of an image obtained by photographing a character is imaged on the mobile terminal device 20 by the character product 10 on which a specific character is printed or pasted. The augmented reality image can be generated and displayed by synthesizing the effect image prepared in correspondence with each of the recognized designs and the subject image of the person wearing the character product 10. . Further, according to the character product 10 according to the present embodiment, the character printed or pasted on the character product 10 is a character photographed by the mobile terminal device 20 that photographed the person wearing the character product 10. At least partly includes a design that is image-recognized from an image of a character included in a subject image of a person wearing the product 10, and the design includes a corresponding effect image in the mobile terminal device 20. In addition, the effect image can be combined with the subject image of the person wearing the character product 10 in the mobile terminal device 20 to generate an augmented reality image. According to the character product 10 according to the present embodiment, not only the sales promotion effect of the product can be obtained, but the fashion value of the character product 10 is maintained as it is, and only the enjoyment is doubled, and the character product 10 is used habitually. It is also possible to obtain a derivative effect such as naturally promoting conversation between the child and the parent who operates the mobile terminal device 20.

  In addition, although illustrated only about the print T-shirt as the character goods 10 according to the above-described embodiment, all clothing (clothes) and accessories (decorations) on which characters are printed or pasted, such as bags, pin batches, and the like It can also be applied to items that are worn or worn, such as toys and daily necessities. Further, although only the still image is illustrated as the effect image generated by the mobile terminal device 20, an illustration or a moving image such as a two-dimensional or three-dimensional animation CG may be used. The effect image is not particularly limited as long as it is an image associated with the character, but is preferably an image in which the character is posing. Thereby, the image obtained by synthesizing the effect image and the subject image of the person wearing the character product has a shape like a souvenir photo, and the interest can be improved. Further, the character is not limited to a virtual character appearing in comics or animation, but may be a real person such as an idol or an actor. Furthermore, although the smart phone was illustrated as the portable terminal device 20, it may be a mobile phone, a PDA (Personal Digital Assistance), or a PC (Personal Computer) having a photographing function and an Internet connection environment.

  As mentioned above, although preferred embodiment of this invention was explained in full detail, it cannot be overemphasized that the technical scope of this invention is not limited to the range as described in the said embodiment. It will be apparent to those skilled in the art that various modifications or improvements can be added to the above-described embodiments. Further, it is apparent from the scope of the claims that the embodiments added with such changes or improvements can be included in the technical scope of the present invention.

  DESCRIPTION OF SYMBOLS 10 ... Character goods, 20 ... Portable terminal device, 30 ... Product tag, 21 ... Imaging part, 22 ... Display part, 23 ... Operation part, 24 ... Audio | voice output part, 25 ... Communication part, 26 ... Memory | storage part, 27 ... Control , 100 ... augmented reality system, 260 ... terminal program, 270 ... main control unit, 271 ... image acquisition unit, 272 ... image recognition unit, 273 ... production control unit, 274 ... display control unit.

The mobile terminal device of the present invention includes at least an imaging unit and a display unit, and the imaging unit is a design of at least a part of an image obtained by photographing a character printed on or affixed to clothing. Image is recognized, and an augmented reality image is generated by synthesizing an effect image prepared corresponding to each of the image-recognized designs and a subject image of a person wearing the clothing to generate the display. A control unit for displaying on the unit. The mobile terminal device of the present invention is a mobile terminal device that captures clothing and generates an augmented reality video, and the mobile terminal device includes at least an imaging unit, a display unit, and a control unit, When a code attached to the clothing is read by the imaging unit, it becomes possible to acquire a terminal program that causes the augmented reality system to function from a server, and when the mobile terminal device acquires the terminal program, the control unit An image for at least a part of a design obtained by photographing a character printed or affixed to the clothing in the imaging unit is image-recognized, and is provided in association with each of the image-recognized designs An augmented reality image is generated by combining an image and a subject image of a person wearing the clothing, and is displayed on the display unit.

The terminal program according to the present invention includes a garment on which a specific character is printed or affixed, and at least an imaging unit and a display unit. In an augmented reality system having a mobile terminal device that generates an image and displays the image on the display unit, the terminal program is controlled by a computer used in the mobile terminal device, and the computer includes the imaging unit. A process for recognizing at least a part of a design of a video obtained by photographing the character, an effect image prepared in association with each of the designs recognized for the image, and a person wearing the clothing A process of generating an augmented reality image by combining the subject image and displaying it on the display unit is executed. Further, the terminal program of the present invention includes a garment on which a specific character is printed or affixed, at least an imaging unit and a display unit, and is based on at least a design of an image photographed by the imaging unit. In an augmented reality system including a mobile terminal device that generates an augmented reality image and displays the augmented reality image on the display unit, the terminal program is controlled by a computer used in the mobile terminal device, and the terminal program includes: When the portable terminal device acquires the terminal program by reading the code attached to the clothing by the imaging unit, and the portable terminal device acquires the terminal program, the imaging unit Processing for recognizing at least a part of the design of the video obtained by photographing the character; A process of generating an augmented reality image by synthesizing an effect image prepared in association with each of the recognized designs and a subject image of a person wearing the clothing and displaying the augmented reality image on the display unit And execute.

The augmented reality system of the present invention includes a clothing on which a specific character is printed or affixed, at least an imaging unit, and a display unit, and the imaging unit captures the character. An augmented reality image by recognizing at least a part of the image and synthesizing a rendering image prepared in association with each of the image-recognized designs and a subject image of a person wearing the clothing And a portable terminal device including a control unit that generates and displays on the display unit. Further, the augmented reality system of the present invention is an augmented reality system, and includes a garment on which a specific character is printed or affixed, at least an imaging unit, and a display unit, and the imaging unit , Recognizing at least a part of a design of a video obtained by photographing the character, providing an effect image prepared in association with each of the recognized designs, and a subject of a person wearing the clothing And a portable terminal device including a control unit that generates an augmented reality image by combining the image and displays the augmented reality image on the display unit, and the augmented reality system includes the imaging unit of the portable terminal device. When the code attached to the garment is read, the mobile terminal device functions by a terminal program that can be acquired from a server.

The garment of the present invention is a garment on which a specific character is printed or affixed, and recognizes at least a part of a design of an image obtained by photographing the character and corresponds to each of the recognized designs. It is used in an augmented reality system including a mobile terminal device that generates and displays an augmented reality image by synthesizing a presentation image prepared and a subject image of a person wearing the clothing. The clothing of the present invention is a clothing on which a specific character is printed or affixed, and the clothing has a code, and is at least the imaging unit of the mobile terminal device having an imaging unit and a display unit. When the code is read, a terminal program for causing the augmented reality system to function by the mobile terminal device can be acquired from the server, and when the mobile terminal device acquires the terminal program, an image obtained by photographing the character The image of at least a part of the image is recognized, and an augmented reality image is generated by synthesizing the effect image prepared in association with each of the recognized designs and the subject image of the person wearing the clothing The present invention is characterized in that it is used in an augmented reality system including a mobile terminal device that displays the information.

The garment of the present invention is a garment on which a specific character is printed or affixed, and the printed or affixed character is photographed in a portable terminal device that photographs a person wearing the garment. At least partly includes a design that is image-recognized from the image of the character included in the subject image of the person wearing the clothing, and the design includes an effect image corresponding to the mobile terminal device. The effect image prepared is used for generating an augmented reality image by being combined with a subject image of a person wearing the clothing in the portable terminal device. The clothing of the present invention is a clothing on which a specific character is printed or affixed. The clothing has a code, and the code is a mobile terminal device having at least an imaging unit and a display unit. When the code is read by the imaging unit, a terminal program that causes the augmented reality system to function by the mobile terminal device can be acquired from a server, and when the mobile terminal device acquires the terminal program, the print, or The affixed character has a design that is image-recognized from the image of the character included in the photographed subject image of the person wearing the clothing in the mobile terminal device that photographed the person wearing the clothing. The design includes at least a part of the design image corresponding to the mobile terminal device. And, the effect for image, characterized in that it is used for generating the augmented reality image by the fact that the garment is combined with a subject image of a person wearing in the portable terminal device.

Claims (7)

Having at least an imaging unit and a display unit,
The imaging unit recognizes at least a part of a design of a video obtained by photographing a character printed or affixed to clothing, and is provided in association with each of the image-recognized designs. A control unit that generates an augmented reality image by combining an image and a subject image of a person wearing the clothing and displays the image on the display unit;
A portable terminal device comprising: In claim 1,
The controller is
A portable terminal device that changes an image size of the effect image according to an image size of the subject image. In claim 1 or claim 2,
An audio output unit;
The controller is
A portable terminal device that generates a sound effect when the effect image is displayed on the display unit and outputs the generated sound effect to the sound output unit. The display includes a garment on which a specific character is printed or affixed, at least an imaging unit and a display unit, and generates an augmented reality image from at least a part of the design of the video captured by the imaging unit. In an augmented reality system comprising a mobile terminal device to be displayed on a part, a terminal program controlled by a computer used for the mobile terminal device,
In the computer,
Processing for recognizing at least a part of the design of the video obtained by the imaging unit capturing the character;
A process of generating an augmented reality image by combining an image for presentation prepared in association with each of the recognized designs and a subject image of a person wearing the clothing and displaying the augmented reality image on the display unit When,
A terminal program that executes Clothing with a specific character printed or affixed,
And at least an imaging unit and a display unit, wherein the imaging unit recognizes an image of at least a part of a video obtained by photographing the character, and associates the design with each of the recognized designs. A portable terminal device including a control unit that generates an augmented reality image by combining the prepared image for production and a subject image of a person wearing the clothing and displays the augmented reality image on the display unit;
Augmented reality system. A clothing with a specific character printed or affixed,
Recognizing at least a part of a design of an image obtained by photographing the character, an effect image prepared in association with each of the recognized designs, and a subject image of a person wearing the clothing The garment used in an augmented reality system including a mobile terminal device that generates and displays an augmented reality image by combining. A clothing with a specific character printed or affixed,
The printed or affixed character is an image from the character image included in the photographed subject image of the person wearing the clothing in a mobile terminal device that photographs the person wearing the clothing. At least part of the recognized design,
The design is expanded by providing a production image corresponding to the portable terminal device, and the production image is combined with a subject image of a person wearing the clothing in the portable terminal device. The clothing used for generation of a real image.

Images