JP2008242891A - Campaign application management system using images of purchased products - Google Patents

Abstract

An object of the present invention is to provide a campaign application management system that prevents double use of photographed images.
[Solution]
A portable terminal device that transmits image data obtained by photographing a print medium and photographing condition data by e-mail; and image identification information received by transmitting image data of the received e-mail to an image recognition server device; And the photographing condition data are transmitted to the application determination server device, the application determination report is received, the application result e-mail is created, and the reception server device that transmits the e-mail to the portable terminal device and the e-mail image data are received. An image recognition server device that sends back image identification information, and an application that determines that an application is illegal if the received shooting condition data and image identification information match the image identification information and shooting condition data of the stored application history data. An application management system including a determination server device.
[Selection] Figure 1

Description

The present invention relates to a system for managing a campaign application by receiving a purchased product image taken by a mobile terminal device (for example, a mobile phone) by e-mail at the time of receiving a campaign participation.

Conventionally, in a closed campaign for merchandise purchasers, eligibility to participate in the campaign can be obtained by submitting evidence of purchase of the merchandise (for example, an application ticket attached to the merchandise).
However, if a trading card or bonus sticker that enjoys collection is used for an application ticket for a closed campaign, it cannot be submitted. A service that can be attached to and sent to the campaign secretariat can be considered.

For example, in Non-Patent Document 1, an image is taken with a mobile phone, feature data of the taken image is obtained, transmitted to a corresponding WEB site, and information corresponding to the feature data is displayed on the mobile phone. Technology is disclosed.
Patent Document 1 discloses a technique in which an image taken with a mobile phone is attached to an e-mail and transmitted to a search server, and the search server uses the taken image as a search key to search for information and acquire information. Has been.
Olympus Corporation New Business Planning Department, “SyncR”, Service Overview-Features (Outline of SyncR), Olympus Corporation, [online], [Search March 1, 2007], Internet <Http://gwmj.jp/> JP 2001-282825 A (paragraphs 0011 to 0016, FIG. 3)

By the way, in the campaign application using the photographed image, the use of the photographed image is limited to one time and it is desired to eliminate the double application. However, the technique of Patent Document 1 has a problem in that this cannot be detected even if the same image is repeatedly used.

The present invention has been made in consideration of such points, and an object of the present invention is to provide a campaign application management system that prevents double use of photographed images.

The present invention solves the above problems by the following means. That is, the invention of claim 1 is an application management system using a photographed image of a print medium having a region including an image portion, and includes a portable terminal device, a reception server device, an image recognition server device, and an application determination server. An application management system using a photographed image configured by connecting a device to a network, wherein the portable terminal device photographs a region including an image portion of a print medium and stores image data An e-mail creating unit that creates shooting data using the camera to be recorded and the image data and shooting condition data recorded in the storage unit and creates an e-mail having sender information attached thereto And an e-mail transmission means for transmitting the created e-mail to the reception server device, and an e-mail for receiving an e-mail including an application result from the reception server device A terminal device comprising: a communication means, an e-mail receiving means for receiving an e-mail including sender information and shooting data; and image data of shooting data included in the received e-mail. An image transmission means for transmitting to the image recognition server apparatus, an image recognition result receiving means for receiving an image recognition result including image identification information from the image recognition server apparatus, and image recognition Using the image recognition result receiving means for receiving the image recognition result transmitted by the server device and the received image recognition result and e-mail, application information including image identification information and shooting condition data is created and application determination is made. An application information creation and transmission means for transmitting to the server device, an application determination report receiving means for receiving the application determination report transmitted by the application determination server device, and the reception An e-mail receiving unit that creates an e-mail including an application result using an application determination report and transmits the e-mail to a mobile terminal device, wherein the image recognition server device stores an image identification information database A database search query is received from the storage means and the receiving server device, and a search means for searching the image identification information database and extracting the image identification information using the database search query, and creating an image recognition result including the image identification information An image recognition result replying means for sending a reply to the reception server device, wherein the application determination server device stores application history data in which the imaging condition data and the image recognition result are associated with each other. Means, application information receiving means for receiving the application information transmitted by the reception server device, image identification information and photographing condition data of the received application information. Using the data, the image identification information and the shooting condition data of the stored application history data are referred to, and if there is application history data that matches both, the unauthorized application determination means for determining an unauthorized application, and the received application An application management system using photographed images, characterized in that it is a server device comprising an application history recording means for recording information.

In this way, it is possible to prevent unauthorized use of the image used for the application.

According to a second aspect of the present invention, in the reception server device, the application information creation / transmission means uses the received image recognition result and an e-mail, and includes an application including image identification information, photographing condition data, and sender information. The information is created and transmitted to the application determination server device, and in the application determination server device, the storage means stores application history data relating the sender information, the shooting condition data, and the image recognition result, The fraudulent application determination means uses the image identification information and shooting condition data of the received application information, refers to the image identification information and shooting condition data of the stored application history data, and matches the application history The data is extracted, and the sender information of the application history data is compared with the sender information of the extracted application history data by using the sender information of the received application information. The application management system using photographed images according to claim 1, wherein if the two match, it is determined that the application is unauthorized by the person, and if both do not match, it is determined that the photographed data of another person is illegally used. It is.

According to a third aspect of the present invention, there is provided a computer program that, when incorporated in a computer, causes the computer to operate as an application management system using the photographed image according to the first or second aspect.

A fourth aspect of the present invention is a computer-readable recording medium on which the computer program according to the third aspect is recorded.

According to the present invention, in a campaign using a camera-equipped mobile phone, it is possible to prevent this when a photographed image used for participation application is illegally used twice.

(Example)
Hereinafter, embodiments of the present invention will be described in more detail with reference to the drawings.

FIG. 1 is a diagram for explaining the outline of an application management system using photographed images according to the present invention.
The application management system 1 using a photographed image is configured by connecting a mobile terminal device 300, a reception server device 100, an image recognition server device 500, and an application determination server device 700 via a network. This network is a network in which a network of a mobile phone carrier provided with an antenna 900 that is wirelessly connected to the mobile terminal device 300 is connected to the Internet 600 via a gateway 800.

The mobile terminal device 300 includes a digital camera. The mobile terminal device 300 is, for example, a camera-equipped mobile phone.

The reception server device 100 is a server computer controlled by a computer program. The computer program of the reception server device 100 includes an existing Internet server program.

The image recognition server device 500 is a computer controlled by a computer program. The computer program of the image recognition server device 500 includes an existing image recognition program.

The application determination server device 700 is a server computer controlled by a computer program.

FIG. 2 is a diagram for explaining a rough processing flow of the application management system using a photographed image according to the present invention.
The portable terminal device 300 photographs a printing medium (for example, a trading card or a bonus sticker) with a digital camera, attaches the photographed image to an e-mail, and transmits it to the reception server device 100 (FIG. 2 (1)). . The reception server device 100 receives the image-attached electronic mail transmitted by the mobile terminal device 300 ((2)).

The reception server device 100 transmits the received email image to the image recognition server device 500 ((11)). The image recognition server device 500 recognizes the received image, creates an image recognition result, and sends it back ((12)).
The receiving server device 100 receives the image recognition result from the image recognition server device 500 ((13)).

The reception server device 100 creates application information using the e-mail information and the image recognition result, and transmits the application information to the application determination server device 700 ((21)).
The application determination server device 700 receives the application information and refers to the past application record to determine whether the image used for the application is not used for the past application ((22)). . If it is determined that the image used for the application has not been used in the past, a prescribed score value (for example, a score value associated with the image identification information) is given ((23)). The application determination server apparatus 700 returns an application determination report to the reception server apparatus 100 ((24)). The reception server apparatus 100 receives the application determination report transmitted by the application determination server apparatus 700 ((25)).

The reception server device 100 creates an e-mail of the application result from the received application determination report, and transmits it to the mobile terminal device 300 that has transmitted the photographic data-attached e-mail ((31)). The portable terminal device 300 receives the application result email transmitted by the reception server device 100 ((32)).

The e-mail attached with the photographed image may be transmitted to the reception server device 100 using a kiosk terminal device installed on the street instead of the mobile terminal device 300.

FIG. 3 is a detailed configuration diagram of the mobile terminal device 300. The mobile terminal device 300 includes a digital camera 301, a communication unit 305, an e-mail creation / transmission unit 320, an e-mail reception unit 330, and a storage unit 390. The communication unit 305 is an antenna coil. The communication unit 305 is connected to a communication unit of another device. The storage unit 390 stores the shooting data 391 and the e-mail 392.

The shooting data 391 includes image data and shooting condition data. The e-mail 392 is data including sender identification information.

The digital camera 301 shoots a print medium (for example, a trading card or a bonus sticker), creates shooting data 391, and records it in the storage unit 390. The e-mail creation / transmission means 320 creates an e-mail attached with the photographing data 391 recorded in the storage means 390 and transmits the e-mail from the communication unit 305 to the reception server device 100.

The e-mail receiving unit 330 receives the e-mail 392 of the application result transmitted from the receiving server device 100 and received by the communication unit 305 and holds it in the storage unit 390.

The e-mail creating / transmitting means 320 and the e-mail receiving means 330 are computer programs. The shooting data 391 is data that can be read by a computer program.
The storage unit 390 is a semiconductor memory or a magnetic memory.

FIG. 4 is a diagram for explaining the format of the shooting data 391. The shooting data 391 includes image data 391a and shooting condition data 391b. The image data 391a is bitmap data such as PNG (abbreviation of Portable Network Graphics), GIF (abbreviation of Graphics Interchange Format), and JPEG (abbreviation of Joint Photographic Experts Group). The shooting condition data 391b includes the number of pixels (width / height), resolution (horizontal resolution / vertical resolution), manufacturer name (manufacturer of the portable terminal device), model name of the digital camera (camera model name), and shooting. Text data including date and time (photographing date).

FIG. 5 is an example of the shooting condition data 391b. FIG. 5 illustrates a display screen of the Exif format shooting condition data 391b. The display screen shows an example in which the width is “176 pixels”, the height is “144 pixels”, the mobile terminal manufacturer is “ABC”, and the camera model is “FY75”.

Exif is an abbreviation for “Exchangeable image file format”, and is a standard format established by the Japan Electronics Industry Promotion Association. Exif is used for images taken with a digital camera.

FIG. 6 is a detailed configuration diagram of the reception server device 100.
The reception server device 100 includes a communication unit 105, an e-mail receiving unit 110, an image transmitting unit 120, an image recognition result receiving unit 130, an application information creation transmitting unit 140, an application determination report receiving unit 150, an electronic A mail transmission unit 170 and a storage unit 190 are provided. The communication unit 105 is an antenna coil. The communication unit 105 communicates with a communication unit of another device.

The e-mail receiving unit 110 receives an e-mail including the sender information received by the communication unit 105 and the photographing data 391 and holds it in the storage unit 190.

The image transmission unit 120 constructs a database search query including the image data 391a of the photographing data included in the received e-mail, and transmits the database search query from the communication unit 105 to the image recognition server device. The image recognition result receiving unit 130 receives the image recognition result including the image identification information transmitted from the image recognition server device and received by the communication unit 105 and holds the image recognition result in the storage unit 190.

The application information creation / transmission means 140 creates application information 194 including image identification information, sender identification information, and shooting condition data by using the image recognition result and the e-mail stored in the storage means 190, and performs communication. The information is transmitted from the unit 105 to the application determination server device. The application determination report receiving unit 150 receives the application determination report transmitted from the application determination server device and accepted by the communication unit 105, and holds it in the storage unit 190.

The e-mail transmission unit 170 creates an application result 198 using the application determination report held in the storage unit 190, creates an e-mail including the application result 198, and transmits the e-mail from the communication unit 105 to the mobile terminal device 300.

The e-mail receiving unit 110, the image transmitting unit 120, the image recognition result receiving unit 130, the application information creation / transmitting unit 140, the application determination report receiving unit 150, and the e-mail transmitting unit 170 are computer programs.

FIG. 7 is a detailed configuration diagram of the image recognition server device 500. The image recognition server device 500 includes a communication unit 505, a search unit 510, an image recognition result transmission unit 520, and a storage unit 590. The storage unit 590 stores an image identification information database 593.

The image identification information database 593 is a database including image identification information.

The search means 510 receives a database search query from the receiving server device 100, and uses this to search the image identification information database 593 to extract image identification information. The image recognition result transmission means 520 creates an image recognition result including the extracted image identification information and transmits it to the inquiry server device.

Search means 510 and image recognition result reply means 520 are computer programs. The image identification information database 593 is data readable by a computer program. The storage unit 590 is a semiconductor memory or a magnetic memory.

FIG. 8 is a detailed configuration diagram of the application determination server device 700. The application determination server device 700 includes a communication unit 705, application information receiving means 710, unauthorized application determination means 740, application history recording means 720, application point recording means 760, application determination report transmission means 780, and storage means. 790. The storage unit 790 stores score value information 796, application points 795, and application history data 797.

The score value information 796 is information associated with the image identification information. The application point 795 is data in which sender information and score information are associated with each other. The application history data 797 is data in which sender information, shooting condition data, and image recognition results are associated with each other.

The application information receiving unit 710 receives and receives the application information transmitted by the reception server device by the communication unit 705.

The unauthorized application determination means 740 uses the image identification information and shooting condition data of the received application information, and refers to the stored image identification information and shooting condition data in the application history data 797, so that both of them match. If there is history data 797, it is determined that the application is illegal.
Further, the unauthorized application determination unit 740 uses the image identification information and the shooting condition data of the received application information to refer to the stored image identification information and the shooting condition data in the application history data 797 so that they match. The application history data is extracted and the sender information of the application history data is compared with the sender information of the extracted application history data using the sender information of the received application information. If it is determined that it is an unauthorized double application by the person, and if both do not match, it is determined that the photographing data of another person is illegally used.

The application history recording means 720 creates and records application history data 797 using the received application information.

The application point recording means 760 uses the sender information of the received application information, refers to the application point 795, reads the application point 795 associated therewith, and image identification information of the received application information The score value information 796 associated with is added to the score information of the read application points to update the application points 795 stored in the storage means.

The application determination report transmission means 780 creates an application determination report and transmits it to the reception server device 100.

The application information receiving means 710, the unauthorized application determination means 740, the application history recording means 720, the application point recording means 760, and the application determination report transmission means 780 are computer programs. The score value information 796, the application point 795, and the application history data 797 are data that can be read by a computer program. The storage unit 790 is a semiconductor memory or a magnetic memory.

FIG. 9 is a flowchart of the application acceptance process.
(1) The application information receiving unit 710 of the application determination server device 700 receives the application information 194 including the image identification information transmitted by the reception server device and the shooting condition data 391b. (Step S410)
(2) The unauthorized application determination unit 740 uses the image identification information and the shooting condition data of the received application information, and refers to the image identification information and the shooting condition data of the stored application history data 797 to It is determined whether there is application history data 797 in which the image identification information and the shooting condition data match.
If there is no application history data 797 in which both the image identification information and the shooting condition data match, the process proceeds to step S440.
If there is application history data 797 in which both the image identification information and the shooting condition data match, the process proceeds to step S43. (Step S420)
(3) The application determination report transmission means 780 creates an application determination report including an unauthorized use notification, transmits it to the reception server device 100, and ends. (Step S430)
(4) The application determination report transmission unit 780 creates an application determination report including an application reception notification and transmits the application determination report to the reception server device 100. (Step S440)
(5) The application history recording means 720 creates and records application history data 797 using the received application information 194, and ends. (Step S450)

Next, an example of determination processing will be described.
Example 1

FIG. 10 is a flowchart of an application determination process for issuing a detailed unauthorized use notification.
(1) The application information receiving means 710 of the application determination server device 700 receives the application information 194 transmitted by the reception server device, including image identification information, sender identification information (= source mail address), and shooting condition data 391b. To do. (Step S510)
(2) Step S520 is the same as step S420 in FIG.
(3) Steps S540 and S550 are the same as steps S440 and S450 in FIG. 9, respectively.
(4) The unauthorized application determination unit 740 extracts application history data 797 in which both the image identification information and the shooting condition data match. (Step S530)
(5) The unauthorized application determination means 740 uses the sender information of the received application information 194 to refer to the transmission source e-mail address of the extracted application history data 797, and the application history data 797 with which both match. It is determined whether or not there is. If there is no application history data 797 in which both match, the process proceeds to step S570. If there is application history data 797 in which both match, the process proceeds to step S575. (Step S560)
(6) The application determination report transmission means 780 creates an application determination report including a notification that the photographing data used by another person has been illegally used, transmits the application determination report to the reception server device 100, and ends. (Step S570)
(7) The application determination report transmission unit 780 creates an application determination report including a notification that the person himself / herself has illegally used the shooting data used in the application, transmits the application determination report to the reception server device 100, and ends. (Step S580)

As described above in detail, according to the present invention, in a campaign using a camera-equipped mobile phone, it is possible to prevent this when a photographed image used for participation application is illegally used twice. became.

Overview of an application management system using photographed images according to the present invention Rough processing flow of an application management system using photographed images according to the present invention Detailed configuration diagram of mobile terminal device 300 Format of shooting data 391 Example of shooting condition data 391b Detailed configuration diagram of reception server device 100 Detailed configuration diagram of the image recognition server device 500 Detailed configuration diagram of the application determination server device 700 Judgment process flowchart (Example 1) Flow chart of application determination processing for issuing a detailed unauthorized use notification

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Application management system 100 using a picked-up image Reception server apparatus 110 E-mail reception means 120 Image transmission means 130 Image recognition result reception means 140 Application information creation transmission means 150 Application determination report reception means 170 E-mail transmission means 190 Storage means 194 Application Information 198 Application result 300 Mobile terminal device 301 Digital camera 320 Email creation / transmission means 330 Email reception means 390 Storage means 391 Shooting data 391a Image data 391b Shooting condition data 392 Email 500 Image recognition server device 510 Search means 520 Image recognition result Reply means 590 Storage means 593 Image recognition dictionary 700 Application determination server device 710 Application information reception means 720 Application history recording means 740 Unauthorized application determination means 760 Application point recording means 780 Application determination information Report sending means 790 Storage means 795 Application points 796 Score value information 797 Application history data

Claims (4)

An application management system using a photographed image of a print medium having an area including an image part,
An application management system using a captured image configured by connecting a mobile terminal device, a reception server device, an image recognition server device, and an application determination server device to a network,
The portable terminal device
Storage means;
An area including the image portion of the print medium is imaged, and image data is created in the storage means, using the camera for recording, the image data and the imaging condition data recorded in the storage means, An e-mail creating means for creating an e-mail having sender information attached with;
E-mail transmitting means for transmitting the created e-mail to the receiving server device;
An e-mail receiving means for receiving an e-mail including an application result from the reception server device;
A terminal device comprising:
E-mail receiving means for receiving an e-mail including sender information and photographing data;
Using the image data of the shooting data included in the received e-mail, constructing a database search query including the image data, and transmitting to the image recognition server device,
Image recognition result receiving means for receiving an image recognition result including image identification information from the image recognition server device;
Image recognition result receiving means for receiving the image recognition result transmitted by the image recognition server device;
Using the received image recognition result and e-mail, application information creation and transmission means for creating application information including image identification information and shooting condition data and transmitting it to the application determination server device;
An application determination report receiving means for receiving an application determination report transmitted by the application determination server device;
An e-mail receiving means for creating an e-mail including an application result using the received application determination report, and transmitting the e-mail to the mobile terminal device;
A server device comprising:
The image recognition server device
Storage means for storing an image identification information database;
Retrieval means for accepting a database search query from the accepting server device, using this to search the image identification information database, and extracting the image identification information;
An image recognition result reply means for creating an image recognition result including the image identification information and sending it back to the reception server device;
A server device comprising:
Application determination server device
Storage means for storing application history data relating imaging condition data and image recognition results;
Application information receiving means for receiving application information transmitted by the reception server device;
Using the received image identification information and shooting condition data of the application information, referring to the image identification information and shooting condition data of the stored application history data, if there is application history data that matches both, A fraud application judging means for judging;
An application history recording means for recording the received application information;
An application management system using photographed images, characterized by being a server device. In the reception server device,
The application information creation / transmission means creates application information including image identification information, shooting condition data, and sender information using the received image recognition result and the e-mail, and transmits the application information to the application determination server device. ,
In the application determination server device,
The storage means stores application history data associating sender information, shooting condition data, and image recognition results,
The fraudulent application determination means uses the image identification information and shooting condition data of the received application information, refers to the image identification information and shooting condition data of the stored application history data, and matches the application history The data is extracted and the sender information of the application history data is compared with the sender information of the extracted application history data using the sender information of the received application information. If it is determined that the application is illegal, and the two do not match, it is determined that the other person's shooting data is illegally used
The application management system using the photographed image according to claim 1. A computer program that causes a computer to operate as an application management system using the captured image according to claim 1 by being incorporated in the computer. The computer-readable recording medium which recorded the computer program of Claim 3.

Images