JP2003319033A - Portable communication terminal information input system, portable communication terminal, portable communication terminal program, analysis server, and portable communication terminal information input method - Google Patents

Abstract

(57) [Summary] [PROBLEMS] A mobile communication terminal information input system, which enables quicker and easier input of information to a mobile communication terminal and closely connects an object and its information, a mobile communication terminal, and a mobile communication terminal A program, an analysis server, and a mobile communication terminal information input method are provided. SOLUTION: A symbol pattern displayed on a bulletin board 1 is photographed by a digital camera 12 provided in a mobile phone 1. The photographed still image is transmitted to the video processing server 2, where the symbol pattern is recognized from the still image and converted into corresponding data. Furthermore, based on the converted data,
The video processing server 2 transfers the information held in the information server 3 to the mobile phone. Thereby, in the mobile phone 1, the symbol pattern of the bulletin board is projected on the screen,
By simply clicking on it, it is possible to link to more detailed information of the information displayed on the bulletin board 5.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a mobile communication terminal information input system, a mobile communication terminal, a mobile communication terminal program, an analysis server, and a mobile communication terminal information input method, and in particular, it is associated with specific processing and information. The present invention relates to a mobile communication terminal information input system, a mobile communication terminal, a mobile communication terminal program, an analysis server, and a mobile communication terminal information input method for inputting information to a mobile communication terminal by capturing a symbol pattern.

[0002]

2. Description of the Related Art In recent years, a method of connecting to a communication line such as the Internet to obtain information has become widespread as a means for obtaining the latest information. Not only when connecting a personal computer (hereinafter referred to as “personal computer”) to a telephone line, but also when connecting a PDA (personal d).
It is possible to access various kinds of information by connecting to the Internet from a mobile communication terminal such as a digital assistant or a mobile phone.

In particular, a mobile phone can be always carried, and can be connected immediately after being turned on, so that it can be connected to the Internet at any time when information is desired. In addition to the unique advantages of mobile phones, the improved data processing performance and data communication speed of mobile phones handle data that was previously handled only when a personal computer was connected to a telephone line, and Processing is becoming possible. For example, it is possible to take not only still images but also moving images with a camera provided in a mobile communication terminal, send and receive them, and download and execute application programs necessary for handling such still images and moving images. .

[0004]

As described above, by performing data communication using the portable communication terminal, various kinds of information can be obtained immediately when desired. However, in order to obtain the information, the information necessary to obtain the desired information, for example, the W
URL to EB page (Universal Reso)
Locator Locator), a keyword for performing a keyword search on the search page, and the like. On the other hand, since the portability of the mobile communication terminal is important, the user interface such as operation buttons is generally designed to be relatively small. For this reason, when users want information, for example, when they discover a new product or a new word through advertisements or posters on the street and want to know more, the user of the mobile communication terminal stops in the crowd. It was not easy to input a long URL into a mobile communication terminal using a small operation button. Even when a search is performed using a search keyword instead of a URL, it may take a long time to reach the target information. In addition, when reaching a workplace or home where a personal computer can be used, there is a case where the user wants to forget the information he / she wants to know, and it was not possible to say that the information communication function of the personal computer or mobile communication terminal was fully exerted. .

In addition, even if the URL is displayed in the advertisement or poster without breaking the balance of the design,
It was not used sufficiently, and it could not be said that the information display such as advertisements and posters was effectively exerting the communication function. An object of the present invention is to enable quicker and simpler information input to a mobile communication terminal, and a mobile communication terminal information input system, a mobile communication terminal, a program for a mobile communication terminal, and an analysis that closely connect objects and their information. It is to provide a server and a mobile communication terminal information input method.

[0006]

A portable communication terminal information input system according to claim 1 of the present invention is provided in a portable communication terminal, and photographing means for photographing a symbol pattern represented on an object, and photographing by said photographing means. A conversion means for recognizing a symbol pattern from the result and converting all the recognized symbol patterns into corresponding data, and processing is performed based on the converted data, and the result of the processing is displayed on the portable terminal. And a processing unit for performing the processing.

As described above, by converting the information represented on the object into a symbol pattern and converting the data into data that can be handled by the mobile communication terminal, the information can be easily taken into the mobile communication terminal. As a result, it is possible to improve the operability of the relatively small operation buttons of the mobile communication terminal that emphasizes portability, and use the functions of the mobile communication terminal immediately for the processing that is closely related to the object that represents the symbol pattern. Can be realized. In addition, by using a mobile communication terminal having a camera function as a symbol pattern reading medium, the symbol pattern can be read at any time in combination with its portability, and the mobile communication terminal is lightweight and easy to move. Therefore, the symbol patterns represented on various objects such as fixed objects can be read. In addition, by using a camera that can be used for multiple purposes, it is possible to prevent deterioration of portability due to the provision of a read-only device in a mobile communication terminal, and to read a symbol pattern displayed on an object at a distant position. it can.

The portable communication terminal information input system according to claim 2 of the present invention is the portable communication terminal information input system according to claim 1, wherein the converted data includes information held in an information server on a network to which the portable communication terminal is connected. The mobile communication terminal is characterized by being associated with a process for downloading. By using the communication function of the mobile communication terminal, it is possible to obtain more information held in the information server, and to realize more processing that is closely related to things such as processing data by the information server. .

The portable communication terminal information input system according to claim 3 of the present invention is the portable communication terminal information input system according to claim 1 or 2, wherein the symbol pattern is represented by an information display object for displaying information. Is associated with the process of downloading the information related to the information indicated by the information display object.

As a result, more detailed information that cannot be displayed on an information display object such as a poster, and related information such as moving images, voices, data of different types such as programs (processing instructions in a mobile communication terminal), can be displayed as symbols. You can get the pattern immediately by just shooting the pattern. The mobile communication terminal information input system according to claim 4 of the present invention is characterized in that in claim 3, the information display object is a poster.

The poster is of a nature that it is stuck on a public place and cannot be easily taken out. Therefore, by displaying a symbol pattern and making it possible to immediately execute a link to related information, the poster can be displayed. By transmitting information according to the viewer's request, it is possible to further enhance the information transmission effect of the poster. The mobile communication terminal information input system according to claim 5 of the present invention is characterized in that in claim 3, the information display object is a signboard.

[0012] The portable communication terminal information input system according to claim 6 of the present invention is characterized in that in claim 3, the information display object is a publication. Even in publications such as books, magazines and newspapers, by expressing the symbol pattern,
More detailed information can be obtained regardless of time and place. The mobile communication terminal information input system according to claim 7 of the present invention is the portable object terminal information input system according to any one of claims 1 to 6, wherein the symbol pattern is fixed at a specific position and serves as a mark when identifying the position. The converted data is associated with the process of downloading the map information indicating the fixed position of the fixed object.

With this, even if the location information such as the current address is grasped and the URL for downloading the map information is not known, the present position of the photographer can be mapped by reading the symbol pattern displayed on the fixed object. Can be confirmed at. The portable communication terminal information input system according to claim 8 of the present invention is characterized in that, in claim 7, the fixed matter is an electric pole.

By assigning position information to each of the electric poles installed everywhere, the present location can be specified in detail. A mobile communication terminal information input system according to claim 9 of the present invention is the mobile communication terminal information input system according to any one of claims 1 to 8, wherein the converted data includes information for specifying an object representing the symbol pattern. Characterize.

Thus, the object representing the symbol pattern can be distinguished from other objects, and the specific processing can be associated with the specified object. Claim 10 of the present invention
The mobile communication terminal information input system according to claim 1,
In any one of the above items, the information held in the information server is voice data output from the mobile communication terminal.

As described above, by utilizing the information held on the network, not only character data but also
Various types of data can be obtained. In particular, by making it possible to download the audio data, it is possible to transmit the information and the like displayed on the information display object to the visually impaired and the elderly. A mobile communication terminal information input system according to claim 11 of the present invention is the mobile communication terminal information input system according to any one of claims 1 to 10, characterized in that the conversion means is installed in an analysis server connected to the mobile communication terminal. To do.

By performing the conversion process of converting the symbol pattern into data in an analysis server connectable from the mobile communication terminal, a program for conversion is held in the mobile communication terminal having a relatively small storage capacity, There is no need to do that process. Further, the correspondence between the symbol pattern and the conversion data can be unified and managed. A mobile communication terminal information input system according to claim 12 of the present invention comprises:
In claim 11, at least a part of the processing by the processing means is performed in the analysis server that has performed the conversion.

By performing the process in the analysis server that holds the converted data, the correspondence between the converted data and the process is unified as compared with the case where the process is performed by each mobile communication terminal. At the same time, redundant communication traffic due to returning the converted data to the mobile communication terminal can be suppressed. Claim 1 of the present invention
The mobile communication terminal information input system according to claim 3,
12. In any one of 12 above, the shooting result is a still image obtained by shooting all the symbol patterns to be converted.

By photographing the symbol patterns to be converted at one time, the conversion unit can be clarified and the conversion can be performed by a simple recognition process. A mobile communication terminal information input system according to claim 14 of the present invention is defined by claims 1 to 12.
In any one of the above items, the shooting result is a moving image including a plurality of still images of which N (N is a natural number) to be converted are captured at the same time, and the converting unit converts each of the moving images from the moving image. It is characterized by recognizing the symbol pattern and converting all the recognized patterns into corresponding data.

By using a moving image, many symbol patterns that cannot be photographed at one time can be used.
Much data can be associated with a symbol pattern. A mobile communication terminal according to claim 15 of the present invention is the mobile communication terminal used in the mobile communication terminal information input system according to any one of claims 1 to 14, and is one or more of the above. It is characterized by further comprising: a photographing means for photographing the symbol pattern, and a display means for displaying a result of processing performed according to the photographing of the symbol pattern.

A mobile communication terminal according to claim 16 of the present invention is the portable communication terminal according to claim 15, which recognizes a symbol pattern from a photographing result by the photographing means and converts all the recognized symbol patterns into corresponding data. Means are further provided. A mobile communication terminal according to a seventeenth aspect of the present invention is the mobile communication terminal according to the sixteenth aspect, further comprising processing means for performing processing based on the converted data.

An analysis server according to claim 18 of the present invention is
A server used in the mobile communication terminal information input system according to any one of claims 1 to 14, wherein a symbol pattern is recognized from a photographing result received from the mobile communication terminal, and all the recognized patterns are recognized. It is characterized by having a conversion means for converting the symbol pattern into corresponding data.

An analysis server according to claim 19 of the present invention is
The method according to claim 18, further comprising processing means for performing processing based on the converted data and transmitting a result of the processing to the mobile terminal. A program for a mobile communication terminal according to claim 20 of the present invention comprises a step of obtaining a photographing result of a symbol pattern represented on an object, and the photographing result is recognized as a symbol pattern from the photographing result, and converted into corresponding data. And a step of displaying the result of the performed processing based on the converted data.

A mobile communication terminal program according to claim 21 of the present invention comprises a step of acquiring a photographing result of a symbol pattern represented on an object, a step of recognizing the symbol pattern from the photographing result and converting the symbol pattern into corresponding data. And a step of performing processing based on the converted data.

A mobile communication terminal information input method according to a twenty-second aspect of the present invention is a method for inputting information to a mobile communication terminal, the method comprising the step of expressing a symbol pattern on an object and a photographing device provided in the mobile communication terminal. The step of photographing the symbol pattern, the step of recognizing the symbol pattern from the photographing result by the photographing means and converting all the recognized symbol patterns into corresponding data, and obtaining the converted data. And a step.

Even when the symbol pattern and the process are not associated with each other, by associating the symbol pattern with specific data, the symbol pattern is only photographed, and the portable communication terminal can be easily and easily operated without using a relatively small operation button. You can enter information quickly. In the step of expressing the symbol pattern on the object, the symbol pattern is directly written / printed on the object using a writing tool, ink, or the like, or
There is a method of combining a plurality of stickers or the like each showing a symbol pattern having a predetermined style and attaching it to an object. Further, in this step, the symbol pattern and the converted data are also associated with each other.

[0027]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, embodiments of the present invention will be described with reference to the drawings. In each drawing referred to in the following description, the same parts as those in other drawings are indicated by the same reference numerals. (Mobile Communication Terminal Information Input System) FIG. 1 shows the configuration of the mobile communication terminal information input system according to the present embodiment. As shown in the figure, the mobile communication terminal information input system includes a mobile phone 1, a network NW, and
The video processing server 2 and the information server 3 are included.

The mobile phone 1 has, in addition to the voice call function,
It also has a data communication function and an Internet communication function, and can send and receive emails and browse WEB pages. Further, in the present embodiment, the digital camera 12 is provided and a still image and a moving image can be taken. In addition, a still image captured by the digital camera 12 is referred to as JPEG (joint photographic).
save in a format such as c expertsgroup),
It can be sent as an attached file to the above-mentioned mail or WEB page.

From the mobile phone 1, the network NW is
It is a network that can be connected by a communication line. The mobile phone 1 according to the present embodiment can be connected to not only the telephone network but also the Internet network as described above. The video processing server 2 can be connected to the mobile phone 1 via the network NW. In the present embodiment, a shooting result such as still image data transmitted from mobile phone 1 is received, and a symbol pattern is recognized from the received shooting result. After that, the video processing server 2 can perform a process of converting all the recognized symbol patterns into corresponding data. In addition, processing can also be performed based on the converted data. The symbol pattern and corresponding data will be described later.

The information server 3 is a server connected to the mobile phone 1 and the video processing server 2 via the network NW. The information server 3 makes the information held internally to the connected mobile phone 1 or the like open, permits database access, or changes the information held internally in response to a request from a connecting client. And so on.

Hereinafter, the symbol pattern 4 displayed on the bulletin board 5
The procedure from the shooting of 1 to the processing corresponding to the symbol pattern will be described with reference to the flowchart of FIG. In step S201 of FIG. 2, the symbol pattern displayed on the bulletin board is photographed by the camera of the mobile phone. In the present embodiment, the application program of the mobile phone is activated to use this system. When this application is activated, an input form 11A as shown in FIG. 3 appears on the screen 11 of the mobile phone 1. This input form 1
1A defines the range of the image to be recognized by defining the starting point and the ending point of the recognition of the symbol pattern by the reference points 11B provided at the upper left and the lower left thereof. Therefore, when photographing the symbol pattern 4, all the symbol patterns 4A, 4B, 4C, 4D to be converted
, Is photographed so that it is projected within the range of the reference point 11B of this input form 11A. In the figure, the four symbol patterns 4A, 4B, 4C, and 4 displayed on the bulletin board.
Shoot all D so that it fits within the frame of the input form 11A. When the shooting of the symbol pattern is confirmed, step S
Move to 202.

In step S202, step S
The still image taken in 201 is transmitted to the video processing server. In step S203, the video processing server that receives the still image recognizes and extracts the symbol pattern from the still image. Then, the recognized symbol pattern is converted into corresponding data. In the present embodiment, this data is a URL indicating the position of information held by the information server 3.

The video processing server in this embodiment is
As described above, not only the image recognition process but also the process based on the converted data is performed. Therefore, the video processing server
If it is recognized that the converted data is a URL, the information held by the information server specified by the URL is acquired and transferred to the mobile phone (step S204). As a result, on the screen of the mobile phone, it is possible to download the information immediately after shooting without inputting a long URL that is cumbersome to input (step S20).
5).

In this way, by photographing the symbol pattern displayed on the bulletin board with the camera provided in the mobile phone, instead of manually inputting the long URL using the small operation button of the mobile phone, the mobile phone is replaced. You can enter instructions to. Moreover, the above-mentioned application program performs a step of acquiring a shooting result and a step of transmitting the shooting result to the video processing server after acquiring the shooting result. In the present embodiment, processing such as definition of the input range of video is also performed. W instead of the application program installed on the mobile phone
The same processing may be performed by EB access. In this case, the WEB page of a video processing server or the like for performing video processing is accessed, shooting is performed using the input form on the WEB page, and the shooting result is attached and transmitted.

It is also possible to perform conversion in the mobile phone by the application program without performing recognition and conversion processing of the symbol pattern by the video processing server 2. In this case, as shown by an arrow R2 in FIG. 1, the mobile phone directly accesses the information server 3 based on the converted data. Therefore, a step of obtaining a shooting result, a step of recognizing a symbol pattern from the shooting result, a step of converting all recognized symbol patterns into corresponding data, and a step of performing processing according to the converted data, I do. The step of performing processing according to the converted data is not an essential step. For example, if it is known in advance that the symbol pattern corresponds to the URL, the shooting result inserted at the URL input position may be converted into data and directly input at the URL input position. If this conversion process is performed by an application program, the conversion process can be performed without connecting to a network. On the contrary, if the video processing server performs the conversion process as described above, it is not necessary to store the program in a storage device having a relatively small capacity as compared with a normal information processing device. Further, since the correspondence relationship between the symbol pattern and the data can be managed in the video processing server in a unified manner, it is possible to promptly deal with the change of the correspondence relationship.

Note that these application programs are available by downloading to the mobile phone. (Symbol pattern) Examples of symbol patterns are shown in FIGS.
Is shown in. As shown in these figures, a simple symbol that can be easily recognized from the image is used for the pattern attached to the surface of the object. The symbol pattern shown in FIG. 4 is 1
By providing different shades of color for each part of the two symbols, different patterns are formed. In the figure, 16 patterns are formed by dividing the symbol into four regions and dividing them into the presence or absence of color. In FIG. 5, there are 34 patterns by combining the number of straight lines of 2 or less, 4 kinds of inclination angles, and the presence or absence of the tip shape of the arrow. The symbol pattern used in the present embodiment is not limited to that shown in the figure. Create a symbol pattern that makes it easy to recognize the difference between the patterns by combining changes in each element such as angle, line, point, color, etc. that are easy to recognize such as presence or absence. You can

In this embodiment, a camera is used to read the symbol pattern. Therefore, as shown in FIG. 1, not only one symbol pattern 4 but also a combination of a plurality of symbol patterns 4 can be read at once. Therefore, if there are X patterns in one symbol pattern, one still image in which four symbol patterns are captured can be associated with X ⁴ different data.

Further, as shown in FIG. 6, the digital camera 12 provided in the mobile phone 1 is indicated by an arrow Y on the symbol pattern groups 4E, 4F, 4G, 4H consisting of four symbol patterns. In this way, a moving image including four still images obtained by photographing each symbol pattern group is photographed. By recognizing each symbol pattern group and each symbol pattern from this moving image, X ¹⁶ different pieces of information can be expressed. In this way, more information can be expressed by using the moving image as well.

The size of the symbol pattern is not particularly limited as long as the entire camera can be photographed and recognized. Therefore, if a large symbol pattern is displayed on a building or the like, the symbol pattern can be used for information input even from a distant position where the entire symbol pattern can be photographed. (Item displaying symbol pattern and contents of processing) Next, an object displaying the symbol pattern and a process based on the corresponding data will be described. (1) Display symbol patterns on posters, hanging advertisements, advertisements displayed on walls of buildings, bulletin boards, information boards, and information displays that display information, such as publications such as books and magazines. .
The data corresponding to the symbol pattern relates to the information displayed on the information display object such as a poster, and specifies the information held in the above information server such as the URL.

[0040] For example, a WE set up by the event organizer on a poster posted at a station or the like to inform the holding of the event.
The symbol pattern corresponding to the URL of page B is shown. A person who views this poster can access the WEB page automatically by taking a picture of the symbol pattern shown on this poster using the camera equipped in his mobile phone, and the screen of the mobile phone can be accessed. Displays more detailed information about the event.

As a result, the information displayed on an immovable object such as a poster posted on a public place or a guideboard at a station can be displayed at hand. Further, in order to display it, it is only necessary to photograph the symbol pattern with the camera. For this reason, you can quickly get the information you want without getting close and manually entering a long URL that is displayed in a small size on your mobile phone, or having to stop and make a note of the event date or contact information written on the poster. You can get it on the spot. Also, for a large advertisement such as a building wall, the WEB page can be accessed by photographing the symbol pattern in the same manner.

That is, when the symbol pattern corresponding to the link mark displayed on the object fits on the shooting screen, the operation button is operated in the same manner as clicking the link mark on the screen displaying the WEB page. By pressing, you can link to information related to the item. As a result, the real thing and the information about it are more seamlessly connected. (2) The symbol pattern is represented by a fixed object, such as a telephone pole, a building, or a road sign, which is fixed at a specific position and serves as a mark for identifying the position. Then, the data corresponding to the symbol pattern is map information indicating the position where the fixed matter is fixed, and specifies the information held in the information server.

For example, in place of or in addition to the conventional notation of place names and addresses shown on telephone poles, W showing a map
The symbol pattern corresponding to the URL to the EB page is shown.
A person looking for the destination shoots the symbol pattern with a camera, and a still image of the symbol pattern is transmitted to the video processing server 2 of FIG. Video processing server 2
Recognizes the symbol pattern from the still image and converts it into URL data representing a map. The video processing server 2 that has recognized the URL accesses the information server 3, acquires the contents of the map page, and transfers the contents to the mobile phone 1. Alternatively, the URL data is transmitted to the mobile phone 1, and the browser of the mobile phone 1 that receives the URL data receives the URL.
Access the WEB page of L and display the map page on the screen of the mobile phone.

The converted data is not limited to the data corresponding to the URL, but the information indicating the photographing position such as accurate latitude / longitude information of the position where the symbol pattern is photographed, the image processing server 2, the information server. 3 and the mobile phone 1 include data including information for requesting specific processing. That is, it suffices that the device for receiving the data can perform the processing for displaying the map information held in the information server on the network to which the mobile phone is directly or indirectly connected, on the mobile phone.

For example, when the converted data is information indicating the photographing position, the video processing server 2 and the mobile phone 1
After converting to data, it is determined that the converted data is position information. Then, the map database determined to be connected in advance is accessed, the shooting position information is searched as a condition, and the map is acquired as the search result. These converted data are decided by considering the amount of information that can be expressed by the symbol pattern, the expandability due to the increase in the corresponding processing, the convenience when attaching the symbol pattern to the object, etc. .

As described above, by displaying the symbol patterns that can be identified at the respective installation locations on the utility poles and the like installed everywhere in the city, highly accurate position information can be obtained by reading the symbol patterns. You can This is GPS (global positioning)
It is possible to specify an accurate position even in a building and to immediately obtain position information corresponding to the position with a simpler system than the system).

Further, since highly accurate position information can be easily obtained in this manner, it can be effectively used as an information guide system for displaying the present location of an amusement park or a department store. For example, a street lamp, a bench, or the like at each point of the amusement park represents a symbol pattern corresponding to position information that is regularly determined in the amusement park. This symbol pattern also includes connection information to the information server holding the map information corresponding to the position information. By photographing these symbol patterns, a map of the amusement park around the photographing position is displayed on the mobile phone. Further, information such as vehicle guidance in the vicinity thereof and route instructions to the destination can be held in the information server and displayed on the mobile phone. (3) The data corresponding to the symbol pattern includes information for specifying an object that represents the symbol pattern. in this case,
In particular, the symbol pattern can be effectively used by representing the symbol pattern as an item that is difficult to distinguish from other items such as products of the same type and baggage items when traveling.

For example, when traveling as a group, a luggage tag representing a different symbol pattern is given to each of the travelers. After temporarily storing the collective luggage in a passenger plane or bus, the symbol pattern displayed on the luggage tag is read when the luggage is delivered to the luggage. Since the sign pattern of the luggage tag is different for each traveler, it can be distinguished from the luggage of other travelers who are easily confused. The sign pattern of the luggage tag and the authentication of the shipper are performed by, for example, distributing a hand-held card that represents the same symbol pattern as the luggage tag together with the luggage tag and comparing whether the sign pattern of the luggage tag and the symbol pattern of the shipper match. . Alternatively, the sign pattern of the luggage tag and the tourist information registered in the database in advance are associated with each other, and at the same time when the symbol pattern of the luggage tag is photographed, the traveler information is displayed on the mobile communication terminal for authentication. May be. In this case, for example,
Conversion to the destination country language is further added to the display of the tourist information. As a result, even when traveling overseas, it is possible to authenticate by a local guide or the like.

In addition, each product is represented by a symbol pattern corresponding to the identification information of the product. Then, the data converted by this symbol pattern can be used for inventory management, article management, etc. of the article by associating with the process of displaying the expiration date of the article on the mobile phone. In this way, by using the camera provided in the mobile phone and the information held on the network, it is possible to freely associate with various information without using a dedicated device such as a barcode scanning device. You can go and use it in various scenes.

Further, since the symbol pattern is read by the camera as described above, the symbol pattern can be displayed in a large size so as to be used for management of outdoor buildings, buildings, cars, containers and the like. (4) The information to be downloaded is converted into voice data by reading the symbol pattern. For example, a symbol pattern is displayed on a guide board or the like that displays regional information installed in front of a station or the like. By photographing this symbol pattern, the information displayed on the guide board is downloaded as voice data from the information server and reproduced through the speaker of the mobile phone. As a result, even visually impaired people and elderly people can only take pictures of symbol patterns, and even if there is no Braille, it is damaged, it is in a part that can not be touched by hand, there is a lot of information, etc. You can get the contents displayed on the board at your hand and listen repeatedly over time. In this case, the range of the symbol pattern is represented by enclosing it in Braille or the like. Further, the above-mentioned application for image capturing and data conversion is also provided with a function of notifying that the symbol pattern is imaged and recognized in a recognizable range by voice.

[0051]

As described in detail above, by converting information represented on an object into a symbol pattern and converting it into data that can be handled by a mobile communication terminal, the information can be easily taken into the mobile communication terminal. . This allows
The operability of a mobile communication terminal with relatively small operation buttons can be improved to improve portability, and processing that is closely related to an object that represents a symbol pattern can be immediately performed using the function of the mobile communication terminal. Can be realized.

By associating a symbol pattern with a link to information about an object representing the symbol pattern, it is possible to immediately obtain information about the object by photographing the symbol pattern represented on the object. Furthermore, the symbol pattern expresses the position information of the object representing it. By reading this symbol pattern, it is possible to specify the detailed position of the person who took the image, and it is possible to acquire the map information corresponding to that position without knowing the position.

[Brief description of drawings]

FIG. 1 is a diagram showing a configuration of a mobile communication terminal information input system according to the present embodiment.

FIG. 2 is a flowchart showing a flow from photographing a symbol pattern displayed on a bulletin board to performing corresponding processing.

FIG. 3 is a diagram showing an input form displayed on a screen when a symbol pattern shooting application is activated.

FIG. 4 is a diagram showing a symbol pattern in which a different pattern is formed by providing different shades of color to each part of one symbol.

FIG. 5 is a diagram showing a symbol pattern in which the number of straight lines of two or less, four types of inclination angles, and the presence or absence of the tip shape of the arrow are combined with them.

FIG. 6 is a diagram showing how a symbol pattern is photographed as a moving image.

[Explanation of symbols]

1 mobile phone 2 Video processing server 3 information server 4 symbol pattern 4A-4D symbol pattern 4E to 4H Symbol pattern group 5 bulletin board 11 screens 11A input form 11B reference point 12 digital cameras NW network

   ─────────────────────────────────────────────────── ─── Continued front page    F term (reference) 5K027 AA11 BB02 CC08 HH26                 5K067 AA34 BB04 DD04 DD17 EE02                       EE16 FF07 KK13 KK15

Claims (22)

[Claims] 1. A mobile communication terminal is provided with a photographing means for photographing a symbol pattern represented on an object, and a symbol pattern is recognized from a photographing result by the photographing means, and all the recognized symbol patterns are associated with each other. A mobile communication terminal information input system, comprising: a conversion unit that converts the converted data into data, and a processing unit that performs a process based on the converted data and displays a result of the process on the mobile terminal. 2. The converted data is associated with a process for downloading, in the mobile communication terminal, information held in an information server on a network to which the mobile communication terminal connects. The portable communication terminal information input system according to claim 1. 3. The symbol pattern is represented on an information display object for displaying information, and the converted data is associated with a process of downloading information related to the information indicated by the information display object. The mobile communication terminal information input system according to claim 1 or 2, characterized in that: 4. The mobile communication terminal information input system according to claim 3, wherein the information display object is a poster. 5. The mobile communication terminal information input system according to claim 3, wherein the information display object is a signboard. 6. The mobile communication terminal information input system according to claim 3, wherein the information display object is a publication. 7. The symbol pattern is fixed to a specific position, and is represented on a fixed object serving as a mark for identifying the position, and the converted data indicates the fixed position of the fixed object. The mobile communication terminal information input system according to any one of claims 1 to 6, which is associated with a process of downloading the indicated map information. 8. The mobile communication terminal information input system according to claim 7, wherein the fixed object is a telephone pole. 9. The mobile communication terminal information input system according to claim 1, wherein the converted data includes information for specifying an object representing the symbol pattern. . 10. The information stored in the information server is
The mobile communication terminal information input system according to any one of claims 1 to 9, wherein the mobile communication terminal outputs audio data. 11. The mobile communication terminal information input system according to claim 1, wherein the conversion means is installed in an analysis server connected to the mobile communication terminal. 12. The mobile communication terminal information input system according to claim 11, wherein at least a part of the processing by the processing unit is performed by the analysis server that has performed the conversion. 13. The mobile communication terminal information according to claim 1, wherein the shooting result is a still image obtained by shooting all the symbol patterns to be converted. Input system. 14. The shooting result is a moving image composed of a plurality of N (N is a natural number) still images that are simultaneously shot as the conversion target, and the conversion unit is a symbol for each of the moving images. The mobile communication terminal information input system according to any one of claims 1 to 12, wherein a pattern is recognized, and all the recognized patterns are converted into corresponding data. 15. A mobile communication terminal used in the mobile communication terminal information input system according to claim 1, wherein the mobile communication terminal captures one or more symbol patterns represented on the object. A mobile communication terminal comprising: a means and a display means for displaying a result of processing performed in response to the photographing of the symbol pattern. 16. The method according to claim 15, further comprising conversion means for recognizing a symbol pattern from a photographing result by the photographing means and converting all the recognized symbol patterns into corresponding data. The mobile communication terminal described. 17. The mobile communication terminal according to claim 16, further comprising processing means for performing processing based on the converted data. 18. A server used in the mobile communication terminal information input system according to claim 1, wherein the server recognizes a symbol pattern from a photographing result received from the mobile communication terminal, An analysis server having a conversion unit for converting all recognized symbol patterns into corresponding data. 19. The analysis server according to claim 18, further comprising processing means for performing processing based on the converted data and transmitting a result of the processing to the mobile terminal. 20. A step of acquiring a photographing result of a symbol pattern represented on an object, and a step of transmitting the photographing result to a video processing server which recognizes the symbol pattern from the photographing result and converts the symbol pattern into corresponding data. And a step of displaying a result of processing performed based on the converted data. 21. A step of obtaining a photographing result of a symbol pattern represented on an object, a step of recognizing a symbol pattern from the photographing result and converting it into corresponding data, and a processing based on the converted data. The steps to take,
A program for a mobile communication terminal, comprising: 22. A method for inputting information to a mobile communication terminal, the method comprising the step of representing a symbol pattern on an object, the step of photographing the symbol pattern by a photographing device provided in the mobile communication terminal, and the photographing means. A mobile communication terminal, comprising: a conversion step of recognizing a symbol pattern from a shooting result and converting all the recognized symbol patterns into corresponding data; and a step of acquiring the converted data. Information input method.