JP2007293612A - Network connection method and electronic equipment - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a network connection method for easily connecting the computer of a user to a desired network address. <P>SOLUTION: This network connection system 100 is provided with a management server 1; a service server 2 for providing a network service; an image acquisition device 7 of a user for photographing an image 4 including a code image 3, and for acquiring the image data of an image 4 and electronic equipment 6 having a computer 8 of a user which can be connected through a network(communication network) 5 to the management server 1 and the service server 2. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to, for example, a network connection method using two types of cords and an electronic apparatus that implements the network connection method.

  In recent years, most products distributed in the market display bar codes (one-dimensional codes) composed of lines of various thicknesses to indicate product information such as product types and prices. Such a bar code is composed of a thick line, a thin line, a double line, etc., and indicates numeric data in which product information is encoded.

  On the other hand, a network address such as a company Internet homepage address or a URL (Uniform Resource Location) such as an e-mail address may be displayed on a business card for general business purposes.

  Such Internet homepages contain information about the company's publicity, and Internet users interested in the company can read the company's publicity on the Internet homepage and then send an e-mail address when there is an inquiry. Try to contact In addition to business cards, Internet homepage addresses and URLs of specific companies may be displayed in advertisement fields such as magazines and newspapers.

  At this time, in order for a user to connect to the URL displayed on these media, the URL displayed on the media must be typed with the keyboard. Or, if an e-mail address is displayed on these media, a user who wants to send an e-mail to the e-mail address must type all the e-mail addresses.

  However, Internet homepage addresses or e-mail addresses are not composed of one or two characters, but are generally composed of ten to several cross characters. As a result, it is difficult for the user to input the address, and there is a problem that the network address is erroneously input and a predetermined service is not provided.

  As a conventional technique for solving such a problem, information relating to a network (for example, a character on a specific network, a character or a symbol contained in a URL, etc.) is coded using colors and shades according to an already defined code system. An image (color code) is converted and displayed on a predetermined medium, and the user acquires the code image by a PC camera, a digital camera, a scanner, or the like, and the user's computer uses a predetermined code system based on the code system described above. There is one that decodes a network address or URL and receives a service of a connected network based on the decoding information (see, for example, Patent Document 1).

  In addition, in order to reduce the display area of the above-described barcode (one-dimensional code), improve the reading operation, and reduce the printing cost, the stack barcode method or the matrix method in which the above-described barcodes are stacked. There are two-dimensional codes that employ the above. This two-dimensional code is obtained by encoding target data such as a URL according to a standard defined by JIS or the like.

  Here, in the prior art, there is an electronic device (for example, a mobile phone) that can read a two-dimensional code.

  As described above, some currently-used electronic devices, particularly mobile phones, can read a two-dimensional code. However, it is necessary to separately install an image recognition algorithm for recognizing a color code. is there.

  When trying to connect a mobile phone to a desired network using a code, the user confirms whether the displayed code is a two-dimensional code or a color code, Furthermore, the user needs to operate the electronic device to select and activate an image recognition algorithm.

As described above, the operation of the electronic device (mobile phone) becomes complicated, and there is a problem that it is not possible to easily connect the user's computer (mobile phone) to a desired network address.
JP 2003-6077 A (page 3-8, FIG. 4)

  The present invention solves the above-described problems, and provides a network connection method and an electronic apparatus that can easily connect a user's computer to a desired network address.

A network connection method according to an aspect of the present invention includes:
In a network connection method for connecting a user's computer to a predetermined network address through a network,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The user's image acquisition device acquiring an image that may include a second code image comprising a two-dimensional code;
Trying to recognize the first code image from the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image;
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
If the first code image is not recognized from the image, the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image. Trying to recognize a second code image from
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding, and
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. And a step of acquiring by the apparatus.

Furthermore, a network connection method according to an aspect of the present invention includes:
The computer attempting to recognize a first code image from the new image acquired by the image acquisition device by the first image recognition algorithm;
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decoding the decoded data from colors;
Transmitting the decoded data decoded by the computer to the management server;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
When the first code image is not recognized from the new image, the second code image is recognized from the new image acquired by the image acquisition device by the second image recognition algorithm. A step to try and
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Decoding the data.

Furthermore, a network connection method according to another aspect of the present invention includes:
In a network connection method for connecting a user's computer to a predetermined network address through a network,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The user's image acquisition device acquiring an image that may include a second code image comprising a two-dimensional code;
Trying to recognize a second code image from the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image;
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding, and
If the second code image is not recognized from the image, the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image. Trying to recognize a first code image from:
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. And a step of acquiring by the apparatus.

Furthermore, a network connection method according to another aspect of the present invention includes:
The computer attempting to recognize a second code image from the new image acquired by the image acquisition device by the second image recognition algorithm;
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Decoding the data;
When the second code image is not recognized from the new image, the first code image is recognized from the new image acquired by the image acquisition device by the first image recognition algorithm. A step to try and
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decoding the decoded data from colors;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The computer comprises a step of connecting through the network to the network address included in the received first object data.

Furthermore, in the network connection method according to one aspect of the present invention, the image acquisition device is a digital camera provided in the user's mobile phone,
The computer is built in the mobile phone.

  Furthermore, the network connection method according to an aspect of the present invention is further characterized in that the computer further includes a step of connecting through the network to a network address included in the decoded second object data.

  Furthermore, the network connection method according to an aspect of the present invention is characterized in that a telephone number is included in the decoded second object data.

  Furthermore, the network connection method according to an aspect of the present invention is characterized in that a mail address is included in the decoded second object data.

  Furthermore, the network connection method according to an aspect of the present invention is characterized in that the image is displayed on a television screen.

An electronic device according to one embodiment of the present invention includes:
An electronic device that can be connected to a predetermined network address through a network,
An image acquisition device capable of capturing an image and acquiring the image as image data;
A computer connectable to the network based on the acquired image data,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The image acquisition device acquires an image that may include a second code image composed of a two-dimensional code;
Attempting to recognize the first code image from the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image;
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
If the first code image is not recognized from the image, the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image. Try to recognize the second code image from
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding,
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. The apparatus is characterized by being acquired.

Furthermore, an electronic device according to one embodiment of the present invention includes:
The computer tries to recognize a first code image from the new image acquired by the image acquisition device by the first image recognition algorithm,
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decode the decoded data from the color,
The computer transmits the decoded decoded data to the management server,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
When the first code image is not recognized from the new image, the second code image is recognized from the new image acquired by the image acquisition device by the second image recognition algorithm. Try,
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. It is characterized by decoding data.

An electronic apparatus according to another aspect of the present invention is
An electronic device that can be connected to a predetermined network address through a network,
An image acquisition device capable of capturing an image and acquiring the image as image data;
A computer connectable to the network based on the acquired image, and
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The image acquisition device acquires an image that may include a second code image composed of a two-dimensional code;
The second image recognition algorithm stored in the computer and recognizing the second code image tries to recognize the second code image from the image acquired by the image acquisition device,
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding,
When the second code image is not recognized from the image, the first image recognition algorithm for recognizing the first code image stored in the computer acquires the image acquired by the image acquisition device. Attempt to recognize the first code image from the image,
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. The apparatus is characterized by being acquired.

Furthermore, an electronic device according to another aspect of the present invention includes:
The computer tries to recognize a second code image from the new image acquired by the image acquisition device by the second image recognition algorithm,
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Decoding the data,
When the second code image is not recognized from the new image, the first code image is recognized from the new image acquired by the image acquisition device by the first image recognition algorithm. Try,
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decode the decoded data from the color,
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The computer is connected to the network address included in the received first object data through the network.

  Furthermore, the electronic device according to one embodiment of the present invention is characterized in that the image acquisition device is a digital camera.

  Furthermore, the electronic device according to one embodiment of the present invention is characterized in that the electronic device is a mobile phone.

  Furthermore, the electronic device according to one aspect of the present invention is characterized in that the computer is further connected to a network address included in the decoded second object data through the network.

  Furthermore, the electronic device according to one embodiment of the present invention is characterized in that a telephone number is included in the decoded second object data.

  Further, the electronic device according to one aspect of the present invention is characterized in that a mail address is included in the decoded second object data.

  Furthermore, the electronic device according to one embodiment of the present invention is characterized in that the image is displayed on a television screen.

  According to the network connection method and the electronic apparatus according to one aspect of the present invention, the user's computer can be easily connected to a desired network address.

  A network connection method according to an embodiment of the present invention is for connecting a user's computer to a predetermined network address through a network (communication network).

  In the embodiment of the present invention, for example, a method of photographing a code image displayed on a paper surface, a television screen or the like with a mobile phone (electronic device) and easily connecting to mobile content related to the code image via a network, Propose electronic equipment.

  Hereinafter, embodiments according to the present invention will be described in more detail with reference to the drawings.

  Embodiment 1 of the present invention will be described below with reference to the drawings. 1 is a diagram illustrating a network connection system according to a first embodiment of the present invention. FIG. 2 is a block diagram showing a main part configuration of the electronic apparatus according to the first embodiment of the present invention.

  As shown in FIG. 1, a network connection system 100 according to the present invention includes a management server 1 and a service server 2 that provides a network service.

  In addition, the network connection system 100 captures an image 4 including the code image 3 and acquires an image data of the image 4, and a management server 1 through a network (communication network) 5. An electronic device 6 having a user computer connectable to the service server 2 is provided.

  The image 4 may include at least one of the first code image and the second code image as the code image 3.

  The first code image (color code) has data cells that are encoded with different colors corresponding to the decoded data associated with the first target data.

  The second code image is composed of a two-dimensional code in which the second target data is encoded.

  Here, as described above, the two-dimensional code is described in order to reduce the display area of the above-described barcode (one-dimensional code), improve the reading operation, and reduce the printing cost. A stack barcode method or a matrix method in which barcodes are stacked is adopted.

  This two-dimensional code is obtained by encoding second target data such as a URL, a telephone number, and an e-mail address according to a standard defined by JIS or the like.

  This two-dimensional code includes, for example, a QR code, PDF417, DataMatrix, MaxiCode, and the like.

  The image 4 is displayed on, for example, a paper surface, a television screen, a personal computer monitor, or the like.

  For example, the management server 1 can store network address information related to the service server 2 and can further store index information defined for the address information.

  Here, the network address indicates the position of the specific equipment in the network environment and is indicated by letters, numbers, special characters, URL, IP (Internet Protocol) address, telephone number or unique identification number of the wired / wireless communication terminal. It is.

  Further, the management server 1 has a table 1a in which the first target data described above including at least the network address related to the service server 2 is associated with the decoded data.

  Further, the first target data of the table 1a can include a name, a protocol, or a document name, service information, and the like as required by the user, in addition to the above-described network address.

  When receiving the decoded data from the electronic device 6, the management server 1 transmits the first target data associated with the decoded data to the electronic device 6 that is the transmission source of the decoded data.

  If necessary, the management server 1 replaces the first target data including the network address with the target data including the other network address and associates it with the decoded data using the table 1a, and changes the contents of the table 1a. To do.

  In other words, the management server 1 is not limited to the range in which the target data is defined as in the conventional two-dimensional code, but is associated with the decoded data according to the request of the user or the service provider, for example. The purpose data can be changed.

  The service server 2 provides, for example, service information to the electronic device 6 connected using the target data.

  As the service information, when an Internet service is used, there are services defined by a protocol displayed in a URL such as a web service, a telnet service, an e-mail service, a gopher service, and FTP (File Transfer Protocol). .

  In addition, the user can use a specific service provided in each service server 2, for example, a text or picture file provided by a specific IP address or URL, as well as being directly connected to an online education service or a shopping mall service. Alternatively, multimedia information composed of sound, stop images, and moving images can be provided.

  On the other hand, the service information includes services defined for other general communication devices, for example, for telephone and FAX services, in addition to those for network services through the Internet. For example, when a telephone number or a FAX number is included as address information, a service for making a call to the number or sending a FAX is provided to the user.

  Further, as described above, since the management server 1 can change the first object data related to the decoded data in response to a request from the user or the service provider, the service server 2 is changed. In addition, a network service corresponding to the first object data can be provided.

  The electronic device 6 is, for example, a mobile phone, a PDA (Personal Digital Assistant), a smart phone, an IMT (International Mobile Telecommunication) -2000 terminal, a personal computer, or the like.

  As shown in FIG. 2, the electronic device 6 includes an image acquisition device 7 that can capture an image 4 and acquire the image 4 as image data, and a computer that can be connected to the network 5 based on the acquired image data. 8.

  The image acquisition device 7 is, for example, a digital camera, a PC camera, a scanner, or the like provided in the mobile phone 6.

  When the electronic device 6 is a mobile phone, data of an image 4 including a code image 3 acquired from a paper surface, a TV screen, or the like is input through an image acquisition device 7 such as a digital camera provided in the mobile phone. It is stored in the memory, disk, buffer, etc. of the computer 8 built in the telephone.

  The computer 8 may be provided separately from the electronic device 6.

  The computer 8 also stores a program 9 having a first image recognition algorithm 8a for recognizing the first code image and a second image recognition algorithm 8b for recognizing the second code image. ing.

  The computer 8 recognizes the data cell by the first image recognition algorithm 8a and recognizes the color of the data cell. Thus, the computer 8 can recognize the first code image from the image 4 and can decode the decoded data from the recognized color by using the program 9.

  Further, the computer 8 can obtain the first target data from the management server 1 by transmitting the decoded data to the management server 1. Then, the computer 8 can be connected through the network 5 to the network address included in the first target data.

  The computer 8 recognizes the two-dimensional code by the second image recognition algorithm 8b. Thus, the computer 8 can recognize the second code image from the image 4 and can decode the second target data from the two-dimensional code by using the program 9.

  Further, the computer 8 can be connected through the network 5 to another network address included in the decoded second object data. Further, the computer 8 may make a telephone call and transmit a mail based on the telephone number and mail address included in the decoded second object data.

  As described above, in the process of recognizing the code image 3 in the computer 8, a process of searching for the shape, color (color) and the like of the code image 3 is necessary. In addition, a process for correcting a distorted image is required.

  For example, the shape and pattern can be detected by using the first and second image recognition algorithms 8a and 8b described above such as boundary detection and thinning algorithms.

  Furthermore, by the first image recognition algorithm 8a, RGB (Red, Green, Blue) model, HSV (Hueangle, Saturation, Value) model, CMY (Cyan, Magenta, Yellow) model, HLS (Hueangle, Lightness, Saturation) model. Among them, it is possible to distinguish colors using one or more methods.

  In this way, the first code image (color code) can be recognized by the first image recognition algorithm 8a, and the second code image (two-dimensional code) can be recognized by the first image recognition algorithm 8b.

  Here, an example of the first code image (color code) used in the network connection system 100 as described above will be described.

  FIG. 3A and FIG. 3B are diagrams showing the areas of the code image in distinction based on the role of information represented in the first code image (color code).

  As shown in FIG. 3A, the first code image includes a data area 10. The data area 10 is formed of at least one data cell encoded such that the color, shading, shape, pattern, or combination thereof is different depending on the content of information.

  The data area 10 is composed of one or more data cells in which characters or the like are encoded in an image, each data cell is composed to represent one character, and one or more data cell sets are included. You may make it comprise so that the above character may be represented. For example, the character “A” may be displayed in one cell made of red, or may be displayed in two cells made of red and green.

  The decoded data stored in the data area 10 includes characters, numbers, symbols, and the like. Further, the decoded data includes a name, an address, a telephone number, a fax number, a network host address, a domain name and an IP address used on the Internet, a URL, a protocol, or a document name as required by the user. You can also.

  The first code image may further include an arrangement recognition area 11. For example, the arrangement recognition area 11 is formed so that cells displaying a predetermined color surround the data area 10 in order to recognize the arrangement of the data area 10 in the television screen. In particular, white is selected as the color of the arrangement recognition area 11 in order to improve the distinguishability between the background displayed in color on the television screen and the first code image. It should be noted that another color having high discrimination from the background or the like may be selected. The arrangement recognition area 11 preferably has a width of 5 pixels or more in order to improve discrimination.

  In addition, although the case where the said code image is set so that the arrangement | positioning recognition area | region 11 may be included in a 1st code image is demonstrated here, the 1st code image which does not include the arrangement | positioning recognition area | region 11 is set, for example, Of course, when the first code image is displayed on the television screen, a white frame surrounding the code image may be displayed. As a result, the arrangement of the data area 10 in the television screen can be recognized in the same manner as the arrangement recognition area 11 is set, and the code image of the data area 10 can be decoded as well. .

  As shown in FIG. 3B, the first code image may further include at least one of a parity area 12, a reference area 13, and a control area 14. The arrangement recognition area 11 is formed so as to surround the data area 10, the parity area 12, the reference area 13, and the control area 14 as shown in the figure.

  The parity area 12 is formed of parity cells for checking a recognition error of the cells displayed in the data area 10.

  The reference region 13 provides at least a reference color, a reference shade, a reference shape, a reference pattern, or a combination thereof for determining a color, shading, shape, pattern, or combination thereof of the data cells formed in the data region 10. One reference cell is formed.

  The control area 14 is formed of at least one control cell that represents a command or service that can be provided using the information displayed in the data area 10.

  Hereinafter, an area excluding the data area 10, for example, an area including the arrangement recognition area 11, the parity area 12, the reference area 13, and the control area 14 is referred to as an “auxiliary area”, and a cell included in the auxiliary area is referred to as an auxiliary cell. .

  The parity area 12 is used for recognizing whether a color or shading (or shape and / or pattern) is expressed so as to be suitable for the data cell corresponding to the decoded data. In the parity area 12, parity data is obtained by a code value defined corresponding to the color or shading displayed in the data cell, and the parity cell is formed with the color or shading corresponding to the parity data.

  The reference area 13 sets a reference color (or reference shading, a reference shape or a reference pattern as required) for recognizing the color (or shading, shape or pattern) expressed in the cells of the data area 10 and the auxiliary area. Used for. The cell color displayed in each area is red green blue (RGB) color mode, Hue Saturation value (HSV) color mode, Cyan Magenta Yellow Black (CMYK) color mode, Hue saturation intensity (HSI) color mode, CIE color mode , YIQ or YUV color mode. In addition, even when a code is formed with black and white shading (gray scale), information on each cell can be accurately recognized based on black and white displayed in the reference area 13.

  Depending on the monitor (television screen) and printer model, even one color may be displayed in different colors, and the same color may be recognized slightly differently depending on the characteristics of the digital camera or scanner. In consideration of such a case, the reference cell of the reference area 13 provides a standard for recognizing the color represented in the data area.

  That is, even if the output device outputs different colors or the image acquisition device 7 such as a digital camera or a scanner inputs different colors, the color of the reference area 13 and the color of the data area 10 are different. Since the color difference is fixed, the color of the cell expressed in the data area 10 can be accurately recognized.

  Since the color represented in the cell of the data area 10 has a color difference relative to the standard color of the reference area 13, it is compared with the standard color of the reference area 13 based on the RGB mode or HSV mode. Ten cell colors are obtained.

  Thus, even if the image acquisition device 7 or the output device (for example, a television) changes, the information of the data cell can be accurately recognized. When the shape or pattern is input by the image acquisition device 7 such as a digital camera, it may be input in a tilted or distorted state.

  However, the reference shape or the reference pattern is provided by the reference region 13, so that the erroneous input state can be sensed and the shape or the pattern expressed in the data cell can be recognized accurately.

  Further, the control area 14 may include a command or metadata for controlling purpose information of the data area 10. For example, the information displayed in the control area 14 may include various meta information such as the decoding order of the cells formed in the data area 10, the position of the reference cell in the reference area 13, and the position and attribute of the parity area 12. it can.

  Here, an example of a code conversion table for converting the above-described decoded data and the first code image will be described. FIG. 4 is a diagram illustrating an example of representing 2-bit data in four colors.

  If each cell can have any one of four colors, 2-bit data can be expressed by one color cell. Furthermore, if one character is defined to be displayed in four consecutive cells, eight bits, that is, 256 types of characters can be expressed. On the other hand, if there are four types of shapes that represent the same color but represent a cell (eg small square, large square, small circle, large circle), 2-bit data can be represented. If the interior is filled with four other colors, 256 types (8 bits) of information can be represented.

  A code conversion table for converting various characters (such as alphabets and special characters), numbers, or forms into images may be set. In this code conversion table, for example, one character is mapped to one or two color cells.

  In the encoding method using this code conversion table, various characters are converted into code values, and then a first code image is generated with a color (color) assigned to each code value. For example, a code image is generated using eight kinds of colors, and two consecutive cells are used to represent one character or number. Eight code values from “000”, “001”, “010”,... “111” are assigned to the eight colors, and each character is encoded into two colors. For example, the number “3” is assigned to the code value “000011” and is encoded into the color (black) assigned to the code value “000” and the color (cyan) assigned to the code value “011”. An image is formed by two continuous cells. With this code conversion table, after converting various characters and numbers included in the decoded data into code values, the color corresponding to the code values can be expressed in the form of a square matrix composed of combinations of square cells. The code value may be used as it is as decoded data.

  Note that the first code image may be generated using a grayscale code. In a gray scale code, a code is formed with black and white luminance instead of the mixing ratio of R, G, and B forming a color. Accordingly, any one of black, white, and gray is set as the reference gray level in the reference area, and the cells in the data area have values that are coated by a gray scale difference with respect to the standard gray level in the reference area.

  If there is no reference area in the first code image, the shade of each cell of the first code image is calculated, and cells having a similar shade (cell set) are collected into cells belonging to the same cell set. On the other hand, the same code value is assigned, and a decoding error is recognized using the parity area.

  If a recognition error occurs, the density of each cell is recalculated, or the criterion for forming the cell set is set to a different one to recognize the error. Such a gray scale code image can be applied to a medium printed mainly in black and white such as a newspaper.

  Next, the flow of the network connection method of the network connection system 100 shown in FIG. 1 will be described.

  FIG. 5A is a flowchart showing a flow of a network connection method for connecting a computer of a mobile phone (electronic device) to a predetermined network address through a network.

  As shown in FIG. 5A, first, a first code image having data cells that are displayed in different colors corresponding to the decoded data associated with the first target data including the network address, or A user's image acquisition device 7 (for example, a digital camera provided in a mobile phone) acquires an image 4 that may include a second code image made up of a two-dimensional code encoded with second target data (step) S1).

  Next, an attempt is made to recognize the first code image (color code) from the image 4 acquired by the image acquisition device 7 by the first image recognition algorithm 8a that is stored in the computer 8 and recognizes the first code image. (Step S2).

  In the next step S3, when the first image recognition algorithm 8a recognizes the data cell and recognizes the color of the data cell, and the first code image is recognized from the image 4, the computer 8 Decode data is decoded from the recognized color (step S4).

  Next, the computer 8 transmits the decoded decoded data to the management server 1 that stores the first target data associated with the decoded data (step S5).

  Next, the computer 8 receives the first object data associated with the decoded data from the management server 1 (step S6).

  Next, the computer 8 connects to the network address included in the received first target data through the network 5 (step S7).

  In step S3, if the first code image is not recognized from the image 4, the image acquisition device 7 acquires the second code recognition algorithm 8b that is stored in the computer 8 and recognizes the second code image. Attempt to recognize the second code image from the image 4 (step S8).

  In the next step S9, when the second image recognition algorithm 8b recognizes the two-dimensional code and the second code image is recognized from the image 4, the computer 8 converts the second object from the two-dimensional code to the second object. Data (for example, URL data) is decoded (step S10).

  Next, the computer 8 connects to another network address (URL) included in the decoded second target data through the network 5 (step S11).

  When the first code image and the second code image are not recognized from the image 4 in step S9, the process returns to step S1 and a new code image that can include the first code image or the second code image is returned. The image acquisition device 7 acquires the image 4.

  After acquiring a new image 4, the above-described steps S2 to S11 are similarly performed.

  That is, in step S2, the computer 8 tries to recognize the first code image from the new image acquired by the image acquisition device 7 by the first image recognition algorithm.

  When the first image recognition algorithm 8a recognizes the data cell and recognizes the color of the data cell in step S3, and the first code image is recognized from the new image 4, the same applies in step S4. Further, the computer 8 decodes the decoded data from the recognized color.

  In step S5, the computer 8 transmits the decoded decoded data to the management server 1.

  In step S <b> 6, the computer 8 receives first target data associated with the decoded data from the management server 1.

  In step S7, the computer 8 connects to the network address included in the received first object data through the network 5.

  If the first code image is not recognized from the new image 4 in step S3, the new image 4 acquired by the image acquisition device 7 by the second image recognition algorithm 8b in step S8. To try to recognize the second code image.

  In step S9, when the second image recognition algorithm 8b recognizes the two-dimensional code and the second code image is recognized from the new image 4, the computer 8 detects that the two-dimensional code is two-dimensional in step S10. The second target data is decoded from the code.

  In step S11, the computer 8 connects to another network address (URL) included in the decoded second target data through the network 5.

  When the first code image and the second code image are not recognized from the new image 4 in step S9, the process returns to step S1, and the first code image or the second code image is obtained. The image acquisition device 7 acquires a further new image 4 that may be included.

  In this way, the above flow is repeated until the code image 3 is recognized.

  Through the above flow, the user's computer 8 is connected to the service server 2 via the network 5, and a desired network service is provided from the service server 2 to the electronic device 6. In addition, the computer 8 can be connected to another server, and a telephone call can be made based on the telephone number and mail address included in the second object data, and mail can be transmitted.

  When the image 4 is continuously acquired as a moving image by the image acquisition device 7, the flow up to steps S1, S2, S3, S8, and S9 is repeatedly performed, for example, in a time of about 100 ms (one frame). Is done.

  Further, as described above, the management server 1 changes the first object data related to the decoded data in response to a request from the user or the service provider, so that the service server 2 can change the changed first data. A network service corresponding to one target data can be provided.

  Steps S2 to S7 for acquiring the first target data from the first code image and connecting to the server, and steps S8 to S7 for acquiring the second target data from the second code image and connecting to the server. You may replace up to S11.

  Hereinafter, the flow in the case of replacement will be described.

  FIG. 5B is a flowchart showing another flow of a network connection method for connecting a computer of a mobile phone (electronic device) to a predetermined network address through a network.

  As shown in FIG. 5B, first, a first code image having data cells that are displayed in different colors corresponding to the decoded data associated with the first target data including the network address, or A user's image acquisition device 7 (for example, a digital camera provided in a mobile phone) acquires an image 4 that may include a second code image made up of a two-dimensional code encoded with second target data (step) S1).

  Next, the second code recognition algorithm 8b that recognizes the second code image stored in the computer 8 tries to recognize the second code image from the image 4 acquired by the image acquisition device 7 (step S28). .

  When the second code image is recognized from the image 4 by the second image recognition algorithm 8b recognizing the two-dimensional code in the next step S29, the computer 8 converts the second object from the two-dimensional code to the second purpose. Data (for example, URL data) is decoded (step S10).

  Next, the computer 8 connects to another network address (URL) included in the decoded second object data through the network 5 (step S11).

  If the second code image is not recognized from the image 4 in step S29, it is acquired by the image acquisition device 7 by the first image recognition algorithm 8a that is stored in the computer 8 and recognizes the first code image. Attempt to recognize the first code image (color code) from the image 4 (step S22).

  In the next step S23, when the first image recognition algorithm 8a recognizes the data cell and recognizes the color of the data cell, and the first code image is recognized from the image 4, the computer 8 Decode data is decoded from the recognized color (step S4).

  Next, the computer 8 transmits the decoded decoded data to the management server 1 that stores the first target data associated with the decoded data (step S5).

  Next, the computer 8 receives the first object data associated with the decoded data from the management server 1 (step S6).

  Next, the computer 8 connects to the network address included in the received first target data through the network 5 (step S7).

  If the first code image and the second code image are not recognized from the image 4 in step S23, the process returns to step S1, and a new code image that can include the first code image or the second code image is returned. The image acquisition device 7 acquires the image 4.

  After acquiring the new image 4, the above-described steps S28 to S7 are similarly performed.

  That is, in step S28, the second image recognition algorithm 8b tries to recognize the second code image from the new image 4 acquired by the image acquisition device 7.

  In step S29, when the second image recognition algorithm 8b recognizes the two-dimensional code and the second code image is recognized from the new image 4, the computer 8 detects that the two-dimensional code is two-dimensional in step S10. The second target data is decoded from the code.

  In step S11, the computer 8 connects to another network address (URL) included in the decoded second target data through the network 5.

  If the first code image is not recognized from the new image 4 in step S29, the computer 8 uses the first image recognition algorithm to acquire the new code image acquired by the image acquisition device 7 in step S22. Attempts to recognize the first code image from the correct image.

  In step S23, if the first image recognition algorithm 8a recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image 4, the process proceeds to step S4. Similarly, the computer 8 decodes the decoded data from the recognized color.

  In step S5, the computer 8 transmits the decoded decoded data to the management server 1.

  In step S <b> 6, the computer 8 receives first target data associated with the decoded data from the management server 1.

  In step S7, the computer 8 connects to the network address included in the received first object data through the network 5.

  When the first code image and the second code image are not recognized from the new image 4 in step S23, the process returns to step S1, and the first code image or the second code image is obtained. The image acquisition device 7 acquires a further new image 4 that may be included.

  In this way, the above flow is repeated until the code image 3 is recognized.

  Through the above flow, the user's computer 8 is connected to the service server 2 via the network 5, and a desired network service is provided from the service server 2 to the electronic device 6. In addition, the computer 8 can be connected to another server, and a telephone call can be made based on the telephone number and mail address included in the second object data, and mail can be transmitted.

  As described above, according to the network connection method and the electronic apparatus according to the present embodiment, the user's computer can be easily connected to a desired network address.

  In the embodiment, the management server and the service server are described as different configurations, but may be configured as one.

It is a figure which shows the network connection system which concerns on Example 1 which is 1 aspect of this invention. It is a block diagram which shows the principal part structure of the electronic device which concerns on Example 1 of this invention. It is a figure which distinguishes and shows the area | region of a code image on the basis of the role of the information represented by the 1st code image (color code). It is a figure which distinguishes and shows the area | region of a code image on the basis of the role of the information represented by the 1st code image (color code). It is a figure which shows the example which represents 2-bit data with four colors. It is a flowchart which shows the flow of the network connection method for connecting the computer of a mobile telephone (electronic device) to a predetermined | prescribed network address through the network which concerns on Example 1 which is 1 aspect of this invention. It is a flowchart which shows the other flow of the network connection method for connecting the computer of a mobile telephone (electronic device) to a predetermined | prescribed network address through the network which concerns on Example 1 which is 1 aspect of this invention.

Explanation of symbols

1 Management Server 1a Table 2 Service Server 3 Code Image 4 Image 5 Communication Network
6 Electronic equipment (mobile phone)
7 image acquisition device 8 computer 8a first image recognition algorithm 8b second image recognition algorithm 9 program 10 data area 11 arrangement recognition area 12 parity area 13 reference area 14 control area 100 network connection system

Claims (19)

In a network connection method for connecting a user's computer to a predetermined network address through a network,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The user's image acquisition device acquiring an image that may include a second code image comprising a two-dimensional code;
Trying to recognize the first code image from the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image;
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
If the first code image is not recognized from the image, the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image. Trying to recognize a second code image from
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding, and
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. A network connection method comprising: a step of acquiring by the apparatus. The computer attempting to recognize a first code image from the new image acquired by the image acquisition device by the first image recognition algorithm;
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decoding the decoded data from colors;
Transmitting the decoded data decoded by the computer to the management server;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
When the first code image is not recognized from the new image, the second code image is recognized from the new image acquired by the image acquisition device by the second image recognition algorithm. A step to try and
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. The network connection method according to claim 1, further comprising: decoding data. In a network connection method for connecting a user's computer to a predetermined network address through a network,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The user's image acquisition device acquiring an image that may include a second code image comprising a two-dimensional code;
Trying to recognize a second code image from the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image;
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding, and
If the second code image is not recognized from the image, the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image. Trying to recognize a first code image from:
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The computer connecting to the network address included in the received first object data through the network;
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. A network connection method comprising: a step of acquiring by the apparatus. The computer attempting to recognize a second code image from the new image acquired by the image acquisition device by the second image recognition algorithm;
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Decoding the data;
When the second code image is not recognized from the new image, the first code image is recognized from the new image acquired by the image acquisition device by the first image recognition algorithm. A step to try and
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decoding the decoded data from colors;
Transmitting the decoded data decoded by the computer to a management server storing the first target data associated with the decoded data;
The computer receiving the first target data associated with the decoded data from the management server;
The network connection method according to claim 3, further comprising: connecting the network address included in the received first object data to the network address through the network. The image acquisition device is a digital camera provided on the user's mobile phone,
The network connection method according to claim 1, wherein the computer is built in the mobile phone. 5. The network connection method according to claim 1, further comprising a step of connecting the computer to a network address included in the decoded second object data through the network. The network connection method according to claim 5, wherein a telephone number is included in the decoded second object data. The network connection method according to claim 1, wherein a mail address is included in the decoded second object data.   The network connection method according to claim 1, wherein the image is displayed on a television screen. An electronic device that can be connected to a predetermined network address through a network,
An image acquisition device capable of capturing an image and acquiring the image as image data;
A computer connectable to the network based on the acquired image data,
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The image acquisition device acquires an image that may include a second code image composed of a two-dimensional code;
Attempting to recognize the first code image from the image acquired by the image acquisition device by a first image recognition algorithm stored in the computer and recognizing the first code image;
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
If the first code image is not recognized from the image, the image acquired by the image acquisition device by a second image recognition algorithm stored in the computer and recognizing the second code image. Try to recognize the second code image from
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding,
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. An electronic device characterized by being acquired by a device. The computer tries to recognize a first code image from the new image acquired by the image acquisition device by the first image recognition algorithm,
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decode the decoded data from the color,
The computer transmits the decoded decoded data to the management server,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
When the first code image is not recognized from the new image, the second code image is recognized from the new image acquired by the image acquisition device by the second image recognition algorithm. Try,
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Data is decoded. The electronic device of Claim 10 characterized by the above-mentioned. An electronic device that can be connected to a predetermined network address through a network,
An image acquisition device capable of capturing an image and acquiring the image as image data;
A computer connectable to the network based on the acquired image, and
A first code image having data cells that are encoded in different colors corresponding to the decoded data associated with the first target data including the network address, or the second target data is encoded. The image acquisition device acquires an image that may include a second code image composed of a two-dimensional code;
The second image recognition algorithm stored in the computer and recognizing the second code image tries to recognize the second code image from the image acquired by the image acquisition device,
In a case where the second code image is recognized from the image by the second image recognition algorithm recognizing the two-dimensional code, the computer extracts the second target data from the two-dimensional code. Decoding,
When the second code image is not recognized from the image, the first image recognition algorithm for recognizing the first code image stored in the computer acquires the image acquired by the image acquisition device. Attempt to recognize the first code image from the image,
If the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the image, the computer determines from the recognized color. Decoding the decoded data;
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The computer connects to the network address included in the received first object data through the network,
When the first code image and the second code image are not recognized from the image, the first code image or a new image that may include the second code image is obtained as the image. An electronic device characterized by being acquired by a device. The computer tries to recognize a second code image from the new image acquired by the image acquisition device by the second image recognition algorithm,
When the second image recognition algorithm recognizes the two-dimensional code and the second code image is recognized from the new image, the computer uses the two-dimensional code to recognize the second object. Decoding the data,
When the second code image is not recognized from the new image, the first code image is recognized from the new image acquired by the image acquisition device by the first image recognition algorithm. Try,
When the first image recognition algorithm recognizes the data cell and recognizes the color of the data cell to recognize the first code image from the new image, the computer recognizes the data cell. Decode the decoded data from the color,
The computer transmits the decoded decoded data to a management server that stores the first target data associated with the decoded data,
The computer receives the first target data associated with the decoded data from the management server;
The electronic device according to claim 12, wherein the computer connects to the network address included in the received first object data through the network.   The electronic apparatus according to claim 10, wherein the image acquisition device is a digital camera.   The electronic device according to claim 14, wherein the electronic device is a mobile phone. The electronic device according to any one of claims 10 to 13, wherein the computer is further connected through the network to a network address included in the decoded second object data. The electronic device according to claim 15, wherein a telephone number is included in the decoded second object data. The electronic device according to claim 10, wherein a mail address is included in the decoded second object data.   The electronic device according to claim 10, wherein the image is displayed on a television screen.

Images