JP2007228512A - Visible light communication system and information processing apparatus - Google Patents

Abstract

A visible light communication system and an information processing apparatus capable of reliably specifying a target place in a short time are provided.
After the position is measured by GPS or the like, the current position and conditions are transmitted to the server. The current position and conditions are transmitted from the server to stores in the range visible from the current position. When the store matches the condition, the user is notified to the user that the store matches the condition with visible light or infrared rays at a signboard, entrance, or the like. When the user looks at the town on the camera screen, a store that matches the conditions sends a signal, so the store can be pinpointed.
[Selection] Figure 1

Description

  The present invention relates to a visible light communication system and an information processing apparatus that transmit and receive data using visible light.

  Opportunities to use a navigation system are increasing when searching for a desired store, for example, a restaurant or a tavern in the city. In addition, a service has already been started in which the position of a mobile phone terminal is specified using a GPS satellite and guidance to a store or the like is guided using a map on the screen. In this case, since the GPS positioning calculation cannot be performed only with the processing device of the mobile phone terminal, a method of specifying the position while linking with the base station is used. In addition, since map information for the whole country cannot be stored in the storage unit of the mobile phone terminal, a separate server is prepared for map information, and only the images required by the mobile phone terminal are received for navigation. ing.

In Patent Document 1, a part of an image of a place taken by a terminal is extracted, transmitted to a server, and pattern matching is performed so that an arbitrary object is transmitted to the part and superimposed on the terminal, Navigation is performed by displaying. In Patent Document 1, when a landscape including a certain object is captured as an image, only the object is extracted from the image, and the image is transmitted to the server. The server matches the image with the template image stored in the server, and searches for the region where the shooting location is. The server transmits an object (for example, an arrow) to be displayed on the terminal from the search result toward the terminal. The terminal stores an object template in the storage unit, and derives the template from the information transmitted from the server and displays it on the screen.
JP 2005-182350 A

  In the conventional navigation system described above, the user can recognize his / her location by looking at the map, the step of recognizing where he / she is by looking at the scenery around him, and the above two steps. I had to match the two in my head and judge what kind of situation I was in, and there was a problem that it was easy to make a mistake in the position.

  In addition, time for interacting with the base station for navigation and time for receiving map information from the server are required. Since the time is 20 to 30 seconds, it is very troublesome for the user.

  Furthermore, since the image information is expected to be several kilobytes to several tens of kilobytes although it is small, there is a demerit that the user cannot use it frequently because the packet communication fee is charged separately.

  The present invention has been made in view of such problems, and an object of the present invention is to provide a visible light communication system and an information processing apparatus capable of reliably specifying a target location in a short time. is there.

  To achieve the above object, the present invention provides a visible light communication system including a light emitting device, an information processing device, and a server, wherein the light emitting device includes a light source that emits light in a pattern corresponding to data to be transmitted. The information processing apparatus includes: position information acquisition means for acquiring position information; condition input means for inputting search conditions; transmission means for transmitting the position information and search conditions; Display means for displaying in real time an image of the subject photographed by the photographing means, and detecting a light source that emits light with a predetermined blinking pattern from the image of the subject photographed by the photographing means, and from the detected light emission pattern of the light source Decoding means for decoding data, and control means for controlling display on the display means in association with the light source the data decoded by the decoding means, Receiving means for receiving the position information and search conditions transmitted from the transmitting means, and instruction means for instructing light emission in which data is superimposed on the light emitting device meeting the position information and search conditions received by the receiving means; It is characterized by providing.

  The information processing apparatus according to the present invention includes a photographing unit that photographs a subject, a display unit that displays an image of the subject photographed by the photographing unit in real time, and a predetermined image from among the subject images photographed by the photographing unit. A decoding unit that detects a light source that emits light in a blinking pattern, decodes data from the detected light emission pattern of the light source, and a control unit that controls display of the data decoded by the decoding unit on the display unit in association with the light source; And further comprising: position information acquisition means for acquiring position information; condition input means for inputting search conditions; and transmission means for transmitting the position information and search conditions. It is determined whether or not the data decoded by the decoding means is the data that matches the position information and the search condition transmitted from the transmission means. It is preferred to highlight the light source corresponding to over data on the display means.

  According to the present invention, since a target location is searched through video captured by a camera, it is easier to understand than the specification on the map, and the target location can be specified reliably and in a short time. In addition, since there is no need to download map data, communication charges can be minimized.

  Embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram for explaining the outline of the present invention, and FIG. 2 is a diagram showing the outline of the present invention in a processing flow.

  The information processing apparatus 11 includes a position information acquisition unit that acquires position information, a condition input unit that inputs search conditions, a transmission unit that transmits position information and search conditions, an imaging unit that captures a subject, and a captured subject Display means for displaying the image in real time, decoding means for detecting a light source that emits light in a predetermined blinking pattern from the photographed subject image, and decoding data from the detected light emission pattern, and decoded data Is associated with the light source, and the display means controls the display.

  Further, the store search server 13 instructs the light emitting device that superimposes the data to the receiving unit that receives the position information and the search condition transmitted from the transmitting unit and the light emitting device that matches the received position information and the search condition. Instruction means are provided.

  First, a search condition required when the user selects a store from the information processing apparatus 11 is input, and the condition is transmitted by e-mail to the store search server 13 via the base station 12, or operated by the store search server system. Visit the site and submit it with an input form. At that time, the information processing apparatus 11 acquires position information of the location where the user is currently located by GPS or the like, and transmits the information together with a search condition from an email or an input form. Further, a telephone number, name, etc. (user information) are also transmitted as IDs for identifying users (step 101).

  The information transmitted from the information processing device 11 reaches the store search server 13 via the base station 12. The store search server 13 picks up a store from the location information sent from the user by picking up a store within a radius of 50 to 100 m from the user's location, that is, a range where the user can shoot from the camera provided in the information processing apparatus 11. Search for stores that match the search criteria sent by the user. Next, in the picked-up stores, instruction information, user information, etc. are sent to stores that match the search conditions and stores that do not match (step 102).

  In a store that matches the search condition, information such as a store name and a reservation URL is transmitted to the information processing apparatus 11 of the user by visible light communication or infrared communication using a store signboard or the like composed of LEDs or the like. In addition, in stores that do not match the search conditions, arrow information that indicates in which direction the matching store is viewed from the information processing apparatus 11 of the user is displayed with an LED or the like by visible light communication or infrared communication. It transmits to the user's information processing apparatus 11 from the comprised signboard etc. (step 103).

  A user who has obtained information from a signboard of a store through visible light communication or infrared communication can find out where the desired store is by looking at the display screen 14 of the information processing apparatus 11 in an easy-to-understand manner. Can do. Further, by selecting the store, the store information can be confirmed and the store can be reserved (step 104).

  Here, visible light communication will be described. Visible light communication is communication that transmits information by blinking LEDs used for advertising lights and lighting at high speed. FIG. 3 is a diagram showing blinking data of the light source. If the CMOS camera of the information processing apparatus 11 captures an image image at 30 frames per second, while the light source is modulated by binary PPM (pulse position modulation), the timing of the frame rate of the camera and the PPM of the light source When the half-value frequencies coincide with each other, the difference between the image images captured by the camera can be identified, and the coordinates on the image image that periodically blink can be specified as the light source. At this time, for example, when “00000000” blinking is set as a flag, and data is sandwiched between the flags, data can be extracted from each of the light source A and the light source B by observing the blinking fluctuation of this portion. , Can be associated with each light source.

  FIG. 4 shows a method for determining a visible light communication source when an image is captured from the camera of the information processing apparatus 11 while the information processing apparatus 11 is fixed. If the camera of the information processing apparatus 11 captures an image image at 30 frames per second and compares each image image every 1/30, if the arrow portion has a blinking pattern that matches the leading flag, The area is determined to be a visible light communication source, and this area is tracked thereafter.

  FIG. 5 shows a method for determining a visible light communication source when an image is captured from the camera of the information processing apparatus 11 while moving the information processing apparatus 11. The N-th image image and the (N + 1) -th image image are compared, and as shown in FIGS. 5A and 5B, the movement of the image image is detected with the highest correlation point as the matching point. Thereafter, when performing the comparison, the direction of movement may be predicted from the previous result to narrow the comparison range to some extent. When the visible light communication source is detected, the coordinates of the light source are derived from the coordinates on the image, and thereafter the coordinates are tracked.

  FIG. 6 is a configuration diagram illustrating an example of an information processing apparatus according to the present invention. Here, a mobile phone terminal will be described as an example of the information processing apparatus. The mobile phone terminal 20 is almost the same as a general mobile phone terminal. When performing visible light communication, an imaging unit (camera) 25 is used as the light receiving unit. When performing infrared communication, it is necessary to prepare a light receiving unit for infrared light separately. In addition, a display unit 28 that displays an image captured by the imaging unit 25 and data received through visible light communication, an operation unit 27 that inputs search conditions, and a baseband unit 24 that transmits search conditions. And the RF unit 22 and the antenna 21, the GPS receiving unit 23 for obtaining the position information, the storage unit 29 for storing the position information of the information light emitting source, and the process for decoding the data received (received) by the imaging unit 25, And a terminal processing unit 26 that controls processing of each component.

  FIG. 7 is a block diagram showing an example of the store search server of the present invention. The store search server 30 may be a server that covers the whole country, or may be a server that is divided for each region. The store search server 30 retrieves store information from the search conditions sent from the user's mobile phone terminal, and also picks up stores near the location where the user is located from the location information sent from the user's mobile phone terminal. It comprises a search unit 33, a storage unit 31 that stores information such as names of stores in the whole country or region, and location information, and a server processing unit 32. In the server processing unit 32, a store that matches the user's mobile phone terminal and the search condition, and other stores in order to indicate the direction of the store that matches the search condition when viewed from the user's mobile phone terminal. From which position information (this store may or may not match the search condition), it is calculated in which direction the matching store is seen from the user's mobile phone terminal. From the information, it is determined which direction is to be instructed to the user's mobile phone terminal. The information is transmitted to the store along with user information and search results.

  FIG. 8 is a configuration diagram illustrating an example of a store-side terminal according to the present invention. The store side terminal 40 stores, in the storage unit 41, user information of the user who performed the search, user search information, store information transmitted to the user, location information of the store, and the like. The information transmission unit 43 is a signboard composed of a plurality of LEDs necessary for performing visible light communication or infrared communication for transmitting store information and arrow information indicating the direction in which the matched store is present to the user. Depending on the store, the reservation information can be received from the user, so the store processing unit 42, the operation unit 44, and the display unit 45 confirm the reservation status or perform an operation for transmitting detailed information to the user again.

  Next, a first embodiment of the present invention will be described. FIG. 9 is a flowchart for explaining the operation of the mobile phone terminal according to the first embodiment.

  The user uses the operation unit 27 and the display unit 28 of the mobile phone terminal 20 to input conditions for searching for a store desired by the user (step 201). In this case, information that changes in real time, such as information on the number of people, classification (Izakaya, French, etc.), food, budget, etc., and the closeness of the search conditions, and the small number of people currently in the store can be added to the search conditions. . Further, in this case, it is conceivable that the input format is to use e-mail, which is an essential function for the mobile phone terminal 20, or to use an input form prepared on the site by the store search server or the like.

  If the search condition information is input, the information is transmitted to the store search server (step 202). The transmitting means transmits the information input using the previously-described mail or input form using the wireless communication means.

  The store search server that has received the search information performs a store search from the received information. Although only a brief description is given here, the operation of the store search server will be described in detail with reference to FIG. The store search server performs a store search, and the mobile phone terminal 20 receives the search result (step 203). For this reception, e-mail or the like is used.

  When a store that matches the search condition desired by the user is found on the store search server (step 204), the camera (imaging unit 25) is activated to receive the information by visible light communication (step 206). ). Here, when activating the camera, it is conceivable that the user confirms the mail received from the store search server and activates the camera himself. It is also conceivable that the mobile phone terminal 20 automatically activates the camera when a search result arrives from the store search server.

  If no store that matches the search condition desired by the user is found on the store search server, “not applicable” is displayed on the display unit 28 of the mobile phone terminal 20 (step 205), and the operation is terminated.

  After starting the camera (step 206), if there is a light source for visible light communication on the screen (step 207), whether the visible light communication is transmitted from a store that matches the search condition or a store that does not match (Step 209).

  If there is no light source on the screen, the user searches for the light source until a light source is found. Here, if a map or the like indicating where the light source is located in the information transmitted for starting the camera is received, it is easy to search for the light source. Also, if the mobile phone terminal 20 has a geomagnetic sensor, the direction in which the camera is facing is known, so it is easy to determine in which direction the light source is located without receiving image data such as a map. It is possible to easily find a light emission source by outputting a display such as an arrow on the screen.

  If it is determined in step 209 that the light source in the screen matches the search condition, the light source position is highlighted (step 210). The screen display method in this case will be described in detail with reference to FIG. Further, in this case, when there are a plurality of matching stores, it is necessary to inform the user of the direction of the other stores, so that an emphasis display and an arrow are displayed on the display screen.

  In step 209, if the light emission source in the screen is a light emission source that does not match the search condition, the direction in which the light emission source that matches the search condition is from the mobile phone terminal 20 is previously stored in the store search server. Since the calculated arrow information is sent, an arrow is displayed on the display screen (step 211).

  When a light source that matches the search condition exists on the same screen as the light source that does not meet the search condition (step 212), and a light source that matches the search condition exists on the same screen As described above, the light emission source that matches the search condition is highlighted (step 210).

  In step 212, when there is no light source that matches the search condition on the same screen as the light source that does not match the search condition, the user searches for the light source according to the arrow display (step 213).

  If there is a selected store desired by the user (step 214), highlighting is selected to display details of the store information, access the store's home page, or make a store reservation (step 215).

  In step 214, if there is no selected store desired by the user, it is determined whether or not to search again (step 216), and if it is not searched again, the process is sent to the store search server to end (step 217). End the operation. In the case of re-searching, the operation is performed again from the search information input in step 201.

  FIG. 10 is a flowchart for explaining the operation of the store search server of the first embodiment. The store search server 30 receives user information and search conditions from an e-mail from the user or an input form prepared on the site (step 301), and has a radius of about 50 to 100 m from the position information sent from the user. A store is picked up (step 302), and a search is performed in the stores picked up from the search conditions from the user (step 303).

  It is determined whether or not there is a store that matches the condition desired by the user (step 304), and a matching store in the vicinity of the user and a store that does not match are notified to perform each processing (step 305). For stores that match the conditions, direction calculation is performed based on location information or the like if there is another matching store (step 312), and the direction information of another matching store is transmitted together with the user information to the matching store (step 312). 313). For stores that do not match, the direction of the matching store is calculated from the position information (step 310), and the direction information of the matching store is transmitted together with the user information to the store that does not match (step 311). In step 304, if there is no store that matches the condition desired by the user, the user is notified that there is no corresponding store (step 306).

  Re-search request by changing the conditions again from the user or reservation request to the store when there is a desired store is received (step 307), and the search is completed or the reservation is terminated because there is no desired store Or if it is notified from the store that the reservation has been received from the user directly (step 308), and if a re-search is performed, the ID and the search condition from the user are received again, and this process is started again from step 301. I do. If the user is notified that there is no desired store and no reservation is made, or if there is a notification from the store that the user has made a reservation directly, a notification is sent to each store to stop sending information (steps) 309).

  FIG. 11 is a flowchart for explaining the operation of the store side terminal according to the first embodiment. The store side terminal 40 receives the user ID sent from the store search server, the search result, the instruction information to the user, etc. (step 401), and judges from the information whether the store is a match store (step 402). ). If it is a matched store, store information and instruction information to other matched stores are transmitted from the information transmitting unit 43 of the store side terminal 40 (step 403).

  If it is not a store that matches the search condition, information that displays a direction for guiding the matched store is transmitted from the information transmitting unit 43 (step 404). The direction instruction information is continuously transmitted until a notification of the end of transmission is received from the store search server (step 409). If there is a call end notification, the call is ended (step 408).

  If a reservation request is received from the user after transmitting information from the information transmitting unit 43 at a store that matches the search conditions (step 405), the store search server is notified that the reservation has been made (step 406). ), The information transmission ends (step 408).

  In step 405, if the reservation request from the user is not received, it is determined whether or not there is a call end notification from the store search server (step 407). Continue sending. In step 407, if there is a call end notification from the store search server, the call is ended (step 408).

  Next, a screen display example of the mobile phone terminal will be described with reference to FIG. A screen display 501 is a basic screen of the present invention. Visible light communication transmitted from the light emission sources 502 and 503 is received by the imaging unit of the mobile phone terminal. The store information is not known as it is, but by searching, the light emission sources 502 and 503 transmit information, receive it at the imaging unit, extract information from the received light, and match the information to the light source. By displaying, it can be seen as it is that the desired store exists in the place. When viewing on a map, it is necessary to link the map and the building, but in the present invention, the image that appears on the display unit of the mobile phone terminal can be seen as it is, so the user can open the store. Easy to grasp.

  In the screen display 504, store names 505 and 506 are displayed in information transmitted from the light emission sources 502 and 503. By doing so, the user can know the name of the store he / she is aiming for, so it becomes easier to accept information such as signboards that he sees while walking.

  In the screen display 507, the light emission source 502 in the screen display 501 is selected by operating the mobile phone terminal (the cursor 508 is set to the light emission source in the figure), so that the store name 509 and detailed information (menu, congestion in the store, etc.) Is displayed.

  In the screen display 510, if the store name is displayed in the vicinity of the light emission source, it interferes with the case where there is another light emission source. Therefore, only the number displays 511 and 512 are provided and do not interfere with the other light emission sources. A display 513 in which the number and the store name are associated with each other is displayed.

  In addition, it is necessary to display the screen display 501, 504, 507, 510 so that the detailed display does not interfere with the light source. Further, in the above four screen displays, it is desirable that by selecting the light emission source and the detailed display, it is linked with the store's homepage and store reservation system, and reservations and orders can be made from there.

  Further, based on the positional relationship between the store and the user, when there is a store that matches the search condition behind the building, there is a possibility that the user cannot see the store. In a store hidden in the shadow of a building, store information is sent to the store in the building closest to the user via the store search server, and information is transmitted from the store's light source using visible light communication. Can be sent. The mobile phone terminal transmits information after clearly indicating that there is a store in the building behind the building. As a display method, for example, attaching a pull-down menu to the emphasis display 506 of the screen display 504 can be raised.

  Depending on the search conditions, matching stores may be close together. In that case, it is also desirable to switch a plurality of light-emitting sources to one large circle display, etc., and select that to make a pull-down menu display or switch with a cursor.

  Although not shown, it is desirable to generate how many stores match the search condition. If the total number of cases and how many are on the screen are known, it can be useful as an index when a user searches for a store along the arrow.

  Screen display 514 indicates a case where there is no store on the screen of the mobile phone terminal that matches the search condition. In that case, it may or may not display where the light source is located. However, the arrow display 515 needs to be notified of which direction the store matches. The arrow display 515 is necessary for searching for other stores even if there is a store that matches the search condition on the screen. Therefore, the arrow information is also transmitted to the store that matches the search condition together with the store information. It is desirable to keep it.

  In the screen display 516, when there is no corresponding store as a result of searching from the store search server, information “not applicable” is received from the store search server by e-mail or the like, and the received mobile phone terminal is “not applicable” "Is displayed. Here, the user can select whether to search again or end the store search.

  When the present invention is actually used in a town, not a single user but a plurality of people search simultaneously to receive information from the light source of the store. In that case, there is a possibility of receiving information unnecessary for the user. In this case, since the telephone number is notified as the user information, the user can receive only necessary information by masking the information with the telephone number as the user ID.

  FIG. 13 is a diagram showing a screen display example of the mobile phone terminal when a store that matches the search condition does not have an information light emitting source. On the screen display 601, the arrow displays 602 and 603 indicate in which direction there is a matching store as viewed from a store that does not match the search condition.

  Next, a second embodiment of the present invention will be described. In the case of the first embodiment, in the downtown area where many stores exist in the building facing the main street as shown in FIG. 14, the user 604 walking on the road can see most stores, and there is no problem with the matching store 605 as well. It can receive light. However, assuming a shopping street as shown in FIG. 15, since the low buildings are densely packed, the information transmitted from the information light source of the matching store 607 from the user 606 walking on the road is transmitted to the buildings around it. May not be able to receive light.

  Therefore, in the second embodiment, a store having an information emission source other than the matching store is matched by transmitting the matching store information to the store having the information emission source other than the matching store via the store search server. Information including store information is transmitted to the user's mobile phone terminal.

  FIG. 16 is a flowchart for explaining the operation of the mobile phone terminal according to the second embodiment. In the second embodiment, step 218, step 219, and step 220 are added to the flowchart of the mobile phone terminal of the first embodiment shown in FIG. When the information light source information of a matching store that cannot receive information on the mobile phone terminal side of the user is transmitted from another information light source (step 218) due to shielding by the building, the shielded information light source It is calculated from the position between the position and the user's mobile phone terminal where there is a light source that cannot be seen on the display unit of the user's mobile phone terminal (step 219), and there is a shielded light source at the calculated position Is displayed on the screen (step 220).

  FIG. 17 is a flowchart for explaining the operation of the store search server of the second embodiment. In the second embodiment, in the flowchart of the store search server of the first embodiment of FIG. 10, the processing related to the shielding object between the store that matches the search condition and the user's mobile phone terminal (step 314 to step 314). 316) is added. When the search is performed according to the search condition transmitted from the user and there is a matching store, the matching store position is compared with the user's mobile phone terminal position (step 314), and the region stored in advance in the store search server is compared. By using information such as the location information of a store having a light emitting source, the height information (the number of floors) where the store is located, the position information of a building that can be a shielding object, or the height information (the number of floors) of a building, etc. When the terminal receives light from the information light source, it is determined whether or not there is an obstacle between them (step 315). If there is a shield, in addition to the user ID and direction information, the location information of the shield is transmitted to the matching store (step 316). If there is no shielding object, the process proceeds to the next process.

  Even in the processing of stores that match the search condition in FIG. 10 and stores that do not match, the position information of the shielding is added to the information to be transmitted to the store-side terminal.

  For the store side terminal, at the time of information transmission in step 403 in FIG. 11, in the case of a matched store, the location information, direction, etc. of the store that matches the location information of the shielding object are transmitted. In the case of a store that does not match, information such as the position information and direction of the shield is transmitted.

  From the above, in the second embodiment, even when there is a building 706 that blocks light in front of the building 705 on the back side as seen from the user, as shown in the screen display 701 shown in FIG. By receiving the position information of the building 706 that is a shielding object from the light emitting sources 703 and 704, the user's mobile phone terminal can detect the position information of the user's mobile phone terminal, the position information of the shielding object, and the shielded information. By calculating which building on the display unit of the user's mobile phone terminal is a shielding object from the location information of the light source, and displaying the building location 702 on the screen, the user can separate the building from the back of the building. Can be informed that there is a matching store. Therefore, even in a shopping street as shown in FIG. 15, the user can easily find a store that meets the conditions on the screen of the mobile phone terminal.

  In the second embodiment, the store search server transmits the location information of all information light emitting sources in the vicinity of the user's mobile phone terminal to the user's mobile phone terminal, and the user's mobile phone terminal uses the search condition as a search condition. Location information of all information emission sources in the vicinity of the user's mobile phone terminal having a storage device for storing the location information of the matching information emission source and the location information of the non-matching information emission source transmitted from the store search server Is received and stored in the storage device, so that the user's mobile phone terminal can specify more detailed shielding object position and matching store position. In other words, if all the store information around the user's mobile phone terminal is already stored in the user's mobile phone terminal itself, it can be seen on the screen from where the light is emitted even if it moves after the search. The user's mobile phone terminal itself can determine that the user's mobile phone terminal is near the light emitting source and that the user's mobile phone terminal is facing the direction. Therefore, even if the mobile phone terminal moves after the search, the user's mobile phone terminal can always maintain the current location information, and the latest location information can be used when calculating the location relationship with the shielded matching store. Can be calculated.

It is a figure explaining the outline | summary of this invention. It is a figure showing the outline | summary of this invention with a processing flow. It is a figure which shows the blink data of a light source. This is a method for determining a visible light communication source when an image is captured from a camera with the information processing apparatus fixed. This is a method for determining a visible light communication source when an image is captured from a camera while moving an information processing apparatus. It is a block diagram which shows an example of the information processing apparatus of this invention. It is a block diagram which shows an example of the shop search server of this invention. It is a block diagram which shows an example of the shop side terminal of this invention. It is a flowchart explaining operation | movement of the mobile telephone terminal of a 1st Example. It is a flowchart explaining operation | movement of the shop search server of a 1st Example. It is a flowchart explaining operation | movement of the shop side terminal of a 1st Example. It is a figure which shows the example of a screen display of a mobile telephone terminal. It is a figure which shows the example of a screen display of a mobile telephone terminal when the shop which matched search conditions does not have an information light emission source. It is a figure which shows the relationship between the user who walks a road, and the shop which matches search conditions in the case where a shop exists in the building facing the main street. It is a figure which shows the relationship between the user who walks on a road, and the shop which matches search conditions in the case where a shop is densely located in a building. It is a flowchart explaining operation | movement of the mobile telephone terminal of a 2nd Example. It is a flowchart explaining operation | movement of the shop search server of a 2nd Example. It is a figure which shows the example of a screen display of a mobile telephone terminal when the building which blocks light exists in front of the building with the shop which satisfy | fills search conditions seeing from a user.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Information processing apparatus 12 Base station 13 Store search server 14 Display screen 20 Mobile phone terminal 21 Antenna 22 RF part 23 GPS receiving part 24 Baseband part 25 Imaging part 26 Terminal processing part 27, 44 Operation part 28, 45 Display part 29, 31, 41 Storage unit 30 Store search server 32 Server processing unit 33 Information search unit 40 Store side terminal 42 Store processing unit 43 Information transmission unit 501, 504, 507, 510, 514, 516, 601, 701 Screen display 502, 503 Light emission Source 505, 506, 509 Store name 508 Cursor 511, 512 Number display 513 Display 515, 602, 603 Arrow display 517 Telop 604, 606 User 605, 607 Matching store 702 Location 703, 704 Information light source 705, 706 Building

Claims (7)

A visible light communication system including a light emitting device, an information processing device, and a server,
The light emitting device includes a light source that emits light in a pattern corresponding to data to be transmitted,
The information processing apparatus includes:
Position information acquisition means for acquiring position information;
A condition input means for inputting search conditions;
Transmitting means for transmitting the position information and the search condition;
Photographing means for photographing the subject;
Display means for displaying in real time an image of a subject photographed by the photographing means;
Decoding means for detecting a light source that emits light in a predetermined blinking pattern from an image of a subject photographed by the photographing means, and decoding data from the detected light emission pattern;
Control means for controlling the display of the data decoded by the decoding means on the display means in association with the light source,
The server
Receiving means for receiving position information and search conditions transmitted from the transmitting means;
Instructing means for instructing light emission in which data is superimposed on the light emitting device meeting the position information and search conditions received by the receiving means;
A visible light communication system comprising:   The information processing device indicates the direction of the light source of the light emitting device that matches the position information and the search condition when the light source of the light emitting device that matches the position information and the search condition cannot be detected in the image of the subject photographed by the photographing unit. The visible light communication system according to claim 1, wherein an arrow is displayed on the display unit.   When the light source of the light emitting device that matches the position information and the search condition is shielded, the information processing device decodes the light emission pattern data of the light source that is not shielded by the decoding means, and is shielded from the decoded data. The visible light communication system according to claim 1 or 2, wherein the presence of a light source is detected, and the detected light source is highlighted on the display means. Photographing means for photographing the subject;
Display means for displaying in real time an image of a subject photographed by the photographing means;
Decoding means for detecting a light source that emits light in a predetermined blinking pattern from an image of a subject photographed by the photographing means, and decoding data from the detected light emission pattern;
Control means for controlling display of the data decoded by the decoding means on the display means in association with the light source;
An information processing apparatus comprising: Position information acquisition means for acquiring position information;
A condition input means for inputting search conditions;
Transmission means for transmitting the position information and search conditions,
The control means determines whether or not the data decoded by the decoding means is data that matches the position information and search conditions transmitted from the transmission means, and if they match, the light source corresponding to the decoded data is 5. The information processing apparatus according to claim 4, wherein the information is highlighted on the display means.   If the light source of the light emitting device that matches the position information and the search condition cannot be detected in the image of the subject photographed by the photographing means, an arrow indicating the direction of the light source of the light emitting device that matches the position information and the search condition is displayed on the display means. The information processing apparatus according to claim 4, wherein the information processing apparatus displays the information processing apparatus.   If the light source of the light emitting device that meets the position information and the search condition is shielded, the light emission pattern data of the unshielded light source is decoded by the decoding means, and there is a light source shielded from the decoded data. The information processing apparatus according to claim 4, wherein the information processing device is detected, and the detected light source is highlighted on the display unit.

Images