JP7709258B1 - A character-based route guidance program using artificial intelligence - Google Patents

Abstract

A portable information device is provided that enables users to reach their destination more easily, enjoyably, and efficiently.
[Solution] The system includes artificial intelligence that recognizes subjects from images taken by the user and generates characters on a map, and generates characters and route guidance methods using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, time, etc. The system includes a function that can use the map function to calculate the optimal route from the current location to the destination, and display the destination location, route, and destination position on the map, as well as a function that takes into account the weather and time to reflect the selection of route guidance methods and changes to the display content.
[Selected Figure] Figure 1

Description

The present invention relates to a character-based route guidance program using artificial intelligence.

As mobile devices such as smartphones become more widespread, navigation services for pedestrians are becoming more widely used. However, because pedestrians have a high degree of freedom in the direction they move in, it can take time for them to match the map displayed on the screen with reality. As a result, navigation using augmented reality (AR) rather than displaying a map has been considered. For example, Patent Document 1 discloses a method of using a head-mounted display (HMD) to superimpose a character moving toward a destination on an image of the real world. Patent Document 2 also describes a portable navigation device, which includes a display unit that displays an image, a route information acquisition unit that acquires route information indicating a route to a destination, an image acquisition unit that acquires an image of the real world, an augmented reality image generation unit that generates an augmented reality image in which an image of a character proceeding along the route is superimposed on the real world image based on the route information, a map image generation unit that generates a map image showing the route on a map based on the route information, an angle detection unit that detects the tilt angle of the display unit from the horizontal direction, and a display control unit that outputs the augmented reality image to the display unit if the angle is equal to or greater than a predetermined threshold, and outputs the map image to the display unit if the angle is less than the predetermined threshold.

JP 2012-63253 A JP 2014-020863 A

The present invention allows users to use artificial intelligence to select the display method of the character guiding them to their destination when they head towards their destination, making it easier to understand, more enjoyable and more efficient to reach their destination.

The present invention relates to a route guidance program using artificial intelligence installed in a mobile terminal. It includes artificial intelligence that recognizes subjects from images taken by the user and generates characters on a map, and can generate characters and route guidance methods using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. In addition, measures such as anonymizing and deleting data and obtaining user consent can be taken to protect privacy. The present invention is expected to be used in tourist spots, commercial facilities, public transportation, etc., and can realize route guidance that is easier to use and tailored to individuals.

The present invention relates to a route guidance program using artificial intelligence installed in a mobile terminal. It includes artificial intelligence that recognizes subjects from images taken by the user and generates characters on a map, and can generate characters and route guidance methods using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. In addition, measures such as anonymizing and deleting data and obtaining user consent can be taken to protect privacy. Furthermore, it is expected to be used in tourist spots, commercial facilities, public transportation, etc., and can realize route guidance that is easier to use and tailored to individuals.

The present invention will also enable facilities such as tourist destinations, commercial facilities, and public transportation to provide better services. The present invention differs significantly from conventional technology in that it uses more advanced technology to provide easier-to-use, personalized route guidance.

The present invention is a navigation program using artificial intelligence installed in a mobile terminal, which includes artificial intelligence that recognizes subjects from images taken by the user and generates characters on a map. The AI can generate characters and navigation methods based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. In addition, measures such as anonymizing and deleting data and obtaining user consent can be taken to protect privacy. It is expected to be used in tourist spots, commercial facilities, public transportation, etc., and can provide navigation that is easier to use and tailored to individuals.

FIG. 13 shows a route guidance function of the portable information device, in which a cat character is displayed superimposed on an image being captured to guide the user along the route, and the character display changes depending on the situation. This is a diagram showing the components and functions of a mobile information terminal. The CPU includes artificial intelligence functions, and the GPS module, orientation sensor, camera, memory, and display are arranged in this diagram. FIG. 13 is a diagram showing how a photographed convenience store sign is compared with its position on a map to identify the photographing direction. FIG. 1 is a diagram showing how artificial intelligence generates a character based on input information. This figure shows how artificial intelligence selects between image-based AR display and map display while shooting.

The keywords in the claims are defined as follows:

Route guidance program using artificial intelligence installed in a mobile terminal: A route guidance program including artificial intelligence that recognizes subjects from captured images and generates characters on a map. A route guidance program using artificial intelligence, characterized in that when the program collects images captured by the user and usage history, the program anonymizes the data so that individuals cannot be identified, and appropriately protects the data. A route guidance program using artificial intelligence installed in a mobile terminal, including artificial intelligence that recognizes subjects from images captured by the user and generates characters on a map, and can generate characters and route guidance methods using artificial intelligence based on information such as past usage history, type of destination, characteristics of the map area, weather, and time. A route guidance program using artificial intelligence that includes a function that can use a map function to calculate the optimal route from the current location to a destination, and display the destination and route on a map, as well as a function that takes into account the weather and time, and reflects this in the selection of route guidance methods and changes to the display content.

The keyword in the claims, "route guidance program using artificial intelligence," refers to a program that utilizes artificial intelligence installed in a mobile terminal to provide route guidance to a user when heading to a destination.

For example, the following are some possible uses of the claims:

In the scope of the claims for a "route guidance program using artificial intelligence," the program includes the following functions:
- A function that uses the camera installed in the mobile device to recognize subjects that the user passes by as they head towards their destination. - A function that uses artificial intelligence to suggest the optimal route based on information such as past usage history, characteristics of the map area, weather, and the time of day. - A function that uses a character generation function to display cute characters on the route guidance. Programs with the above functions are expected to be used in tourist spots, commercial facilities, public transportation, etc., and will enable easier-to-use, personalized route guidance.

Furthermore, to realize the above program, it is necessary to equip the mobile device with a camera, map, artificial intelligence, and character generation functions, and to develop a program that integrates these functions. Specifically, it is necessary to recognize the subject with the camera, set the destination on the map, calculate the optimal route using artificial intelligence, and display a character on the route guide using the character generation function.

Artificial intelligence: Technology that gives computers the ability to process, make decisions, and learn intelligently.

Photography function: A function to capture surrounding scenery and subjects using the camera installed on a mobile device.

Image recognition function: A function that uses artificial intelligence to recognize the subject, the direction the camera was pointed, the weather at the time of shooting, etc. from the captured image.

Display function: A function that displays information about recognized subjects and destinations in an easy-to-understand manner for the user.

Map function: Used when the user sets a destination, this function calculates the optimal route from the current location to the destination and displays the location of the destination and route on a map.

Character generation function: A function that can generate a character based on the user's location and provide directions.

Usage history: A function that records information about directions a user has taken using a mobile device in the past, and uses artificial intelligence to analyze the user's preferences and behavioral trends and use them to provide future directions.

Destination type: Set using an address, facility name, etc. depending on the purpose of the user's travel, and the purpose of the user's travel can be inferred from the content using artificial intelligence.

Characteristics of the map area: This includes the type and level of detail of information displayed on the map, the scale of the map, etc., and using artificial intelligence, it is possible to determine whether an area is densely populated, a tourist destination, whether there are elevation differences, etc.

Weather and time: Taking into consideration the accuracy and safety of route guidance, these are reflected in the selection of route guidance method and changes to the displayed content.

<Examples of use of claims>
It is a navigation program using artificial intelligence installed in a mobile device, which recognizes the subject using the photography function, sets the destination using the map function, recognizes the weather and time using the image recognition function, and displays a character on the navigation using the character generation function. It can generate the optimal navigation method using artificial intelligence based on information such as usage history, destination type, map area characteristics, weather, and time. In addition, measures such as anonymizing and deleting data and obtaining user consent can be taken to protect privacy. This makes it possible to realize navigation that is easier to use and more tailored to individuals, and is expected to be used in tourist spots, commercial facilities, public transportation, etc.

This embodiment relates to a route guidance program that utilizes landmark information. The landmark information can be combined with spatial information to provide more accurate and easy-to-use route guidance. In this embodiment, by using processing related to the physical identification and use of landmarks, context can be added to the route guidance and landmarks related to the user's knowledge can be integrated. The integrated landmarks can also be integrated with advertisements. This can provide landmark-based route guidance and can increase the likelihood that the user will follow the route guidance. This embodiment can provide a route guidance program that is useful to the user.

Example: A smartphone application displays an animated character on the screen as the user is guided to their destination. Depending on the distance between the user's current location and the destination, the character will indicate the real-world direction and also display the distance. This animated character acts as a friendly guide for the user.

The following describes the route guidance program for a mobile device according to this embodiment.

The present invention is a navigation program for a mobile device, which includes a photographing function for controlling the mobile device to photograph a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map a destination to which a user holding the mobile device is traveling, and a character generation function for generating a character for the display function based on the user's position, the character generation function generating an image of a character based on difference information between the distance traveled by the user and the destination destination, and information on the direction in which the recognized subject should head to the destination destination by matching the recognized subject with a subject on the map.

In an embodiment of the present invention, a mobile terminal can provide route guidance to a user when the user is heading to a destination. The mobile terminal includes a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting a destination on a map where the user holding the mobile terminal is moving, and a character generation function for generating a character for the display function based on the user's position. The character generation function can generate an image of a character based on difference information between the distance traveled by the user and the destination, and information on the direction in which the recognized subject should move to the destination by matching it with an object on the map. The present invention also provides an image display program executed by a terminal device. This program includes a determination means for determining whether to display a live-action guide image or a map guide image with priority based on the relationship between the photographing direction of the photographing means and the direction of travel, and a display control means based on the determination result.

The present invention provides a route guidance program, characterized in that a computer includes an imaging function that controls a portable terminal that photographs a subject, an image recognition function that recognizes the subject, a location information extraction and storage function that extracts and stores location information from the photographed subject, a route information acquisition and storage function that acquires and stores route information to the destination from the location information acquired from the location information extraction and storage function, a direction display function that calculates and displays direction information from the current position to the next destination from the route information acquired from the route information acquisition and storage function, and a guidance means selection switching means that guides a user with guidance means such as voice guidance or vibration guidance based on the direction information calculated by the direction display function.
Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc.

The computer controls its own operation according to the read program, thereby realizing a surrounding area map display processing unit and a landmark map display processing unit on the computer. The surrounding area map display processing unit searches for a route from the user's current location to the destination and obtains landmark information on the route. The landmark map display processing unit displays landmarks that the user passes on the route from the current location to the destination based on the obtained landmark information. This allows the user to more intuitively grasp the route to the destination.
The voice recognition device has a voice recognition function that analyzes voice input voice data and outputs a voice recognition result based on the analysis result, and an operation function that judges the content of the voice input voice data based on the voice recognition result and performs an operation according to the content of the voice input voice data based on the judgment result.
The present invention relates to an operation function of a voice recognition device. Specifically, the voice recognition device can start a specific application or execute a specific operation according to the contents of voice data received. For example, when voice data of "tell me your phone number" is input, a phone book application is started, and when voice data of "next" is input, the next image is displayed in an application such as a slide show.

In this embodiment, the subject's position is identified by a subject recording process in which a first photograph is taken of the subject at the photographing location, a subject guidance process in which an operator who has moved from one photographing location to another is guided to the approximate location of the subject so that a second photograph can be taken, and a subject measurement process in which a second photograph is taken of the subject at the photographing location to measure the subject's position. In this embodiment, the route guidance program also has a character generation function that generates a character image based on difference information between the distance traveled by the operator and the destination location, and information on the direction to take to the destination location by matching the recognized subject with a subject on a map.

In the present invention, in the subject guidance process, when it is determined from the GPS signal obtained from the GPS unit that the unit operator has approached the subject to a distance less than a predetermined distance, the digital camera vibrates, sounds an alarm, or displays a message to notify the operator. This makes it easier to find the subject and take a picture. In addition, the present invention can display the route to the destination using a route guidance program, so that even a person who does not know the route to the destination can easily reach the destination. Furthermore, the present invention can generate an image of a character using a character generation function, and when an operating member such as a "shoot" button is pressed, it may be determined from a signal transmitted from the "shoot" button that the operating member has been pressed.
In the present invention, when an operating member such as a "shooting" button is pressed, it is determined from a signal transmitted from the "shooting" button, etc. that the operating member has been pressed. As a result, since it is determined from a signal transmitted from the "shooting" button, etc. that the operating member has been pressed, accurate information processing is performed even if the operating member has not been pressed from a signal transmitted from the "shooting" button, etc. Furthermore, if it is determined from a signal transmitted from the "shooting" button, etc. that the operating member has been pressed, necessary processing such as "shooting" processing and "saving" processing is also automatically performed.

If the subject recording process is performed multiple times on the same subject, the previously acquired shooting data may be updated with more recent data or with shooting data taken at a position where the subject's position can be easily identified.

1. Use the shooting function to take a picture of the subject.
2. The subject is recognized using the image recognition function.
3. Use the display function to display the photographed subject.
4. Using the map function, the user's destination is set on the map.
5. The character generation function generates a character based on the user's position.
6. The route guidance program generates an image of the character based on the difference between the distance traveled by the user and the destination, and by matching the recognized subject with subjects on the map, based on information about the direction to take to the destination.

In addition, the computer obtains subject position information from the image obtained in the first photographing in the subject measurement process, calculates information such as the distance and direction to the photographing point from this information, and reflects this in difference information used in the route guidance program.
A route guidance program in which a computer is provided with a photographing function that controls a mobile terminal that photographs a subject, an image recognition function that recognizes the subject, a location information acquisition processing unit that matches the photographed subject with a subject on a map to acquire its location information, and a route guidance processing unit that provides route guidance to a destination based on the location information acquired from the location information acquisition processing unit, and the computer can provide route guidance to an operator by voice guidance, screen display, etc. based on the route guidance information calculated by the route guidance processing unit.

The present invention is a "route guidance program." This program runs on a "computer." This program provides "route guidance" (e.g., "turn right") from an "image" (e.g., a video captured by a camera) that shows a "subject" (e.g., a building, a sign, etc.) to a "destination" (e.g., a building, a sign, etc.), and allows "fun travel" (e.g., fun travel with a game-like feel). Since this program runs on a "computer," it can also be used on a "smartphone," "tablet terminal," etc.

The computer is equipped with an image capture control unit, an image recognition unit, a position information acquisition unit, a route guidance program execution unit, a display unit, and an audio output unit, which control a mobile device that captures an image of a subject, and the position information acquisition unit acquires current position information from the subject captured by the mobile device.The route guidance program execution unit calculates route information to the destination from the current position information.The audio output unit then provides audio guidance on the next direction, distance, etc. based on the calculated route information.The display unit then provides guidance on the next direction, distance, etc. on a screen based on the calculated route information.
In the computer device, the location information acquisition unit acquires current location information from the subject photographed by the mobile terminal.The route guidance program execution unit calculates route information to the destination from the current location information.Then, the audio output unit provides audio guidance on the next direction, distance, etc. based on the calculated route information.

The present invention aims to provide a route guidance program for a mobile device that provides route guidance when a user heads to a destination. The route guidance program of the present invention comprises a photographing function that controls the mobile device to photograph a subject, an image recognition function that recognizes the subject, a display function that displays the photographed subject, a map function that sets on a map a destination to which a user holding the mobile device is moving, and a character generation function that generates a character for the display function based on the user's position. Furthermore, when second type surrounding map information is sent from a map information server, the surrounding map display processing unit can display on the display unit a surrounding map with the landmark direction and destination direction superimposed.

When the mobile terminal receives information input by the user by executing a specific program stored in the memory or an external storage device, the central processing unit transmits a map display request based on the received information to the map image processing device. Next, when map data, etc. is received from the map image processing device, a function is realized to display a map image on the display based on this. In addition, a mobile terminal equipped with a photographing function and an image recognition function can operate a character generation function based on the subject recognition results and the user's position information, and provide guidance to the destination.

The present invention relates to a route guidance program using a mobile terminal. According to the present invention, a destination to which a user travels can be set on a map, and route guidance to the destination can be provided. Also, by matching the recognized subject with a subject on the map, and using difference information between the distance traveled by the user and the destination, an image of a character can be generated based on information on the direction to travel to the destination. Furthermore, if the user displays the mobile terminal in a location other than the searched route, the searched route information is erased from the screen according to the user's orientation, and an arrow (not shown) indicating the searched route direction is displayed, making it possible to guide the user to the destination by pointing the mobile terminal in the searched route direction.

Pedestrians can directly input addresses or other information indicating their starting point and destination, or they can select their starting point and destination from a map app.

The present invention relates to a route guidance system using a mobile terminal. The mobile terminal is equipped with a photographing function, an image recognition function, a display function, a map function, and a character generation function. A user sets a destination on a map and photographs a subject with the photographing function. The image recognition function recognizes the subject and obtains information on the direction to the destination by matching it with the subject on the map. The character generation function generates an image of a character based on the user's position information and information on the direction to the destination. In addition, when an image switching button is pressed, the system control unit places a marker and switches the currently displayed image.
This is a route guidance program for causing a computer to execute a photographing function that controls a portable terminal that photographs a subject, an image recognition function that recognizes the subject, a display function that displays the photographed subject, a map function that sets on a map a destination to which a user holding the portable terminal is traveling, and a character generation function that generates a character for the display function based on the user's position, the character generation function generating an image of a character based on difference information between the distance traveled by the user and the destination destination and information on the direction in which the recognized subject should head to the destination destination by matching it with a subject on the map.

The present invention is a route guidance program used on devices such as smartphones. In the present invention, a subject is recognized from a captured image, and necessary information such as direction information and distance information from the current position to the destination is calculated from the position information and used in the route guidance program. In addition, the direction and distance instructions required to proceed from the current position to the destination are displayed in an easy-to-understand manner by animated characters. This makes route guidance that was difficult to understand with conventional technology easier to understand.
This is a navigation program for a device such as a mobile terminal, characterized in that the computer comprises a photographing function for controlling a device such as a mobile terminal that photographs a subject, an image recognition function for recognizing the subject, a processing unit for calculating necessary information (directional information, etc.) from the photographed subject, the current position, and the destination position, etc., and an animation processing unit, etc., as well as communication means between these processing units.

In this embodiment, when the user heads towards a destination, the route guidance program executes the generation of a character image based on difference information between the distance traveled by the user and the destination, and on information on the direction in which the recognized subject should head towards the destination by matching it with subjects on a map. The character image generated in this manner is displayed by the display function. In this embodiment, the route guidance program also has a map function that sets the destination to which the user is traveling on a map. Furthermore, in this embodiment, the character generation function also has a character display function that displays the image of the character generated by the route guidance program.

The map information providing system of the present invention is composed of a terminal sales company that produces and sells car navigation terminals, a map data sales company that manages the system and generates and sells map data (map information), a communication line company that provides users with the generated map data via a communication line, and multiple users who receive the map data and pay for it (here, a financial institution that classifies the payment made by the users into the map data sales company and the communication line company and pays it to them). The terminal sales company, map data sales company, communication line company, and financial institution are connected by a network such as the Internet. The system is used by application software installed in a car navigation terminal manufactured by the terminal sales company. This application software displays map information provided by the map data sales company based on the location information received by the car navigation terminal from a GPS satellite. The application software also obtains payment information from the financial institution via the communication line and limits the range of map information available to users based on that information.

The present invention is a route guidance program that combines subject recognition technology and character generation technology. This program calculates directional information to a destination by matching a photographed subject with an object on a map, and generates a character image based on that directional information. This character image is displayed on a display device, allowing the user to receive route guidance to the destination. In addition, because the photographed subject is used to calculate directional information to the destination, the present invention also makes it possible to provide route guidance inside buildings and in mountainous areas, which was not possible with conventional technology.

The present invention aims to provide a route guidance program for a mobile device that provides route guidance when a user heads to a destination. The route guidance program of the present invention includes a photographing function that controls a mobile device to photograph a subject, an image recognition function that recognizes the subject, a display function that displays the photographed subject, a map function that sets on a map a destination to which a user holding the mobile device is traveling, and a character generation function that generates a character for the display function based on the user's position, and the character generation function generates an image of the character based on difference information between the distance traveled by the user and the destination, and information on the direction in which the recognized subject should head to the destination by matching the recognized subject with a subject on the map.

The route guidance system of the present invention is a system that sets a destination to which a user is traveling and provides route guidance to the destination. The system has a photographing function that controls a mobile device that photographs a subject, an image recognition function that recognizes the subject, a display function that displays the photographed subject, a map function that sets on a map the destination to which the user holding the mobile device is traveling, and a character generation function that generates a character for the display function based on the user's position. In addition, when the system receives an instruction that the user has reached a point farther from the destination, it can also display a captured image corresponding to the user's next destination.

When the user sets a destination, the route guidance program calculates the distance from the user's current location to the destination. In addition, each time the user moves, the program recalculates the distance between the current location and the destination and generates a character image. The character image changes depending on the direction in which the user should travel to the destination. For example, as the user approaches the destination, the character may begin to dance with joy. On the other hand, as the user moves away from the destination, the character may begin to look anxious. In addition, if the recognized object is matched with an object on the map, the character may display an animation related to that object.

In addition, this route guidance program may be terminated when the user reaches the destination, and may be executed again if the user does not reach the destination.

The present invention provides a route guidance program and method that allows a user to intuitively understand the direction in which to travel and the distance to a destination. Specifically, a route guidance program and method are provided that are configured in a computer to perform various processing steps such as photographing, recognition, display, map, and character generation. These processing steps are linked to each other, and for example, a character image is generated by calculating the direction and distance from a photographed subject to a destination. A route guidance program and method that are configured in these processing steps can be used on a wide variety of devices such as smartphones and car navigation systems, and can be widely used for purposes other than specific applications.

The purpose of this embodiment is to enable the user to display a landmark map that has been divided into multiple groups according to a predetermined rule. Therefore, in this embodiment, if the user specifies a group of landmarks that they wish to display on the landmark map before sending a surrounding map request, a landmark map that includes the landmarks that belong to the group specified by the user and the user's current location can be displayed. This allows the user to display only the landmarks that interest them, and to obtain the information they need efficiently and quickly.

The purpose of this embodiment is to provide a character generation method and a route guidance method that do not deviate from the route guidance program even when the user is moving. For this reason, this embodiment calculates the distance traveled in a straight line from the current position to the destination at the time of character generation (hereinafter referred to as the "degree of progress") and the distance traveled in a straight line from the current position to the destination (hereinafter referred to as the "degree of deviation"), and determines the character image and the voice guidance content, etc. from these values. Also, in this embodiment, the character image and the voice guidance content, etc. are changed depending on whether the "degree of progress" and the "degree of deviation" increase or decrease by a certain amount. With these ideas, the user can move efficiently and quickly without deviating from the route guidance program.

The present invention has a function to determine whether or not a landmark is present on a surrounding map when a user heads to a destination, and if so, to transmit the surrounding map to the mobile device, and if not, to select a landmark for which direction is to be displayed from among the landmarks whose position information is registered in the landmark position information storage unit, and to transmit the landmark position information of the selected landmark and the surrounding map to the mobile device. This allows the user to more accurately grasp the route to the destination. Furthermore, the present invention also reduces the user's stress, as the user can more accurately grasp the route to the destination.

The surrounding map request processing unit is a route guidance program that, even if a landmark exists on the surrounding map, does not notify the mobile device of its location. However, if a landmark exists on the surrounding map that is at an angle of less than 90 degrees to the orientation of the mobile device, the program also notifies the mobile device of the location of the landmark.

When information is provided by multiple companies, icon images can be obtained from each piece of information and then integrated for display.

The present invention relates to a route guidance program for a mobile terminal. According to the present invention, a destination to which a user is to travel can be set on a map, and route guidance to the destination can be provided. Specifically, a mobile terminal equipped with an image recognition function for recognizing subjects can be used to set a destination to which a user is to travel on a map, and route guidance to the destination can be provided. In addition, a character generation function can generate an image of a character based on difference information between the distance traveled by the user and the destination, and information on the direction to travel to the destination by matching the recognized subject with a subject on the map.

The route guidance system according to the present invention is a system that sets a destination to which a user is traveling and provides route guidance to the destination. This system is realized by a mobile terminal carried by the user. This mobile terminal has a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting the destination to which the user is traveling on a map, and a character generation function for generating a character for the display function based on the user's position. Furthermore, the route guidance system according to the present invention also has a receiving means for receiving instructions from the user, and the target image display control means can sequentially switch and display a plurality of captured images stored in the image storage means based on the user's instructions.
The computer comprises a photographing function that controls a portable terminal that photographs a subject, an image recognition function that recognizes the subject, a location information extraction and storage means that extracts and stores location information from the photographed subject, and a display means that acquires and displays location information data from the location information extraction and storage means, and the computer is a display control program that, from the location information data, information on the distance and direction traveled from the last time photographed to the present, current location information, and distance and direction information to the destination, etc., displays guidance information such as the direction and distance the user should proceed, and characters etc. according to the direction and distance to proceed.
The above-mentioned route guidance system makes it easy to provide the user with guidance information such as the direction and distance to travel, and a display control program for characters, etc. Also, in the present invention, more accurate guidance is possible by acquiring and displaying position information data from the position information extraction and storage means.

The route guidance program of the present invention has the technical features described above, and is more convenient than conventional navigation systems because it combines object recognition technology, location information acquisition technology, etc. Furthermore, the route guidance program of the present invention is more convenient than conventional navigation systems because it combines object recognition technology, location information acquisition technology, etc. Furthermore, the route guidance program of the present invention is more convenient than conventional navigation systems because it combines object recognition technology, location information acquisition technology, etc.

In one embodiment of the present invention, the terminal device includes an image capturing means, a determination means for determining whether to display a live-action guide image using an image captured by the image capturing means or a map guide image using map information based on a relationship between the image capturing direction of the image capturing means and the traveling direction of the terminal device, and a display control means for controlling the display of one of the live-action guide image and the map guide image based on the determination by the determination means. In one embodiment of the present invention, the determination means extracts feature amounts of buildings, etc. on a road along which the terminal device is traveling, and selects one of the live-action guide image and the map guide image by comparing the feature amounts with map information.
The mobility support system is characterized in that the computer is provided with an imaging function that controls a portable terminal that captures an image of a subject, an image recognition function that recognizes the subject, a display function that displays the captured subject, a route display function that acquires and displays route information to a destination set by the user, a destination prediction function that acquires and displays information such as the time and distance required to reach the destination set by the user, a step calculation function that calculates and displays the number of steps required by the user to reach the destination from information such as the time and distance required to reach the destination set by the user, a calorie consumption calculation function that calculates and displays the amount of calorie consumption required by the user to reach the destination from the number of steps required to reach the destination set by the user, and a hydration calculation function that calculates and displays the amount of hydration required by the user to reach the destination from the calorie consumption required to reach the destination set by the user.
The present invention relates to a mobility support system, which provides necessary information and advice when heading to a specific location, enabling users to travel comfortably and efficiently. The present invention also calculates and provides the number of steps and calorie consumption required to reach a destination set by the user based on the time and distance required, enabling users to travel efficiently in terms of health.

In addition, this route guidance program may be terminated when the user reaches the destination, and may be executed again if the user does not reach the destination.

The present invention relates to a route guidance program for a mobile information terminal. The route guidance program of the present invention causes the mobile information terminal to determine whether or not a point before a corner has been passed for each positioning, and when the mobile information terminal determines that a point before a corner has been passed, causes the mobile information terminal to access a map and photo information providing server to download a photo image of the moving direction at the point one point before the point before the corner, and causes the photo image of the moving direction at the point one point before the point before the corner to be displayed on the image display screen. The present invention also provides a photographing function for controlling the mobile terminal to photograph a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map a destination to which a user holding the mobile terminal is moving, and a character generation function for generating a character to be displayed on the display function based on the position of the user.

In this embodiment, when the user heads towards a destination, the route guidance program executes the generation of a character image based on difference information between the distance traveled by the user and the destination, and on information on the direction in which the recognized subject should head towards the destination by matching it with subjects on a map. The character image generated in this manner is displayed by the display function. In this embodiment, the route guidance program also has a map function that sets the destination to which the user is traveling on a map. Furthermore, in this embodiment, the character generation function also has a character display function that displays the image of the character generated by the route guidance program.

The present invention relates to a route guidance program for a mobile information terminal. The mobile information terminal is equipped with a function for photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function sets the destination to which the user travels on the map, and generates a character based on the user's position. The character generation function generates an image of the character based on difference information between the distance traveled by the user and the destination, and information on the direction to travel to the destination by matching the recognized subject with a subject on the map. The route guidance program can also measure the current position at predetermined time intervals, and download and display a photo image of the direction of travel at a point near the current position.

In one embodiment of the present invention, a user takes a mobile device and heads to a destination. The mobile device has a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map a destination to which the user holding the mobile device is moving, and a character generation function for generating a character for the display function based on the user's position. The character generation function can generate an image of a character based on difference information between the distance traveled by the user and the destination, and information on the direction in which the recognized subject should move to the destination by matching it with a subject on the map. Such a route guidance program displays a character indicating the direction of travel when the user moves to the destination, allowing the user to move more smoothly.

The character control unit may determine that the user has arrived at the destination when it is determined that the character has arrived at the destination and is located in a first distance area, which is the distance area closest to the user.

The route guidance program of the present invention provides intuitive route guidance to the user by displaying a character when the user heads to the destination. The size of this character can be changed according to the scale of the destination image and the distance from the photographing point of the destination image to the parking spot so that the size corresponds to the actual size of the vehicle in the destination image. This allows the user to receive more accurate route guidance. In addition, the present invention has an image recognition function that recognizes subjects, so that the user can refer to surrounding buildings and signs when checking the route to the destination.

The present invention relates to a route guidance program for a mobile terminal. According to the present invention, when a user heads to a destination, a character is displayed to attract the user's interest. In addition, by controlling the character's movement, the direction in which the user should head to the destination can be shown. Furthermore, by controlling the character's position, the direction in which the user should head to the destination can be shown. The present invention allows the user to enjoy being guided to the destination.

When the route guidance program of the present invention determines that the character is located in a distance area, the character control unit controls the character to move toward the destination at a faster speed than in a distance area.

The present invention uses a mobile phone terminal as a navigation device to provide route guidance to a user heading to a destination. Specifically, the mobile phone terminal is equipped with a photographing function for photographing a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map the destination to which the user holding the mobile terminal is traveling, and a character generation function for generating a character for the display function based on the user's position. With such a route guidance program, the user can reach the destination smoothly without getting lost.

The present invention is a system that allows users to select their favorite character from among multiple characters and have the character guide them to their destination. The user heads to their destination with their mobile device, and the character provides guidance to the destination based on photos taken along the way. In addition, the user can acquire new characters as they move around. This system is fun for users to use, and by providing guidance to the destination, the character can reach the destination without getting lost.

The present invention is a system that allows users to select their favorite character from among multiple characters and have the character guide them to their destination. The user heads to their destination with their mobile device, and the character provides guidance to the destination based on photos taken along the way. In addition, the user can acquire new characters as they move around. This system is fun for users to use, and by providing guidance to the destination, the character can reach the destination without getting lost.

The present invention allows the user to select and display a character that they like from among a number of characters. In addition, the user can add new characters by moving a certain distance. This allows the user to collect characters that they like. Furthermore, the present invention allows the user to set a destination to which the user will move, and provides route guidance to get to that destination. In this case, route guidance is achieved by matching the recognized subject with a subject on a map, and generating information on the direction to go to the destination.

The present invention is a device for providing route guidance to a user when heading to a destination. The device has a photographing function for controlling a mobile device that photographs a subject, an image recognition function for recognizing the subject, a display function for displaying the photographed subject, a map function for setting on a map the destination to which the user holding the mobile device is moving, and a character generation function for generating a character for the display function based on the user's position. The device also has a display mode selection means for selecting a display mode or a non-display mode based on a user's operation, and the control means can display an image of the character when the display mode is selected, and can hide the image of the character when the non-display mode is selected.

The present invention makes it possible to display a map guide image rather than a live guide image in priority when the photographed subject does not match the subject on the map.

The present invention relates to a route guidance program for a mobile information terminal. The mobile information terminal is equipped with a function for photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function sets the destination to which the user travels on the map, and generates a character based on the user's position. The character generation function generates an image of the character based on difference information between the distance traveled by the user and the destination, and information on the direction to travel to the destination by matching the recognized subject with a subject on the map. The route guidance program can also measure the current position at predetermined intervals, download photos of the direction of travel at points near the current position, and display the photos of the direction of travel on the image display screen.

When a user sets a route to a destination on a map, the route guidance system of the present invention can recognize the photographed subject while moving along the route and display a character indicating the direction to the destination. In this case, the route to the destination includes multiple partial routes, and the partial route connecting the point where the currently displayed captured image was captured and the previous point can be highlighted. This allows the user to more clearly understand the route to the destination.

The present invention relates to a route guidance system that makes it easier for users to understand the route to their destination. This system allows the user to set a route to the destination, acquires directional information from photographed subjects while moving, and generates and displays a character image. It is also possible to highlight the closest partial route from the current position out of multiple partial routes. This makes it easier for users to understand the route.

The present invention relates to a route guidance program using a mobile terminal. According to the present invention, when a user sets a destination to travel to, route guidance to the destination can be provided. Also, while the user is traveling, surrounding subjects can be recognized and matched with subjects on a map to generate directional information to travel to the destination. Furthermore, a character generation function can generate and display a character to travel to the destination. In this way, the user can enjoy traveling to the destination.

The route guidance program of the present invention has an image recognition function for recognizing a subject, a map function for setting on a map a destination to which the user is traveling, and a character generation function for generating a character to be displayed based on the user's position, and the character generation function executes the generation of an image of the character based on difference information between the distance traveled by the user and the destination destination, and information on the direction in which the recognized subject should head to the destination destination by matching the recognized subject with a subject on the map. The route guidance program of the present invention is also a program implemented on a computer.

If it is determined that the character is not present within a predetermined determination range, the image generation unit may generate a navigation screen that displays information about the direction of the character's presence.

The present invention relates to a route guidance program using a mobile terminal. According to the present invention, a destination to which a user is to travel can be set, and route guidance to the destination can be provided. Specifically, when the user moves, location information of the user is acquired, and a character is generated based on the location information. Also, when the user heads toward the destination, directional information of the user is acquired, and a character is generated based on the directional information. Furthermore, when the user moves, surrounding subjects are recognized, and by matching the subjects with subjects on a map, information on the direction to travel to the destination can be acquired, and a character can be generated based on the directional information.

When the setting is "No priority display" and the character image is displayed, if a touch is detected on the character image, an auxiliary illustration such as an enlarged view using the navigation function can be displayed instead of the character image.

The present invention is also applicable to mobile terminals such as smartphones and tablet terminals.
The computer is equipped with a photographing function that controls a portable terminal that photographs a subject, an image recognition function that recognizes the subject, a location information extraction and storage function that extracts and stores location information from the photographed subject, a history data creation and display function that creates and displays history data of places visited by the user from the location information stored by the location information extraction and storage function, a place of interest extraction and display function that extracts and displays information on places, stores, etc. that the user himself is interested in from the history data created by the history data creation and display function, a new visited place extraction and display function that extracts and displays information on places, stores, etc. that the user has not visited from information on places of interest, stores, etc. extracted by the place of interest extraction and display function, and new visited place extraction and display.
The present invention relates to the "location service" technical field consisting of "location information,""historydata,""places of interest,""newly visited places," etc., and aims to provide means for solving technical problems, namely, "creating history data,""extracting places of interest," and "extracting newly visited places," in the "location service" technical field.

The present invention is a route guidance program used on devices such as smartphones. In this invention, the subject is recognized from a captured image, and the route and direction information from the current position to the destination are calculated and displayed based on the position information. In addition, an avatar or the like is used as a guide when proceeding from the current position to the destination. This makes it possible to provide visual route guidance that was not possible with conventional technology, making it highly convenient.

When the system receives an indication that the user has reached a point farther from the destination, it can also display an image corresponding to a point closer to the destination that the user should next aim for.

When a user sets a route to a destination on a map, the route guidance system of the present invention can recognize the photographed subject while moving along the route and display a character indicating the direction to the destination. In this case, the route to the destination includes multiple partial routes, and the partial route connecting the point where the currently displayed captured image was captured and the previous point can be highlighted and displayed. In this way, the user can more easily understand the route to the destination.

The present invention relates to a route guidance system that makes it easier for users to understand the route to their destination. After the user sets a route to the destination, this system acquires directional information from subjects photographed while moving, and generates and displays a character image from that information. In addition, the route to the destination includes multiple partial routes, and it is also possible to highlight and display the partial route that connects the point where the currently displayed captured image was captured and the previous point. These mechanisms allow the user to more clearly understand the route to the destination and the direction of travel.

The present invention is a system for providing route guidance to a user when heading to a destination. In this system, the user holds a mobile device and can photograph a subject using the mobile device. The system recognizes the photographed subject and identifies where the subject is located on a map. The system also sets a destination to which the user is traveling, and provides route guidance to the destination. In this case, a character is generated based on the user's location information, and the character indicates the direction to head to the destination. In this way, the user can receive route guidance to the destination.

Pedestrians can directly input addresses or other information indicating their starting point and destination, or they can select their starting point and destination from a map app.

The character control unit may determine that the user has arrived at the destination when it is determined that the character has arrived at the destination and is located in a first distance area that is the closest distance area from the user. By providing a route guidance program, the present invention can assist the user in moving smoothly to the destination without getting lost.

When the user arrives at a destination, a check is made to see if the destination is the final destination. If not, i.e., if the destination is an intermediate destination, the process continues for the next destination.

The location information providing system according to the present invention comprises a location information providing device for providing location information, a location information receiving device for receiving location information, and a location information utilizing device for utilizing location information. Based on the current location received from the location information receiving device, the location information providing device obtains store information from a database that contains information on a plurality of stores in order of proximity to the current location, and transmits the store information to the location information receiving device. The location information receiving device receives the store information and displays the store information. Furthermore, the location information utilizing device can use the store information to perform processes such as product purchases and reservations.

This is a route guidance program equipped with an object recognition function, a map function, and a character generation function. When executed by a computer, the destination to which the user is traveling is set on the map, and the direction to the destination is determined by matching the object photographed as the user travels with the object on the map, and a character image is generated and displayed based on the difference between the distance traveled by the user and the distance to the destination.

The present invention relates to a route guidance program for a mobile information terminal. According to the present invention, a destination to which a user holding a mobile information terminal moves is set on a map, and a route guidance program is provided by generating an image of a character based on difference information between the distance traveled by the user and the destination, and information on the direction to move to the destination by matching the recognized subject with subjects on the map. In addition, a route guidance server control program can search for a guidance route, which is a route from a starting position to a destination position, and create map and photo identification information for identifying map and photo information corresponding to scenery that can be seen in the direction of movement along the guidance route, and display route guidance on the image display screen of the mobile information terminal.

The present invention relates to a navigation program and control method thereof, which are composed of many elements such as photography, recognition, display, maps, and character generation, controlled by a computer, and provides technical means and methods for realizing the same that enable natural navigation under specific conditions. For example, instead of giving instructions such as "Go to that place and turn right," it is possible to give instructions such as "Go to the building over there," and "that building" is automatically recognized from the building image captured by a camera. It is also possible to give instructions such as "Go to that place and turn right" on the way to "that building," and "that place" is automatically calculated from position information obtained from a GPS or the like.

The navigation system according to the present invention comprises an image storage means for storing a plurality of captured images of the scenery of each of a plurality of points on a route to a destination, a map storage means for storing a map including the destination, a target image display control means for sequentially switching and displaying the plurality of captured images stored in the image storage means in accordance with the order of the route to the destination, and a map display control means for reflecting the route connecting each of the plurality of points on the map stored in the map storage means and displaying the route in association with the plurality of captured images. The navigation system according to the present invention may further comprise a product information display control means for displaying product information available from the vending machines when the plurality of points on the route to the destination are vending machines installed at regular intervals.

The route guidance system according to the present invention is a route guidance system as described above, comprising an image storage means for storing a plurality of captured images capturing the scenery of each of a plurality of points on a route to a destination, a map storage means for storing a map including the destination, a target image display control means for sequentially switching and displaying the plurality of captured images stored in the image storage means in accordance with the order of the route to the destination, and a route connecting each of the plurality of points reflected on the map stored in the map storage means.

The present invention comprises a wireless mobile phone owned by the user who is to receive directions, capable of acquiring location information indicating the user's current location measured by a GPS device via a communication network 2 by starting an application program set according to the required operation, and connected to the route guidance operator facility via the communication network to inquire about a destination using message data including voice to the operator and image data such as GPS (photo) indicating location information, and a police box server computer installed at the route guidance operator facility and operated by the operator to search for map information including unique information about the destination and other additional information to provide information in response to a destination inquiry from the user, including a route to the destination selected and registered in advance by a knowledgeable person who is familiar with the destination information, and download it to the user via the communication network 2. The present invention provides a route guidance system and method that can extract facility information such as stores and other additional information on the route to the destination inquired by the user from the map information downloaded by the police box server computer, and provide the user with the facility information and additional information.

A program that provides a computer with a photographing function that controls a mobile device that photographs a subject, an image recognition function that recognizes the subject, a display function that displays the photographed subject, a route guidance function that displays route guidance information such as the distance and direction to a destination point to which a user holding the mobile device is moving, and a character generation function that displays character images and animations generated from the user's position and direction of movement on the display function, and the character generation function is capable of generating and displaying character images and animations based on the distance and direction traveled by the user.

The present invention relates to a route guidance program for a mobile information terminal. The route guidance program of the present invention causes the mobile information terminal to determine whether or not a point before a corner has been passed for each positioning, and when the mobile information terminal determines that a point before a corner has been passed, causes the mobile information terminal to access a map and photo information providing server to download a photo image of the direction of travel at the point one point before the corner, and causes the photo image of the direction of travel at the point one point before the corner to be displayed on the image display screen.

In an embodiment of the present invention, when a user holding a mobile terminal sets a destination, route guidance to the destination can be provided. At this time, the subject is photographed using the photography function, and the subject is recognized using the image recognition function. Then, the destination set on the map is matched with the subject, and information on the direction to the destination is obtained. Based on this direction information, a character image is generated using the character generation function, and route guidance is provided by displaying it. Route guidance is also provided by generating a character image from information on the difference between the distance traveled by the user and the destination, and displaying it. Furthermore, map information including the route to the destination can be obtained and presented from current location information obtained from a GPS device and the nearest land number or building notified by the operator.

The present invention utilizes the latest technologies, such as object recognition and GPS technology, and can provide a more accurate route guidance service than ever before. The present invention can also be implemented using Java (registered trademark) application programs, etc., making it available to many users.

The road guidance method according to the present invention comprises a road guidance device, a user terminal, and a database server. The road guidance device comprises a position information acquisition unit, an image capture unit, an image analysis unit, and a road guidance information generation unit. The user terminal comprises a display unit. The database server comprises a database. The position information acquisition unit acquires the latitude and longitude of the current position of the road guidance device. The image capture unit captures an image of the scenery at that position based on the latitude and longitude acquired from the position information acquisition unit. The image analysis unit extracts landmarks from the captured image. The road guidance information generation unit generates a route to the destination.

In this invention, the "character" moves based on information such as the "direction to the destination" and the "distance," making it easy to understand the "direction to the destination" and the "distance." In addition, the "character" moves in accordance with the "recognized subject," making it easy to understand how the "recognized subject" should proceed from where it is to the "destination."

The present invention relates to a system for providing route guidance to a user when heading to a destination. The system is controlled by a mobile terminal held by the user. The system has a function for photographing a subject, an image recognition function, a display function, a map function, and a character generation function. The character generation function can generate an image of a character based on information about the direction in which the user should head to the destination by matching difference information between the distance traveled by the user and the destination, and the recognized subject with a subject on the map. The relative azimuth of each candidate evacuation site is displayed on the screen.

The candidate evacuation locations are listed in order of closest straight-line distance from the current location, and are displayed in the format of "straight-line distance from current location to candidate evacuation location," "straight-line distance from current location to candidate evacuation location," and "straight-line distance from current location to candidate evacuation location."

The present invention relates to a system that provides route guidance when a user is heading to a destination. The system operates under computer control, acquiring and processing a large number of parameters, such as the current position and direction of travel, from information obtained from a number of sensors, including cameras for photographing the subject and cameras for image recognition, as well as GPS information.

The present invention relates to a route guidance program for a mobile information terminal. The route guidance program of the present invention causes the mobile information terminal to determine whether or not a point before a corner has been passed for each positioning, and when the mobile information terminal determines that a point before a corner has been passed, causes the mobile information terminal to access a map and photo information providing server to download a photo image of the direction of travel at the point one point before the corner, and causes the photo image of the direction of travel at the point one point before the corner to be displayed on the image display screen.

The route guidance program according to the present invention is provided as an application installed on a mobile terminal. A user holds a mobile terminal and starts the route guidance program by setting a destination. The route guidance program takes a picture of the surrounding scenery using the mobile terminal's camera and recognizes the subject using image recognition technology. It matches the recognized subject with landmarks on a map and determines the landmark for which direction display is to be performed. It generates a character image based on the landmark for which direction display is to be performed, and indicates the direction in which the user should head to the destination. It also calculates and displays the remaining distance from the distance traveled by the user and the distance to the destination.

This is a navigation program for enabling a computer to have the following functions: a photographing function for controlling a portable terminal that photographs a subject; an image recognition function for recognizing the subject; an information acquisition function for acquiring information related to the photographed subject; a display function for displaying information related to the subject based on the information acquired by the information acquisition function; a group information display function for determining the group to which the subject belongs from the information acquired by the information acquisition function and displaying information related to the group; and the group information display function is characterized by being displayed in a different color, shape, etc. depending on the category to which the group belongs.
In the present invention, the "subject" includes not only man-made objects such as buildings and signs, but also natural objects.
The route guidance program according to the present invention runs on a mobile terminal such as a smartphone and provides the user with route guidance to a destination, surrounding information, etc. The user takes a picture of the surrounding scenery, buildings, etc. (hereinafter referred to as "subject") with a camera on the smartphone or the like, and the program automatically acquires and displays information related to the subject (e.g., store name, business hours, etc.) and groups (e.g., restaurant groups, etc.). In addition, the visual effect is enhanced by displaying each "group" in a different color, shape, etc.

The present invention provides a route guidance program that allows a mobile information terminal to determine the current location of the mobile information terminal at predetermined time intervals, has the mobile information terminal access a map and photo information server to download photo images of the direction of travel at points near the current location, and displays the photos of the direction of travel on the image display screen of the mobile information terminal, thereby enabling the user to reach the destination without getting lost.

A route confirmation button is displayed on the image display screen of the mobile information terminal, and when the user of the mobile information terminal clicks the route confirmation button, the mobile information terminal accesses a map and photo information server to sequentially download photos at each point in the direction of travel, and displays them on the image display screen of the mobile information terminal. The route guidance program also acquires the position information of the mobile information terminal, and calculates the distance between the current location and the destination. Then, when the distance to the destination falls below a certain value, a message indicating arrival at the destination is displayed. Furthermore, when the distance to the destination is equal to or greater than a certain value, the route guidance program also displays a character according to the direction of travel.

The route guidance program may also adopt a method of guiding the user to the nearest station, bus stop, or other location on the route from the current location to the destination where public transportation is available, and then guiding the user to the destination by public transportation from there. The route guidance program may also adopt a method of providing multiple options, such as the shortest route or the optimal route, from the current location to the destination.

The central processing unit determines that if the inclination of the camera's shooting direction is within a specified range relative to the horizontal plane, the live-action guide image is to be displayed with priority, and if the inclination of the camera's shooting direction is outside the specified range relative to the horizontal plane, the central processing unit determines that the map guide image is to be displayed with priority.

The route guidance program according to the present invention comprises a map function for setting a destination to which the user travels, an image recognition function for recognizing an object, a display function for displaying a photographed object, a character generation function for generating a character, and an image generation unit for generating an image of the character. The character generation function generates an image of the character based on difference information between the distance traveled by the user and the destination, and on information on the direction to travel to the destination by matching the recognized object with an object on the map. The image generation unit may also generate a navigation image in which the character is displayed at a position on the image in the right image area when it is determined that the character is located within a predetermined determination range based on the user's field of view on the map and that the character is located in the right area in the direction of the head or line of sight.

The route guidance program according to the present invention is executed in the following procedure. That is, the photography function photographs the subject, the image recognition function recognizes the subject, the display function displays the subject, the map function sets the user's destination, the character generation function generates a character image from the user's position information, calculates directional information from the difference information, modifies the character image from the directional information and displays it on the display screen, and if the user moves, recalculates the directional information from the difference information, modifies the character image and displays it on the display screen. The list numbers correspond to the "Examples" in the "Detailed Description of the Invention".

The mobile information terminal according to the present invention has the following functions: an artificial intelligence function; a location information detection function; a direction detection function; a photographing function; an image recognition function; a map information recording function; a destination setting function; a route calculation function; a display function for displaying an image; a destination direction display function for inputting information related to an image photographed by the photographing function, the recognized image, the photographing direction of the photographing function detected by the direction detection function, the map recorded in the map information recording function, the set destination, and the calculated route into the artificial intelligence function, the artificial intelligence function calculates the direction to the destination, and displays the direction on the image being photographed or the map displayed in the display function; a character generation and display function for generating and displaying a character using the artificial intelligence function; a route guidance display function for simultaneously displaying the photographed image or map, the destination, the route, and the generated character on the display function; and a display selection function for selecting whether the artificial intelligence function displays the image being photographed or the map based on the map according to the photographed image, the user's past usage history, the type of destination, and the characteristics of the destination area by the artificial intelligence function.

The character generation and display function can generate completely new characters based on information such as captured images, the user's past usage history, the type of destination, and the characteristics of the destination area. The character generation and display function can also change the generated character display depending on the situation. For example, this includes functions to change the character display based on the distance to the destination, the subject recognized in the image being captured, the relative number of steps to the destination, the amount of calories burned or the amount of hydration, the position of corners on the route, advertising information on the route, weather and time situation information during route guidance, directional information detected by the direction detection function, tourist information related to points on the route, and voice received from the user.

By changing the character display according to the distance to the destination, the user can recognize that they are approaching the destination, and the user can be excited. By changing the character display according to the subject recognized in the image being taken, the user can be made aware of the presence of landmarks and shops of interest, making the route guidance more enjoyable. By changing the character display according to the relative number of steps to the destination, the calorie consumption, or the amount of water intake, the user can be given route guidance in a game-like manner. By changing the character display according to the position of a corner on the route, the user can be made strongly aware of the presence of the corner. By changing the character display according to advertising information on the route, the user can be made aware of the presence of the advertisement. By changing the character display according to the weather and time situation information at the time of route guidance, the user can be given the freedom to choose an action to speed up or slow down the travel time to the destination. By changing the character display according to the direction information detected by the direction detection function, the user can be informed of whether or not they are heading in the correct direction. By changing the character display according to tourist information related to points on the route, tourist information can be efficiently conveyed to the user. Finally, by changing the character display based on the voice received from the user, the user's intention can be reflected in the route guidance.

Figure 1 is a schematic diagram showing the function of the present invention in which a character (cat) is displayed on a mobile information terminal superimposed on an image being captured to provide route guidance.

Figure 2 is a diagram showing the functions and components included in the mobile information terminal 1 according to the present invention. That is, the CPU 2 includes an artificial intelligence function, an image recognition function, a destination setting function, a route calculation function, a destination direction display function, a character generation and display function, a route guidance display function, and a display selection function, the GPS module 2 includes a position information detection function, the orientation sensor 3 includes a direction detection function, the camera 4 includes a photographing function, the memory 5 includes a map information recording function and other recording functions, and the display 6 includes a display function.

Figure 3 shows how the camera function can determine the direction the current location and the camera are facing by using artificial intelligence to match the convenience store sign information, which the camera function has image-recognized as the direction in which the camera is shooting, with the location of the convenience store on a map.

Figure 4 is a diagram illustrating how the artificial intelligence function uses artificial intelligence to generate a character.

Figure 5 illustrates how the artificial intelligence function uses a display selection function to select whether the display is based on the image being captured or on a map.

Claims (1)

On the computer,
A photographing function for taking photographs on a mobile device;
A display function for displaying an image obtained by photographing;
A function of measuring the current location of the mobile terminal by GPS;
A map function for setting a destination to which a user holding the mobile terminal is to move on a map;
A direction display function for calculating and displaying direction information from the current position to the destination
and,
The route guidance program realizes a character generating function for generating a route guidance character by superimposing it on the image, changing the character display according to the distance to the destination, changing it based on the direction information, and generating the character so that it dances with joy when the destination is approached.