HK1188821B - Method and apparatus for determining location offset information - Google Patents

Description

Method and apparatus for determining position offset information

Background Art

Service providers and device manufacturers (e.g., wireless, cellular, etc.) are continually challenged to deliver value and convenience to consumers, for example, by offering compelling services. One area of development is the use of augmented reality to provide location and navigation services to users. For example, modern user devices utilizing augmented reality can overlay graphics and text on a video image depicting the user's view. In this regard, by using a camera to generate images, a GPS receiver to accurately locate the user device's position, and a compass to determine the direction the user device is pointing, the user device can tell the user what they are viewing (e.g., points of interest (POIs), roads, terrain types, boundaries, etc.). However, such augmented reality systems rely on data (e.g., from GPS, compass, etc.) that may be inaccurate due to errors associated with the user device's position and orientation. Inaccurate placement of the real-world representation depicted on the overlaid user device display based on this inaccurate data can be unhelpful to the user and, in some cases, even cause confusion and frustration. Therefore, service providers and device manufacturers face significant technical challenges in providing users with accurate location and navigation information.

Summary of the Invention

Therefore, a method for effectively and efficiently determining position offset information is needed.

According to one embodiment, a method includes determining to present a location-based display at a device, the display including one or more representations of one or more location-based features. The method also includes receiving input specifying offset information for at least one of the one or more representations associated with the location-based display. The method further includes determining to present the one or more representations in the location-based display based at least in part on the offset information.

According to another embodiment, an apparatus includes at least one processor and at least one memory including computer program code, the at least one memory and the computer program code being configured to, utilizing the at least one processor, at least in part, cause the apparatus to determine, at a device, to present a location-based display, the display including one or more representations of one or more location-based features. The apparatus is further caused to receive input specifying offset information for at least one of the one or more representations associated with the location-based display. The apparatus is further caused to determine, based at least in part on the offset information, to present the one or more representations in the location-based display.

According to another embodiment, a computer-readable storage medium carries one or more sequences of one or more instructions that, when executed by one or more processors, cause an apparatus, at least in part, to determine to present a location-based display at a device, the display including one or more representations of one or more location-based features. The apparatus also causes the apparatus to receive input specifying offset information for at least one of the one or more representations associated with the location-based display. The apparatus further causes the apparatus to determine to present the one or more representations in the location-based display based, at least in part, on the offset information.

According to another embodiment, an apparatus includes means for determining to present a location-based display at a device, the display including one or more representations of one or more location-based features. The apparatus also includes means for receiving input specifying offset information for at least one of the one or more representations associated with the location-based display. The apparatus further includes means for determining to present the one or more representations in the location-based display based at least in part on the offset information.

Other aspects, features, and advantages of the present invention will become apparent from the following detailed description, which illustrates only a number of specific embodiments and implementations, including the best mode contemplated for carrying out the invention. The invention is also capable of other and different embodiments, and its several details may be modified in various obvious respects without departing from the spirit and scope of the invention. Accordingly, the drawings and description are to be regarded as illustrative in nature and not restrictive.

BRIEF DESCRIPTION OF THE DRAWINGS

Embodiments of the present invention are described by way of example and not by way of limitation. In the accompanying drawings:

FIG1 is a schematic diagram of a system capable of determining position offset information according to one embodiment;

FIG2 is a schematic diagram of components of a correction manager according to one embodiment;

FIG3 is a schematic diagram of components of a user equipment according to one embodiment;

FIG4 is a flow chart of a process for determining position offset information according to one embodiment;

5 is a flow diagram of a process for utilizing stored position offset information according to one embodiment;

6 is a flow chart of a process for determining an approximate location, according to one embodiment;

7A-7D are schematic diagrams of user interfaces utilized in the process of FIG. 4 , according to various embodiments;

FIG8 is a schematic diagram of a user interface utilized in the process of FIG5 according to one embodiment;

FIG9 is a schematic diagram of hardware that may be used to implement an embodiment of the present invention;

FIG10 is a schematic diagram of a chipset that can be used to implement an embodiment of the present invention; and

FIG11 is a schematic diagram of a mobile terminal (eg, a handheld device) that can be used to implement an embodiment of the present invention.

DETAILED DESCRIPTION

Examples of methods, apparatuses, and computer programs for determining position offset information are disclosed. In the following description, for purposes of explanation, numerous specific details are set forth to provide a thorough understanding of the embodiments of the present invention. However, it will be apparent to one skilled in the art that the embodiments of the present invention can be practiced without these specific details or with equivalent arrangements. In other instances, well-known structures and devices are shown in block diagram form to avoid unnecessarily obscuring the embodiments of the present invention.

Although various embodiments are described in connection with location-based displays (i.e., augmented reality displays), it is contemplated that the methods described herein can be used with any other location-based displays, including but not limited to mixed reality displays, mapping displays (e.g., two-dimensional maps, three-dimensional maps, topographic maps, etc.), navigation displays, or combinations thereof.

Figure 1 is a schematic diagram of a system capable of determining location offset information, according to one embodiment. It's becoming increasingly common for service providers and device manufacturers to bundle or make navigation and mapping services available on a wide range of user devices (e.g., mobile handsets, computers, navigation devices, etc.). Such devices can utilize location-based technologies (e.g., Global Positioning System (GPS) receivers, cellular triangulation, Assisted GPS (A-GPS), etc.) to provide navigation and mapping information. A growing trend for these services is to move beyond two-dimensional (2D) maps and provide location services based on three-dimensional (3D) maps or representations of locations and/or routes of interest. For example, modern devices can utilize augmented reality modes to overlay graphics and text on a video image showing a building in front of the user. The graphics and text overlaid on the video image can, for example, be icons or labels representing the displayed building. Building representations (e.g., icons, labels, information, etc.) can further overlay the video image based on the building's location to provide information about the building to the user. For example, the device may initially gather preliminary building information by using a camera to generate images, a GPS receiver to pinpoint the user device's location, and a compass to determine the direction the user device is pointing. Based on this preliminary information, further information about the building may be gathered from data on the device, local databases, service providers, the Internet, and/or any other place where data can be obtained. Additional information may include data such as the name or type of building, address, telephone number, description of the building, services provided by the building, and the like. As mentioned, the information provided to the user about their surroundings is not limited to buildings, but may apply to any location-based feature such as the user's location, other locations, POIs, roads, terrain features, boundaries, and the like.

However, such augmented reality systems rely on data (e.g., from a GPS receiver, a compass, etc.) that may be inaccurate due to errors associated with the user device's location, orientation, etc. For example, a GPS receiver on a mobile device may only provide a location accuracy of approximately 20 meters, while a compass within the mobile device may only provide a direction accuracy of approximately 20 degrees. Consequently, these errors can result in incorrect placement of graphics or textual representations overlaying the real world, such as depicted on a mobile device display. These inaccuracies can cause significant problems for users, particularly in situations where location-based features are closely spaced (e.g., two restaurants with different ratings side by side, the boundaries of multiple adjacent cities, etc.).

To address this issue, system 100 of FIG. 1 introduces the ability to specify offset information for representations of location-based features and then present the representations on the location-based display based on the offset information. More specifically, system 100 may receive the offset information, for example, from a user. By way of example, the user may enter the offset information into a user device by typing the offset information, dragging the representation (e.g., using a mouse, a touchscreen, etc.) to the correct location in the location-based display, or through some other similar means. The user may enter the offset information for each representation sequentially, or the user may choose to apply the user-provided offset information to a group of representations. The group of representations may include representations manually selected by the user, representations currently visible on the location-based display, representations available in a predetermined area, or all representations generated or available to system 100. If the significant error is in the location information (e.g., geographic coordinates) of a specific location-based feature (e.g., a specific POI), the user may only want to apply the offset information to the representations for that specific location-based feature. However, if the significant error is in directional information that significantly affects the placement of many representations, the user may want to apply the offset information to a group of representations (e.g., representations available in a predetermined area). Furthermore, the received offset information can also be automatically applied to a representation or a group of representations.

In some embodiments, system 100 can recognize that a user can return to a specific location and, therefore, can store the offset information and any other relevant information for later use. Thus, the offset information can also be received from memory. Furthermore, the offset information can be transmitted to other devices in the area. Thus, other devices can use the offset information to present other location-based displays. Similarly, the offset information can be received from other devices.

In other embodiments, the location-based display may be based on position information and/or orientation information. In this regard, system 100 may be capable of determining accuracy information associated with the position information and/or orientation information and then presenting a representation based on this accuracy information. In one example, system 100 may be capable of determining that a compass used by a user has an accuracy of +/- 20 degrees and then presenting a representation based on this determination. In another example, system 100 may determine accuracy information using other position or orientation metrics, such as from a gyroscope, accelerometer, magnetometer, etc., utilized by the user's device. In a further example, if it is determined that the accuracy information meets a predetermined accuracy threshold, system 100 may rely solely or primarily on sensor data, rather than using offset information, to make adjustments within the location-based display. For example, it may be determined that an accuracy of +/- 20 degrees does not meet the predetermined accuracy threshold. However, it may be determined that an accuracy of +/- 5 degrees is sufficiently narrow to meet the predetermined accuracy threshold.

More specifically, system 100 can present a location-based display at a device that includes one or more representations of one or more location-based features. Representations can include icons, labels, information, or anything else that can be used to represent location-based features. Location-based features can include the user's location, other locations, POIs, roads, terrain types, boundaries, or any other characteristic of a location (or locations). System 100 can then receive input for specifying offset information for at least one of the one or more representations associated with the location-based display. As previously discussed, input for specifying offset information can be received from the user, from the device or from memory available to the device, from another device, and so on. In this regard, system 100 can further present one or more representations on the location-based display based on the offset information.

As shown in Figure 1, system 100 includes a user equipment (UE) 101 connected to a mapping platform 103 via a communication network 105. Applications 107 on UE 101 (e.g., augmented reality applications 107, navigation applications 107, etc.) can utilize mapping information. Applications 107 can also include a correction manager 109 to correct the mapping information in location-based displays generated by applications 107. It is noted that correction manager 109 can be included in UE 101 as shown, or can be provided and operated by mapping platform 103. Furthermore, mapping information can be included in a map database 111 associated with mapping platform 103 for access by applications 107. In certain embodiments, mapping information is information that can be used by augmented display applications 107 to provide users with location-based features (e.g., the user's location, other locations, points of interest, roads, terrain features, boundaries, etc.) and related information. Mapping information may also include maps, satellite imagery, POI information, street and path information, terrain information, boundary information, signing information associated with the map, objects and buildings associated with the map, information about people and their locations, coordinate information associated with the above information, and the like, or a combination thereof. A POI may be a specific point of location that a person may find interesting or useful, for example. Examples of points of interest may include airports, bakeries, dams, landmarks, restaurants, hotels, a person's location, or any point that is interesting, useful, or significant in some way. Examples of boundaries may include the boundaries of real estate, private and public recreational areas, schools, roads, buildings, regions, cities, counties/provinces, states, countries, continents, and/or any area with boundaries or definitions.

In some embodiments, the mapping information may be associated with content information including real-time media (e.g., streaming broadcasts), stored media (e.g., stored on a network or locally), metadata associated with the media, textual information, location information of other user devices, or a combination thereof. The content may be provided by a service platform 113, which may include one or more services 115a-115n (e.g., music services, mapping services, video services, social networking services, content broadcast services, etc.), one or more content providers (not shown) (e.g., online content retailers, public databases, etc.), or other content sources available or accessible on the communication network 105. For example, the application 107 may display location-related content information (e.g., content associated with a POI or a specific location) in a location-based display, in addition to or in lieu of POI information and/or other mapping information.

In one embodiment, the image capture module 117 of the UE 101 can be utilized in conjunction with an augmented reality application 107 to present mapping information to the user. For example, an augmented reality interface associated with an augmented reality application 107 or a navigation application 107 that presents mapping information, content information, and the like on a location-based display can be presented to the user. In some embodiments, the user interface can display a hybrid physical and virtual environment in which 3D objects from a map database 111 are superimposed on a live image (e.g., via a camera of the UE 101) or a pre-recorded image (e.g., a 360° panoramic image) of the corresponding location. In another embodiment, the mapping information and the map presented to the user can be a simulated 3D environment as an alternative to or in addition to the live augmented reality display. Accordingly, the correction manager 109 can operate on the augmented reality location-based display, the simulated 3D display, and/or other location-based displays to correct the mapping information presented therein.

We note that UE 101 can execute one or more applications 107 to view or access mapping information. As mentioned above, the mapping information can include POI information, location information, directions or associations to locations, or a combination thereof. In one example, a default setting can allow a user to view information about POIs, buildings, and other objects associated with a location that are associated with an augmented reality display or 3D environment. In a typical use case, a user can point UE 101 at a location-based feature (e.g., a POI) in a location-based display to view the corresponding information. More specifically, application 107 (e.g., augmented reality application 107) can associate the location-based feature with geographic coordinates (e.g., from satellite 119) based on a determined observation point. Application 107 can then obtain information corresponding to the location from mapping platform 103 for presentation in the location-based display.

In another typical use case, when a user points UE 101 toward a location-based feature (e.g., a POI) or in a general direction, UE 101 may present one or more representations of one or more location-based features (e.g., a POI) on a location-based display. The placement of the representations on the location-based display may be based not only on the UE 101's location, heading reference, and tilt angle, but also on the geographic coordinates of the respective location-based features. As previously mentioned, the placement of the representations may be imprecise due to various reasons, such as errors associated with the UE 101's location, orientation, etc. Therefore, the correction manager 109 may accept, for example, offset information for the representations from the user. In this example, the user may provide the offset information by typing the offset information, by dragging the representations (e.g., using a mouse, a touchscreen, etc.), or by some other similar means. As discussed above, the user may enter the offset information for each representation sequentially, or the user may choose to apply the user-provided offset information to a group of representations. Furthermore, the received offset information may be automatically applied to a representation or a group of representations.

By way of example, the communication network 105 of the system 100 includes one or more networks such as a data network (not shown), a wireless network (not shown), a telephone network (not shown), or any combination thereof. It is contemplated that the data network can be any local area network (LAN), a metropolitan area network (MAN), a wide area network (WAN), a public data network (e.g., the Internet), a short-range wireless network, or any other suitable packet-switched network such as a commercial packet-switched network, a proprietary packet-switched network (e.g., a proprietary cable or fiber optic network), or any combination thereof. In addition, the wireless network can be, for example, a cellular network, and can adopt various technologies including Enhanced Data Rates for Global Evolution (EDGE), General Packet Radio Service (GPRS), Global System for Mobile Communications (GSM), Internet Protocol Multimedia Subsystem (IMS), Universal Mobile Telecommunications System (UMTS), etc., and any other suitable wireless media (such as Worldwide Interoperability for Microwave Access (WIMAX), Long Term Evolution (LTE) network, Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Wireless Fidelity (WiFi), Wireless Local Area Network (WLAN), Bluetooth, Internet Protocol (IP) data broadcast, satellite, mobile ad-hoc network (MANET), etc.) or any combination of the above.

UE 101 is any type of mobile, fixed, or portable terminal, including a mobile handheld device, a station, a unit, a device, a multimedia computer, a multimedia tablet, an Internet node, a communicator, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a personal computer system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio/video player, a digital camera/camcorder, a positioning device, a television receiver, a radio receiver, an electronic book device, a gaming device, or any combination thereof, including accessories and peripherals thereof. It is also contemplated that UE 101 may support any type of interface to the user (e.g., "wearable" circuitry, etc.).

In another embodiment, calibration manager 109 may store the offset information along with any other relevant information. The information may be stored in UE 101 (e.g., cache memory, memory, hard drive, etc.), a local database, map database 111, or any other storage device accessible via communication network 105. Calibration manager 109 may further apply the stored offset information to one or more other location-based displays presented based on location information that is substantially similar to, or within, a predetermined proximity of, the location information associated with the location-based display. In a typical use case, a user may be a regular morning visitor to a particular cafe. In this context, as the user walks toward the cafe, calibration manager 109 may recognize that the current location information is substantially similar to, or within a predetermined proximity of, the location information of a previous location-based display. Therefore, calibration manager 109 may apply the stored offset information to the current location-based display, for example, by automatically calibrating UE 101 based on the stored offset information. Thus, when the user walks to the cafe every morning, the user can automatically see, for example, the cafe's daily specials precisely overlaid on the cafe in the location-based display of the UE 101 .

In another embodiment, the correction manager 109 may transmit the offset information to one or more other devices within the vicinity of the device, where the offset information is used to present other location-based displays at the corresponding other devices. By way of example, a typical coffee shop may have many customers holding mobile devices at any time during its business hours. When the correction manager 109 receives the offset information from a user, for example, it may then transmit the offset information to other UEs 101 within the vicinity of the user's UE 101. The correction managers 109 of the other UEs 101 may then correct the placement of representations on the corresponding location-based displays based on the transmitted offset information.

In another embodiment, the correction manager 109 may obtain other offset information associated with one or more other devices, other offset information collected at one or more other times, or a combination thereof. The correction manager 109 may then generate aggregated offset information based on the offset information, the other offset information, or a combination thereof. As provided, the correction manager 109 may obtain and/or store a collection of offset information. By way of example, the offset information and/or the other offset information may be combined and then averaged to generate the aggregated offset information. In addition, for example, based on the relative closeness of the location associated with the other offset information to the location associated with the offset information, a default or user-defined weight may be assigned to the offset information, while individual weights may be assigned to the other offset information automatically or by the user. Thus, the correction manager 109 may generate the aggregated offset information based on the weights assigned to the offset information and/or the other offset information.

In another embodiment, the calibration manager 109 may categorize the offset information, other offset information, or a combination thereof based on at least one device, a type of location sensor, a source of the location information, or a combination thereof, wherein the aggregate offset information is further based on the categorization. For example, in addition to relative proximity, the calibration manager 109 may identify that certain device types have more accurate sensor devices than other device types, or that a particular location sensor is more accurate than other location sensors. Based on this information, the offset information and/or other offset information may be assigned respective weights, either automatically or by a user. Thus, the calibration manager 109 may generate aggregate offset information based on the weights assigned to the offset information and/or other offset information.

By way of example, UE 101, mapping platform 103, and service platform 113 communicate with each other and with other components of communication network 105 using known, new, or still-developing protocols. In this context, a protocol comprises a set of rules that define how network nodes within communication network 105 interact with each other based on the information sent over communication links. Protocols operate at different operational levels within each node, from generating and receiving various types of physical signals, to selecting the links used to transmit those signals, to the format of the information represented by those signals, to identifying which software application executing on the computer system is sending or receiving information. The conceptually different layers of protocols used to exchange information on a network are described in the Open Systems Interconnection (OSI) reference model.

Communication between network nodes is typically effected by exchanging discrete packets of data. Each packet typically includes: (1) header information associated with a particular protocol; and (2) payload information, which follows the header information and contains information that can be processed independently of the particular protocol. In some protocols, the packet includes (3) trailer information that follows the payload and indicates the end of the payload information. The header includes information such as the source of the packet, its destination, the length of the payload, and other attributes used by the protocol. Typically, the data in the payload for a particular protocol includes headers for different protocols associated with different higher layers of the OSI reference model, as well as payloads. The header for a particular protocol typically indicates the type of next protocol included in its payload. As described, higher layer protocols are encapsulated in lower layer protocols. The headers included in a packet traversing multiple heterogeneous networks such as the Internet typically include a physical (layer 1) header, a data-link (layer 2) header, an internetwork (layer 3) header, and a transport (layer 4) header as defined in the OSI reference model, as well as various application headers (layers 5, 6, and 7).

Figure 2 is a schematic diagram of the components of a correction manager according to one embodiment. By way of example, correction manager 109 includes one or more components for providing position offset information. It is contemplated that the functionality of these components may be combined in one or more components or performed by other components of equivalent functionality. In this embodiment, correction manager 109 includes control logic 201, which executes at least one algorithm for performing the functions of correction manager 109. For example, control logic 201 interacts with rendering module 203 to render or display graphical information (e.g., POI information) on a location-based display of UE 101. In one embodiment, rendering module 203 presents an augmented reality display by instructing UE 101's image capture module 117 to provide the user with a live camera view of UE 101's current location. Image capture module 117 may include a camera, video camera, and/or other imaging device. In one embodiment, visual media is captured in the form of an image or a series of images. These images are then presented in the location-based display by rendering module 203.

In addition to or in lieu of augmented reality displays, the rendering module 203 can provide a location-based display using a non-reality-based representation of a specific location as described above (e.g., a 3D simulated environment or other rendered map). For example, the rendering module 203 can obtain mapping data (e.g., 3D models, map tiles, map images, terrain features, etc.) from the map database 111 or the map platform 103 to render the location-based display.

After obtaining an underlying location-based display (e.g., an augmented reality display or a rendered map), the rendering module 203 retrieves mapping information (e.g., POI information) to determine which location-based features are visible in the display. The rendering module 203 then renders representations of the visible location-based features in the location-based display based at least in part on their location information and/or orientation information. In other words, the rendering module 203 renders the representations of the location-based features so that the representations of the location-based features are displayed in the location-based display at locations corresponding to their location information and/or orientation information.

Next, control logic 201 instructs selection module 205 to receive input from UE 101 for selecting a plurality of representations to which the received offset information can be applied. By way of example, a group can be manually selected by the user from the location-based display. For example, the user can tap a group of overlapping or closely located representations to select the entire group. Furthermore, the group can include representations currently visible on the location-based display, representations available in a predetermined area, or all representations available to or generated by correction manager 109.

Further, the control logic 201 cooperates with the comparison module 207 to determine whether the offset information should be applied or the extent to which the offset information should be applied. In one typical use case, the comparison module 207 can determine that, for example, accuracy information associated with the location information and/or direction information meets a predetermined accuracy threshold. Thus, the comparison module 207 can recommend the application of reduced offset information to present a representation on a location-based display. In another typical use case, the comparison module 207 can determine whether to apply the stored offset information to other location-based displays. For example, if the comparison module 207 determines that the location information of the other location-based displays is substantially close to or within a predetermined proximity range of the location information associated with the location-based display for which the stored offset information was received, the stored offset information can be employed.

FIG3 is a diagram of components of a user equipment according to one embodiment. By way of example, UE 101 includes one or more components for providing location offset information. It is contemplated that the functionality of these components may be combined in one or more components or performed by other components of equivalent functionality. In this embodiment, UE 101 includes: (1) a user interface 301 for presenting a location-based display including, for example, a representation of a location-based feature, and receiving input for specifying offset information for the representation associated with the location-based display; (2) a map platform interface 303 for retrieving content and drawing information from a map platform 103 and/or a service platform 113; (3) a runtime module 305 for executing one or more applications (e.g., an augmented reality application 107, a navigation application 107); (4) a cache memory 307 for locally storing drawing information and/or associated content information; (5) a location module 309 for determining the location of UE 101; (6) a magnetometer module 311 for determining the horizontal direction and directional heading (e.g., compass heading) of UE 101; and (7) an accelerometer module 313 for determining the vertical direction or elevation angle of UE 101; and (8) an image capture module 117.

Location-based displays can be presented to the user via user interface 301, which can include various communication methods. For example, user interface 301 can have outputs including visual components (e.g., a screen), audio components (e.g., verbal commands), physical components (e.g., tactile feedback), and other communication methods. User input can include a touchscreen interface, a speaker, a camera, a scroll-and-click interface, a button interface, and the like. Furthermore, a user can input a request to launch an application 107 (e.g., an augmented reality or navigation application) and utilize user interface 301 to receive a location-based display including POIs and/or other graphical information. Through user interface 301, a user can request the presentation of different types of content, graphics, or location information. Furthermore, a 3D or augmented reality representation of a specific location and associated objects (e.g., buildings, terrain features, POIs, etc. at the specific location) can be presented to the user as part of a graphical user interface on the screen of UE 101.

The runtime module 305 communicates with the mapping platform 103 using the mapping platform interface 303. In some embodiments, the interface is used to obtain content, graphics, and/or location information from the mapping platform 103, the service platform 113, and/or a content provider (not shown). The UE 101 can retrieve the graphics and content information using a request in a client-server format. Furthermore, the UE 101 can specify location information and/or direction information in the request to retrieve the graphics and content information. The location module 309, the magnetometer module 311, the accelerometer module 313, and the image capture module 117 can be used to determine the location and/or direction information to determine the direction in which the UE 101 is pointed (e.g., the viewpoint of the UE 101), so that the graphics and content information corresponding to the pointed direction can be retrieved. Furthermore, the graphics and content information can be stored in the cache memory 307 for use in correcting the location-based display at the UE 101.

In one embodiment, the location module 309 can determine the user's location. The user's location can be determined by a triangulation system such as GPS, assisted GPS (A-GPS), origin cell, wireless local area network triangulation, or other location inference technology. Standard GPS and A-GPS systems can use satellites 119 to accurately pinpoint the location of UE 101 (e.g., longitude, latitude, and altitude). The origin cell system can be used to determine the cellular tower with which UE 101 is synchronized. This information provides a rough location of UE 101, as cellular towers can have unique cellular identifiers (cell-IDs) that can be geographically mapped. The location module 309 can also use a variety of technologies to detect the location of UE 101. GPS coordinates can provide finer details about the location of UE 101. As described above, the location module 309 can be used to determine location coordinates used by application 107 and/or mapping platform 103.

The magnetometer module 311 may include an instrument capable of measuring the strength and/or direction of a magnetic field. Using the same methods as a compass, the magnetometer can determine the directional heading of the UE 101 using the Earth's magnetic field. The front end of the image capture device (e.g., a digital camera) (or another reference point on the UE 101) can be marked as a reference point in the determined direction. Thus, if the magnetic field points north relative to the reference point, the angle by which the UE 101 reference point deviates from the magnetic field is known. A simple calculation can be performed to determine the direction of the UE 101. In one embodiment, horizontal direction data obtained from the magnetometer is used to determine the user's direction. The direction information can be corrected using the UE 101's location information to determine where the UE 101 is pointing (e.g., at what geographic feature, object, or point of interest). This information can be used to select a first-person perspective for rendering graphics and content information in a location-based display.

Furthermore, the accelerometer 313 may include an instrument capable of measuring acceleration. A three-axis accelerometer with X, Y, and Z axes is used to provide acceleration in three directions with known angles. The front of the media capture device can again be marked as a reference point in the determined direction. Because the acceleration due to gravity is known, when the UE 101 is stationary, the accelerometer module 313 can determine the angle at which the UE 101 is pointed relative to the Earth's gravity. In one embodiment, vertical direction data obtained from the accelerometer is used to determine the elevation or tilt angle at which the UE 101 is pointed. Information combining magnetometer information and location information is used to determine a viewpoint for providing content and mapping information to the user. In this regard, this information can be used to select available content items to present navigation information to the user. Furthermore, the combined information can be used to determine portions of a particular 3D map or augmented reality view that may be of interest to the user. In one embodiment, if the location information associated with one or more available content items does not correspond to the viewpoint (e.g., is not visible from the selected viewpoint), one or more indicators (e.g., arrows or pointers) can be displayed on the user interface to indicate the direction toward the location of the content items.

In another embodiment, rather than determining the viewpoint from the sensors, the user can manually input any one or more of a location, a directional heading, and a tilt angle to specify a viewpoint for displaying a user interface on the UE 101. In this way, the user can select a "virtual viewpoint" as a location rather than the current location and orientation of the UE 101.

An image capture module 117 can be used to capture images used to support a graphical user interface. The image capture module 117 can include a camera, a video camera, a combination thereof, or the like. In one embodiment, the visual media is captured in the form of an image or a series of images. The image capture module 117 can obtain an image from a camera and associate the image with position information, magnetometer information, accelerometer information, or a combination thereof. As described above, by combining the user's position, the user's horizontal orientation information, and the user's vertical orientation information, the combination of information can be used to determine the user's point of view. This information can be used to retrieve mapping and content information from the map cache 307 or the map platform 103. In some embodiments, the cache 307 includes all or part of the information in the map database 111.

FIG4 is a flow chart of a process for determining position offset information according to one embodiment. In one embodiment, correction manager 109 performs process 400 and is implemented in, for example, a chipset including a processor and memory as shown in FIG10 . In this regard, control logic 201 may provide components for performing portions of process 400 and components for performing other processes in conjunction with other components of correction manager 109.

In step 401, control logic 201 determines to present a location-based display at a device that includes one or more representations of one or more location-based features. The one or more location-based features may include a user's location, other locations, POIs, roads, types of terrain, boundaries, or any other characteristics of a location (or locations). In one embodiment, the presented location-based display may be based on location information, directional information, or a combination thereof associated with the device. For example, the location-based display may include an image captured by the device or a viewable image on the device's viewfinder.

In step 403, control logic 201 may verify whether accuracy information associated with the location information, direction information, or a combination thereof has been determined. If accuracy information has not been determined, control logic 201 may then receive input specifying offset information for at least one of the one or more representations associated with the location-based display in step 405. As described above, input may be received from various sources, including from a user, from memory on or accessible to the device, from other devices, and the like. In one embodiment, input is provided as movement of at least one of the one or more representations. For example, a user may provide input specifying offset information by dragging a representation to a correct location within the location-based display. Control logic 201 may then determine, in step 407, to present the one or more representations in the location-based display based at least in part on the offset information.

However, if control logic 201 is able to confirm that the accuracy information has been determined, then control logic may determine in step 409 whether the accuracy information meets a predetermined accuracy threshold. In a typical use case, it may be initially determined that the component (or components) used by UE 101 to measure direction, such as a compass, gyroscope, accelerometer, magnetometer, etc., has an accuracy of +/- 20 degrees. In this regard, control logic 201 may determine that the predetermined accuracy threshold has not been met. However, if it is later determined that the direction-measuring component has an accuracy of +/- 5 degrees, control logic 201 may determine that the predetermined accuracy threshold has been met. For example, a user may be in a particular area with a large amount of ferrous metal. As the user leaves this area, the accuracy of the direction-measuring component may improve. In another typical use case, the user may be traveling through an area without significant wireless interference or signal blockage. In these circumstances, it may be initially determined that the GPS receiver utilized by UE 101 has an accuracy of +/- 5 meters, which may meet the predetermined accuracy threshold. However, when the user is walking into town or under a bridge, it may be determined that the GPS receiver has an accuracy of +/- 20 meters, which may not be accurate enough to meet the predetermined accuracy threshold.

If control logic 201 determines that the predetermined accuracy threshold has been met, control logic 201 may determine to reduce application of the offset information to present one or more representations in step 411. In this regard, the offset information may not be utilized to adjust one or more representations within the position-based display.

FIG5 is a flow chart of a process for utilizing stored position offset information, according to one embodiment. In one embodiment, the correction manager 109 performs the process 500 and is implemented in, for example, a chipset including a processor and memory as shown in FIG10 . In this regard, the control logic 201 may provide components for performing portions of the process 500 and components for performing other processes in conjunction with other components of the correction manager 109.

In step 501 , the control logic 201 determines the offset information. As described above, the information may be stored at the UE 101 (eg, cache, memory, hard drive, etc.), a local database, a map database 111 , or any other storage device available via the communication network 105 .

Before determining to apply the stored offset information to one or more other location-based displays, control logic 201 may determine, in step 503, whether the location information associated with the one or more other location-based displays is substantially close to or within a predetermined proximity of the location information associated with the location-based display for which the stored offset information was received. For example, if the control logic determines that the location information associated with the one or more other location-based displays is not substantially close to or within the predetermined proximity, the stored offset information may not be applied to the one or more other location-based displays. In a typical use case, a user may have recently shopped at a grocery store in a particular shopping mall. Although the user may return to the shopping mall at a later time (e.g., to study at a cafe at the other end of the shopping mall), control logic 201 may determine that returning to the shopping mall is not substantially close to or within the predetermined proximity of the grocery store. Thus, in this example, the stored offset information may not be applied to the location-based display that presents the user returning to the shopping mall.

However, if it is determined that one or more other location-based displays are substantially close to or within the predetermined proximity, the control logic 201 may apply the stored offset information in presenting the one or more other location-based displays in step 505 .

FIG6 is a flow chart of a process for determining an approximate location, according to one embodiment. In one embodiment, the correction manager 109 performs the process 600 and is implemented in, for example, a chipset including a processor and memory as shown in FIG10. In this regard, the control logic 201 may provide components for performing portions of the process 600 and components for performing other processes in conjunction with other components of the correction manager 109.

In step 601, control logic 201 receives input specifying an approximate location or the location of UE 101 or a user of UE 101. In one embodiment, the specified approximate location can serve as a starting point for navigation services, mapping services, or other location-based services. For example, if an initial sensor-based location fix (e.g., a GPS fix) is delayed or otherwise unavailable, the user can still manually indicate an approximate location to initiate a service. As mentioned, input can be received from various sources (including from the user, from memory on or accessible to the device, from other devices, etc.). The received input can be used to specify the user's approximate location, other users, a starting location, etc. In one embodiment, offset information specified by the input can also specify or otherwise indicate the approximate location of UE 101 or the user. By way of example, the user can provide input by moving at least one representation. In this regard, the user can drag the representation of the user's location to a desired location in the location-based display. Similarly, the user can drag the representation of the location (e.g., by simply dragging a map layer) so that the user's location ultimately arrives at a desired location in the location-based display. In addition, the user can provide input in many other ways, including indicating an approximate location within a location-based display (e.g., by clicking or tapping on a specific location), entering the address of a specific location, capturing an image of the user's surroundings (e.g., taking a picture using a camera module of UE101) to indicate a specific location, etc.

In step 603, control logic 201 may determine whether location information is already available, for example, from a GPS receiver of UE 101. If control logic 201 determines that location information is not available, control logic 201 may present a representation in a location-based display based on the received input in step 605.

However, if the control logic 201 determines that location information is available, the control logic 201 may determine whether to utilize the location information in step 607. In a typical use case, the control logic 201 may prompt the user, via the UE 101, to decide whether to utilize the received input provided by the user, the location information provided by the GPS receiver, or both in presenting a representation in the location-based display. For example, if the user decides to utilize both the received input and the location information, the control logic 201 may present the received input and the location information as different representations on the location-based display (e.g., a pink dot is used to present the received input, while a red dot is used to represent the GPS location information).

In another typical use case, the determination of whether to utilize location information can be based on whether the location information provided by the GPS receiver meets a predetermined accuracy threshold. If the control logic 201 determines that the location information should not be utilized (e.g., the predetermined accuracy threshold is not met), then the presentation of the representation in the location-based display can be based on the received input provided by the user. Otherwise, as mentioned, the location information can be utilized in addition to or in lieu of the received input provided by the user to present the representation in the location-based display.

Figures 7A-7D are schematic diagrams of user interfaces utilized in the process of Figure 4, according to various embodiments. Specifically, Figures 7A-7D are examples of user interfaces utilizing an augmented reality display that utilizes star-shaped icons to indicate location-based features (e.g., POIs) within a viewing point. Because the user interface is an augmented reality display, the image displayed in the drawing is, for example, a live image of a town square.

Figure 7A shows a user interface with three star-shaped icons (e.g., representations 701, 703, and 705) representing three different POIs. In this example, representations 701, 703, and 705 appear to be accurately superimposed on the location-based display of the town square, at least with respect to their location information and/or horizontal orientation. However, the vertical orientation (e.g., height) is clearly inaccurate. For example, representations 701 and 705 appear to be between the first and second floors, while representation 703 appears to be between the second floor and the roof of the building.

Figure 7B shows a user interface with six star icons (e.g., representations 711, 713, 715, 717, 719, and 721) and a hand symbol 723. As shown, the three star icons with dashed lines (e.g., representations 711, 713, and 715) depict the locations where representations 701, 703, and 705 were located, while the three star icons with solid lines (e.g., representations 717, 719, and 721) indicate where they have moved to. Hand symbol 723 illustrates the ability to provide offset information by dragging a representation to the correct location within the location-based display of the town square. In this example, the user can provide input specifying offset information for all representations within the location-based display by moving or dragging just one representation, such as representation 721 (or the original representation 705).

Figure 7C shows a user interface with three star icons (e.g., representations 731, 733, and 735) and three labels (representations 737, 739, and 741). As shown, the labels, including the name of the POI (or type of POI) and the distance to the user, are overlaid just below the star icons. In this example, the previous movement or dragging of only one star icon provides offset information for visible and generated representations (e.g., representations 731, 733, and 735) and for invisible representations that may not have been generated at the time the user provided the offset information.

7D shows a user interface with a fully visible star icon (e.g., representation 751) and an overview (e.g., representation 753) providing information about a particular POI (e.g., a hotel). In this example, the overview may appear automatically or through some user action (e.g., clicking or tapping on a particular star icon).

FIG8 is a schematic diagram of a user interface utilized in the process of FIG5 , according to one embodiment. Specifically, FIG8 provides examples of user interfaces utilized in navigation displays (e.g., user interfaces 800 , 810 , 820 , 830 , 840 , 850 , 860 , and 870 ). By way of example, user interface 800 provides the user with several options, including “Location,” “Route,” “Find,” “Favorites,” “Set,” and “Cancel.” In this use case, the user has selected the “Route” option, which causes user interface 810 to appear.

User interface 810 provides the user with several options, including "Start Location," "Destination," "Add Destination," "Go!", and "Cancel." In this example, the start location and destination may be predetermined (e.g., the last known start location or destination). Thus, the user can immediately select "Go!". However, the user can also review, modify, or confirm the start location or destination by selecting "Start Location" or "Destination." In this use case, the user has already selected "Start Location," which causes user interface 820 to appear.

User interface 820 provides the user with several options, including "My Location," "Places," "Addresses," "Favorites," and "Cancel." In this use case, the user has selected "My Location," which allows the user to update the user's location or use the user's last known location. As illustrated in user interface 830, the user has selected "Update Now" instead of "Use Last Known."

As mentioned above, a user can provide a starting location in many ways (e.g., "My Location"). As shown, user interface 840 indicates that the user can "Adjust on Map," "Enter Address," or "Take a Photo" to provide a starting location. In this use case, the user has chosen to provide a starting location by adjusting the starting location on the map. In this regard, user interface 850 displays a map with the user's starting location labeled "A." The user's starting location is shown as 123 Last Road, which may be the user's last known location. To see a magnified version of the map, the user has clicked the magnifying glass icon with a "+" symbol.

In response, user interface 860 displays a zoomed-in version of the map with the user's starting location labeled "A." As described above, the user can adjust the starting location in a number of ways (e.g., moving at least one representation, clicking on a location on the map, etc.), such as dragging the starting location labeled "A," dragging a map layer, or clicking on a location on the map. In this use case, the user has selected to drag the map layer in order to adjust the user's starting location on the map. Thus, as shown in user interface 870, the user's starting location has been modified to 456 Now Street. The user then selects "Done" to begin further navigation.

Figure 9 illustrates a computer system 900 on which embodiments of the present invention may be implemented. Although computer system 900 is described with respect to a specific device or apparatus, it is contemplated that other devices or apparatuses (e.g., network elements, servers, etc.) in Figure 9 may implement the hardware and components of the illustrated system 900. Computer system 900 is programmed (e.g., via computer program code or instructions) to determine the position offset information described herein and includes communication structures such as a bus for passing information between other internal and external components of computer system 900. Information (also known as data) is represented as a physical representation of a measurable phenomenon, typically electron voltage, but in other embodiments includes phenomena such as magnetic, electromagnetic, pressure, chemical, biological, molecular, atomic, subatomic, and quantum interactions. For example, north and south electromagnetic fields or zero and nonzero voltage represent the two states (0, 1) of a binary digit (bit). Other phenomena may represent digits in higher bases. A superposition of multiple simultaneous quantum states before measurement represents a qubit. A sequence of one or more digits constitutes digital data, which is used to represent a number or code for a character. In some embodiments, information, referred to as analog data, is represented by a nearly continuous stream of measurable values within a specific range. Computer system 900, or a portion thereof, constitutes a means for performing one or more steps of determining position offset information.

The bus 910 includes one or more information conductors for quickly transferring information between devices coupled to the bus 910. One or more processors 902 are coupled to the bus 910 for processing information.

Processor (or multiple processors) 902 performs a set of operations related to determining position offset information, as specified by computer program code. Computer program code is a set of instructions, or statements providing instructions, for operating a processor and/or computer system to perform specified functions. For example, the code may be written in a computer programming language and compiled into the processor's native instruction set. The code may also be written directly using the native instruction set (e.g., its language). The set of operations includes: bringing information from bus 910 and placing information onto bus 910. The set of operations also typically includes: comparing two or more units of information; changing the positions of units of information; and combining two or more units of information, such as by addition, multiplication, or logical operations like OR. Each operation of the set of instructions that can be performed by the processor is represented to the processor by information called an instruction, such as an operation code of one or more digits. A series of operations (such as a series of operation codes) performed by processor 902 constitutes processor instructions, also known as computer system instructions, or simply computer instructions. The processor may be implemented as mechanical, electrical, magnetic, optical, chemical, or quantum components, alone or in combination.

Computer system 900 also includes memory 904 coupled to bus 910. Memory 904, such as random access memory (RAM) or any other dynamic storage device, stores information, including processor instructions for determining location offset information. Dynamic memory allows information stored therein to be changed by computer system 900. RAM allows a unit of information stored at a location known as a memory address to be stored and retrieved independently of information at neighboring addresses. Memory 904 is also used by processor 902 to store temporary values during the execution of processor instructions. Computer system 900 also includes read-only memory (ROM) 906 or any other static storage device coupled to bus 910 for storing static information, including instructions, that is not changed by computer system 900. Some memory includes volatile storage, which loses information stored thereon when power is removed. Non-volatile (permanent) storage 908, such as a magnetic disk, optical disk, or flash memory card, is also coupled to bus 910 for storing information, including instructions, that persists even when computer system 900 is shut down or otherwise powered off.

Information, including instructions for determining positional offset information, is provided to bus 910 from an external input device 912, such as a keyboard with alphanumeric keys operated by a human user or a sensor, for use by the processor. Sensors detect conditions in their vicinity and convert those detections into physical expressions consistent with measurable phenomena representing information in computer system 900. Other external devices coupled to bus 910, primarily for human interaction, include: a display device 914, such as a cathode ray tube (CRT), liquid crystal display (LCD), light emitting diode (LED) display, and organic light emitting diode (OLED); and a pointing device 916, such as a mouse, trackball, cursor direction keys, or motion sensor, for controlling the position of a small cursor displayed on display 914 and issuing instructions associated with graphical elements displayed on display 914. In some embodiments, such as those in which computer system 900 performs all functions automatically without human input, one or more of external input device 912, display device 914, and pointing device 916 are omitted.

In the illustrated real-time example, specialized hardware, such as an application-specific integrated circuit (ASIC) 920, is coupled to bus 910. The specialized hardware is configured to perform operations not performed by processor 902 quickly enough for a specific purpose. Examples of ASICs include graphics accelerator cards for generating images for display 914; cryptographic boards for encrypting and decrypting messages transmitted over a network; speech recognizers; and interfaces to specialized external devices, such as robotic arms and medical scanning equipment, that repeatedly perform some complex series of operations that are more efficiently implemented in hardware.

Computer system 900 also includes one or more instances of a communication interface 970 coupled to bus 910. Communication interface 970 provides one-way or two-way communication coupling to various external devices, such as printers, scanners, and external disks, operating in conjunction with its own processor. Generally, this coupling utilizes a network link 978 to connect to a local network 980, which connects various external devices with their own processors. For example, communication interface 970 may be a parallel port, a serial port, or a Universal Serial Bus (USB) port on a personal computer. In some embodiments, communication interface 970 is an Integrated Services Digital Network (ISDN) card, a Digital Subscriber Line (DSL) card, or a telephone modem that provides an information communication connection to a corresponding type of telephone line. In some embodiments, communication interface 970 is a cable modem that converts signals on bus 910 into signals for communication connection over a coaxial cable or for communication connection over a fiber optic cable. As another example, communication interface 970 may be a local area network (LAN) card that provides a data communication connection to a compatible LAN, such as Ethernet. Wireless links may also be implemented. For wireless links, communication interface 970 transmits or receives, or both transmits and receives, electrical, acoustic, or electromagnetic signals, including infrared and optical signals, that carry information streams, such as digital data. For example, in wireless handheld devices, such as mobile phones, communication interface 970 includes a radio-band electromagnetic transmitter and receiver, known as a transceiver. In certain embodiments, communication interface 970 enables connection to communication network 105 for determining location offset information for UE 101.

As used herein, the term "computer-readable medium" refers to any medium that participates in providing information to processor 902, including instructions for execution. Such media can take many forms, including but not limited to computer-readable storage media (e.g., non-volatile media, volatile media) and transmission media. Non-transient media such as non-volatile media include, for example, optical or magnetic disks such as storage device 908. Volatile media include, for example, dynamic memory 904. Transmission media include, for example, twisted-pair cables, coaxial cables, copper wire, fiber optic cables, and carrier waves that travel through space without wires or cables, such as acoustic waves and electromagnetic waves, including radio, optical, and infrared waves. Signals include man-made, instantaneous changes in amplitude, frequency, phase, polarity, or other physical properties that are transmitted through the transmission medium. Common forms of computer-readable media include, for example, floppy disks, diskettes, hard disks, magnetic tape, any other magnetic medium, CD-ROMs, CDRWs, DVDs, any other optical media, punch cards, paper tape, optical marking sheets, any other physical medium with holes or other optically recognizable markings, RAM, PROMs, EPROMs, FLASH-EPROMs, EEPROMs, flash memory, any other memory chips or magnetic cassettes, carrier waves, or any other medium from which a computer can read. The term computer-readable storage medium is used herein to refer to any computer-readable medium except transmission media.

Logic encoded in one or more tangible media includes one or both of instructions on a computer-readable storage medium and dedicated hardware 920 such as an ASIC.

Network link 978 typically provides information communication using a transmission medium through one or more networks to other devices that use or process the information. For example, network link 978 can provide a connection through local network 980 to a host computer 982 or to equipment 984 operated by an Internet Service Provider (ISP). ISP equipment 984, in turn, provides data communication services through the public, global packet-switched communications network now commonly referred to as the Internet 990.

A computer connected to the Internet, called a server host 992, manages the processes for providing services in response to information received over the Internet. For example, server host 992 manages the processes for providing information representing video data presented at display 914. It is contemplated that the components of system 900 may be implemented in various configurations within other computer systems, such as host 982 and server 992.

At least some embodiments of the present invention relate to using a computer system 900 to implement some or all of the techniques described herein. According to one embodiment of the present invention, those techniques are performed by the computer system 900 in response to the processor 902 executing one or more sequences of one or more processor instructions contained in the memory 904. Such instructions, also known as computer instructions, software, and program code, can be read into the memory 904 from another computer-readable medium such as a storage device 908 or a network link 978. Execution of the sequence of instructions contained in the memory 904 enables the processor 902 to perform one or more method steps described herein. In alternative embodiments, hardware, such as an ASIC 920, can be used in place of or in combination with software to implement the present invention. Thus, embodiments of the present invention are not limited to any specific combination of hardware and software, unless otherwise expressly stated herein.

Information is transmitted to and from computer system 900 via signals transmitted over network link 978 and other networks via communication interface 970. Computer system 900 can send and receive information, including program code, via network link 978 and communication interface 970 over networks 980, 990, and the like. In an example using the Internet 990, server host 992 transmits program code for a specific application requested by a message transmitted from computer 900 via Internet 990, ISP equipment 984, local network 980, and communication interface 970. The received code can be executed by processor 902 as it is received, or can be stored in memory 904, storage device 908, or any other non-volatile storage for later execution, or both. In this manner, computer system 900 can obtain application code in the form of signals on a carrier wave.

Various forms of computer-readable media may be involved in transmitting one or more strings of instructions or data, or both, to the processor 902 for execution. The remote computer loads the instructions and data into its dynamic memory and sends the instructions and data over a telephone line using a modem. A modem local to the computer system 900 receives the instructions and data over the telephone line and uses an infrared transmitter to convert the instructions and data into a signal on an infrared carrier wave used as a network link 978. An infrared detector, used as communication interface 970, receives the instructions and data carried in the infrared signal and places information representing the instructions and data on bus 910. Bus 910 transmits the information to memory 904, where processor 902 retrieves and executes the instructions using some of the data transmitted along with the instructions. The instructions and data received in memory 904 may be stored in storage device 908, either before or after execution by processor 902, as appropriate.

FIG10 illustrates a chip set or chip 1000 in which embodiments of the present invention may be implemented. Chip 1000 is programmed to determine positional offset information as described herein and includes, for example, the processor and memory components described with respect to FIG9 incorporated into one or more physical packages (e.g., chips). By way of example, the physical package includes an arrangement of one or more materials, components, and/or wires on a structural assembly (e.g., a substrate) to provide one or more properties such as physical strength, dimensional conservation, and/or electrical interaction limitation. It is contemplated that, in certain embodiments, chip set 1000 may be implemented in a single chip. It is further contemplated that, in certain embodiments, chip set or chip 1000 may be implemented as a "system on a chip." It is further contemplated that, in some embodiments, a separate ASIC may not be used; for example, all relevant functionality disclosed herein may be performed by a processor or multiple processors. Chip set or chip 1000, or a portion thereof, constitutes a means for performing one or more steps of providing user interface navigation information associated with function availability. Chip set or chip 1000, or a portion thereof, constitutes a means for performing one or more steps of determining positional offset information.

In one embodiment, chipset or chip 1000 includes a communication mechanism, such as bus 1001, for transferring information between components of chipset 1000. Processor 1003 is connected to bus 1001 to execute instructions and process information stored in memory 1005, for example. Processor 1003 may include one or more processing cores, each configured for independent execution. Multi-core processors enable multiprocessing within a physical package. Examples of multi-core processors include two, four, eight, or more cores. Alternatively or additionally, processor 1003 may include one or more microprocessors configured to collectively communicate via bus 1001 to enable independent instruction execution, pipelining, and multithreading. Processor 1003 may also be accompanied by one or more specialized components for performing certain processing functions and tasks, such as one or more digital signal processors (DSPs) 1007 or one or more application-specific integrated circuits (ASICs) 1009. DSP 1007 is typically configured to process real-world signals (e.g., sound) in real time, independent of processor 1003. Similarly, ASIC 1009 can be configured to perform specialized functions that are not easily performed by more general-purpose processors. Other specialized components that help perform the inventive functions described herein may include one or more field programmable gate arrays (FPGAs) (not shown), one or more controllers (not shown), or one or more other special-purpose computer chips.

In one embodiment, the chip set or chip 1000 includes merely one or more processors or some software and/or firmware supporting and/or relating to and/or for one or more processors.

Processor 1003 and associated components are connected to memory 1005 via bus 1001. Memory 1005 includes both dynamic memory (e.g., RAM, magnetic disk, writable optical disk, etc.) and static memory (e.g., ROM, CD-ROM, etc.), and is used to store executable instructions that, when executed, perform the steps described herein to determine position offset information. Memory 1005 also stores data associated with and generated by performing the steps of the present invention.

FIG11 is a schematic diagram of exemplary components of a mobile terminal (e.g., a handheld device) for communicating that can operate in the system of FIG1 according to one embodiment. In some embodiments, the mobile terminal 1101, or a portion thereof, constitutes a component for performing one or more steps of determining position offset information. In general, a radio receiver is typically defined in terms of front-end and back-end characteristics. The front-end of a receiver includes all radio frequency (RF) circuitry, while the back-end includes all baseband processing circuitry. As used in this application, the term "circuitry" refers to both: (1) a hardware-only implementation (e.g., implemented in only analog and/or digital circuitry); and (2) a combination of circuitry and software (and/or firmware) (e.g., a combination of a processor, including a digital signal processor, software, and memory that work together to enable a device such as a mobile phone or server to perform various functions, if applicable to the particular context). The definition of "circuitry" applies to all uses of the term in this application, including in any claims. As a further example, as used in this application, and if applicable to the particular context, the term "circuitry" would also cover an implementation of only a processor (or multiple processors) and its accompanying software/or firmware. The term "circuitry" would also cover, if applicable to the particular context, for example, a baseband integrated circuit or an applications processor integrated circuit in a mobile phone or a similar integrated circuit in a cellular network device or other network equipment.

The relevant internal components of the phone include a main control unit (MCU) 1103, a digital signal processor (DSP) 1105, and a receiver/transmitter unit including a microphone gain control unit and a speaker gain control unit. A main display unit 1107 provides a user with a display supporting various applications and mobile terminal functions that perform or support the steps of determining position offset information. Display 1107 includes display circuitry configured to display at least a portion of a user interface of a mobile terminal (e.g., a mobile phone). Furthermore, display 1107 and the display circuitry are configured to facilitate user control of at least some functions of the mobile terminal. Audio function circuitry 1109 includes a microphone 1111 and a microphone amplifier that amplifies voice signals output from microphone 1111. The amplified voice signals output from microphone 1111 are provided to a coder/decoder (CODEC) 1113.

Radio section 1115 amplifies power and converts frequency for communication with a base station included in a mobile communication system via antenna 1117. Power amplifier (PA) 1119 and transmitter/modulation circuitry are operatively responsive to MCU 1103, with outputs from PA 1119 coupled to a duplexer 1121, a circulator, or an antenna switch as known in the art. PA 1119 is also coupled to a battery interface and power control unit 1120.

In use, a user of mobile terminal 1101 speaks into microphone 1111, and their voice and detected background noise are converted into an analog voltage. The analog voltage is then converted into a digital signal by analog-to-digital converter (ADC) 1123. Control unit 1103 routes the digital signal to DSP 1105, where it performs processing such as speech encoding, channel coding, encryption, and interleaving. In one embodiment, the processed voice signal is encoded by a unit (not separately shown) using a cellular transmission protocol such as Enhanced Data Rates for Global Evolution (EDGE), General Packet Radio Service (GPRS), Global System for Mobile Communications (GSM), Internet Protocol Multimedia Subsystem (IMS), Universal Mobile Telecommunications System (UMTS), or any other suitable wireless medium (e.g., WiMAX, Long Term Evolution (LTE) networks, Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Wireless Fidelity (WiFi), satellite, etc.), or any combination thereof.

The encoded signal is then routed to the equalizer 1125, which compensates for frequency-dependent losses such as phase and amplitude distortion that occur during over-the-air transmission. After equalizing the bit stream, the modulator 1127 combines the signal with the RF signal generated by the RF interface 1129. The modulator 1127 generates a sine wave through frequency or phase modulation. To prepare the signal for transmission, the upconverter 1131 combines the sine wave output from the modulator 1127 with another sine wave generated by the synthesizer 1133 to achieve the desired transmission frequency. The signal is then sent through the PA 1119, which boosts the signal to the appropriate power level. In a practical system, the PA 1119 functions as a variable-gain amplifier, whose gain is controlled by the DSP 1105 based on information received from the network base station. The signal is then filtered within the duplexer 1121 and, if necessary, sent to the antenna coupler 1135 for impedance matching to provide maximum power conversion. Finally, the signal is transmitted to the local base station via the antenna 1117. Automatic Gain Control (AGC) may be provided to control the gain of the final receiver stage. The signal can then be forwarded to a remote telephone, which may be another cellular phone, any other mobile phone, or a landline connected to the Public Switched Telephone Network (PSTN) and other telephone networks.

Voice signals transmitted to mobile terminal 1101 are received via antenna 1117 and immediately amplified by low-noise amplifier (LNA) 1137. Downconverter 1139 lowers the carrier frequency, while demodulator 1141 removes the RF, leaving only a digital bit stream. The signal then passes through equalizer 1125 and is processed by DSP 1105. Digital-to-analog converter (DAC) 1143 converts the signal, and the resulting output is transmitted to the user via speaker 1145. All of this is controlled by main control unit (MCU) 1103, which can be implemented as a central processing unit (CPU) (not shown).

The MCU 1103 receives various signals, including input signals from the keypad 1147. The keypad 1147 and/or the MCU 1103, in conjunction with other user input components (e.g., the microphone 1111), includes user interface circuitry for managing user input. The MCU 1103 runs user interface software to facilitate user control of at least some functions of the mobile terminal 1101, including determining position offset information. The MCU 1103 also transmits display commands and exchange commands to the display 1107 and to the voice output exchange controller, respectively. Furthermore, the MCU 1103 exchanges information with the DSP 1105 and has access to the SIM card 1149 and memory 1151, which may be incorporated as appropriate. Depending on the implementation, the DSP 1105 can perform any of a variety of conventional digital processing functions on the voice signals. Furthermore, the DSP 1105 determines the background noise level of the local environment from the signal detected by the microphone 1111 and sets the gain of the microphone 1111 to a level selected to compensate for the natural tendencies of the user of the mobile terminal 1101.

CODEC 1113 includes ADC 1123 and DAC 1143. Memory 1151 stores various call data, including incoming voice data, and can also store other data, including music data received via, for example, the global Internet. Software modules may reside in RAM, flash memory, registers, or any other form of writable storage medium known in the art. Storage device 1151 may be, but is not limited to, a single memory, CD, DVD, ROM, RAM, EEPROM, optical memory, magnetic disk, flash memory, or any other non-volatile storage medium capable of storing digital data.

The optionally incorporated SIM card 1140 carries important information such as the cellular phone number, carrier offerings, subscription details, and security information. The SIM card 1149 primarily serves to identify the mobile terminal 1101 on the radio network. The card 1149 also contains memory for storing a personal phone book, text messages, and user-specific mobile terminal settings.

Although the present invention is described in conjunction with a number of embodiments and implementations, the present invention is not limited thereto but covers various obvious modifications and equivalent arrangements that fall within the scope of the appended claims. Although features of the invention are expressed in certain combinations among the claims, it is contemplated that these features may be arranged in any combination and order.

Claims (26)

1. A method for providing offset information, the method comprising the following steps: Provide a location-based representation on the device's display that is associated with the device's location, the location-based representation including at least a visual representation of the device's surroundings based on the device's geographic coordinates; Input is received from a user via the device's display, the input representing offset information for at least the location-based representation; The offset information is used to correct the position-based representation; and The offset information is transmitted to one or more other devices within the vicinity of the device. The offset information is used for additional location-based displays at corresponding other devices; The location-based representation on the display is based at least on one of location information and orientation information associated with the device, and the method further includes: Determine at least one accuracy information associated with the location information and the orientation information. Determine whether the accuracy information meets a predetermined accuracy threshold; wherein the correction of the position-based representation using the offset information is performed based on the determination that the accuracy information does not meet the predetermined accuracy threshold; The application of reducing the offset information in correcting the position-based representation is determined, at least in part, based on the determination that the accuracy information meets the predetermined accuracy threshold. 2. The method according to claim 1, further comprising: Store the offset information; and The stored offset information is applied to one or more other location-based displays, which are presented at least in part based on a predetermined neighborhood of location information substantially close to or within the predetermined neighborhood of the location information associated with the location-based display. 3. The method of claim 1, wherein the input, the offset information, or a combination thereof further specifies the approximate location of the device for navigation services, mapping services, location-based services, or a combination thereof, or the user of the device. 4. The method of claim 1, wherein the input is a movement of at least one of one or more location-based representations within the display, a captured image, an indication of approximate location, or a combination thereof. 5. The method of claim 1, further comprising: Retrieve additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; and The total offset information is generated at least in part based on the offset information, the other offset information, or a combination thereof. 6. The method of claim 1, wherein the location-based display is at least one of augmented reality display, mixed reality display, virtual reality display, drawing display, navigation display, or a combination thereof. 7. A method for providing offset information, the method comprising the following steps: Provide a location-based representation on the device's display that is associated with the device's location, the location-based representation including at least a visual representation of the device's surroundings based on the device's geographic coordinates; Input is received from a user via the device's display, the input representing offset information for at least the location-based representation; The offset information is used to correct the position-based representation; Retrieve additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; The offset information, the other offset information, or combinations thereof, shall be classified at least according to the type of device, the type of position sensor, the source of the position information, or a combination thereof; and The total offset information is generated at least in part based on the offset information, the other offset information, or a combination thereof, and based on the classification. 8. A method for presenting a location-based display, comprising: Present a location-based display on the device that is associated with the device's location; The location-based display presents a representation of multiple location-based features based on the location of the device; Receive input specifying offset information regarding at least one of the plurality of representations of the location-based display; and Adapting the rendering of at least one other representation among the plurality of representations on the position-based display, at least in part, based on the offset information; and The offset information is transmitted to one or more other devices within the vicinity of the device. The offset information is used to determine whether to display other location-based displays on other corresponding devices; The location-based display is also based on orientation information associated with the device; The method further includes: Determine the accuracy information associated with the location-based display, orientation information, or a combination thereof, and Determine whether the accuracy information meets a predetermined accuracy threshold; The adaptation of at least one of the multiple representations is performed based on the determination that the accuracy information does not meet the predetermined accuracy threshold; The method further includes: The application of reducing the offset information is determined at least in part based on the determination that the accuracy information meets the accuracy threshold. 9. The method of claim 8, wherein the representation comprises at least one of the following: graphic information, text information, and combinations thereof. 10. The method of claim 8, wherein the location-based features include at least one of the following: location, point of interest, road, terrain type, boundary, and combination thereof. 11. The method of claim 8, further comprising: Store the offset information; and The stored offset information is applied to one or more other location-based displays, which are presented at least in part based on a predetermined neighborhood of location information substantially close to or within the predetermined neighborhood of the location information associated with the location-based display. 12. The method of claim 8, wherein the input, the offset information, or a combination thereof further specifies the approximate location of the device for navigation services, mapping services, location-based services, or a combination thereof, or the user of the device. 13. The method of claim 8, wherein the input is provided as movement of at least one of the plurality of representations within the location-based display, a captured image, an indication of approximate location, or a combination thereof. 14. The method of claim 8, further comprising: Retrieve additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; and Determine that the total offset information is generated at least in part based on the offset information, the other offset information, or a combination thereof. 15. The method of claim 8, wherein the location-based display is at least one of augmented reality display, mixed reality display, virtual reality display, drawing display, navigation display, or a combination thereof. 16. A method for presenting a location-based display, comprising: Present a location-based display on the device that is associated with the device's location; The location-based display presents a representation of multiple location-based features based on the location of the device; Receive input specifying offset information about at least one of the plurality of representations of the location-based display; The rendering of at least one other representation among the plurality of representations is adapted at least in part based on the offset information in the position-based display; Retrieve additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; The offset information, the other offset information, or combinations thereof, shall be classified at least according to the type of device, the type of position sensor, the source of the position information, or a combination thereof; and The total offset information is determined based at least in part on the offset information, the other offset information, or a combination thereof, and based on the classification. 17. An apparatus for presenting a location-based display, comprising: A means for presenting a location-based display on a device in association with the location of the device; A means for presenting a representation of multiple location-based features based on the location of a device on the location-based display; A means for receiving input, the input specifying offset information regarding at least one of the plurality of representations of the location-based display; and A means for adapting the presentation of at least one other representation among the plurality of representations on the position-based display, at least in part, based on the offset information; and A means for transmitting the offset information to one or more other devices within the vicinity of the device. The offset information is used to render additional location-based displays on other corresponding devices; The location-based display is also based on orientation information associated with the device; The device further includes: A means for determining accuracy information associated with the location-based display, the orientation information, or a combination thereof; A means for determining whether the accuracy information meets a predetermined accuracy threshold; and A means for determining an application that reduces the offset information based at least in part on the determination of satisfying the accuracy threshold based on the accuracy information; The adaptation device adapts the presentation of at least one other representation among the plurality of representations based on the determination that the accuracy information does not meet the accuracy threshold. 18. The apparatus of claim 17, wherein the representation comprises at least one of the following: graphic information, text information, and combinations thereof. 19. The apparatus of claim 17, wherein the location-based features include at least one of the following: location, point of interest, road, terrain type, boundary, and combinations thereof. 20. The apparatus of claim 17, further comprising: A device for storing the offset information; and A means for applying stored offset information to one or more other location-based displays, which are presented at least in part based on a predetermined proximity range of location information substantially close to or within the predetermined proximity range of location information associated with the location-based display. 21. The apparatus of claim 17, wherein the input, the offset information, or a combination thereof further specifies the approximate location of the device or the user of the device for navigation services, mapping services, location-based services, or a combination thereof. 22. The apparatus of claim 17, wherein the input is provided as movement of at least one of the plurality of representations within the location-based display, a captured image, an indication of approximate location, or a combination thereof. 23. The apparatus of claim 17, further comprising: A means for retrieving additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; and A means for determining aggregate offset information generated at least in part based on the offset information, the other offset information, or a combination thereof. 24. The apparatus of claim 17, wherein the location-based display is at least one of augmented reality display, mixed reality display, virtual reality display, drawing display, navigation display, or a combination thereof. 25. An apparatus for presenting a location-based display, comprising: A means for presenting a location-based display on a device in association with the location of the device; A means for presenting a representation of multiple location-based features based on the location of a device on the location-based display; A means for receiving input, the input specifying offset information about at least one of the plurality of representations of the location-based display; A means for adapting, at least in part, the presentation of at least one other representation among the plurality of representations on the location-based display based on the offset information; A means for retrieving additional offset information associated with one or more other devices, additional offset information collected at one or more other times, or a combination thereof; Means for classifying the offset information, the other offset information, or combinations thereof, at least according to the type of device, the type of position sensor, the source of the position information, or a combination thereof; and A means for determining total offset information based at least in part on the offset information, the other offset information, or a combination thereof, and based on the classification. 26. A method for presenting a location-based display, comprising facilitating access to at least one interface configured to allow access to at least one service configured to perform the method of any one of claims 8 to 16.