TWI660289B - Server for providing augmented reality environment - Google Patents

Abstract

This case relates to a server that provides augmented reality for services. It is mainly composed of network card, hard disk and processor. The network card is communicatively linked with a mobile device to obtain images and positioning from the mobile device, and the hard disk stores information such as a base, a store, an analysis, or finance. The processor transmits the above information of the positioning of the nearby mobile device to the mobile device to dynamically display the augmented reality interface based on the image acquired by the mobile device on the mobile device. Among them, a virtual character or auxiliary component displays the above information to the user in the augmented reality interface, and the user can interact with the augmented reality interface.

Description

Augmented reality server

This case relates to a server, and more particularly to a server that provides augmented reality for services.

With the development of technology, the proportion of mobile devices in people's lives has increased rapidly.

With the popularity of mobile devices and peripheral equipment, industries must inevitably face the need to extend or transfer their services to mobile devices. However, the service nature of certain industries focuses on people-to-people communication. If only general services or difficult-to-read data are provided through mobile devices, service conditions are inevitably unsatisfactory. Therefore, how to improve the interaction and user experience at the service level of mobile devices is an important research topic in this field.

One of the contents of this case is to provide an augmented reality server to improve the interactivity of the prior art at the service level of mobile devices and the problem of poor user experience.

The implementation aspect of this case relates to an augmented reality server. According to an embodiment of the present invention, the augmented reality server includes a network card, a hard disk, and a processor. The network card is communicatively connected to a mobile device, and is used to obtain a positioning information and an image information of the mobile device. The hard disk is used to store at least one location information or at least one store information. The processor is respectively connected to the network card and the hard disk, and the processor can transmit the at least one base point information or the at least one store information to the mobile device according to the positioning information, so that an expansion based on the image information is performed. Augmented Reality (AR) interface is dynamically displayed on the mobile device. Among them, a virtual character is provided to the augmented reality interface to display the at least one location information or the at least one store information to the user of the mobile device in the augmented reality interface.

Therefore, according to the technical content of this case, the embodiment of this case provides an augmented reality server to improve the service provided to the mobile device, so that the service's interactivity and user experience are improved.

The following will clearly illustrate the spirit of this case with diagrams and detailed descriptions. Any person with ordinary knowledge in the technical field who understands the embodiments of this case can be changed and modified by the techniques taught in this case without departing from the scope of this case. Spirit and scope.

The terminology used herein is for describing particular embodiments only and is not intended as a limitation of the present case. Singular forms such as "a", "the" and "the", as used herein, also include the plural forms.

Regarding the "first", "second", ..., etc. used herein, it does not mean a specific order or order, nor is it used to limit the present invention, which is only for distinguishing elements or operations described in the same technical terms.

As used herein, "coupled" or "connected" can refer to two or more components or devices directly making physical contact with each other, or indirectly making physical contact with each other, or two or more components or devices to each other. Operation or action.

The terms "including", "including", "having", "containing" and the like used in this article are all open-ended terms, which means including but not limited to.

As used herein, "and / or" includes any and all combinations of the things described.

Regarding the directional terms used in this article, such as: up, down, left, right, front or back, etc., are only directions referring to the attached drawings. Therefore, the directional terms used are used to illustrate and not to limit the case.

Regarding the terms "roughly" and "about" used in this article, they are used to modify any slightly changeable quantity or error, but such slight change or error does not change its essence. Generally speaking, the range of minor changes or errors modified by such terms is 20%, 10% in some preferred embodiments, and 5% in some more preferred embodiments.

Regarding the terms used in this article, unless otherwise specified, they usually have the ordinary meaning of each term used in this field, in the content of this case, and in special content. Certain terms used to describe this case will be discussed below or elsewhere in this specification to provide additional guidance to those skilled in the art on the description of this case.

FIG. 1 is a schematic diagram of an augmented reality server according to an embodiment of the present invention. In this embodiment, the server 100 includes a network card 110, a processor 120, and a hard disk 130. The network card 110 may be any existing or feasible communication interface, such as a wireless network card, a wired network card, or a micro network card. The network card 110 is used to send or receive information. The processor 120 may be any existing or feasible option, such as a central processing unit or microprocessor produced by Intel or AMD. The processor 120 is used to execute a program or operation to generate a processing result. The hard disk 130 may also be any existing or feasible storage device, such as a Read Only Memory (ROM), etc., for storing information for a longer period of time.

In this embodiment, the mobile device 200 and the server 100 are communicatively connected via the network card 110. For example, the mobile device 200 may be communicatively connected to the server 100 via a wireless network service. The processor 120 in the server 100 can obtain the information transmitted by the mobile device 200 through the network card 110, and can transmit the information to the mobile device 200 through the network card 110. The hard disk 130 stores a number of base information, such as a bank's first branch, second branch, and bank head office. The base information also includes the services provided by each of the above bases, the location of the base, guidance to the base, Internal structure of the base, basic information of the base, business hours of the base, etc. Hard disk 130 also stores a number of store information, such as the first special store, second special store, and special chain stores of a bank. The store information also includes special items of each of the above stores, goods or services sold by the store, and the store's Location, directions to the store, internal structure of the store, basic information about the store, business hours of the store, etc. The processor 120 is further connected to the hard disk 130 to obtain base information or store information.

In this embodiment, the mobile device 200 may be any existing or feasible option, such as a smart phone or a tablet computer with an Internet access function, and so on. Generally, the mobile device 200 has a plurality of positioning sensors to detect its location, changes in gravity or inclination, etc. These positioning sensors can be used to obtain positioning information of the mobile device 200. Generally, the mobile device 200 also has an image capturing unit or an image capturing unit to obtain image information toward a certain direction or inclination. Generally, the mobile device 200 is provided with a display screen to display a process or result of executing a program or acquiring an image to a user. The mobile device 200 may have an audio unit to play audio to the user or record to the user. The mobile device 200 may have several other sensors to detect the user's usage status, touch pressure, gesture changes, or facial expressions, etc. These other sensors can be used to obtain user feedback information.

In this embodiment, since the mobile device 200 is communicatively connected to the network card 110, when a user uses the mobile device 200 to execute an application or activate a service about a bank, the current positioning information and image information of the mobile device 200 will be transmitted wirelessly. The network is transmitted to the server 100, which is received by the network card 110, and then the positioning information and image information of the mobile device 200 are transmitted to the processor 120. The processor 120 will obtain the real-time location of the mobile device 200 according to the positioning information of the mobile device 200, and obtain the relevant base information or store information of the real-time location near the mobile device 200 from the hard disk 130. Subsequently, the processor 120 transmits the base information or store information adjacent to the mobile device 200 to the mobile device 200 through the network card 110.

In this embodiment, the base information or store information adjacent to the mobile device 200 will be displayed on the mobile device 200 through an Augmented Reality (AR) interface. Among them, the augmented reality interface is an interface based on the real-time or semi-real-time image information provided by the mobile device 200, which is based on the real-world image information obtained by the video recording unit or image acquisition unit of the mobile device 200 , And then attach a virtual image, window or interactive unit to the base to form it. The augmented reality interface will be provided to the user through the display screen of the mobile device 200. The augmented reality interface can cooperate with certain voice or audio information and provide it to the user through the audio unit of the mobile device 200.

In this embodiment, a virtual character is provided in the augmented reality interface of the mobile device 200 to display the base information or store information transmitted by the processor 120 to the user. The virtual character is an ornamental type It is a humanoid or humanoid expression, which is a simulated character based on a real or cartoon character or a virtual character. It can be provided to the mobile device 200 through a three-dimensional or two-dimensional representation. The virtual character can display the base with action or voice. Listing or store listing. In addition to virtual characters, other static indicators, dynamic indicators, dialog windows, interactive menus, animations, pictures and other auxiliary components can be provided in the augmented reality interface to display more or more complex information. The auxiliary components and the virtual character can interact synchronously or asynchronously in the augmented reality interface, and can interact with the user. In order to diversify and adapt services, virtual characters, auxiliary components or audio in the augmented reality interface will be provided in more than one language.

In summary, the embodiments of the present invention provide an augmented reality interface that displays virtual characters on mobile devices to provide users with an immersive experience (Flow Experience) to improve service interaction. Sexual problems.

In this embodiment, the augmented reality interface can further transmit the feedback information generated by the user through the mobile device 200 and the augmented reality interface to the processor 120. Generally, the feedback information includes gestures, voices, touches, photos, videos, or other actions performed by the user through the mobile device 200, or changes in the positioning, tilt angle, pointing changes, and image capture range of the mobile device 200. The feedback information is obtained through various sensors and units provided in the mobile device 200. After the processor 120 obtains the feedback information, it will update the augmented reality interface or the virtual character therein according to the feedback information. For example, if the feedback information is a change in the image capture range of the mobile device 200, the image information base in the augmented reality interface is updated. For example, if the feedback information is that the mobile device 200 detects that the user touches the virtual character in the augmented reality interface, the action of the virtual character is changed and a dialog window is provided. For example, if the feedback information is a change in the positioning of the mobile device 200, the image information base in the augmented reality interface is updated and the virtual character moves in the augmented reality interface. The processor 120 may provide more or more complicated updates according to different feedback information, and is not limited to the appearance in the above examples.

In another embodiment, the hard disk 130 stores analysis information about users of the mobile device 200 in addition to store information or store information. For example, the user of the mobile device 200 is an existing customer of a bank. During the user's contact with a bank, the bank has conducted data collection, data mining, or data through various channels to obtain a lot of analytical data about the user. The analysis information can include user's personal information, adaptability information, historical information, consumption information, credit card information, customer classification, investment information, and other common customer attribute information. The analysis information will also be provided by the processor 120 to the augmented reality interface of the mobile device 200 so that the virtual character or auxiliary component can display the analysis information, or provide the user with a corresponding marketing plan or preferential conditions based on the analysis information. Wait.

In another embodiment, the hard disk 130 stores some financial information in addition to the base information or the store information. For example, the user of the mobile device 200 is a deposit customer of a bank, and a bank has deposit information about the user, and these deposit data can be provided to the augmented reality interface to the user through encryption or identity authentication. Financial information can also include common market information such as exchange rates, deposits, stock prices, insurance, loans, recommended products, and more. The analysis information will also be provided by the processor 120 to the augmented reality interface of the mobile device 200 so that the virtual character or auxiliary component can display the financial information, or provide users with corresponding marketing solutions or preferential conditions based on the financial information. Wait.

Please refer to FIG. 2, which is a schematic diagram of a first scenario according to an embodiment of the present application. This embodiment can be implemented through the architecture of the augmented reality server in FIG. 1, and therefore, FIG. 1 can be referred to together. FIG. 2 shows an image information, which schematically shows that the user starts an application of a bank, and the application obtains the image information obtained through the image capturing unit or the image capturing unit of the mobile device 200. This image information contains a part of the real world. The center of the image information has a channel that extends forward, and the bottom has a step. There is a building entrance on the left side of the image information, and a number of building entrances are also included on the right side of the image information. This image information will be transmitted to the server 100 together with the real-time positioning information of the mobile device 200, and then sent to the processor 120 via the network card 110. The processor 120 will obtain the nearby base information or store information or the user's analysis information or financial information from the hard disk 130 according to the positioning information, and transmit it to the mobile device 200 so that the information can be amplified through The real-world interface is displayed on the mobile device 200.

Please refer to FIG. 3, which is a schematic diagram of a second scenario according to an embodiment of the present invention. Figure 3 is a schematic diagram of the augmented reality interface provided for the substrate based on the image in Figure 2. Continuing from the previous paragraph, the processor 120 obtains information of a nearby bank location from the hard disk 130 according to the positioning information and transmits it to the mobile device 200 so that the location information can be displayed on the mobile device 200 through the augmented reality interface 300 . According to the base information transmitted by the processor 120, the augmented reality interface 300 is provided to the mobile device 200, and the user can view the augmented reality interface 300 through the display screen of the mobile device 200. It is worth noting that a virtual clerk A is provided on the right side of the augmented reality interface 300, and the virtual clerk A is wearing a bank counter uniform. The virtual crew member A is provided to the augmented reality interface 300 along with the interactive voice. Therefore, the user can feel as if a crew member is providing services or having a conversation, and the experience is different from the previous plane service. In addition, in order to prevent the environment volume from affecting the voice provided by the virtual clerk A, a dialogue window A1 recording the voice content is provided in the augmented reality interface 300.

The embodiment of FIG. 3 is continued. In this embodiment, since the head office of a bank is located in front of the instant position of the mobile device 200, the entrance of the bank head office B on the left side of the augmented reality interface 300 will be marked for user identification. In addition, an auxiliary component is provided on the augmented reality interface 300, which is the indication path C, which extends from the lower side of the augmented reality interface 300 along the central channel forward, and instructs the bank head office to the left from a distance. Entrance position of B. Since the background of the augmented reality interface 300 is based on the street view image obtained by the mobile device 200, the user can quickly understand the location of the entrance of the bank's head office B in the real world according to the indicated path C, and the user can directly Follow the guidance to Bank Headquarters B, instead of straying into other buildings on the right in the image information.

Please refer to FIG. 4, which is a schematic diagram of a third scenario according to an embodiment of the present application. The scenario in FIG. 4 is an augmented reality interface 300 that continues from FIG. 3. In this embodiment, in the augmented reality interface 300 in FIG. 3, the user touches the marked position of the entrance of the bank's head office B. The feedback information of this touch action will be transmitted by the augmented reality interface 300 through the mobile device. 200 is transmitted to the server 100 and then sent to the processor 120 via the network card 110. The processor 120 will update the augmented reality interface 300 according to the touch action. The processor 120 further retrieves information about the services provided by the head office B from the hard disk 130 and transmits the information provided by the head office B to the mobile device 200 through the network card 110. In the augmented reality interface 300, the information provided by the bank's head office B will be displayed in the form of an introduction window D. This introduction window D occupies a wider space on the upper left side of the augmented reality interface 300 before it can be displayed. Enough information for users to read.

It can be known from the foregoing embodiments of the present application that the application of the present application has the following advantages. The embodiment of the present invention provides an augmented reality interface where an augmented reality server displays a virtual character on a mobile device to provide an immersive user experience and improve the problem of insufficient service interaction. The embodiment of the present case further provides auxiliary components in the augmented reality interface to increase the complexity of the performance information of the virtual character. The embodiment of the present case further provides information such as a base, a store, analysis, or finance in an augmented reality interface, so that the virtual character can provide more diversified services according to it, such as introduction, guidance, or sales.

Although this case is disclosed as above with examples, it is not intended to limit the case. Any person skilled in this art can make various modifications and retouches without departing from the spirit and scope of the case. Therefore, the scope of protection of this case shall be attached as The scope of the patent application shall prevail.

100‧‧‧Server

110‧‧‧ network card

120‧‧‧ processor

130‧‧‧HDD

200‧‧‧ mobile device

300‧‧‧ Augmented Reality Interface

A‧‧‧Virtual Crew

A1‧‧‧Dialog window

B‧‧‧Bank Head Office

C‧‧‧ Direction

D‧‧‧ Introduction window

FIG. 1 is a schematic diagram of an augmented reality server according to an embodiment of the present invention; FIG. 2 is a schematic diagram of a first scenario of an embodiment of the present case; FIG. 3 is a schematic diagram of a second scenario of an embodiment of the present case; and FIG. 4 This is a schematic diagram of the third scenario according to an embodiment of the present invention.

Claims (6)

An augmented reality server includes: a network card that communicates with a mobile device to obtain positioning information and image information of the mobile device; a hard disk that stores at least one location information or at least one store information; And a processor, respectively, connecting the network card and the hard disk, transmitting the at least one location information or the at least one store information adjacent to the positioning information to the mobile device, and dynamically displaying the image information based on the image information on the mobile device An Augmented Reality (AR) interface; wherein a virtual character displays the at least one location information or the at least one store information in a voice interaction in at least one language on the augmented reality interface; wherein, the augmented reality The real-world interface further indicates the entrance position of the at least one base point information or the at least one store information. The augmented reality interface further provides at least one auxiliary element for indicating a path to the entrance position. The at least one auxiliary element includes One of a static indicator, a dynamic indicator, a dialog window, an interactive menu, an animation, and an image; wherein the hard disk further stores information about the mobile device At least one analysis information of the user, the at least one analysis information is provided by the processor to the augmented reality interface of the mobile device, the virtual character displays the at least one analysis information, and the at least one analysis information includes the mobile device One of the user's personal information, adaptability information, historical information, consumption information, credit card information, customer classification and investment information; and the hard disk further stores the at least one financial information, the at least one financial information including exchange rates, deposits , The stock price, insurance, loans, and recommended products, the at least one financial information is also displayed on the augmented reality interface and displayed by the virtual character. The server according to claim 1, wherein the augmented reality interface further transmits a feedback information generated by the mobile device to the processor. The server according to claim 1, wherein the at least one site information includes a service provided by the site, a location of the site, a guide to the site, an internal structure of the site, basic information of the site, and business of the site One of time. The server according to claim 1, wherein the at least one store information includes a special item of the store, the product of the store, the location of the store, a guide to the store, the internal structure of the store, and basic information of the store And one of the store's opening hours. The server according to claim 2, wherein the feedback information includes gestures, voices, touches, photos, video recordings, changes in the inclination of the mobile device, changes in the orientation of the mobile device, and the action through the mobile device. The device's image capture range varies. The server according to any one of claims 2 or 5, wherein the processor updates the augmented reality interface or the virtual character according to the feedback information.