[go: up one dir, main page]

CN102843347B - Realize system and method, terminal and the server of mobile augmented reality business - Google Patents

Realize system and method, terminal and the server of mobile augmented reality business Download PDF

Info

Publication number
CN102843347B
CN102843347B CN201110173562.2A CN201110173562A CN102843347B CN 102843347 B CN102843347 B CN 102843347B CN 201110173562 A CN201110173562 A CN 201110173562A CN 102843347 B CN102843347 B CN 102843347B
Authority
CN
China
Prior art keywords
augmented reality
content
mobile
request
target
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201110173562.2A
Other languages
Chinese (zh)
Other versions
CN102843347A (en
Inventor
黄成�
加赞法尔·阿里
李伟华
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nantong Tianyuan Security Equipment Co ltd
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201110173562.2A priority Critical patent/CN102843347B/en
Priority to PCT/CN2012/070613 priority patent/WO2012174865A1/en
Publication of CN102843347A publication Critical patent/CN102843347A/en
Application granted granted Critical
Publication of CN102843347B publication Critical patent/CN102843347B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/131Protocols for games, networked simulations or virtual reality

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

本发明公开了一种实现移动增强现实业务的方法,包括:接收到增强现实业务请求后,移动增强现实服务器获取所述增强现实业务请求的参数,确定所述增强现实业务请求类型,对所请求的移动增强现实业务进行控制。本发明还公开了一种实现移动增强现实业务的系统,移动增强现实服务器以及移动增强现实终端。发明中移动增强现实业务实现方法适应不同类型的增强现实目标识别、增强现实内容获取,具有良好的可扩展性,在不同应用场景为用户提供统一的业务体验。

The invention discloses a method for implementing mobile augmented reality services, which includes: after receiving an augmented reality service request, a mobile augmented reality server obtains the parameters of the augmented reality service request, determines the type of the augmented reality service request, and performs the requested mobile augmented reality services for control. The invention also discloses a system for realizing mobile augmented reality services, a mobile augmented reality server and a mobile augmented reality terminal. The mobile augmented reality service implementation method in the invention is suitable for different types of augmented reality object recognition and augmented reality content acquisition, has good scalability, and provides users with a unified service experience in different application scenarios.

Description

实现移动增强现实业务的系统及方法、终端及服务器System and method for realizing mobile augmented reality service, terminal and server

技术领域technical field

本发明涉及实现移动增强现实业务的技术,尤其涉及一种实现移动增强现实业务的系统及方法,以及,移动增强现实终端、移动增强现实服务器。The present invention relates to technologies for realizing mobile augmented reality services, and in particular to a system and method for realizing mobile augmented reality services, a mobile augmented reality terminal, and a mobile augmented reality server.

背景技术Background technique

随着智能终端、移动互联网技术的成熟与发展,曾经局限于实验室的增强现实(AR,Augmented Reality)技术开始走进大众视野,一大批以图像识别、终端定位技术为基础的互联网/移动互联网AR应用开始涌现,称为移动增强现实(Mobile AR)应用,这引起了业界较大关注,逐渐成为技术研究的热点。With the maturity and development of smart terminals and mobile Internet technologies, augmented reality (AR, Augmented Reality) technology, which was once confined to laboratories, has begun to enter the public's field of vision. A large number of Internet/mobile Internet based on image recognition and terminal positioning technologies AR applications began to emerge, called mobile augmented reality (Mobile AR) applications, which has attracted great attention from the industry and has gradually become a hotspot in technology research.

移动增强现实技术的研究与应用,将虚拟的增强现实信息应用到真实世界,改变了用户观察周围世界的方式——由传统的基于文本输入的WEB页面浏览查询模式,转变为基于摄像头拍摄,捕获热点并实时浏览增强信息的全新模式。The research and application of mobile augmented reality technology, applying virtual augmented reality information to the real world, has changed the way users observe the surrounding world—from the traditional WEB page browsing query mode based on text input to camera-based shooting, capturing Hotspot and view a new mode of enhanced information in real time.

Mobile AR用户利用移动终端如智能手机等在拍摄周围景物的同时可以得到增强现实业务体验,主要存在以下业务场景:移动终端上运行的增强现实应用(ARApplication)基于用户当前位置捕获AR业务提供商部署的增强现实目标(AR Target),如与地理位置相关兴趣点(POI,Point of Interest),并根据用户选择获取增强现实内容(ARContent),包括文字、图片、语音、视频,最终结合用户终端地理指纹信息如经纬度、朝向等,将获取的增强现实内容与终端摄像头实时拍摄的周围实景在屏幕融合显示,获取不同寻常的增强现实业务体验。Mobile AR users can use mobile terminals such as smart phones to obtain augmented reality service experience while shooting surrounding scenes. The main business scenarios include the following: the augmented reality application (ARApplication) running on the mobile terminal captures the deployment of AR service providers based on the user's current location. The augmented reality target (AR Target), such as the point of interest (POI, Point of Interest) related to the geographical location, and obtain the augmented reality content (ARContent) according to the user's choice, including text, picture, voice, video, and finally combined with the geographical location of the user terminal Fingerprint information, such as latitude and longitude, orientation, etc., is displayed on the screen by combining the obtained augmented reality content with the surrounding real scene captured by the terminal camera in real time, so as to obtain an unusual augmented reality business experience.

当前市场增强现实解决方案中,不同的增强现实业务提供商各自独立开发AR应用,不同AR应用是基于不同的增强现实技术实现的,目前的增强现实技术主要包括以下几种:AR目标识别技术、AR内容获取技术、AR内容展示技术等。如此以来,AR应用开发者为不同AR业务提供商开发的AR应用必须使用不同技术实现,这无疑增加了AR应用开发难度。AR用户必须根据所订购AR业务提供商的不同而选择安装不同AR应用运行环境,这非常不利于用户对终端的更换,这是因为,AR业务提供商各自发布的AR应用互不兼容,用户一旦更换终端,就需要重新安装所有AR应用的运行环境,这无疑极大地阻碍了AR应用的市场普及。In the current market augmented reality solutions, different augmented reality service providers independently develop AR applications, and different AR applications are implemented based on different augmented reality technologies. The current augmented reality technologies mainly include the following: AR target recognition technology, AR content acquisition technology, AR content display technology, etc. As a result, AR applications developed by AR application developers for different AR service providers must be implemented using different technologies, which undoubtedly increases the difficulty of AR application development. AR users must choose to install different AR application operating environments according to the different AR service providers they subscribe to, which is very unfavorable for users to replace terminals. To replace the terminal, it is necessary to reinstall the operating environment of all AR applications, which undoubtedly greatly hinders the market popularization of AR applications.

在现有增强现实解决方案中,由于AR业务提供商各自发布的AR应用互不兼容,因此AR应用也就无法集中上线销售,这会大大减少AR业务提供商的签约用户群体。另外,AR业务提供商不仅需要部署AR业务服务器,还需要独自承担AR内容的设计工作,这也增加了AR业务提供商的业务运营成本。In existing augmented reality solutions, since the AR applications released by AR service providers are incompatible with each other, AR applications cannot be sold online in a centralized manner, which will greatly reduce the number of subscribers of AR service providers. In addition, the AR service provider not only needs to deploy the AR service server, but also needs to independently undertake the design work of the AR content, which also increases the service operation cost of the AR service provider.

综上所知,传统AR业务提供商根据各自实现技术开展各自AR业务,其结果是不仅割裂了AR应用市场,还对广大AR用户造成了极大的不便,目前这已成为阻碍AR业务市场发展的一个重要因素。To sum up, traditional AR service providers carry out their own AR services based on their respective implementation technologies. As a result, the AR application market has not only been split, but also caused great inconvenience to the majority of AR users. At present, this has become a hindrance to the development of the AR service market. an important factor.

发明内容Contents of the invention

有鉴于此,本发明的主要目的在于提供一种实现移动增强现实业务的系统及方法,以及,移动增强现实终端、移动增强现实服务器,能强化用户体验效果。In view of this, the main purpose of the present invention is to provide a system and method for implementing mobile augmented reality services, and the mobile augmented reality terminal and the mobile augmented reality server can enhance user experience.

为达到上述目的,本发明的技术方案是这样实现的:In order to achieve the above object, technical solution of the present invention is achieved in that way:

一种实现移动增强现实业务的方法,包括:A method for implementing a mobile augmented reality service, comprising:

接收到增强现实业务请求后,移动增强现实服务器获取所述增强现实业务请求的参数,确定所述增强现实业务请求类型,对所请求的移动增强现实业务进行控制。After receiving the augmented reality service request, the mobile augmented reality server acquires the parameters of the augmented reality service request, determines the type of the augmented reality service request, and controls the requested mobile augmented reality service.

优选地,所述增强现实业务请求包括以下请求的至少一种:Preferably, the augmented reality service request includes at least one of the following requests:

增强现实目标搜索请求、增强现实内容获取请求、增强现实测度上报请求和增强现实内容管理请求。AR target search requests, AR content acquisition requests, AR measurement report requests, and AR content management requests.

优选地,所述增强现实业务请求为增强现实目标搜索请求时,对所请求的移动增强现实业务进行控制,为:Preferably, when the augmented reality service request is an augmented reality target search request, controlling the requested mobile augmented reality service is:

所述移动增强现实服务器根据请求中携带的目标搜索参数进行增强现实目标匹配,获取匹配到的增强现实目标,并返回给所述移动增强现实终端。The mobile AR server performs AR target matching according to the target search parameters carried in the request, acquires the matched AR target, and returns it to the mobile AR terminal.

优选地,所述增强现实业务请求为增强现实内容获取请求时,对所请求的移动增强现实业务进行控制,为:Preferably, when the augmented reality service request is an augmented reality content acquisition request, controlling the requested mobile augmented reality service is:

所述移动增强现实服务器根据增强现实内容获取请求中携带的内容获取参数获取增强现实内容访问地址,获取增强现实内容并返回给所述移动增强现实终端。The mobile AR server obtains the AR content access address according to the content acquisition parameters carried in the AR content acquisition request, acquires the AR content and returns it to the mobile AR terminal.

优选地,所述增强现实业务请求为增强现实测度上报请求时,对所请求的移动增强现实业务进行控制,为:Preferably, when the augmented reality service request is an augmented reality measurement report request, the requested mobile augmented reality service is controlled as:

所述移动增强现实服务器根据增强现实测度上报请求中携带的测度上报参数进行增强现实目标元数据搜索,获取测度上报通知合法接收方地址。The mobile AR server searches the metadata of the AR target according to the measurement reporting parameters carried in the AR measurement reporting request, and obtains the legal recipient address of the measurement reporting notification.

优选地,所述增强现实业务请求为增强现实内容管理请求时,对所请求的移动增强现实业务进行控制,为:Preferably, when the augmented reality service request is an augmented reality content management request, controlling the requested mobile augmented reality service is:

对管理请求对应的增强现实内容管理权限进行验证,验证通过后根据增强现实内容服务器的增强现实内容对相应增强现实内容的目标信息进行更新。The augmented reality content management authority corresponding to the management request is verified, and after the verification is passed, the target information of the corresponding augmented reality content is updated according to the augmented reality content of the augmented reality content server.

优选地,所述移动增强现实服务器在满足设定推送设置条件时,获取对应的增强现实目标和/或增强现实内容,并发送给移动增强现实终端。Preferably, the mobile AR server acquires the corresponding AR object and/or AR content when the set push setting condition is met, and sends the corresponding AR object and/or AR content to the mobile AR terminal.

优选地,所述设定推送设置条件为:Preferably, the set push setting condition is:

根据用户偏好及业务设置确定获取发现增强现实目标中与移动增强现实终端位置比较接近的目标所对应的增强现实内容;According to user preferences and business settings, determine and obtain the augmented reality content corresponding to the target that is relatively close to the position of the mobile augmented reality terminal among the discovered augmented reality targets;

或者,设定时刻到来;Or, set the time to come;

或者,移动增强现实终端进入设定区域;Or, the mobile augmented reality terminal enters the set area;

或者,在增强现实目标搜索参数及用户业务设置符合第三方增值业务触发条件。Alternatively, the augmented reality target search parameters and user service settings meet the triggering conditions for third-party value-added services.

一种实现移动增强现实业务的系统,包括移动增强现实终端、移动增强现实服务器和增强现实内容服务器,其中,A system for implementing mobile augmented reality services, including a mobile augmented reality terminal, a mobile augmented reality server, and an augmented reality content server, wherein,

移动增强现实终端,用于向所述移动增强现实服务器发送增强现实业务请求;获取增强现实内容服务器中与增强现实目标相关联的增强现实内容,并根据所述移动增强现实终端实时状态将所述增强现实内容与所述移动增强现实终端拍摄的实景融合并展示;The mobile augmented reality terminal is configured to send an augmented reality service request to the mobile augmented reality server; obtain the augmented reality content associated with the augmented reality target in the augmented reality content server, and send the augmented reality content according to the real-time status of the mobile augmented reality terminal The augmented reality content is fused with the real scene captured by the mobile augmented reality terminal and displayed;

移动增强现实服务器,用于获取所述接收移动增强现实终端发送的增强现实业务请求或推送请求的参数,确定增强现实业务请求类型,对所请求的移动增强现实业务进行控制;以及,接收到增强现实内容服务器发送的增强现实内容管理请求后,对管理请求对应的增强现实内容管理权限进行验证,验证通过后更新管理请求对应的增强现实内容的目标信息;The mobile augmented reality server is configured to acquire the parameters of the augmented reality service request or push request sent by the receiving mobile augmented reality terminal, determine the type of the augmented reality service request, and control the requested mobile augmented reality service; and, receive the augmented reality After the augmented reality content management request sent by the reality content server, verify the augmented reality content management authority corresponding to the management request, and update the target information of the augmented reality content corresponding to the management request after the verification is passed;

增强现实内容服务器,用于提供与所述移动增强现实服务器中已部署的增强现实目标相关联的增强现实内容的存储与管理。The augmented reality content server is configured to provide storage and management of augmented reality contents associated with deployed augmented reality objects in the mobile augmented reality server.

优选地,所述移动增强现实终端包括摄像头、状态获取单元、通信单元和展示单元,其中,Preferably, the mobile augmented reality terminal includes a camera, a state acquisition unit, a communication unit and a display unit, wherein,

摄像头,用于实时拍摄所述移动增强现实终端周围的实景;A camera, used for real-time shooting of the real scene around the mobile augmented reality terminal;

状态获取单元,用于获取所述移动增强现实终端的当前位置信息;摄像头与地面高度、朝向、与地面夹角信息;A state acquisition unit, configured to acquire the current position information of the mobile augmented reality terminal; the height, orientation, and angle information between the camera and the ground;

通信单元,用于实现与所述移动增强现实服务器的通信,向所述移动增强现实服务器发送增强现实业务请求,并获取增强现实内容服务器中与增强现实目标相关联的增强现实内容;A communication unit, configured to communicate with the mobile AR server, send an AR service request to the mobile AR server, and acquire AR content associated with the AR target in the AR content server;

展示单元,用于利用所获取的增强现实内容,修饰渲染所述摄像头拍摄的实景中的增强现实目标,并展示。The display unit is configured to use the acquired augmented reality content to decorate and render the augmented reality target in the real scene captured by the camera, and display it.

优选地,所述增强现实业务请求包括以下请求的至少一种:Preferably, the augmented reality service request includes at least one of the following requests:

增强现实目标搜索请求、增强现实内容获取请求、增强现实测度上报请求。AR target search requests, AR content acquisition requests, and AR measurement report requests.

优选地,所述移动增强现实服务器对于增强现实目标搜索请求,根据请求中携带的目标搜索参数进行增强现实目标匹配,获取匹配到的增强现实目标,并返回给所述移动增强现实终端。Preferably, the mobile AR server performs AR target matching according to the target search parameters carried in the request for the AR target search request, acquires the matched AR target, and returns it to the mobile AR terminal.

优选地,所述移动增强现实服务器在增强现实目标搜索参数是用户位置信息时,获取对应增强现实内容及搜索到的增强现实目标,返回给所述移动增强现实终端。Preferably, when the AR target search parameter is user location information, the mobile AR server obtains the corresponding AR content and the searched AR target, and returns them to the mobile AR terminal.

优选地,所述移动增强现实服务器在增强现实目标搜索参数及用户业务设置符合第三方增值业务触发条件时,触发第三方增值业务,并返回执行结果。Preferably, the mobile AR server triggers the third-party value-added service when the AR target search parameters and user service settings meet the triggering conditions of the third-party value-added service, and returns the execution result.

优选地,所述移动增强现实服务器对于增强现实内容获取请求,根据增强现实内容获取请求中携带的内容获取参数获取增强现实内容访问地址,获取增强现实内容并返回给所述移动增强现实终端。Preferably, for the AR content acquisition request, the mobile AR server acquires the AR content access address according to the content acquisition parameters carried in the AR content acquisition request, acquires the AR content and returns it to the mobile AR terminal.

优选地,所述移动增强现实服务器对于增强现实测度上报请求,根据增强现实测度上报请求中携带的测度上报参数进行增强现实目标元数据搜索,获取测度上报通知合法接收方地址。Preferably, the mobile AR server searches the AR target metadata for the AR measurement report request according to the measurement report parameters carried in the AR measurement report request, and obtains the legal recipient address of the measurement report notification.

优选地,所述移动增强现实服务器对于推送请求,向移动增强现实客户端推送所获取的增强现实目标和/或增强现实内容。Preferably, the mobile AR server pushes the acquired AR object and/or AR content to the mobile AR client in response to the push request.

一种移动增强现实服务器,包括增强现实内容/目标递送功能、增强现实内容/目标选择功能和增强现实内容/目标管理功能,其中,A mobile AR server comprising AR content/object delivery functionality, AR content/object selection functionality, and AR content/object management functionality, wherein

增强现实内容/目标选择功能,用于根据接收的移动增强现实客户端的业务请求,搜索增强现实目标,选择并获取增强现实内容;Augmented reality content/target selection function, used to search for augmented reality targets, select and obtain augmented reality content according to the service request received from the mobile augmented reality client;

增强现实内容/目标递送功能,用于通过响应移动增强现实客户端的业务请求,递送增强现实目标和/或增强现实内容至移动增强现实客户端;或者,主动发起请求推送增强现实目标和/或增强现实内容至移动增强现实客户端;Augmented reality content/target delivery function, used to deliver augmented reality targets and/or augmented reality content to mobile augmented reality clients by responding to service requests from mobile augmented reality clients; or actively initiate requests to push augmented reality targets and/or Real content to the mobile augmented reality client;

增强现实内容/目标管理功能,用于根据增强现实内容管理请求,存储并管理增强现实目标部署信息,增强现实内容发布信息,以及增强现实内容缓存策略及本地缓存增强现实内容。The augmented reality content/target management function is used to store and manage augmented reality target deployment information, augmented reality content release information, augmented reality content cache policy and local cache augmented reality content according to augmented reality content management requests.

优选地,所述增强现实业务请求包括以下请求的至少一种:Preferably, the augmented reality service request includes at least one of the following requests:

增强现实目标搜索请求、增强现实内容获取请求、增强现实测度上报请求。AR target search requests, AR content acquisition requests, and AR measurement report requests.

优选地,所述增强现实内容/目标选择功能对于增强现实目标搜索请求,根据请求中携带的目标搜索参数搜索增强现实目标,选择并获取增强现实内容。Preferably, the augmented reality content/object selection function searches for the augmented reality object according to the object search parameters carried in the request for the augmented reality object search request, and selects and acquires the augmented reality content.

优选地,所述增强现实内容/目标选择功能对于增强现实内容获取请求,根据增强现实内容获取请求中携带的内容获取参数获取增强现实内容访问地址,获取增强现实内容。Preferably, for the augmented reality content acquisition request, the augmented reality content/target selection function acquires the augmented reality content access address according to the content acquisition parameters carried in the augmented reality content acquisition request, and acquires the augmented reality content.

22、根据权利要求19所述的移动增强现实服务器,其特征在于,22. The mobile augmented reality server according to claim 19, characterized in that:

所述增强现实内容/目标选择功能对于增强现实测度上报请求,根据增强现实测度上报请求中携带的测度上报参数进行增强现实目标元数据搜索,获取测度上报通知合法接收方地址。The augmented reality content/target selection function searches the augmented reality target metadata for the augmented reality measure report request according to the measure report parameters carried in the augmented reality measure report request, and obtains the legal recipient address of the measure report notification.

优选地,所述增强现实内容/目标管理功能接收到增强现实内容管理请求后,进行增强现实内容管理权限的验证,并在验证通过后促使增强现实内容/目标管理功能更新与管理请求相对应增强现实目标信息。Preferably, after receiving the AR content management request, the AR content/object management function verifies the AR content management authority, and prompts the AR content/object management function to update and correspondingly enhance the management request after the verification is passed. realistic goal information.

优选地,所述增强现实内容/目标管理功能根据增强现实内容管理请求执行结果发送增强现实内容发布状态、部署规则变化信息。Preferably, the augmented reality content/target management function sends augmented reality content publishing status and deployment rule change information according to the execution result of the augmented reality content management request.

一种移动增强现实终端,包括摄像头、状态获取单元、通信单元和展示单元,其中,A mobile augmented reality terminal, including a camera, a state acquisition unit, a communication unit and a display unit, wherein,

摄像头,用于实时拍摄所述移动增强现实终端周围的实景;A camera, used for real-time shooting of the real scene around the mobile augmented reality terminal;

状态获取单元,用于获取所述移动增强现实终端周围的实景信息,当前位置信息;摄像头与地面高度、朝向、与地面夹角信息;A state acquisition unit, configured to acquire real scene information around the mobile augmented reality terminal, current location information; height, orientation, and angle information between the camera and the ground;

通信单元,用于实现与所述移动增强现实服务器的通信,向所述移动增强现实服务器发送增强现实业务请求,并获取增强现实内容服务器中与增强现实目标相关联的增强现实内容;A communication unit, configured to communicate with the mobile AR server, send an AR service request to the mobile AR server, and acquire AR content associated with the AR target in the AR content server;

展示单元,用于利用所获取的增强现实内容,修饰渲染增强现实目标所对应的所述摄像头拍摄的实景,并展示。The display unit is configured to modify and render the real scene captured by the camera corresponding to the augmented reality target by using the acquired augmented reality content, and display it.

本发明克服了现有AR解决方案中应用开发难度大,业务部署成本高,以及用户体验不一致的问题,对AR市场的发展起到良好的推动作用。本发明移动增强现实系统(服务器、客户端)为增强现实应用开发开放API,提供增强现实业务底层能力支撑,包括:目标搜索、内容获取等,从而降低增强现实应用开发难度;移动增强现实服务器为增强现实内容服务器提供增强现实内容发布管理接口,降低增强现实业务部署成本;本发明中移动增强现实业务实现方法适应不同类型的增强现实目标识别、增强现实内容获取,具有良好的可扩展性,在不同应用场景为用户提供统一的业务体验。The invention overcomes the problems of high application development difficulty, high service deployment cost, and inconsistent user experience in the existing AR solution, and plays a good role in promoting the development of the AR market. The mobile augmented reality system (server, client) of the present invention develops an open API for the augmented reality application, and provides augmented reality business underlying capability support, including: target search, content acquisition, etc., thereby reducing the difficulty of augmented reality application development; the mobile augmented reality server is The augmented reality content server provides an augmented reality content release management interface to reduce the deployment cost of augmented reality services; the method for implementing mobile augmented reality services in the present invention is suitable for different types of augmented reality target recognition and augmented reality content acquisition, and has good scalability. Application scenarios provide users with a unified service experience.

附图说明Description of drawings

图1为本发明实现移动增强现实业务的系统的组成结构示意图;Fig. 1 is the composition structure schematic diagram of the system that realizes the mobile augmented reality business of the present invention;

图2为本发明增强现实内容/目标选择功能222的组成结构示意图;FIG. 2 is a schematic diagram of the composition and structure of the augmented reality content/target selection function 222 of the present invention;

图3为本发明增强现实内容/目标管理功能223的组成结构示意图;FIG. 3 is a schematic diagram of the composition and structure of the augmented reality content/object management function 223 of the present invention;

图4为本发明实现移动增强现实业务的方法的流程图;Fig. 4 is the flowchart of the method for realizing the mobile augmented reality service of the present invention;

图5为本发明应用例一实现移动增强现实业务的方法的流程图;Fig. 5 is a flowchart of a method for implementing a mobile augmented reality service in application example 1 of the present invention;

图6为本发明应用例二实现移动增强现实业务的方法的流程图;FIG. 6 is a flowchart of a method for implementing a mobile augmented reality service in Application Example 2 of the present invention;

图7为本发明应用例三实现移动增强现实业务的方法的流程图;FIG. 7 is a flowchart of a method for implementing a mobile augmented reality service in application example 3 of the present invention;

图8为本发明应用例四实现移动增强现实业务的方法的流程图;FIG. 8 is a flow chart of a method for implementing a mobile augmented reality service in Application Example 4 of the present invention;

图9为本发明应用例五实现移动增强现实业务的方法的流程图。FIG. 9 is a flow chart of a method for implementing a mobile augmented reality service according to Application Example 5 of the present invention.

具体实施方式detailed description

为使本发明的目的、技术方案和优点更加清楚明白,以下举实施例并参照附图,对本发明进一步详细说明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail by citing the following embodiments and referring to the accompanying drawings.

图1为本发明实现移动增强现实业务的系统的组成结构示意图,如图1所示,本发明实现移动增强现实业务的系统包括移动增强现实终端200、移动增强现实服务器220、增强现实内容服务器230、支撑业务服务器240和第三方增值应用服务器250;其中,移动增强现实终端200、移动增强现实服务器220、增强现实内容服务器230是实现本发明移动增强现实业务的基本核心网元,支撑业务服务器240和第三方增值应用服务器250用于优化本发明的移动增强现实业务。移动增强现实服务器220、增强现实内容服务器230、支撑业务服务器240和第三方增值应用服务器250均为网络侧网元,移动增强现实终端200通过移动网络等实现对上述网络侧服务器的访问,如发送相关业务请求,获取相关服务器返回的所请求的业务内容。本领域技术人员应当理解,移动增强现实终端200实现对移动网络的访问,实现与上述服务器的通信并获取相关业务内容是容易实现的,本发明不再赘述上述的通信细节。以下,对上述各网元所实现的功能以及其之间是如何实现交互的,进行详细描述。Fig. 1 is a schematic diagram of the composition structure of the system for realizing the mobile augmented reality service of the present invention. As shown in Fig. 1 , the system for realizing the mobile augmented reality service of the present invention includes a mobile augmented reality terminal 200, a mobile augmented reality server 220, and an augmented reality content server 230 , a supporting service server 240 and a third-party value-added application server 250; wherein, the mobile augmented reality terminal 200, the mobile augmented reality server 220, and the augmented reality content server 230 are basic core network elements for realizing the mobile augmented reality service of the present invention, and the supporting service server 240 and the third-party value-added application server 250 are used to optimize the mobile augmented reality service of the present invention. The mobile augmented reality server 220, the augmented reality content server 230, the supporting service server 240 and the third-party value-added application server 250 are network elements on the network side. Relevant business request, obtain the requested business content returned by the relevant server. Those skilled in the art should understand that it is easy for the mobile augmented reality terminal 200 to access the mobile network, communicate with the above server and obtain related service content, and the present invention will not repeat the above communication details. Hereinafter, the functions implemented by the foregoing network elements and how to implement interaction among them will be described in detail.

移动增强现实终端200,用户使用的具备增强现实业务功能的移动终端,除了提供基本的通信功能以外,还可以为用户提供增强现实业务体验,具体还包括以下功能模块:The mobile augmented reality terminal 200 is a mobile terminal with augmented reality service functions used by users. In addition to providing basic communication functions, it can also provide users with augmented reality service experience, and specifically includes the following functional modules:

终端能力部件201,负责移动增强现实业务实现所需信息的采集与展示,包括:The terminal capability component 201 is responsible for the collection and display of information required for the realization of mobile augmented reality services, including:

摄像头,用来实时拍摄用户周围物理世界的实景信息(Camera View)。也可以使用具备显存功能的摄像头,以实时缓存拍摄到的实景信息。The camera is used to capture real-time information (Camera View) of the physical world around the user in real time. It is also possible to use a camera with a video memory function to cache the captured real-scene information in real time.

显示屏幕,为用户呈现摄像头拍摄实景信息在增强现实内容修饰渲染下的增强现实内容视图(AR View,Augmented Reality View);具体的,显示屏幕主要用于展示根据从网络侧的增强现实内容服务器230获取的增强现实内容对对应的增强现实目标进行渲染,并展示给移动增强现实终端200的用户。也就是说,终端能力部件201需要在摄像头所拍摄的实景信息中定位出待进行特别显示的增强现实目标,利用所获取的增强现实目标的对应的增强现实内容对该现实目标进行渲染,然后展示给用户。The display screen presents to the user the augmented reality content view (AR View, Augmented Reality View) of the real-scene information captured by the camera under the modified rendering of the augmented reality content; specifically, the display screen is mainly used to display the AR content server 230 The acquired augmented reality content is rendered to the corresponding augmented reality object, and displayed to the user of the mobile augmented reality terminal 200 . That is to say, the terminal capability component 201 needs to locate the augmented reality object to be specially displayed in the real scene information captured by the camera, use the acquired augmented reality object's corresponding augmented reality content to render the reality object, and then display to the user.

全球卫星定位系统(GPS,Global Positioning System)模块、指南针、传感器等,其中GPS模块与GPS卫星通讯,实时提供终端位置信息(如经纬度信息)。指南针、传感器,用来采集用户终端状态,包括:摄像头朝向、与地面夹角等;这里,移动增强现实终端200之所以具备这些功能模块,主要是为实现对增强现实目标进行相应的图像处理而设置的,也就是说,需要移动增强现实终端200在自身摄像头所拍摄的实景信息中定位出增强现实目标,以方便对其进行相应的图像处理。Global Positioning System (GPS, Global Positioning System) module, compass, sensor, etc., wherein the GPS module communicates with GPS satellites to provide terminal location information (such as latitude and longitude information) in real time. The compass and sensor are used to collect the state of the user terminal, including: the orientation of the camera, the angle between the ground and the like; here, the reason why the mobile augmented reality terminal 200 has these functional modules is mainly to realize the corresponding image processing of the augmented reality target. It is set, that is to say, the mobile augmented reality terminal 200 needs to locate the augmented reality target in the real scene information captured by its own camera, so as to facilitate corresponding image processing on it.

射频识别(RFID,Radio Frequency Identification)阅读器、二维码扫描器、图像识别、计算机视觉处理等模块,实现备选增强现实目标特征进行扫描、输入与提取等。Radio Frequency Identification (RFID, Radio Frequency Identification) reader, two-dimensional code scanner, image recognition, computer vision processing and other modules, to realize the scanning, input and extraction of alternative augmented reality target features.

增强现实应用202,提供移动增强现实业务实现的终端侧应用程序,通过本发明移动增强现实接口MobAR-1访问移动增强现实客户端210提供的增强现实业务支撑能力,在此基础上提供不同形式的增强现实业务体验,如增强现实多媒体广告应用、增强现实导航应用、增强现实游戏应用等。The augmented reality application 202 provides a terminal-side application program for implementing mobile augmented reality services, accesses the augmented reality service support capabilities provided by the mobile augmented reality client 210 through the mobile augmented reality interface MobAR-1 of the present invention, and provides different forms of augmented reality services on this basis. Augmented reality business experience, such as augmented reality multimedia advertising applications, augmented reality navigation applications, augmented reality game applications, etc.

支撑业务客户端203,提供移动增强现实业务实现所需支撑业务的客户端能力实现,包括:The supporting business client 203 provides the realization of the client-side capabilities required for the mobile augmented reality business to support the business, including:

设备管理客户端,基于DM协议,实现设备管理客户端与设备管理服务器之间的通信,为用户移动增强现实终端提供设备管理功能;The device management client, based on the DM protocol, realizes the communication between the device management client and the device management server, and provides device management functions for the user's mobile augmented reality terminal;

可扩展标记语言(XML,Extensible Markup Language)文档管理客户端,基于XML配置访问协议(XCAP,XML Configuration Access Protocol)实现X显示管理器(XDM,XDisplay Manager)客户端与XDM服务器之间的通信,为用户增强现实业务提供用户偏好和业务设置管理功能;Extensible Markup Language (XML, Extensible Markup Language) document management client, based on the XML Configuration Access Protocol (XCAP, XML Configuration Access Protocol) to realize the communication between the X Display Manager (XDM, XDisplay Manager) client and the XDM server, Provide user preference and business setting management functions for user augmented reality services;

呈现客户端,基于会话初始协议(SIP,Session Initiation Protocol),用于呈现客户端与呈现服务器(包含于支撑业务服务器240中)之间的通信,为用户移动增强现实终端提供呈现信息发布功能;The presence client, based on the Session Initiation Protocol (SIP, Session Initiation Protocol), is used for communication between the presence client and the presence server (included in the supporting service server 240), and provides a presence information release function for the user's mobile augmented reality terminal;

移动增强现实客户端210,提供增强现实业务能力客户端功能实体,负责向增强现实服务器220发送增强现实目标搜索请求,获取增强现实内容服务器230中与增强现实目标相关联的增强现实内容,并根据移动增强现实终端200实时状态控制增强现实内容与终端能力部件201摄像头拍摄实景的融合展示。包括以下功能模块:Mobile augmented reality client 210, providing augmented reality business capability client functional entity, responsible for sending augmented reality target search request to augmented reality server 220, obtaining augmented reality content associated with augmented reality target in augmented reality content server 230, and according to The real-time status of the mobile augmented reality terminal 200 controls the fusion display of the augmented reality content and the real scene captured by the camera of the terminal capability part 201 . Including the following functional modules:

增强现实内容获取模块,负责根据增强现实应用202的请求,联系移动增强现实服务器220,发现增强现实目标或直接获取增强现实内容;The augmented reality content acquisition module is responsible for contacting the mobile augmented reality server 220 according to the request of the augmented reality application 202, discovering the augmented reality target or directly acquiring the augmented reality content;

增强现实内容展示模块,负责根据终端能力部件201采集的用户移动增强现实终端实时状态信息,控制所述增强现实内容获取模块获取到的增强现实内容与摄像头拍摄实景在显示屏幕上融合显示;The augmented reality content display module is responsible for controlling the augmented reality content obtained by the augmented reality content acquisition module and the real scene captured by the camera to be fused and displayed on the display screen according to the real-time status information of the user's mobile augmented reality terminal collected by the terminal capability component 201;

移动增强现实服务器220,是增强现实业务提供商部署在网络侧的功能实体,负责实现增强现实服务器端业务逻辑,根据用户业务订购关系以及偏好设置,为用户提供增强现实服务,主要包括以下功能实体:The mobile augmented reality server 220 is a functional entity deployed by the augmented reality service provider on the network side, responsible for implementing the augmented reality server-side business logic, and providing augmented reality services for users according to the user's service subscription relationship and preference settings, mainly including the following functional entities :

增强现实内容/目标递送功能221,负责用户移动增强现实客户端增强现实业务请求的接收与应答,为用户传输移动增强现实服务器发现的增强现实目标和/或获取的增强现实内容。The AR content/target delivery function 221 is responsible for receiving and responding to the user's mobile AR client AR service request, and transmitting the AR target discovered by the mobile AR server and/or the acquired AR content for the user.

增强现实内容/目标递送功能221接收移动增强现实客户端210(移动增强现实终端200)发送的用户侧增强现实业务请求消息,其中,增强现实业务请求消息包括:增强现实目标搜索请求、增强现实内容获取请求、增强现实测度上报请求等增强现实业务类请求消息,并转发增强现实内容/目标选择功能222;以及,接收增强现实内容/目标选择功能222返回的增强现实目标和/或增强现实内容,并在增强现实业务请求应答中将所述增强现实目标和/或增强现实内容返回至请求方移动增强现实客户端;同时,还接收外部支撑业务服务器240发送的网络侧增强现实业务通知消息,其中,增强现实业务通知消息包括:用户移动增强现实终端位置通知消息、用户移动增强现实终端呈现状态通知消息、用户备选增强现实目标特征通知消息等,并转发增强现实内容/目标选择功能222;以及,接收增强现实内容/目标选择功能222返回的增强现实目标和/或增强现实内容,并根据返回响应中携带增强现实用户标识,将所述增强现实目标和/或增强现实内容递送至与该用户对应的移动增强现实客户端。The augmented reality content/target delivery function 221 receives the user-side augmented reality service request message sent by the mobile augmented reality client 210 (mobile augmented reality terminal 200), wherein the augmented reality service request message includes: augmented reality target search request, augmented reality content Acquiring augmented reality business request messages such as request and augmented reality measurement report request, and forwarding the augmented reality content/target selection function 222; and receiving the augmented reality target and/or augmented reality content returned by the augmented reality content/target selection function 222, And return the AR target and/or AR content to the mobile AR client of the requesting party in the AR service request response; at the same time, also receive the network-side AR service notification message sent by the external support service server 240, wherein , the augmented reality service notification message includes: user mobile augmented reality terminal position notification message, user mobile augmented reality terminal presentation state notification message, user alternative augmented reality target feature notification message, etc., and forward the augmented reality content/target selection function 222; and , receive the AR target and/or AR content returned by the AR content/target selection function 222, and deliver the AR target and/or AR content to the user according to the AR user ID carried in the returned response The corresponding mobile augmented reality client.

增强现实内容/目标选择功能222,负责提取所接收增强现实业务请求消息中携带的请求参数,确定增强现实业务类型,并进行相应的移动增强现实业务控制。其中,对于需要访问增强现实目标和/或增强现实内容的业务,确定相关用户上下文和/或业务偏好,据此获取或更新对应增强现实目标和/或增强现实内容。并根据增强现实业务类型对应处理流程处理所述访问得到的增强现实目标和/或增强现实内容;具体的,接收增强现实内容/目标递送功能221转发的用户侧增强现实业务请求,提取该请求消息中携带的请求参数,确定增强现实业务类型:The AR content/target selection function 222 is responsible for extracting the request parameters carried in the received AR service request message, determining the AR service type, and performing corresponding mobile AR service control. Wherein, for services that need to access AR objects and/or AR contents, relevant user context and/or service preferences are determined, and corresponding AR objects and/or AR contents are acquired or updated accordingly. And process the augmented reality target and/or augmented reality content obtained by the access according to the corresponding processing flow of the augmented reality service type; specifically, receive the user-side augmented reality service request forwarded by the augmented reality content/target delivery function 221, and extract the request message The request parameters carried in to determine the augmented reality service type:

对于增强现实目标搜索请求,根据请求中携带的目标搜索参数向增强现实内容/目标管理功能223发送增强现实目标搜索请求,并将搜索的增强现实目标返回增强现实内容/目标递送功能221。For the AR target search request, send the AR target search request to the AR content/target management function 223 according to the target search parameters carried in the request, and return the searched AR target to the AR content/target delivery function 221 .

如果增强现实目标搜索参数是用户位置信息,则增强现实内容/目标选择功能222根据用户偏好及业务设置判断是否同时获取所发现增强现实目标中与用户终端位置比较接近目标所对应的增强现实内容,以供移动增强现实客户端缓存。若是,则增强现实内容/目标选择功能222向增强现实内容服务器230发送增强现实内容获取请求,获取对应增强现实内容并连同搜索到的增强现实目标返回增强现实内容/目标递送功能221。If the augmented reality target search parameter is user location information, the augmented reality content/target selection function 222 judges whether to simultaneously acquire the augmented reality content found in the augmented reality targets that are relatively close to the position of the user terminal according to user preferences and service settings, for mobile augmented reality client caching. If yes, the AR content/object selection function 222 sends an AR content acquisition request to the AR content server 230, obtains the corresponding AR content and returns it to the AR content/object delivery function 221 together with the searched AR object.

如果增强现实目标搜索参数及用户业务设置符合第三方增值应用触发条件,则增强现实内容/目标选择功能222向对应第三方增值应用服务器250发送触发通知,获取第三方增值应用服务内容并连同搜索的增强现实目标返回增强现实内容/目标递送功能221。If the augmented reality target search parameters and user service settings meet the trigger conditions of the third-party value-added application, the augmented reality content/target selection function 222 sends a trigger notification to the corresponding third-party value-added application server 250 to obtain the service content of the third-party value-added application together with the searched value-added application. The augmented reality goal returns the augmented reality content/goal delivery function 221 .

对于增强现实内容获取请求,根据请求中携带的内容获取参数得到增强现实内容访问地址,向对应增强现实内容服务器230发送增强现实内容获取请求,并将获取的增强现实内容返回增强现实内容/目标递送功能221。For the augmented reality content acquisition request, obtain the augmented reality content access address according to the content acquisition parameters carried in the request, send the augmented reality content acquisition request to the corresponding augmented reality content server 230, and return the acquired augmented reality content to the augmented reality content/target delivery function 221.

对于增强现实测度上报请求,根据请求中携带的测度上报参数向增强现实内容/目标管理功能203发送增强现实目标元数据搜索请求,获取测度上报通知合法接收方地址,并向对应的增强现实内容服务器230发送增强现实测度上报通知。For the augmented reality measurement reporting request, send the augmented reality target metadata search request to the augmented reality content/target management function 203 according to the measurement reporting parameters carried in the request, obtain the address of the legal recipient of the measurement reporting notification, and send the request to the corresponding augmented reality content server 230 Sending an augmented reality measurement reporting notification.

接收增强现实内容/目标递送功能221转发的网络侧增强现实业务通知消息,根据用户业务设置判断是否执行增强现实目标自动发现流程。若是,则提取所述通知消息中增强现实目标搜索参数(用户移动增强现实终端位置、用户移动增强现实终端呈现状态、备选增强现实目标特征),向增强现实内容/目标管理功能203发送增强现实目标搜索请求,并将搜索的增强现实目标返回增强现实内容/目标递送功能221。Receive the network-side AR service notification message forwarded by the AR content/target delivery function 221, and judge whether to execute the AR target automatic discovery process according to the user service setting. If so, extract the augmented reality target search parameters (user mobile augmented reality terminal location, user mobile augmented reality terminal presentation status, candidate augmented reality target features) in the notification message, and send the augmented reality target to the augmented reality content/target management function 203. Target search request, and return the searched AR target to the AR content/target delivery function 221 .

增强现实内容/目标管理功能223,负责增强现实目标信息的存储和管理。接收到增强现实内容服务器230发送的增强现实内容管理请求后,执行增强现实内容管理权限控制验证。若通过验证,更新与管理请求相对应增强现实目标信息存储。所述增强现实内容管理请求包括:增强现实内容与增强现实目标关联请求,增强现实内容状态发布请求,增强现实内容部署规则设置请求,以及增强现实测度订阅请求。AR content/target management function 223 is responsible for storage and management of AR target information. After receiving the AR content management request sent by the AR content server 230, the AR content management authority control verification is performed. If the verification is passed, the augmented reality target information store corresponding to the management request is updated. The AR content management request includes: a request for associating AR content with an AR target, an AR content state release request, an AR content deployment rule setting request, and an AR measurement subscription request.

增强现实内容/目标管理功能223接收到增强现实内容/目标选择功能222发送的增强现实目标搜索请求后,根据搜索条件查询增强现实目标信息存储并返回搜索结果;以及,根据增强现实内容管理请求执行结果向增强现实内容/目标选择功能222发送增强现实内容发布状态、部署规则变化通知;After the augmented reality content/target management function 223 receives the augmented reality target search request sent by the augmented reality content/target selection function 222, it queries the augmented reality target information storage according to the search conditions and returns the search results; As a result, AR content release status, deployment rule change notifications are sent to the AR content/target selection function 222;

增强现实内容服务器230,增强现实内容提供商部署在网络侧的功能实体,提供与移动增强现实服务器220中已发布增强现实目标,如兴趣点POI,相关联的增强现实内容,包括:文字、图像、音频、视频等多媒体信息。Augmented reality content server 230, the functional entity deployed by the augmented reality content provider on the network side, provides augmented reality content associated with the published augmented reality target in the mobile augmented reality server 220, such as a point of interest POI, including: text, image , audio, video and other multimedia information.

为更好地实现移动增强现实业务,本发明的移动增强现实系统还包括以下功能实体:In order to better realize the mobile augmented reality service, the mobile augmented reality system of the present invention also includes the following functional entities:

支撑业务服务器240,提供移动增强现实业务实现所需支撑业务的服务器端能力实现,具体包括以下功能实体:The supporting service server 240 provides the server-side capability realization of supporting services required for mobile augmented reality services, specifically including the following functional entities:

设备管理服务器,为用户移动增强现实终端提供终端管理服务;The device management server provides terminal management services for users' mobile augmented reality terminals;

XDM服务器,存储用户增强现实业务偏好并接收移动增强现实服务器查询;The XDM server stores user augmented reality service preferences and receives mobile augmented reality server queries;

呈现服务器,向移动增强现实服务器发送与用户增强现实业务状态相关的呈现信息变化通知;The presence server sends a notification of changes in presence information related to the user's augmented reality service status to the mobile augmented reality server;

计费服务器,接收移动增强现实服务器上报的计费信息并提供收费依据。The billing server receives the billing information reported by the mobile augmented reality server and provides a billing basis.

第三方增值应用服务器250,用于为增强现实用户提供第三方增值服务,具体包括以下功能实体:The third-party value-added application server 250 is used to provide third-party value-added services for augmented reality users, specifically including the following functional entities:

增强现实广告应用、增强现实游戏应用、增强现实社交应用等。Augmented reality advertising applications, augmented reality game applications, augmented reality social applications, etc.

另外,本发明的移动增强现实系统还涉及了一些各功能实体之间的通信接口,进行详细描述,具体如下:In addition, the mobile augmented reality system of the present invention also involves communication interfaces between some functional entities, which are described in detail, as follows:

第一接口(MobAR-1),是移动增强现实客户端开放给增强现实应用的接口,具体支持下述功能:The first interface (MobAR-1) is an interface opened by the mobile augmented reality client to the augmented reality application, and specifically supports the following functions:

增强现实应用通过MobAR-1接口实现下述功能:Augmented reality applications implement the following functions through the MobAR-1 interface:

访问移动增强现实客户端提供的增强现实内容,具体包括:基于位置获取增强现实内容,或者,基于增强现实目标特征匹配获取增强现实内容。Accessing the augmented reality content provided by the mobile augmented reality client specifically includes: acquiring augmented reality content based on location, or acquiring augmented reality content based on augmented reality target feature matching.

访问移动增强现实客户端提供的其他增强现实业务功能,具体包括:增强现实目标特征识别,增强现实目标搜索与跟踪,增强现实内容展示,增强现实内容存储以及增强现实测度上报等。Access other augmented reality business functions provided by the mobile augmented reality client, including: augmented reality object feature recognition, augmented reality object search and tracking, augmented reality content display, augmented reality content storage, and augmented reality measurement reporting, etc.

第二接口(MobAR-2),是移动增强现实服务器开放给移动增强现实客户端的接口,具体支持下述功能:The second interface (MobAR-2) is an interface opened by the mobile augmented reality server to the mobile augmented reality client, and specifically supports the following functions:

移动增强现实服务器通过MobAR-2接口实现下述功能:The mobile augmented reality server implements the following functions through the MobAR-2 interface:

接收移动增强现实客户端的增强现实目标搜索请求,并返回响应;Receive the augmented reality target search request from the mobile augmented reality client, and return a response;

接收移动增强现实客户端的增强现实内容获取请求(PULL),并返回响应;Receive the augmented reality content acquisition request (PULL) of the mobile augmented reality client, and return a response;

接收移动增强现实客户端的增强现实测度上报请求,并返回响应;Receive the augmented reality measurement reporting request from the mobile augmented reality client, and return a response;

通知移动增强现实客户端删除本地缓存的一些增强现实内容;Notify the mobile AR client to delete some AR content in the local cache;

移动增强现实客户端通过MobAR-2接口实现下述功能:请求发现增强现实目标,请求获取增强现实内容,以及请求上报增强现实测度。The mobile augmented reality client implements the following functions through the MobAR-2 interface: request to discover augmented reality objects, request to obtain augmented reality content, and request to report augmented reality measurements.

第三接口(MobAR-3):移动增强现实客户端开放给移动增强现实服务器的接口,具体支持下述功能:The third interface (MobAR-3): the interface that the mobile augmented reality client opens to the mobile augmented reality server, and specifically supports the following functions:

移动增强现实客户端通过MobAR-3接口实现功能:接收移动增强现实服务器递送的增强现实内容(或者目标)(PUSH);The mobile augmented reality client realizes the function through the MobAR-3 interface: receives the augmented reality content (or target) delivered by the mobile augmented reality server (PUSH);

移动增强现实服务器通过MobAR-3接口实现功能:递送(单播)增强现实内容(或目标)至移动增强现实客户端;推送(单播)增强现实内容(或目标)获取通知至移动增强现实客户端;广播增强现实内容(或者目标)至移动增强现实客户端;The mobile augmented reality server implements functions through the MobAR-3 interface: deliver (unicast) augmented reality content (or target) to the mobile augmented reality client; push (unicast) augmented reality content (or target) acquisition notification to the mobile augmented reality client terminal; broadcast augmented reality content (or target) to the mobile augmented reality client;

第四接口(MobAR-4),是移动增强现实服务器开放给增强现实内容服务器的接口,具体支持下述功能:The fourth interface (MobAR-4) is an interface opened by the mobile augmented reality server to the augmented reality content server, and specifically supports the following functions:

移动增强现实服务器通过MobAR-4接口实现功能:接收增强现实内容服务器发送的增强现实内容管理请求,其中,增强现实内容管理请求包括:增强现实内容与增强现实目标关联请求,增强现实内容状态发布请求,增强现实内容部署规则设置请求,增强现实测度订阅请求等;The mobile augmented reality server realizes the function through the MobAR-4 interface: receives the augmented reality content management request sent by the augmented reality content server, wherein the augmented reality content management request includes: the request for associating the augmented reality content with the augmented reality target, and the request for publishing the status of the augmented reality content , AR content deployment rule setting request, AR measurement subscription request, etc.;

增强现实内容服务器通过MobAR-4接口实现功能:发送增强现实内容管理请求至移动增强现实服务器。The augmented reality content server realizes the function through the MobAR-4 interface: sends the augmented reality content management request to the mobile augmented reality server.

图2为本发明增强现实内容/目标选择功能222的组成结构示意图,如图2所示,增强现实内容/目标选择功能222包括下述处理单元:FIG. 2 is a schematic diagram of the composition and structure of the augmented reality content/target selection function 222 of the present invention. As shown in FIG. 2, the augmented reality content/target selection function 222 includes the following processing units:

增强现实请求处理单元321,负责接收增强现实内容/目标递送功能310转发的增强现实业务请求,提取请求参数并确定增强现实请求对应的业务类型,转发增强现实目标搜索单元322或者增强现实内容获取单元323处理;The AR request processing unit 321 is responsible for receiving the AR service request forwarded by the AR content/target delivery function 310, extracting the request parameters and determining the service type corresponding to the AR request, and forwarding the AR service request to the AR target search unit 322 or the AR content acquisition unit 323 processing;

增强现实目标搜索单元322,负责处理增强现实目标搜索业务请求。根据请求中携带目标搜索参数向增强现实内容/目标管理功能330发送增强现实目标搜索请求,并接收搜索结果;The augmented reality object search unit 322 is responsible for processing the augmented reality object search service request. Send an AR target search request to the AR content/target management function 330 according to the target search parameters carried in the request, and receive the search result;

如果增强现实目标搜索参数是用户位置信息,且用户偏好及业务设置允许同时获取所发现增强现实目标中与用户终端位置比较接近目标所对应增强现实内容,则增强现实目标搜索单元322向增强现实内容获取单元323发送与用户当前位置接近增强现实目标对应增强现实内容获取请求;If the augmented reality target search parameter is user location information, and user preferences and service settings allow simultaneous acquisition of the augmented reality content corresponding to the discovered augmented reality target that is closer to the user terminal location, then the augmented reality target search unit 322 sends the augmented reality content The acquisition unit 323 sends an augmented reality content acquisition request corresponding to the user's current position close to the augmented reality target;

增强现实内容获取单元323,负责处理增强现实内容获取业务请求。根据请求中携带的内容获取参数向增强现实内容服务器400发送增强现实内容获取请求,并接收返回内容;The augmented reality content acquisition unit 323 is responsible for processing the augmented reality content acquisition service request. Send an augmented reality content acquisition request to the augmented reality content server 400 according to the content acquisition parameters carried in the request, and receive the returned content;

增强现实内容过滤单元324,负责根据用户上下文和/或业务偏好过滤增强现实目标搜索单元322发现的增强现实目标,以及增强现实内容获取单元获取的增强现实内容,并将最终结果返回增强现实内容传输单元321;The AR content filtering unit 324 is responsible for filtering the AR targets found by the AR target search unit 322 and the AR content acquired by the AR content acquisition unit according to the user context and/or business preferences, and returning the final result to the AR content transmission Unit 321;

用户上下文及偏好340,代表增强现实内容/目标选择功能222获取的增强现实业务使用过程中用户相关信息。The user context and preference 340 represents user-related information obtained by the AR content/target selection function 222 during use of the AR service.

用户上下文是指与用户及其使用终端相关状态信息,包括:用户当前位置、移动增强现实终端能力(屏幕尺寸、终端电量、存储空间、媒体播放能力等)。用户上下文通常动态更新,可以通过增强现实业务请求上报移动增强现实服务器,也可以通过请求其他外部支撑功能实体获取,如通过请求开放式移动体系结构(OMA,Open Mobile Architecture)DPE获取。User context refers to the state information related to the user and the terminal used, including: the user's current location, mobile augmented reality terminal capabilities (screen size, terminal power, storage space, media playback capabilities, etc.). The user context is usually dynamically updated, which can be reported to the mobile AR server through an AR service request, or obtained by requesting other external supporting functional entities, such as by requesting an Open Mobile Architecture (OMA, Open Mobile Architecture) DPE.

用户业务偏好是指是指与用户使用增强现实业务相关业务设置信息,包括:增强现实目标搜索范围半径、增强现实内容过滤规则、增强现实内容主动传输触发条件等。用户业务偏好可以存储在移动增强现实服务器,也可以通过请求其他外部存储实体获取,如通过请求OMA Shared Preference XDMS获取。User service preference refers to service setting information related to the use of augmented reality services by users, including: augmented reality target search range radius, augmented reality content filtering rules, trigger conditions for active transmission of augmented reality content, etc. User service preferences can be stored in the mobile augmented reality server, or can be obtained by requesting other external storage entities, for example, by requesting OMA Shared Preference XDMS.

图3为本发明增强现实内容/目标管理功能223的组成结构示意图,如图3所示,增强现实内容/目标管理功能223包括以下处理单元:FIG. 3 is a schematic diagram of the structure of the augmented reality content/object management function 223 of the present invention. As shown in FIG. 3, the augmented reality content/object management function 223 includes the following processing units:

增强现实目标信息存储单元331,负责存储增强现实目标信息,接收增强现实内容/目标选择功能222的查询请求。支持不同类型的增强现实目标,包括:兴趣点(POI)、人、建筑物、自然景物(山川、河流)等。The AR target information storage unit 331 is responsible for storing the AR target information and receiving the query request from the AR content/target selection function 222 . Support different types of augmented reality objects, including: points of interest (POI), people, buildings, natural scenery (mountains, rivers), etc.

所存储的增强现实目标信息包括:The stored augmented reality target information includes:

1)增强现实目标属性,包括:增强现实目标的地理位置、名称、标识、类别、元数据(创建时间、作者、是否可见),以及增强现实目标之间关系等;1) Augmented reality target attributes, including: the geographic location, name, logo, category, metadata (creation time, author, visible or not) of the augmented reality target, and the relationship between the augmented reality targets, etc.;

2)相关联增强现实内容属性,包括:增强现实内容的名称、标识、格式、尺寸、发布时间、发布者、访问地址等;2) Associated augmented reality content attributes, including: the name, logo, format, size, release time, publisher, access address, etc. of the augmented reality content;

3)相关联增强现实内容部署规则,包括:增强现实内容部署开始时间、部署周期,基于用户设置的相同增强现实目标与不同增强现实内容之间的关联,基于时间设置的相同增强现实目标与不同增强现实内容之间的关联,针对额外增强现实内容的访问控制规则等;3) Associated AR content deployment rules, including: AR content deployment start time, deployment cycle, association between the same AR target and different AR content based on user settings, time-based setting of the same AR target and different AR content Association between augmented reality content, access control rules for additional augmented reality content, etc.;

4)增强现实目标测度访问控制列表,包括:增强现实目标测度上报通知的合法接收者标识;4) Augmented reality target measurement access control list, including: the legal recipient identification of the augmented reality target measurement reporting notification;

增强现实内容/目标推送单元332,负责接收增强现实内容服务器400发送的增强现实内容管理请求,执行访问权限控制验证,验证请求的合法性。识别管理请求类型,并根据请求中携带的增强现实内容管理对象信息更新增强现实目标信息存储。The augmented reality content/target push unit 332 is responsible for receiving the augmented reality content management request sent by the augmented reality content server 400, performing access control verification, and verifying the legitimacy of the request. Identify the management request type, and update the AR target information storage according to the AR content management object information carried in the request.

以下通过具体的示例应用,对本发明的实现移动增强现实业务的系统及其相应网元,以及各网元之间如何实现交互而实现移动增强现实业务的,进行详细的描述。The system for implementing mobile augmented reality services and its corresponding network elements of the present invention, and how to implement interaction between network elements to implement mobile augmented reality services will be described in detail below through specific example applications.

图4为本发明实现移动增强现实业务的方法的流程图,如图4所示,本发明实现移动增强现实业务的方法具体包括以下步骤:Fig. 4 is the flowchart of the method for realizing the mobile augmented reality service of the present invention, as shown in Fig. 4, the method for realizing the mobile augmented reality service of the present invention specifically comprises the following steps:

步骤S100,移动增强现实服务器接收增强现实业务请求消息。所述增强现实业务请求包括增强现实目标发现请求、增强现实内容获取请求、增强现实测度上报请求、增强现实内容管理请求等增强现实业务类请求消息。In step S100, the mobile AR server receives an AR service request message. The AR service request includes AR service request messages such as an AR target discovery request, an AR content acquisition request, an AR measurement report request, and an AR content management request.

步骤S110,移动增强现实服务器根据所述增强现实业务请求消息携带的请求参数确定业务类型并进行相应的移动增强现实服务器端业务控制。其中,对于需要访问增强现实目标和/或增强现实内容的业务,确定相关用户上下文和/或业务偏好,据此获取或更新对应增强现实目标和/或增强现实内容。Step S110, the mobile AR server determines the service type according to the request parameter carried in the AR service request message and performs corresponding mobile AR server-side service control. Wherein, for services that need to access AR objects and/or AR contents, relevant user context and/or service preferences are determined, and corresponding AR objects and/or AR contents are acquired or updated accordingly.

以下通过具体示例,进一步阐明本发明技术方案的实质。The essence of the technical solution of the present invention is further clarified through specific examples below.

图5为本发明应用例一实现移动增强现实业务的方法的流程图,如图5所示,本示例是实现移动增强现实客户端请求发现增强现实目标并获取相应增强现实内容的流程图,为PULL模式;本示例实现移动增强现实业务的方法具体包括以下步骤:Fig. 5 is a flow chart of a method for implementing a mobile augmented reality service in application example 1 of the present invention. As shown in Fig. 5, this example is a flowchart of realizing a mobile augmented reality client requesting to discover an augmented reality target and obtaining corresponding augmented reality content, which is PULL mode; the method for realizing the mobile augmented reality service in this example specifically includes the following steps:

步骤F1,用户启动移动增强现实终端上的增强现实应用,增强现实应用请求移动增强现实客户端发现可获取的增强现实目标;Step F1, the user starts the augmented reality application on the mobile augmented reality terminal, and the augmented reality application requests the mobile augmented reality client to find available augmented reality targets;

步骤F2,移动增强现实客户端通过移动增强现实终端能力部件采集终端上下文(经纬度信息)和/或备选增强现实目标特征(RFID标识、图像特征码),生成增强现实目标搜索参数,并向移动增强现实服务器发送增强现实目标搜索请求;Step F2, the mobile augmented reality client collects terminal context (latitude and longitude information) and/or alternative augmented reality target features (RFID identification, image feature code) through the mobile augmented reality terminal capability component, generates augmented reality target search parameters, and sends to the mobile The augmented reality server sends an augmented reality target search request;

步骤F3,移动增强现实服务器中增强现实内容/目标递送功能将该请求转发增强现实内容/目标选择功能;Step F3, the augmented reality content/target delivery function in the mobile augmented reality server forwards the request to the augmented reality content/target selection function;

步骤F4,增强现实内容/目标选择功能提取所述请求中的增强现实目标搜索参数(用户终端位置参数、备选增强现实目标特征参数),并据此向增强现实内容/目标管理功能发送增强现实目标搜索请求;Step F4, the augmented reality content/target selection function extracts the augmented reality target search parameters (user terminal location parameters, alternative augmented reality target characteristic parameters) in the request, and sends the augmented reality target to the augmented reality content/target management function accordingly target search request;

步骤F5,增强现实内容/目标管理功能根据目标搜索参数检索增强现实目标存储,并返回匹配到的增强现实目标元数据集合;Step F5, the augmented reality content/object management function retrieves the augmented reality object storage according to the object search parameters, and returns the matched augmented reality object metadata set;

步骤F6至步骤F7,如果增强现实目标搜索参数是用户终端位置信息,则增强现实内容/目标选择功能根据用户偏好及业务设置判断是否同时获取所发现增强现实目标中与用户终端位置比较接近目标所对应的增强现实内容,以供移动增强现实客户端缓存。如果增强现实目标搜索参数不是用户终端位置信息,则增强现实内容/目标选择功能向增强现实内容服务器发送增强现实内容获取请求,获取对应增强现实内容;From step F6 to step F7, if the augmented reality target search parameter is user terminal location information, then the augmented reality content/target selection function judges whether to simultaneously obtain the found augmented reality targets that are closer to the target than the user terminal position according to user preferences and service settings. The corresponding augmented reality content is cached by the mobile augmented reality client. If the augmented reality target search parameter is not the location information of the user terminal, the augmented reality content/target selection function sends an augmented reality content acquisition request to the augmented reality content server to acquire the corresponding augmented reality content;

步骤F8,增强现实内容/目标选择功能根据用户偏好及上下文过滤所获取的增强现实目标(或目标及内容),得到符合用户偏好及用户终端当前状态的增强现实目标(或目标及内容),并返回增强现实内容/目标递送功能;Step F8, the augmented reality content/target selection function filters the acquired augmented reality target (or target and content) according to the user preference and context, and obtains the augmented reality target (or target and content) that meets the user preference and the current state of the user terminal, and return augmented reality content/target delivery function;

步骤F9,增强现实内容/目标递送功能向移动增强现实客户端返回应答,携带所获取的增强现实目标(或目标及内容);Step F9, the augmented reality content/target delivery function returns a response to the mobile augmented reality client, carrying the acquired augmented reality target (or target and content);

步骤F10,移动增强现实客户端向增强现实应用返回已发现的增强现实目标元数据,包括:增强现实目标标识、名称、描述等信息。此外,移动增强现实客户端还将缓存同时获取的增强现实内容。增强现实应用则根据自身业务逻辑在终端屏幕上展示与已发现增强现实目标对应的增强现实标签;In step F10, the mobile AR client returns the discovered AR target metadata to the AR application, including: the AR target ID, name, description and other information. In addition, the mobile AR client will also cache the concurrently fetched AR content. The augmented reality application displays the augmented reality label corresponding to the discovered augmented reality target on the terminal screen according to its own business logic;

步骤F11,根据用户选择操作,增强现实应用请求移动增强现实客户端获取与某个增强现实目标对应的增强现实内容;Step F11, according to the operation selected by the user, the augmented reality application requests the mobile augmented reality client to obtain the augmented reality content corresponding to a certain augmented reality target;

步骤F12,移动增强现实客户端根据所选择增强现实目标生成增强现实内容获取参数,向移动增强现实服务器发送增强现实内容获取请求;Step F12, the mobile AR client generates AR content acquisition parameters according to the selected AR target, and sends an AR content acquisition request to the mobile AR server;

步骤F13,移动增强现实服务器中增强现实内容/目标递送功能将该请求转发增强现实内容/目标选择功能。增强现实内容/目标选择功能提取所述请求中增强现实内容获取参数,得到与所选择增强现实目标对应的增强现实内容访问地址,若增强现实内容获取参数为相关联增强现实目标标识,则增强现实内容/目标选择功能将请求增强现实内容/目标管理功能查询对应增强现实内容访问地址;Step F13, the AR content/target delivery function in the mobile AR server forwards the request to the AR content/target selection function. The augmented reality content/target selection function extracts the augmented reality content acquisition parameters in the request, and obtains the augmented reality content access address corresponding to the selected augmented reality target. If the augmented reality content acquisition parameter is the associated augmented reality target identifier, the augmented reality The content/target selection function will request the augmented reality content/target management function to query the corresponding augmented reality content access address;

步骤F14至步骤F15,增强现实内容/目标选择功能根据访问地址向提供该内容的增强现实内容服务器发送增强现实内容获取请求,并获取增强现实实际内容;From step F14 to step F15, the augmented reality content/target selection function sends an augmented reality content acquisition request to the augmented reality content server providing the content according to the access address, and acquires the actual augmented reality content;

步骤F16,增强现实内容/目标选择功能根据用户偏好及上下文过滤所获取的增强现实内容,得到符合用户偏好及用户终端当前状态的增强现实内容,并返回增强现实内容/目标递送功能;Step F16, the augmented reality content/target selection function filters the acquired augmented reality content according to the user preference and context, obtains the augmented reality content that meets the user preference and the current state of the user terminal, and returns the augmented reality content/target delivery function;

步骤F17,增强现实内容/目标递送功能向移动增强现实客户端返回应答,携带所获取的增强现实内容;Step F17, the augmented reality content/target delivery function returns a response to the mobile augmented reality client, carrying the acquired augmented reality content;

步骤F18,移动增强现实客户端向增强现实应用返回已获取的增强现实实际内容。增强现实应用则根据自身业务逻辑在终端屏幕上展示该内容。Step F18, the mobile AR client returns the acquired AR actual content to the AR application. The augmented reality application displays the content on the terminal screen according to its own business logic.

图6为本发明应用例二实现移动增强现实业务的方法的流程图,如图6所示,本示例是实现移动增强现实服务器主动发现增强现实目标并传输相应增强现实内容的流程图,为PUSH模式;本示例实现移动增强现实业务的方法具体包括以下步骤:Fig. 6 is a flow chart of the method for realizing the mobile augmented reality service in the second application example of the present invention. As shown in Fig. 6, this example is a flowchart of realizing the active discovery of the augmented reality target by the mobile augmented reality server and transmitting the corresponding augmented reality content, which is PUSH mode; the method for realizing the mobile augmented reality service in this example specifically includes the following steps:

步骤F1至步骤F2,移动增强现实服务器接收外部支撑业务服务器有关用户移动增强现实终端业务通知消息,譬如基于位置服务(LBS,Location Based Service)Server发送的用户位置变化信息(进入某一位置区域),以及呈现业务服务器(Presence Server)发送的用户终端呈现状态(打开摄像头拍摄功能),或者第三方图形图像识别服务器发送的根据用户移动增强现实终端拍摄图像计算分析出的备选增强现实目标特征;From step F1 to step F2, the mobile augmented reality server receives the service notification message about the user's mobile augmented reality terminal from the external support service server, such as the user location change information (entering a certain location area) sent by the location based service (LBS, Location Based Service) server , and the presence status of the user terminal sent by the presence service server (Presence Server) (the camera shooting function is turned on), or the alternative augmented reality target features calculated and analyzed according to the image taken by the user's mobile augmented reality terminal sent by the third-party graphic image recognition server;

步骤F3,移动增强现实服务器中增强现实内容/目标递送功能将该通知消息转发增强现实内容/目标选择功能;Step F3, the augmented reality content/target delivery function in the mobile augmented reality server forwards the notification message to the augmented reality content/target selection function;

步骤F4,增强现实内容/目标选择功能根据用户增强现实业务设置判断是否执行增强现实目标自动发现流程。若是,则提取所述通知消息中增强现实目标搜索参数(用户终端位置参数、备选增强现实目标特征参数),并据此向增强现实内容/目标管理功能发送增强现实目标搜索请求;Step F4, the augmented reality content/target selection function judges whether to execute the augmented reality target automatic discovery process according to the user's augmented reality service settings. If so, then extract the augmented reality target search parameters (user terminal location parameters, alternative augmented reality target feature parameters) in the notification message, and send an augmented reality target search request to the augmented reality content/target management function accordingly;

步骤F5,增强现实内容/目标管理功能根据目标搜索参数检索增强现实目标存储,并返回匹配到的增强现实目标元数据集合;Step F5, the augmented reality content/object management function retrieves the augmented reality object storage according to the object search parameters, and returns the matched augmented reality object metadata set;

步骤F6至步骤F7,如果增强现实目标搜索参数是用户终端位置信息,则增强现实内容/目标选择功能根据用户偏好及业务设置判断是否同时获取所发现增强现实目标中与用户终端位置比较接近目标所对应的增强现实内容,以供移动增强现实客户端缓存。如果增强现实目标搜索参数不是用户终端位置信息,则增强现实内容/目标选择功能向增强现实内容服务器发送增强现实内容获取请求,获取对应增强现实内容;From step F6 to step F7, if the augmented reality target search parameter is user terminal location information, then the augmented reality content/target selection function judges whether to simultaneously obtain the found augmented reality targets that are closer to the target than the user terminal position according to user preferences and service settings. The corresponding augmented reality content is cached by the mobile augmented reality client. If the augmented reality target search parameter is not the location information of the user terminal, the augmented reality content/target selection function sends an augmented reality content acquisition request to the augmented reality content server to acquire the corresponding augmented reality content;

步骤F8,增强现实内容/目标选择功能根据用户偏好及上下文过滤所获取的增强现实目标(或目标及内容),得到符合用户偏好及用户终端当前状态的增强现实目标(或目标及内容),并返回增强现实内容/目标递送功能;Step F8, the augmented reality content/target selection function filters the acquired augmented reality target (or target and content) according to the user preference and context, and obtains the augmented reality target (or target and content) that meets the user preference and the current state of the user terminal, and return augmented reality content/target delivery function;

步骤F9至步骤F10,增强现实内容/目标递送功能向移动增强现实客户端递送所获取的增强现实目标(或目标及内容);From step F9 to step F10, the augmented reality content/target delivery function delivers the acquired augmented reality target (or target and content) to the mobile augmented reality client;

步骤F11至步骤F12,移动增强现实客户端向增强现实应用提供已发现的增强现实目标元数据,包括:增强现实目标标识、名称、描述等信息。此外,移动增强现实客户端还将缓存同时获取的增强现实内容。增强现实应用则根据自身业务逻辑在增强现实终端屏幕上展示与已发现增强现实目标对应的增强现实标签;From step F11 to step F12, the mobile AR client provides the discovered AR object metadata to the AR application, including information such as: AR object identification, name, and description. In addition, the mobile AR client will also cache the concurrently fetched AR content. The augmented reality application displays the augmented reality label corresponding to the discovered augmented reality target on the augmented reality terminal screen according to its own business logic;

步骤F13至步骤F20,与图4的步骤F11至步骤F18完全相同,这里不再赘述。Steps F13 to F20 are identical to steps F11 to F18 in FIG. 4 , and will not be repeated here.

图7为本发明应用例三实现移动增强现实业务的方法的流程图,如图7所示,本示例是实现增强现实内容服务器管理增强现实内容的流程图,本示例实现移动增强现实业务的方法具体包括以下步骤:Fig. 7 is a flow chart of the method for realizing the mobile augmented reality service in application example 3 of the present invention. As shown in Fig. 7, this example is a flow chart of realizing the management of augmented reality content by the augmented reality content server, and this example realizes the method of mobile augmented reality service Specifically include the following steps:

步骤F1,增强现实内容服务器发送增强现实内容管理请求至移动增强现实服务器,所述请求携带增强现实内容管理请求类型字段:“Type=Association”,表示希望建立增强现实目标与增强现实内容之间联系,以及相应管理对象信息,包括:增强现实目标标识“AR Target ID”,增强现实内容标识“AR Content ID”,以及当前增强现实内容发布状态“Available”或“Unavailable”;Step F1, the AR content server sends an AR content management request to the mobile AR server, and the request carries an AR content management request type field: "Type=Association", indicating that it is desired to establish a relationship between the AR target and the AR content , and corresponding management object information, including: AR target ID "AR Target ID", AR content ID "AR Content ID", and current AR content publishing status "Available" or "Unavailable";

步骤F2,增强现实内容/目标管理功能执行增强现实内容服务器访问权限控制,判断是否具备相关增强现实内容管理权限。若通过验证,则增强现实内容/目标管理功能触发增强现实内容发布单元更新增强现实目标信息存储中与所述请求管理对象相对应的增强现实目标信息,即建立所述请求中增强现实目标与增强现实内容之间的联系;Step F2, the augmented reality content/object management function executes the access authority control of the augmented reality content server, and judges whether it has the relevant augmented reality content management authority. If the verification is passed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the requested management object in the augmented reality target information store, that is, to establish the augmented reality target and augmented reality target in the request. Links between real-life content;

步骤F3至步骤F4,移动增强现实服务器向增强现实内容服务器返回增强现实内容管理请求应答;From step F3 to step F4, the mobile AR server returns an AR content management request response to the AR content server;

步骤F5,增强现实内容服务器发送增强现实内容管理请求至移动增强现实服务器,所述请求携带增强现实内容管理请求类型字段:“Type=Publication”,表示请求更新与增强现实目标相联系的增强现实内容发布状态,以及相应管理对象信息,包括:增强现实目标标识“AR Target ID”,增强现实内容标识“AR Content ID”,以及当前增强现实内容发布状态“Available”或“Unavailable”;Step F5, the AR content server sends an AR content management request to the mobile AR server, and the request carries an AR content management request type field: "Type=Publication", indicating that it is requested to update the AR content associated with the AR target Publishing status, and corresponding management object information, including: AR target ID "AR Target ID", AR content ID "AR Content ID", and current AR content publishing status "Available" or "Unavailable";

步骤F6,增强现实内容/目标管理功能执行增强现实内容服务器访问权限控制,判断是否具备相关增强现实内容管理权限。若通过验证,则增强现实内容/目标管理功能触发增强现实内容发布单元更新增强现实目标信息存储中与所述请求管理对象相对应的增强现实目标信息,即更新所述请求中增强现实内容发布状态;Step F6, the augmented reality content/object management function executes the access authority control of the augmented reality content server, and judges whether it has the relevant augmented reality content management authority. If the verification is passed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information store, that is, to update the augmented reality content publishing status in the request ;

步骤F7至步骤F8,移动增强现实服务器向增强现实内容服务器返回增强现实内容管理请求应答;From step F7 to step F8, the mobile AR server returns an AR content management request response to the AR content server;

步骤F9至步骤F10,增强现实内容/目标管理功能向增强现实内容/目标选择功能发送增强现实内容发布状态变化通知,其中携带相关增强现实目标标识、增强现实内容标识、增强现实内容当前发布状态、访问地址等;From step F9 to step F10, the augmented reality content/object management function sends an augmented reality content release status change notification to the augmented reality content/target selection function, which carries the relevant augmented reality target identifier, augmented reality content identifier, current release status of the augmented reality content, Access address, etc.;

步骤F11,增强现实内容/目标选择功能根据用户上下文和/或业务偏好经由增强现实传输功能向相关用户移动增强现实客户端发送增强现实内容发布状态变化通知。可以向已经发现对应增强现实目标的移动增强现实客户端发送通知,也可能向已经获取相关增强现实内容的移动增强现实客户端发送通知,所述通知中携带对应增强现实目标标识、增强现实内容标识、增强现实内容当前发布状态、访问地址等。Step F11 , the AR content/target selection function sends the AR content release status change notification to the mobile AR client of the relevant user via the AR transmission function according to the user context and/or business preference. Notifications may be sent to mobile AR clients that have discovered the corresponding AR target, or may be sent to mobile AR clients that have acquired relevant AR content, the notification carrying the corresponding AR target ID, AR content ID , the current release status of augmented reality content, access address, etc.

移动增强现实客户端根据接收到的通知执行相应增强现实业务控制流程,包括:The mobile augmented reality client executes the corresponding augmented reality business control process according to the received notification, including:

如果增强现实内容发布状态变为不可用,或者在增强现实目标展示标签中显示提示信息,或者删除本地缓存的增强现实内容;If the augmented reality content publishing status becomes unavailable, or display a prompt message in the augmented reality target display tab, or delete the locally cached augmented reality content;

如果与某个增强现实目标相关联的增强现实内容发生改变,或者在增强现实目标展示标签中显示提示信息,或者请求获取变化后的增强现实内容;If the augmented reality content associated with an augmented reality target changes, or display a prompt message in the augmented reality target display tab, or request to obtain the changed augmented reality content;

步骤F12,增强现实内容服务器发送增强现实内容管理请求至移动增强现实服务器,所述请求携带增强现实内容管理请求类型字段:“Type=Deployment”,表示希望设置增强现实内容的部署规则,以及相应管理对象信息,包括:增强现实目标标识“AR TargetID”,增强现实内容标识“AR Content ID”,以及与增强现实内容部署访问相关控制规则,至少包括:增强现实内容部署开始时间“Start time”及部署周期“duration”,基于用户设置的同一增强现实目标与不同增强现实内容之间的关联“association based on user”,基于时间设置的同一增强现实目标与不同增强现实内容之间的关联“association based ontime”,针对额外增强现实内容的访问控制规则“Access control to premium content”;Step F12, the AR content server sends the AR content management request to the mobile AR server, and the request carries the AR content management request type field: "Type=Deployment", indicating that it is desired to set the deployment rules of the AR content, and the corresponding management Object information, including: augmented reality target identifier "AR TargetID", augmented reality content identifier "AR Content ID", and access control rules related to augmented reality content deployment, at least including: augmented reality content deployment start time "Start time" and deployment Period "duration", based on the association between the same AR target and different AR content set by the user "association based on user", based on the association between the same AR target and different AR content set based on time "association based ontime ", the access control rule "Access control to premium content" for additional augmented reality content;

步骤F13,增强现实内容/目标管理功能执行增强现实内容服务器访问权限控制,判断是否具备相关增强现实内容管理权限。若通过验证,则增强现实内容/目标管理功能触发增强现实内容发布单元更新增强现实目标信息存储中与所述请求管理对象相对应的增强现实目标信息,即建立所述请求中增强现实内容部署规则;Step F13, the augmented reality content/target management function executes the access authority control of the augmented reality content server, and judges whether it has the relevant augmented reality content management authority. If the verification is passed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the request management object in the augmented reality target information store, that is, establish the deployment rule of the augmented reality content in the request ;

步骤F14至步骤F15,移动增强现实服务器向增强现实内容服务器返回增强现实内容管理请求应答;From step F14 to step F15, the mobile AR server returns an AR content management request response to the AR content server;

步骤F16至步骤F17,增强现实内容/目标管理功能向增强现实内容/目标选择功能发送增强现实内容部署规则变化通知,其中携带相关增强现实目标标识、增强现实内容标识、增强现实内容部署规则等;From step F16 to step F17, the AR content/object management function sends an AR content deployment rule change notification to the AR content/target selection function, which carries relevant AR target IDs, AR content IDs, AR content deployment rules, etc.;

步骤F18,增强现实内容/目标选择功能根据用户上下文和/或业务偏好经由增强现实传输功能向相关用户移动增强现实客户端发送增强现实内容发布状态变化通知。移动增强现实客户端根据接收到的通知执行相应增强现实业务控制流程。Step F18, the AR content/target selection function sends the AR content release status change notification to the mobile AR client of the relevant user via the AR transmission function according to the user context and/or business preference. The mobile augmented reality client executes the corresponding augmented reality service control process according to the received notification.

步骤F19,增强现实内容服务器发送增强现实内容管理请求至移动增强现实服务器,所述请求携带增强现实内容管理请求类型:“Type=Subscription”或“Type=Unsubscribe”,表示希望订阅或者取消订阅增强现实目标及增强现实内容测度上报通知,以及相应管理对象信息,包括:增强现实目标标识“AR Target ID”,增强现实内容标识“ARContent ID”,以及订阅周期“duration”;Step F19, the AR content server sends an AR content management request to the mobile AR server, and the request carries the AR content management request type: "Type=Subscription" or "Type=Unsubscribe", indicating the desire to subscribe or unsubscribe the AR content Target and augmented reality content measurement report notification, and corresponding management object information, including: augmented reality target identifier "AR Target ID", augmented reality content identifier "ARContent ID", and subscription cycle "duration";

步骤F20,增强现实内容/目标管理功能执行增强现实内容服务器访问权限控制,判断是否具备相关增强现实内容管理权限。若通过验证,则增强现实内容/目标管理功能触发增强现实内容发布单元更新增强现实目标信息存储中与所述请求管理对象相对应的增强现实目标信息,即增加或删除增强现实目标及增强现实内容测度上报通知对象;Step F20, the augmented reality content/target management function executes the access authority control of the augmented reality content server, and judges whether it has the relevant augmented reality content management authority. If the verification is passed, the augmented reality content/target management function triggers the augmented reality content publishing unit to update the augmented reality target information corresponding to the requested management object in the augmented reality target information store, that is, to add or delete the augmented reality target and the augmented reality content Measurement report notification object;

步骤F21至步骤F22,移动增强现实服务器向增强现实内容服务器返回增强现实内容管理请求应答。From step F21 to step F22, the mobile AR server returns an AR content management request response to the AR content server.

图8为本发明应用例四实现移动增强现实业务的方法的流程图,如图8所示,本示例是实现增强现实应用请求增强现实测度上报的流程图,本示例实现移动增强现实业务的方法具体包括以下步骤:Fig. 8 is a flowchart of a method for implementing mobile augmented reality services in application example 4 of the present invention. As shown in Fig. 8, this example is a flowchart for implementing an augmented reality application to request augmented reality measurement reporting, and this example implements a method for mobile augmented reality services Specifically include the following steps:

步骤F1至步骤F2,增强现实应用根据用户使用增强现实业务过程的反馈信息,构造生成增强现实测度(AR Metrics),包括:用户所选择操作的增强现实标签,用户增强现实内容访问历史,譬如:访问时间、增强现实目标位置、对应增强现实内容标识等。增强现实应用上报所述增强现实测度至移动增强现实客户端;From step F1 to step F2, the augmented reality application constructs and generates augmented reality metrics (AR Metrics) according to the feedback information of the user's use of the augmented reality business process, including: the augmented reality label selected by the user, the access history of the user's augmented reality content, for example: Access time, augmented reality target location, corresponding augmented reality content identification, etc. The augmented reality application reports the augmented reality measure to the mobile augmented reality client;

步骤F3至步骤F4,移动增强现实客户端向移动增强现实服务器发送增强现实测度上报请求;From step F3 to step F4, the mobile augmented reality client sends an augmented reality measurement reporting request to the mobile augmented reality server;

步骤F5至步骤F6,移动增强现实服务器中增强现实内容/目标递送功能根据请求类型将该请求转发增强现实内容/目标选择功能;From step F5 to step F6, the augmented reality content/target delivery function in the mobile augmented reality server forwards the request to the augmented reality content/target selection function according to the request type;

步骤F7至步骤F8,增强现实内容/目标选择功能提取所述请求中的增强现实测度上报参数(相关增强现实目标标识),并据此向增强现实内容/目标管理功能发送增强现实目标元数据搜索请求,获取针对所述上报增强现实测度订阅通知合法接收方地址,即增强现实测度中涉及的增强现实内容发布方增强现实内容服务器地址;From step F7 to step F8, the augmented reality content/target selection function extracts the augmented reality measurement reporting parameters (relevant augmented reality target identification) in the request, and sends the augmented reality target metadata search to the augmented reality content/target management function accordingly Request to obtain the address of the legitimate recipient of the subscription notification for the reported augmented reality measurement, that is, the address of the augmented reality content server of the publisher of the augmented reality content involved in the augmented reality measurement;

步骤F9至步骤F10,增强现实内容/目标选择功能过滤不符合用户偏好及业务设置的增强现实测度通知接收方地址,向合法增强现实内容服务器发送所述增强现实测度通知。From step F9 to step F10, the augmented reality content/object selection function filters the address of the recipient of the augmented reality measurement notification that does not conform to user preferences and service settings, and sends the augmented reality measurement notification to the legitimate augmented reality content server.

图9为本发明应用例五实现移动增强现实业务的方法的流程图,如图9所示,本示例是实现第三方增值应用服务的流程图,本示例实现移动增强现实业务的方法具体包括以下步骤:Fig. 9 is a flow chart of a method for realizing a mobile augmented reality service in Application Example 5 of the present invention. As shown in Fig. 9, this example is a flow chart for realizing a third-party value-added application service, and the method for realizing a mobile augmented reality service in this example specifically includes the following step:

本发明中,第三方增值应用服务提供商通过与移动增强现实服务提供商达成合作协议可以为移动增强现实用户提供额外增值应用服务,包括:多媒体广告,公共安全指南,社交网络服务等。In the present invention, the third-party value-added application service provider can provide mobile augmented reality users with additional value-added application services by reaching a cooperation agreement with the mobile augmented reality service provider, including: multimedia advertisements, public safety guides, social network services, etc.

步骤F1至步骤F7,参照图4实施例中对应的F1至步骤F7;For steps F1 to F7, refer to the corresponding steps F1 to F7 in the embodiment of FIG. 4 ;

步骤F8至步骤F9,增强现实内容/目标选择功能根据增强现实目标搜索参数及用户业务设置判断是否额外提供第三方增值应用,判断条件包括:用户的增强现实目标搜索参数(如用户地理位置信息、备选增强现实目标特征等)是否符合该第三方增值应用触发条件,并且用户增强现实业务设置是否允许移动增强现实服务器自动触发第三方增值应用。From step F8 to step F9, the augmented reality content/target selection function judges whether to additionally provide a third-party value-added application according to the augmented reality target search parameters and user service settings. The judgment conditions include: the user's augmented reality target search parameters (such as user geographic location information, Candidate augmented reality target features, etc.) meet the triggering conditions of the third-party value-added application, and whether the user's augmented reality service setting allows the mobile augmented reality server to automatically trigger the third-party value-added application.

若判断需要触发第三方增值应用,则增强现实内容/目标选择功能向对应第三方增值应用服务器发送触发通知,携带增强现实目标搜索参数和/或用户标识;If it is determined that a third-party value-added application needs to be triggered, the augmented reality content/target selection function sends a trigger notification to the corresponding third-party value-added application server, carrying augmented reality target search parameters and/or user identification;

步骤F10至步骤F11,第三方增值应用服务器根据触发通知中携带的增强现实目标搜索参数和/或用户标识选择执行相应业务逻辑,如选择符合用户当前位置的广告内容,或者搜索与用户相关的社交网络信息。第三方增值应用服务器将获取的第三方增值应用内容或者内容标识返回移动增强现实服务器;From step F10 to step F11, the third-party value-added application server selects and executes corresponding business logic according to the augmented reality target search parameters and/or user identification carried in the trigger notification, such as selecting advertisement content that matches the user’s current location, or searching for social media related to the user. Internet Information. The third-party value-added application server returns the obtained third-party value-added application content or content identification to the mobile augmented reality server;

步骤F12至步骤F13,如果第三方增值应用服务器返回内容标识,则增强现实内容/目标选择功能根据该标识向增强现实内容服务器或者其他内容存储实体发送第三方增值应用内容获取请求,获取相应内容;From step F12 to step F13, if the third-party value-added application server returns the content identifier, the augmented reality content/target selection function sends a third-party value-added application content acquisition request to the augmented reality content server or other content storage entity according to the identifier, and obtains the corresponding content;

步骤F14,增强现实内容/目标选择功能根据用户偏好及上下文过滤所获取的增强现实目标(内容)以及第三方增值应用内容,并返回增强现实内容/目标递送功能;Step F14, the augmented reality content/target selection function filters the acquired augmented reality target (content) and third-party value-added application content according to user preference and context, and returns the augmented reality content/target delivery function;

步骤F15,增强现实内容/目标递送功能向移动增强现实客户端返回应答,携带所获取的增强现实目标(内容,可选),以及第三方增值应用内容;Step F15, the augmented reality content/target delivery function returns a response to the mobile augmented reality client, carrying the acquired augmented reality target (content, optional) and third-party value-added application content;

步骤F16,移动增强现实客户端向增强现实应用返回已发现的增强现实目标以及第三方增值应用内容,并在增强现实终端屏幕上展示。Step F16, the mobile AR client returns the discovered AR objects and third-party value-added application content to the AR application, and displays them on the screen of the AR terminal.

以上所述,仅为本发明的较佳实施例而已,并非用于限定本发明的保护范围。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the protection scope of the present invention.

Claims (23)

1. a kind of method for realizing mobile augmented reality business, it is characterised in that methods described includes:
Receive after augmented reality service request, mobile augmented reality server obtains the ginseng of the augmented reality service request Number, determines the augmented reality service request type, the mobile augmented reality business asked is controlled;
The mobile augmented reality server when meeting setting and pushing setting condition, obtain corresponding augmented reality target and/ Or augmented reality content, and it is sent to mobile augmented reality terminal.
2. according to the method described in claim 1, it is characterised in that the augmented reality service request includes following request extremely Few one kind:
The request of augmented reality target search, augmented reality content acquisition request, augmented reality, which are estimated, reports request and augmented reality Content Management is asked.
3. according to the method described in claim 1, it is characterised in that the augmented reality service request is that augmented reality target is searched When rope is asked, the mobile augmented reality business asked is controlled, is:
The mobile augmented reality server carries out augmented reality object matching according to the target search parameter carried in request, obtains The augmented reality target matched is taken, and returns to the mobile augmented reality terminal.
4. according to the method described in claim 1, it is characterised in that the augmented reality service request is that augmented reality content is obtained When taking request, the mobile augmented reality business asked is controlled, is:
The mobile augmented reality server increases according to the content obtaining parameter acquiring carried in augmented reality content acquisition request Strong real content reference address, obtains augmented reality content and returns to the mobile augmented reality terminal.
5. according to the method described in claim 1, it is characterised in that the augmented reality service request is on augmented reality is estimated Submit a report asking for when asking, the mobile augmented reality business asked is controlled, is:
The mobile augmented reality server is estimated according to augmented reality reports what is carried in request to estimate and report parameter to be increased Strong real-world objects metasearch, acquisition, which is estimated, reports notice legitimate receipt side address.
6. according to the method described in claim 1, it is characterised in that the augmented reality service request is augmented reality content pipe During reason request, the mobile augmented reality business asked is controlled, is:
Augmented reality Content Management authority corresponding to management request is verified, is taken after being verified according to augmented reality content The augmented reality content of business device is updated to the target information of corresponding augmented reality content.
7. according to the method described in claim 1, it is characterised in that it is described set push setting condition as:
Set according to user preference and business determine to obtain find in augmented reality target with mobile augmented reality terminal location ratio Augmented reality content corresponding to the target being closer to;
Or, the setting moment arrives;
Or, mobile augmented reality terminal enters setting regions;
Or, set in augmented reality target search parameter and customer service and meet third party's value-added service trigger condition.
8. a kind of system for realizing mobile augmented reality business, it is characterised in that the system include mobile augmented reality terminal, Mobile augmented reality server and augmented reality content server, wherein,
Mobile augmented reality terminal, for sending augmented reality service request to the mobile augmented reality server;Obtain and increase The augmented reality content associated with augmented reality target in strong real content server, and it is whole according to the mobile augmented reality The augmented reality content is merged and shown with the outdoor scene of the mobile augmented reality terminal taking by end real-time status;
Mobile augmented reality server, for obtaining the augmented reality service request of the mobile augmented reality terminal transmission or pushing away The parameter of request is sent, augmented reality service request type is determined, the mobile augmented reality business asked is controlled;With And, after the augmented reality Content Management request for receiving the transmission of augmented reality content server, enhancing corresponding to management request Real content administration authority is verified that more new management asks the target information of corresponding augmented reality content after being verified;
Augmented reality content server, for providing the augmented reality target with having been disposed in the mobile augmented reality server The storage and management of associated augmented reality content.
9. system according to claim 8, it is characterised in that the mobile augmented reality terminal includes camera, state Acquiring unit, communication unit and display unit, wherein,
Camera, the outdoor scene for mobile augmented reality terminal surrounding described in captured in real-time;
State acquiring unit, the current location information for obtaining the mobile augmented reality terminal;Camera and ground level, Direction and ground angle information;
Communication unit, for realizing the communication with the mobile augmented reality server, to the mobile augmented reality server Augmented reality service request is sent, and obtains augmented reality associated with augmented reality target in augmented reality content server Content;
Display unit, for utilizing acquired augmented reality content, modification renders the increasing in the outdoor scene that the camera is shot Strong real-world objects, and show.
10. system according to claim 8, it is characterised in that the augmented reality service request includes following request It is at least one:
The request of augmented reality target search, augmented reality content acquisition request, augmented reality, which are estimated, reports request.
11. system according to claim 10, it is characterised in that the mobile augmented reality server is for augmented reality Target search is asked, and augmented reality object matching is carried out according to the target search parameter carried in request, obtains the increasing matched Strong real-world objects, and return to the mobile augmented reality terminal.
12. system according to claim 11, it is characterised in that the mobile augmented reality server is in augmented reality mesh When mark search parameter is customer position information, correspondence augmented reality content and the augmented reality target searched are obtained, is returned to The mobile augmented reality terminal.
13. system according to claim 11, it is characterised in that the mobile augmented reality server is in augmented reality mesh When mark search parameter and customer service setting meet third party's value-added service trigger condition, third party's value-added service is triggered, and return Return implementing result.
14. system according to claim 11, it is characterised in that the mobile augmented reality server is for augmented reality Content acquisition request, according to the content obtaining parameter acquiring augmented reality access to content carried in augmented reality content acquisition request Address, obtains augmented reality content and returns to the mobile augmented reality terminal.
15. system according to claim 11, it is characterised in that the mobile augmented reality server is for augmented reality Estimate and report request, estimated according to augmented reality report request in carry estimate report parameter carry out augmented reality target element number According to search, acquisition, which is estimated, reports notice legitimate receipt side address.
16. system according to claim 11, it is characterised in that the mobile augmented reality server please for pushing Ask, augmented reality target and/or augmented reality content acquired in mobile augmented reality client push.
17. a kind of mobile augmented reality server, it is characterised in that the mobile augmented reality server is included in augmented reality Appearance/intended delivery function, augmented reality content/target selection function and augmented reality content/objective management function, wherein,
Augmented reality content/target selection function, receives what is carried in augmented reality business request information for being responsible for extraction Required parameter, determines augmented reality type of service, and carries out corresponding mobile augmented reality Service control, according to the movement of reception The augmented reality service request of augmented reality client, searches for augmented reality target, selects and obtain augmented reality content;
Augmented reality content/intended delivery function, please for the augmented reality business by responding mobile augmented reality client Ask, deliver augmented reality target and/or augmented reality content to mobile augmented reality client;Or, actively initiate request and push away Augmented reality target and/or augmented reality content are sent to mobile augmented reality client;
Augmented reality content/objective management function, for being asked according to augmented reality Content Management, stores and manages augmented reality Target deployment information, augmented reality content releases news, and augmented reality content caching strategy and local cache augmented reality Content.
18. mobile augmented reality server according to claim 17, it is characterised in that the augmented reality service request Include at least one of following request:
The request of augmented reality target search, augmented reality content acquisition request, augmented reality, which are estimated, reports request.
19. mobile augmented reality server according to claim 18, it is characterised in that
Augmented reality content/target selection the function is asked for augmented reality target search, according to the mesh carried in request Search parameter search augmented reality target is marked, selects and obtains augmented reality content.
20. mobile augmented reality server according to claim 18, it is characterised in that the augmented reality content/mesh Selection function is marked for augmented reality content acquisition request, is joined according to the content obtaining carried in augmented reality content acquisition request Number obtains augmented reality access to content address, obtains augmented reality content.
21. mobile augmented reality server according to claim 18, it is characterised in that
Augmented reality content/target selection the function is estimated for augmented reality reports request, estimated according to augmented reality on Submit a report asking for and ask estimating for middle carrying to report parameter to carry out augmented reality target metadata search, acquisition, which is estimated, reports notice legitimate receipt Square address.
22. mobile augmented reality server according to claim 18, it is characterised in that the augmented reality content/mesh Mark management function is received after the request of augmented reality Content Management, carries out the checking of augmented reality Content Management authority, and is being tested Card promotes augmented reality content/objective management function renewal augmented reality target information corresponding with management request after passing through.
23. the mobile augmented reality server according to claim 18 or 22, it is characterised in that in the augmented reality Appearance/objective management function asks implementing result to send augmented reality content issued state, deployment according to augmented reality Content Management Regular change information.
CN201110173562.2A 2011-06-24 2011-06-24 Realize system and method, terminal and the server of mobile augmented reality business Active CN102843347B (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201110173562.2A CN102843347B (en) 2011-06-24 2011-06-24 Realize system and method, terminal and the server of mobile augmented reality business
PCT/CN2012/070613 WO2012174865A1 (en) 2011-06-24 2012-01-19 System and method for implementing mobile augmented reality service, terminal and server

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201110173562.2A CN102843347B (en) 2011-06-24 2011-06-24 Realize system and method, terminal and the server of mobile augmented reality business

Publications (2)

Publication Number Publication Date
CN102843347A CN102843347A (en) 2012-12-26
CN102843347B true CN102843347B (en) 2017-10-31

Family

ID=47370410

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201110173562.2A Active CN102843347B (en) 2011-06-24 2011-06-24 Realize system and method, terminal and the server of mobile augmented reality business

Country Status (2)

Country Link
CN (1) CN102843347B (en)
WO (1) WO2012174865A1 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103488525A (en) * 2012-06-08 2014-01-01 诺基亚公司 Determination of user preference relevant to scene
CN103561382B (en) * 2013-10-22 2017-08-04 华为终端有限公司 A mobile terminal message presentation method and mobile terminal
CN103606310B (en) * 2013-10-29 2016-01-13 中兴通讯股份有限公司 Teaching method and system
RU2606874C1 (en) * 2015-12-02 2017-01-10 Виталий Витальевич Аверьянов Method of augmented reality environment generating device controlling
CN106445154A (en) * 2016-09-29 2017-02-22 宇龙计算机通信科技(深圳)有限公司 Method and device for providing AR content, AR equipment and server
TWI642002B (en) 2017-04-14 2018-11-21 李雨暹 Method and system for managing viewability of location-based spatial object
CN108983971A (en) * 2018-06-29 2018-12-11 北京小米智能科技有限公司 Labeling method and device based on augmented reality
CN110147288A (en) * 2019-05-13 2019-08-20 浙江商汤科技开发有限公司 Information interacting method and device, electronic equipment and storage medium
US11157762B2 (en) 2019-06-18 2021-10-26 At&T Intellectual Property I, L.P. Surrogate metadata aggregation for dynamic content assembly
AU2021240949A1 (en) * 2020-03-23 2022-10-13 Mentar Holding AG Device and method for providing augmented reality interaction
US11721075B2 (en) * 2020-11-05 2023-08-08 Computer Generated Solutions, Inc. Systems and methods for integrating and using augmented reality technologies
CN113421356B (en) * 2021-07-01 2023-05-12 北京华信傲天网络技术有限公司 Inspection system and method for equipment in complex environment
CN115914716A (en) * 2021-09-30 2023-04-04 中兴通讯股份有限公司 Image display method and device, storage medium and electronic device
CN115112351B (en) * 2022-06-30 2025-03-07 武汉极目智能技术有限公司 Detection device for testing the real-view function of a camera
US20240365175A1 (en) * 2023-04-26 2024-10-31 Samsung Electronics Co., Ltd. Metaverse services with network slicing

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1213683A2 (en) * 2000-11-30 2002-06-12 Mixed Reality Systems Laboratory Inc. Position and orientation determining method and apparatus and storage medium
CN101605313A (en) * 2009-06-26 2009-12-16 华为技术有限公司 Service processing method and system, call session control function entity device and application server
CN101924992A (en) * 2010-07-30 2010-12-22 中国电信股份有限公司 Method, system and equipment for acquiring scene information through mobile terminal
CN101971618A (en) * 2008-03-14 2011-02-09 阿尔卡特朗讯 Method for implementing rich video on mobile terminals

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7304585B2 (en) * 2004-07-02 2007-12-04 Nokia Corporation Initiation of actions with compressed action language representations
US8830267B2 (en) * 2009-11-16 2014-09-09 Alliance For Sustainable Energy, Llc Augmented reality building operations tool

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1213683A2 (en) * 2000-11-30 2002-06-12 Mixed Reality Systems Laboratory Inc. Position and orientation determining method and apparatus and storage medium
CN101971618A (en) * 2008-03-14 2011-02-09 阿尔卡特朗讯 Method for implementing rich video on mobile terminals
CN101605313A (en) * 2009-06-26 2009-12-16 华为技术有限公司 Service processing method and system, call session control function entity device and application server
CN101924992A (en) * 2010-07-30 2010-12-22 中国电信股份有限公司 Method, system and equipment for acquiring scene information through mobile terminal

Also Published As

Publication number Publication date
CN102843347A (en) 2012-12-26
WO2012174865A1 (en) 2012-12-27

Similar Documents

Publication Publication Date Title
CN102843347B (en) Realize system and method, terminal and the server of mobile augmented reality business
WO2012174974A1 (en) Method, system, terminal, and server for implementing mobile augmented reality service
JP6015888B2 (en) Portable wireless communication device, program and event data system for augmented reality
JP5620517B2 (en) A system for multimedia tagging by mobile users
CN102958114B (en) Methods to access augmented reality user context
US20070214180A1 (en) Social network application for processing image or video data from wireless devices of users and methods of operation
CN102845081B (en) Mobile device profile aggregation
KR20100050567A (en) Discovering peer-to-peer content using metadata streams
JP2015505384A (en) Image annotation method and system
CN102958009B (en) The transmission method and mobile augmented reality server of augmented reality information
CN107454126B (en) Message pushing method, server and terminal
US20070032945A1 (en) System and method for providing location related information to a network user
EP2879363A1 (en) Apparatus, system, and method of managing counterpart terminal information, and carrier medium
US10248665B1 (en) Method and system for collecting, and globally communicating and evaluating digital images of sports fans, public displays of affection and miscellaneous groups from entertainment venues
TW201345256A (en) System for applying metadata for object recognition and event representation
KR20180004433A (en) Image contents sharing system using application program and communication method using the same
US20070260704A1 (en) Method of providing service for user search, and apparatus, server, and system for the same
EP2849420B1 (en) Counterpart terminal information management system, method and carrier means
CN112770185A (en) Method and device for processing Sprite map, electronic equipment and storage medium
CN101657006A (en) Method, device and system for selecting user according to user state
US20160005230A1 (en) Server Controlled Augmented Reality
WO2013189218A1 (en) Augmented reality content acquisition method, mobile augmented reality server and client terminal
CN107133291B (en) Method and device for displaying page content
US20140324344A1 (en) Method, server, and system for obtaining navigation information
CN111555956B (en) Method for processing picture containing readable geographic position information in instant messaging and electronic device

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right

Effective date of registration: 20201230

Address after: 226002 No.65, Chenggang Road, Gangzha District, Nantong City, Jiangsu Province

Patentee after: NANTONG TIANYUAN SECURITY EQUIPMENT Co.,Ltd.

Address before: 518057 Ministry of justice, Zhongxing building, South Science and technology road, Nanshan District hi tech Industrial Park, Shenzhen, Guangdong

Patentee before: ZTE Corp.

TR01 Transfer of patent right