CN111866411A - Content display apparatus, method, apparatus, and computer-readable storage medium - Google Patents
Content display apparatus, method, apparatus, and computer-readable storage medium Download PDFInfo
- Publication number
- CN111866411A CN111866411A CN201910362300.7A CN201910362300A CN111866411A CN 111866411 A CN111866411 A CN 111866411A CN 201910362300 A CN201910362300 A CN 201910362300A CN 111866411 A CN111866411 A CN 111866411A
- Authority
- CN
- China
- Prior art keywords
- display device
- content display
- content
- visible light
- pattern
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04B—TRANSMISSION
- H04B10/00—Transmission systems employing electromagnetic waves other than radio-waves, e.g. infrared, visible or ultraviolet light, or employing corpuscular radiation, e.g. quantum communication
- H04B10/11—Arrangements specific to free-space transmission, i.e. transmission through air or vacuum
- H04B10/114—Indoor or close-range type systems
- H04B10/116—Visible light communication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/22—Adaptations for optical transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3102—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM] using two-dimensional electronic spatial light modulators
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/12—Picture reproducers
- H04N9/31—Projection devices for colour picture display, e.g. using electronic spatial light modulators [ESLM]
- H04N9/3179—Video signal processing therefor
Landscapes
- Engineering & Computer Science (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Computer Networks & Wireless Communication (AREA)
- Optical Communication System (AREA)
Abstract
Description
技术领域technical field
本公开的实施例总体上涉及通信技术领域,更具体地,涉及用于内容显示设备、方法、装置以及计算机可读存储介质。Embodiments of the present disclosure generally relate to the field of communication technologies, and more particularly, to devices, methods, apparatuses, and computer-readable storage media for content display.
背景技术Background technique
随着用户对视频体验的要求不断提高,诸如交互式虚拟现实(VR)/增强现实(AR)技术等提供超高清画质并且能够使参与者与所创建的虚拟环境交互,甚至完全沉浸其中的仿真技术应运而生。这样的交互式技术具有感知功能,可以捕捉参与者的反应和行为,继而通过计算机处理来生成与参与者的反应和行为相适应的影像内容。As users' requirements for video experience continue to increase, technologies such as interactive virtual reality (VR)/augmented reality (AR) provide ultra-high-definition picture quality and enable participants to interact with the created virtual environment, even fully immersed in it. Simulation technology came into being. Such interactive technology has a sensory function, which can capture the reactions and behaviors of participants, and then use computer processing to generate video content that is adapted to the participants' reactions and behaviors.
符合802.11系列标准的无线局域网(WLAN)是向支持VR的无线设备提供有效带宽的最常用的技术。目前,为了满足多个用户同时观看VR影像或体验VR游戏的需求,可以通过增加无线路由器(例如,Wi-Fi AP)的数目来扩展无线网络覆盖范围、增加可用的网络带宽。然而,Wi-Fi AP之间会产生干扰,使用户体验降低。Wireless Local Area Networks (WLANs) compliant with the 802.11 family of standards are the most commonly used technology to provide effective bandwidth to VR-enabled wireless devices. At present, in order to meet the needs of multiple users watching VR images or experiencing VR games at the same time, it is possible to expand the wireless network coverage and increase the available network bandwidth by increasing the number of wireless routers (eg, Wi-Fi APs). However, interference occurs between Wi-Fi APs, degrading the user experience.
发明内容SUMMARY OF THE INVENTION
总体上,本公开的示例实施例提出了内容显示设备、方法、装置以及计算机可读存储介质。In general, example embodiments of the present disclosure propose a content display apparatus, method, apparatus, and computer-readable storage medium.
在第一方面,提供了一种内容显示设备。该内容显示设备包括:位于内容显示设备的壳体的变形,该变形适于反射组合可见光并且使组合可见光的图案特征发生变化以用于定位内容显示设备;以及可见光通信(VLC)接收器,被布置在壳体中的与变形相对应的位置,并且被配置为将以组合可见光形式发射的光信号转换成与内容显示设备的位置相对应的内容。In a first aspect, a content display device is provided. The content display device includes: a deformation in a housing of the content display device adapted to reflect the combined visible light and change a pattern characteristic of the combined visible light for positioning the content display device; and a visible light communication (VLC) receiver, It is arranged in the housing at a position corresponding to the deformation, and is configured to convert the light signal emitted in the form of combined visible light into content corresponding to the position of the content display device.
在第二方面,提供了一种集成通信设备。该集成通信设备包括可见光通信(VLC)发射器以及组合光投影仪。VLC发射器被配置为:将内容数据信号调制成光信号;以及以可见光形式发射光信号。组合光投影仪被配置为:将可见光与图案特征相组合,以获取组合可见光;以及投射组合可见光。In a second aspect, an integrated communication device is provided. The integrated communication device includes a visible light communication (VLC) transmitter and a combined light projector. The VLC transmitter is configured to: modulate the content data signal into an optical signal; and emit the optical signal in visible light. The combined light projector is configured to: combine the visible light with the pattern features to obtain the combined visible light; and project the combined visible light.
在第三方面,提供了一种媒体服务器。该媒体服务器包括至少一个处理器以及包括计算机程序代码的至少一个存储器。至少一个存储器和计算机程序代码被配置为与至少一个处理器一起促使媒体服务器:针对根据第一方面的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与第一通信地址不同的第二通信地址。In a third aspect, a media server is provided. The media server includes at least one processor and at least one memory including computer program code. At least one memory and computer program code are configured to, with the at least one processor, cause the media server to: set a first communication address for downlink data transmission for the content display device according to the first aspect, and for uplink data A second communication address that is different from the first communication address is transmitted.
在第四方面,提供了一种内容显示系统。该内容显示系统包括:根据第一方面的内容显示设备、根据第二方面的集成通信设备、以及根据第三方面的媒体服务器。In a fourth aspect, a content display system is provided. The content display system includes a content display device according to the first aspect, an integrated communication device according to the second aspect, and a media server according to the third aspect.
在第五方面,提供了一种用于显示内容的方法。该方法包括:从集成通信设备接收以组合可见光形式发射的光信号,该光信号是基于内容显示设备的位置信息而发送的,内容显示设备的位置信息是利用位于内容显示设备的壳体的变形而被确定的;以及将光信号转换成与内容显示设备的位置相对应的内容。In a fifth aspect, a method for displaying content is provided. The method includes receiving, from an integrated communication device, an optical signal emitted in the form of combined visible light, the optical signal being transmitted based on location information of the content display device, the location information of the content display device using deformations located in a housing of the content display device and being determined; and converting the light signal into content corresponding to the location of the content display device.
在第六方面,提供了一种用于通信的方法。该方法包括:将内容数据信号调制成光信号;以可见光形式发射光信号;将可见光与图案特征相组合,以获取组合可见光;以及投射组合可见光。In a sixth aspect, a method for communicating is provided. The method includes: modulating a content data signal into an optical signal; emitting the optical signal in the form of visible light; combining the visible light with pattern features to obtain the combined visible light; and projecting the combined visible light.
在第七方面,提供了一种用于通信的方法。该方法包括:针对根据第一方面的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与第一通信地址不同的第二通信地址。In a seventh aspect, a method for communicating is provided. The method includes setting, for the content display device according to the first aspect, a first communication address for downlink data transmission, and a second communication address for uplink data transmission that is different from the first communication address.
在第八方面,提供了一种用于显示内容的装置。该装置包括:用于从集成通信设备接收以组合可见光形式发射的光信号的部件,该光信号是基于内容显示设备的位置信息而发送的,内容显示设备的位置信息是利用位于内容显示设备的壳体的变形而被确定的;以及用于将光信号转换成与内容显示设备的位置相对应的内容的部件。In an eighth aspect, an apparatus for displaying content is provided. The apparatus includes: means for receiving, from an integrated communication device, an optical signal emitted in the form of combined visible light, the optical signal being transmitted based on location information of the content display device, the location information of the content display device using a location information located at the content display device deformation of the housing; and means for converting the light signal into content corresponding to the position of the content display device.
在第九方面,提供了一种用于通信的装置。该装置包括:用于将内容数据信号调制成光信号的部件;用于以可见光形式发射光信号的部件;用于将可见光与图案特征相组合,以获取组合可见光的部件;以及用于投射组合可见光的部件。In a ninth aspect, an apparatus for communicating is provided. The device includes: means for modulating a content data signal into an optical signal; means for emitting the optical signal in visible light; means for combining the visible light with pattern features to obtain the combined visible light; and for projecting the combined Visible light components.
在第十方面,提供了一种用于通信的装置。该装置包括:用于针对根据第一方面所述的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与所述第一通信地址不同的第二通信地址的部件。In a tenth aspect, an apparatus for communicating is provided. The apparatus includes: for setting a first communication address for downlink data transmission with respect to the content display device according to the first aspect, and a first communication address different from the first communication address for uplink data transmission Two communication address components.
在第十一方面,提供了一种计算机可读存储介质,其上存储有计算机程序。计算机程序包括指令,该指令在被设备上的处理器执行时,促使设备执行根据第五方面所述的方法。In an eleventh aspect, there is provided a computer-readable storage medium having a computer program stored thereon. The computer program comprises instructions which, when executed by a processor on the device, cause the device to perform the method according to the fifth aspect.
在第十二方面,本公开的示例实施例提供一种计算机可读存储介质,其上存储有计算机程序。计算机程序包括指令,该指令在被设备上的处理器执行时,促使设备执行根据第六方面所述的方法。In a twelfth aspect, example embodiments of the present disclosure provide a computer-readable storage medium having a computer program stored thereon. The computer program comprises instructions which, when executed by a processor on the device, cause the device to perform the method according to the sixth aspect.
在第十三方面,本公开的示例实施例提供一种计算机可读存储介质,其上存储有计算机程序。计算机程序包括指令,该指令在被设备上的处理器执行时,促使设备执行根据第七方面所述的方法。In a thirteenth aspect, example embodiments of the present disclosure provide a computer-readable storage medium having a computer program stored thereon. The computer program includes instructions which, when executed by a processor on the device, cause the device to perform the method according to the seventh aspect.
应当理解,发明内容部分中所描述的内容并非旨在限定本公开实施例的关键或重要特征,亦非用于限制本公开的范围。本公开的其它特征将通过以下的描述变得容易理解。It should be understood that the matters described in this Summary are not intended to limit key or critical features of the embodiments of the present disclosure, nor are they intended to limit the scope of the present disclosure. Other features of the present disclosure will become apparent from the following description.
附图说明Description of drawings
结合附图并参考以下详细说明,本公开各实施例的上述和其它特征、优点及方面将变得更加明显。在附图中,相同或相似的附图标记表示相同或相似的元素,其中:The above and other features, advantages and aspects of various embodiments of the present disclosure will become more apparent when taken in conjunction with the accompanying drawings and with reference to the following detailed description. In the drawings, the same or similar reference numbers refer to the same or similar elements, wherein:
图1示出了本公开的实施例可以在其中实施的示例通信系统;FIG. 1 illustrates an example communication system in which embodiments of the present disclosure may be implemented;
图2示出了结构光定位原理的示意图;Figure 2 shows a schematic diagram of the principle of structured light positioning;
图3示出了根据本公开的示例实施例的交互过程的流程图;FIG. 3 shows a flowchart of an interaction process according to an example embodiment of the present disclosure;
图4A示出了根据本公开的示例实施例的内容显示设备的示意图;4A shows a schematic diagram of a content display device according to an example embodiment of the present disclosure;
图4B示出了根据本公开的示例实施例的可见光通信(VLC)接收器的框图;4B shows a block diagram of a visible light communication (VLC) receiver according to an example embodiment of the present disclosure;
图5示出了根据本公开的示例实施例的用于在内容显示设备处实施的方法的流程图;5 shows a flowchart of a method for implementation at a content display device according to an example embodiment of the present disclosure;
图6A示出了根据本公开的示例实施例的集成通信设备的框图;6A shows a block diagram of an integrated communication device according to an example embodiment of the present disclosure;
图6B示出了根据本公开的示例实施例的可见光通信(VLC)发射器的框图;6B shows a block diagram of a visible light communication (VLC) transmitter according to an example embodiment of the present disclosure;
图7示出了根据本公开的示例实施例的用于在集成通信设备处实施的方法的流程图;7 shows a flowchart of a method for implementation at an integrated communication device according to an example embodiment of the present disclosure;
图8示出了根据本公开的示例实施例的媒体服务器的框图;8 shows a block diagram of a media server according to an example embodiment of the present disclosure;
图9示出了根据本公开的示例实施例的用于在媒体服务器处实施的方法的流程图;9 shows a flowchart of a method for implementation at a media server according to an example embodiment of the present disclosure;
图10示出了适合实现本公开的示例实施例的设备的框图。10 shows a block diagram of an apparatus suitable for implementing example embodiments of the present disclosure.
具体实施方式Detailed ways
下面将参考附图描述一些示例实施例。虽然附图中显示了本公开的示例实施例,然而应当理解的是,本公开可以通过各种形式来实现,而且不应该被解释为限于这里阐述的实施例,相反提供这些实施例是为了更加透彻和完整地理解本公开。应当理解的是,本公开的附图及实施例仅用于示例性作用,并非用于限制本公开的保护范围。Some example embodiments will be described below with reference to the accompanying drawings. While example embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, but rather are provided for further A thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes, and are not intended to limit the protection scope of the present disclosure.
在此使用的术语“可见光(VLC)通信”是指利用可见光波段的光作为信息载体而在空气中直接传输光信号的无线通信方式。可见光通信技术可以达到1Gbps至3.4Gbps的数据速率。日光灯、白炽灯、荧光灯、发光二极管(LED)等均可以作为可见光的光源。为了讨论方便,本公开的示例实施例以LED作为可见光的光源的示例进行描述。The term "visible light (VLC) communication" used herein refers to a wireless communication method in which light in the visible light band is used as an information carrier to directly transmit optical signals in the air. Visible light communication technology can achieve data rates of 1Gbps to 3.4Gbps. Fluorescent lamps, incandescent lamps, fluorescent lamps, light emitting diodes (LEDs) and the like can all be used as light sources of visible light. For the convenience of discussion, the example embodiments of the present disclosure are described by taking an example of an LED as a light source of visible light.
在此使用的术语“组合可见光”是指具有结构或图案特征并且其上调制并承载有数字信号的可见光。根据具体的需要,结构或图案特征可以包括条纹图案、斑点图案、圆圈图案、栅格图案及其任意合适的组合。通过向支持VLC技术的设备投射组合可见光,可以同时实现测量设备的位置信息和向设备传输数据的功能。The term "combined visible light" as used herein refers to visible light having structural or patterned features and modulated and carrying digital signals thereon. The structural or pattern features may include stripe patterns, spot patterns, circle patterns, grid patterns, and any suitable combination thereof, depending on specific needs. By projecting the combined visible light to the device supporting VLC technology, the function of measuring the location information of the device and transmitting data to the device can be realized at the same time.
在此使用的术语“内容显示设备”是指具有无线通信能力的用于显示影像的设备,并且可以是多媒体播放器、平板电脑、智能电话、可穿戴设备等。为了讨论方便,本公开的示例实施例以虚拟现实(VR)/增强现实(AR)一体机作为内容显示设备的示例进行描述。The term "content display device" as used herein refers to a device having wireless communication capabilities for displaying images, and may be a multimedia player, a tablet computer, a smart phone, a wearable device, and the like. For the convenience of discussion, the exemplary embodiments of the present disclosure are described by taking a virtual reality (VR)/augmented reality (AR) all-in-one machine as an example of a content display device.
在此使用的术语“超高清(UHD)”是指超高清晰度,其分辨率达到4K及以上的标准。例如,4K是3840*2160个像素的分辨率标准,8K是7680*4320个像素的分辨率标准。术语“高清(HD)”是指720P以上的全高清清晰度,其分辨率达到1280*720以上像素的标准。术语“标清(SD)”是指标准清晰度,其可以达到720*480以上像素的分辨率标准。The term "Ultra High Definition (UHD)" as used herein refers to Ultra High Definition, with resolutions up to 4K and beyond. For example, 4K is a resolution standard of 3840*2160 pixels, and 8K is a resolution standard of 7680*4320 pixels. The term "high definition (HD)" refers to the full HD resolution of 720P or higher, and its resolution reaches the standard of 1280*720 pixels or higher. The term "standard definition (SD)" refers to standard definition, which can achieve a resolution standard of more than 720*480 pixels.
在此使用的术语“电路”是指以下的一项或多项:The term "circuit" as used herein refers to one or more of the following:
(a)仅硬件电路实现方式(诸如仅模拟和/或数字电路的实现方式);以及(a) hardware-only circuit implementations (such as analog and/or digital-only circuit implementations); and
(b)硬件电路和软件的组合,诸如(如果适用):(i)模拟和/或数字硬件电路与软件/固件的组合,以及(ii)硬件处理器的任意部分与软件(包括一起工作以使得诸如OLT或其它计算设备等装置执行各种功能的数字信号处理器、软件和存储器);以及(b) a combination of hardware circuits and software, such as (if applicable): (i) a combination of analog and/or digital hardware circuits and software/firmware, and (ii) any portion of a hardware processor and software (including working together to digital signal processors, software, and memory that cause devices, such as OLTs or other computing devices, to perform various functions); and
(c)硬件电路和/或处理器,诸如微处理器或者微处理器的一部分,其要求软件(例如固件)用于操作,但是在不需要软件用于操作时可以没有软件。(c) Hardware circuits and/or processors, such as a microprocessor or portion of a microprocessor, that require software (eg, firmware) for operation, but may be absent when software is not required for operation.
电路的定义适用于此术语在本申请中(包括任意权利要求中)的所有使用场景。作为另一示例,在此使用的术语“电路”也覆盖仅硬件电路或处理器(或多个处理器)、或者硬件电路或处理器的一部分、或者其随附软件或固件的实现方式。例如,如果适用于特定权利要求元素,术语“电路”还覆盖基带集成电路或处理器集成电路或者OLT或其它计算设备中的类似的集成电路。The definition of circuit applies to all uses of this term in this application, including in any claims. As another example, the term "circuitry" as used herein also covers an implementation of only a hardware circuit or processor (or processors), or a portion of a hardware circuit or processor, or its accompanying software or firmware. For example, if applicable to a particular claim element, the term "circuitry" also covers a baseband integrated circuit or a processor integrated circuit or similar integrated circuit in an OLT or other computing device.
在此使用的术语“包括”及其变形是开放性包括,即“包括但不限于”。术语“基于”是“至少部分地基于”。术语“一个实施例”表示“至少一个实施例”;术语“另一实施例”表示“至少一个另外的实施例”。其它术语的相关定义将在下文描述中给出。As used herein, the term "including" and variations thereof are open inclusive, ie "including but not limited to". The term "based on" is "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment". Relevant definitions of other terms will be given in the description below.
当前,随着VR/AR技术的普及,越来越多的UHD VR/AR应用,例如交互式VR/AR视频或游戏应用受到广大用户的欢迎。如前所述,在进行VR/AR体验时,VR/AR系统需要捕捉参与者的反应和行为来转换成必要的交互输入。例如,通过用户所使用的头戴式VR一体机来跟踪用户的头部运动,可以定位出用户在虚拟环境中的位置。这需要头戴式VR/AR一体机提供高精度的跟踪和定位功能。为了不限制用户的移动,头戴式VR/AR一体机总体上采用无线通信技术。同时,为了不使用户体验降低,头戴式VR/AR一体机还应具有尽可能小的体积和较轻的质量。然而,在传统VR/AR一体机中,用于跟踪和定位的功能与用于无线通信的功能分别由两个独立系统提供。这显然对于VR/AR一体机的重量、体积和成本都是不利的。Currently, with the popularization of VR/AR technology, more and more UHD VR/AR applications, such as interactive VR/AR video or game applications, are welcomed by the majority of users. As mentioned earlier, when performing a VR/AR experience, the VR/AR system needs to capture the participant's reactions and behaviors to convert them into necessary interactive inputs. For example, the user's position in the virtual environment can be located by tracking the user's head movement through the VR headset used by the user. This requires the headset VR/AR all-in-one to provide high-precision tracking and positioning functions. In order not to restrict the user's movement, the head-mounted VR/AR all-in-one machine generally adopts wireless communication technology. At the same time, in order not to degrade the user experience, the head-mounted VR/AR all-in-one machine should also have the smallest possible size and light weight. However, in traditional VR/AR all-in-one machines, the functions for tracking and positioning and the functions for wireless communication are provided by two independent systems. This is obviously unfavorable for the weight, volume and cost of the VR/AR all-in-one machine.
另一方面,为了支持诸如VR/AR视频应用等UHD 360度全景技术,需要足够的WLAN覆盖范围并满足远远高于SD标准的带宽要求。然而,通常所采用的802.11系列标准所提供的数据速率不足以支持许多用户同时进行UHD VR/AR体验。作为示例,802.11ay是当前802.11系列标准中所能达到数据速率最高的无线标准。按照IEEE制定的标准,802.11ay可以达到的单流传输速率为44 Gbps,四流并发的传输速率可达176 Gbps,其中44 Gbps用于下行链路,132 Gbps用于上行链路。假设在能够提供VR/AR视频或游戏体验的室内环境(诸如,影院、游戏吧、游戏舱、飞机或游轮的客舱等)中,单个用户所需的下行链路数据速率为2Gbps,则一个802.11ay AP仅能支持约22个用户同时进行体验。On the other hand, in order to support UHD 360-degree panorama technologies such as VR/AR video applications, sufficient WLAN coverage and bandwidth requirements far higher than SD standards are required. However, the data rates provided by the commonly used 802.11 family of standards are not sufficient to support many simultaneous users of UHD VR/AR experiences. As an example, 802.11ay is the wireless standard with the highest data rate currently achievable in the 802.11 family of standards. According to the standard established by IEEE, 802.11ay can achieve a single-stream transmission rate of 44 Gbps, and a four-stream concurrent transmission rate of up to 176 Gbps, of which 44 Gbps is used for downlink and 132 Gbps is used for uplink. Assuming a downlink data rate of 2Gbps required for a single user in an indoor environment capable of providing a VR/AR video or gaming experience (such as a movie theater, gaming bar, gaming cabin, the cabin of an airplane or cruise ship, etc.), an 802.11 ay AP can only support about 22 users to experience at the same time.
如前所述,一种解决方案是通过高密度部署诸如Wi-Fi AP等无线路由器的方式来扩大WLAN的覆盖范围和提供足够的数据速率。但是,这种解决方案至少会面临如下问题:1)无线路由器之间彼此干扰,从而降低有效传输速率;2)为高密度部署的无线路由器分配无线电频谱资源非常困难;3)无线路由器会对同一场景内部署的其它无线电通信系统造成干扰;以及4)经由Wi-Fi传输的数据在空中很容易被截获,使得数据安全性没有保障。As mentioned earlier, one solution is to expand the coverage of WLANs and provide adequate data rates by deploying high-density wireless routers such as Wi-Fi APs. However, this solution will at least face the following problems: 1) wireless routers interfere with each other, thereby reducing the effective transmission rate; 2) it is very difficult to allocate radio spectrum resources for high-density deployment of wireless routers; 3) wireless routers will Other radio communication systems deployed in the scene cause interference; and 4) data transmitted via Wi-Fi is easily intercepted in the air, so that data security is not guaranteed.
发明人认识到可见光通信具有传输速率高、数据安全性强、无电磁干扰、无需频谱认证等优点,如果能将可见光通信(VLC)技术与Wi-Fi、LTE、5G等无线电通信技术互补,可以很好地解决上述问题。The inventor realized that visible light communication has the advantages of high transmission rate, strong data security, no electromagnetic interference, and no need for spectrum certification. A good solution to the above problem.
为此,本公开的示例实施例提出了一种将VLC技术与结构光技术结合的交互式通信机制。该机制将媒体数据调制成以可见光为载体传输的光信号,并将可见光与用于定位的图案特征组合,从而形成组合可见光。这样,当组合可见光被投射到内容显示设备(例如,头戴式VR设备、VR一体机)时,内容显示设备可以利用例如支持VLC的接收器经由下行链路接收流媒体数据。与此同时,由于一部分组合可见光会被内容显示设备反射,使得这部分组合可见光的图案特征发生变化,基于变化程度就可以确定内容显示设备的位置信息。To this end, example embodiments of the present disclosure propose an interactive communication mechanism that combines VLC technology and structured light technology. The mechanism modulates the media data into an optical signal transmitted with visible light as a carrier, and combines the visible light with the pattern features used for positioning, thereby forming a combined visible light. In this way, when the combined visible light is projected to a content display device (eg, VR headset, VR kiosk), the content display device can receive streaming media data via a downlink using, eg, a VLC-enabled receiver. At the same time, since a part of the combined visible light will be reflected by the content display device, the pattern characteristics of the part of the combined visible light will change, and the position information of the content display device can be determined based on the degree of change.
换言之,根据本公开的示例实施例的通信机制借助于组合可见光同时实现了定位和数据传输的功能,这将大大缓解有效带宽不足的问题,降低所需无线路由器的数目,并且提供了高精确度的定位功能。这样的交互式通信机制使得更多的用户在同一空间内同时进行VR/AR视频或游戏体验成为可能。In other words, the communication mechanism according to the exemplary embodiments of the present disclosure simultaneously realizes the functions of positioning and data transmission by combining visible light, which will greatly alleviate the problem of insufficient effective bandwidth, reduce the number of required wireless routers, and provide high accuracy positioning function. Such an interactive communication mechanism makes it possible for more users to simultaneously experience VR/AR video or gaming in the same space.
特别地,这样的通信机制可以很好地与电磁波传输受限、障碍物多的室内环境相融,因为其中广泛存在可见光光源(例如,LED、白炽灯、日光灯等),所以在实践中更为节能和经济。In particular, such a communication mechanism can be well integrated with indoor environments with limited electromagnetic wave transmission and many obstacles, because visible light sources (eg, LEDs, incandescent lamps, fluorescent lamps, etc.) Energy efficient and economical.
此外,相较于完全依赖WLAN的通信机制,根据本公开的示例实施例的通信机制更加安全、可靠。In addition, the communication mechanism according to the exemplary embodiments of the present disclosure is more secure and reliable than the communication mechanism completely relying on WLAN.
图1示出了本公开的实施例可以在其中实施的示例通信系统。如图1所示,通信系统100包括内容显示设备110、集成通信设备120、媒体服务器130、无线路由器140、以及路由交换设备150。FIG. 1 illustrates an example communication system in which embodiments of the present disclosure may be implemented. As shown in FIG. 1 , the
内容显示设备110可以经由无线路由器140和路由交换设备150与媒体服务器130无线地通信,例如,向媒体服务器130发送上行链路数据,或者从媒体服务器130接收下行链路数据。内容显示设备110与集成通信设备120之间利用VLC技术无线地通信,例如,内容显示设备110可以从集成通信设备120投射的可见光接收下行链路数据。关于内容显示设备110将在之后详细讨论。The
集成通信设备120经由宽带局域网(例如,经由吉比特以太网)或任何适当的网络与媒体服务器130有线或无线地通信。在某些示例实施例中,集成通信设备120可以配置为向媒体服务器130请求内容数据信号。关于集成通信设备120将在之后详细讨论。The
在图1所示的通信系统中,媒体服务器130可以充当数据源,向集成通信设备120提供内容数据信号,以使得集成通信设备120向内容显示设备110发送该内容数据信号。在其它示例实施例中,媒体服务器130可以经由互联网从应用服务器、门户服务器、内容服务器或云端服务器(未示出)等远程节点取回内容数据,并提供给集成通信设备120。在这样的实施例中,内容服务器可以存储所有内容数据并充当数据源,门户服务器和应用服务器可以被配置为支持内容显示设备110上所安装的VR/AR应用,并且提供电子节目指南(EPG)系统,以便向内容显示设备110提供各种业务的索引和导航。关于媒体服务器130将在之后详细讨论。In the communication system shown in FIG. 1 , the
无线路由器140经由路由交换设备150被连接到媒体服务器,并且被配置为向用户所处的室内环境提供无线网络覆盖。无线路由器140可以是符合802.11系列标准的网络设备或者由任何适当的设备实现,比如Wi-Fi AP,本公开的范围在此方面不受限制。The
路由交换设备150可以是能够实现网络互连的任何适当的网络设备,本公开的范围在此方面不受限制。Routing
特别地,在示例实施例中,通信系统100可以是基于内容分发网络(CDN)架构的通信系统。此时,媒体服务器130可以充当CDN边缘递送服务器或边缘节点,而远程节点可以充当中心内容服务器。In particular, in example embodiments, the
还应当理解,仅出于示例性的目的描述通信系统100,而不暗示对于本公开的范围的任何限制。例如,本公开的示例实施例还可以被应用到与通信系统100不同的系统中。所示出的元件或实体的数目仅仅是示例,而非限制。而且,元件或实体之间可以采用当前已知以及将来开发的任意通信技术来通信。作为示例,在VR/AR影院、游戏吧或支持VR/AR显示系统的飞机或游轮的客舱等场景中,可以存在许多同时进行VR/AR体验的用户。此时,通信系统100可以包括不止一个内容显示设备110和不止一个集成通信设备120,并且单个集成通信设备120可以与一个或多个内容显示设备110相对应。It should also be understood that the
本公开的示例实施例借助于基于结构光的测量技术,利用结构光的图案特征在遇到障碍物或人时会发生变化的原理来跟踪内容显示设备110的运动,从而实现对用户的高精确度定位。图2示出了结构光定位原理。如图2中所示,当从投影仪210投射的具有条纹图案的结构光遇到凸起结构220时,其图案特征发生诸如扭曲或变形等变化。摄像机230可以捕捉到经反射的、图案特征发生变化的结构光,继而根据图案特征的变化程度就可以计算出凸起结构220的位置。在计算位置信息方面,很多算法是已知的,因而不在此赘述。Exemplary embodiments of the present disclosure track the movement of the
图3示出了根据本公开的示例实施例的示例交互过程的流程图。出于讨论的目的,将参考图1来描述示例交互过程300。过程300可以涉及如图1中所示的内容显示设备110、集成通信设备120和媒体服务器130。应当理解,尽管针对图1的通信系统100来描述过程900,但是图3所示的过程同样适用于其它通信场景。3 shows a flowchart of an example interaction process according to example embodiments of the present disclosure. For discussion purposes, an
在过程300中,媒体服务器130针对内容显示设备110设置(305)用于下行链路数据传输的第一通信地址和用于上行链路传输的第二通信地址。取决于所使用的无线通信技术,通信地址可以包括IP地址或者任意其它类型的无线通信地址,例如符合蓝牙协议的设备地址、符合ZigBee协议的设备地址等。In
根据本公开的示例实施例,内容显示设备110可以由支持图像/视频播放、VR/AR显示系统的任何适当的设备实现,包括但不限于多媒体播放器、智能手机、膝上型计算机、平板设备、可穿戴设备(例如,头戴式VR设备、VR/AR一体机等)等。According to example embodiments of the present disclosure, the
媒体服务器130可以采用任意适当的协议或机制来设置和管理用于内容显示设备110的通信地址,诸如基于Netconf网络配置协议的动态IP地址机制和/或静态IP地址机。根据本公开的示例实施例,媒体服务器130所设置的第一通信地址不同于第二通信地址,并且两个通信地址分别对应于内容显示设备110支持的两种无线通信机制,这将在之后详细讨论。The
媒体服务器130针对集成通信设备120设置(310)第一通信地址。The
可选地,内容显示设备110可以例如经由无线路由器140利用所设置的第二通信地址来向媒体服务器130发送(315)内容数据信号请求。内容数据信号请求可以包括内容显示设备110的配置和设置,例如,第一通信地址和第二通信地址。在这样的实施例中,媒体服务器随后将内容显示设备110的配置中的至少第一通信地址发送到相应的集成通信设备120。可选地,内容显示设备110还可以例如经由无线路由器140利用所设置的第二通信地址从媒体服务器130接收数据。Optionally, the
媒体服务器130将内容数据信号发送(320)到集成通信设备120。内容数据信号可以包括、但不限于多媒体文件、VR/AR视频流等。在示例实施例中,媒体服务器130可以响应于内容数据信号请求而发送内容数据信号,也可以直接进行发送。The
集成通信设备120将内容数据信号调制(325)成光信号,以可见光形式发射(330)该光信号,将所述可见光与图案特征相组合,获取(335)组合可见光。与可见光相组合的图案特征可以包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。The
在示例实施例中,集成通信设备120是支持可见光通信技术的网络设备。此外,集成通信设备120还可以作为通信系统100所覆盖的室内环境中的照明装置。作为示例,集成通信设备120可以被安装在提供VR/AR视频或游戏体验的场所内,其中一个或多个用户正在使用内容显示设备110观看VR/AR内容。In an example embodiment, the
然后,集成通信设备120投射(340)组合可见光。在示例实施例中,内容显示设备110的壳体具有适于接收并反射光线(例如,组合光)的变形。由于组合光具有图案特征,当组合光投射到内容显示设备上时,图案特征会发生变化。如上所述,结构光的图案特征在遇到障碍物或人时会发生变化的原理可以用于跟踪用户或用户身体的特定部分(例如,头部)的运动。这样,内容显示设备的壳体的变形可以作为定位用户的头部运动的标识块。The
集成通信设备120接收(345)由内容显示设备110反射的组合可见光。如上所述,组合可见光的图案特征已经发生变化,基于图案特征的变化,集成通信设备120确定(350)内容显示设备110的位置信息。The
在一些示例实施例中,内容显示设备110的位置可以由多自由度(nDoF)来限定。例如,nDoF可以包括三自由度(3DoF)和六自由度(6DoF)。当利用3DoF来定位内容显示设备时,可以在上下、左右、前后等三个自由度中反映用户的动作或运动。6DoF是在3DoF的基础上额外考虑俯仰、偏航、滚转三个自由度。因而当利用6DoF来定位内容显示设备时,可以在上述六个自由度中反映用户的动作或运动。In some example embodiments, the position of the
在一些示例实施例中,集成通信设备120还可以基于例如,一定时间段内的图案特征的变化来确定内容显示设备110的运动速度。In some example embodiments, the
内容显示设备110可以将以组合可见光形式发射的光信号转换(355)成内容进行显示。作为示例,内容可以是影像或视频内容。The
然后,集成通信设备120向媒体服务器130请求(360)与位置信息相对应的内容数据信号。The
作为示例,在内容显示设备110是头戴式VR设备的情况下,内容显示设备110的位置信息与用户的头部运动相对应,可以指示用户的当前视场。当正在进行VR/AR体验的用户的位置发生改变时,呈现给用户的画面也应当随着其位置而相应地改变,因而需要向媒体服务器130请求与用户的当前视场相适应的内容。As an example, in the case where the
响应于来自集成通信设备120的请求,媒体服务器130将与位置相对应的内容数据信号提供(365)给集成通信设备120。In response to the request from the integrated
与325-335中的步骤类似,集成通信设备120将所接收的内容数据信号调制(370)成光信号,以可见光形式发射(375)该光信号,将可见光与图案特征相组合,以获取(380)组合可见光。Similar to steps 325-335, the
继而,集成通信设备120向内容显示设备110投射(385)组合可见光,以该组合可见光形式发射的光信号包括与内容显示设备110的位置相对应的内容数据信号。In turn, the
内容显示设备110将以组合可见光形式发射的光信号转换(390)成与内容显示设备110的位置相对应的内容。在示例实施例中,内容显示设备110利用第一通信地址来执行下行链路传输,即接收光信号。在接收光信号之后,内容显示设备110可以将光信号转换成电信号,并解调制电信号以获取与位置相对应的内容数据信号。然后,内容显示设备110可以显示与内容数据信号相关联的内容。The
尽管以特定顺序对上述交互过程300中的各个步骤进行了描述,但该顺序仅仅出于说明性而非限制性目的。除非明确注明,否则不应当理解为要求此类交互过程以示出的特定顺序或以相继顺序完成。在某些情况下,多任务或并行处理会是有益的。另外,交互过程300还可以包括未示出的附加操作和/或可以省略所示出的一个或多个操作。作为示例,例如操作330和335、操作350和操作355可以同步执行等等。Although the various steps in the
图4A示出了根据本公开的示例实施例的内容显示设备的示意图。内容显示设备可以被实现为图1中所示的内容显示设备110。FIG. 4A shows a schematic diagram of a content display device according to an example embodiment of the present disclosure. The content display device may be implemented as the
如图4A所示,内容显示设备110的壳体具有变形,该变形适于接收并反射可见光。内容显示设备110包括可见光通信(VLC)接收器412,VLC接收器412被布置在与壳体的变形相对应的位置处。在一些示例实施例中,VLC接收器412可以被安装或者镶嵌在内容显示设备110的壳体上,以使壳体具有变形。作为示例,VLC接收器412可以被直接安装在内容显示设备110的壳体表面,或者也可以从内容显示设备110的壳体表面挖空一定区域,并且将VLC接收器412镶嵌在该区域内。尽管在图4A中,VLC接收器412被示为位于内容显示设备410的壳体上的凸起结构中,但是VLC接收器412还可以具有诸如凹陷结构等其它适于反射光线的外形结构。或者,在VLC接收器412被镶嵌在内容显示设备110的壳体上且二者处于同一连续平面的情形中,由于VLC接收器412的材料与壳体表面的材料不同,VLC接收器412的存在依然会导致所反射的可见光的图案特征发生变化。如上所述,壳体的变形可以作为用于定位用户的头部运动的标识块,因此,只要这种变形适于反射可见光并且使得可见光的图案特征发生变化即可。As shown in FIG. 4A, the housing of the
在示例实施例中,内容显示设备110还可以包括无线信号发射器,使得内容显示设备110可以利用诸如LTE、LTE-A、5G、Wi-Fi、蓝牙、ZigBee等其它无线通信技术进行通信。在一些示例实施例中,在无线信号发射器可以经由无线路由器140和路由交换设备150与媒体服务器130进行通信。在一些示例实施例中,无线信号发射器可以被替换为无线信号收发器,其同时具有上行/下行双向传输的功能,本公开在此方面不受限制。In an example embodiment, the
应当理解,内容显示设备110还包括用于内容显示所必要的其它组件,包括但不限于核心处理单元、显示终端、驱动组件、输入/输出组件、触控传感器、数据传输接口、电源等等。为了方便讨论并出于简单的目的,在附图中没有示出这些组件,但不意味着本公开的实施例不具备这些组件,并且本公开的范围在此方面不受限制。应当理解,路由交换设备150包括但不限于网关、路由器、交换机等具有路由交换功能的设备或装置。It should be understood that the
图4B示出了根据本公开的示例实施例的VLC接收器的框图。VLC接收器可以由图4A中所示的VLC接收器412实现。如图4B所示,VLC接收器412包括光电二极管414、放大及滤波模块416、模拟-数字(AD)转换器418、信号处理模块420以及调制模块422。应当理解,VLC接收器412仅仅是示例,VLC接收器还可以包括未示出的附加组件或模块,本公开的范围在此方面不受限制。4B shows a block diagram of a VLC receiver according to an example embodiment of the present disclosure. The VLC receiver may be implemented by the
图5示出了根据本公开的示例实施例的用于在内容显示设备处实施的方法500的流程图。为了方便讨论,下面将结合图4A和4B从内容显示设备110的角度描述方法500。FIG. 5 shows a flowchart of a
如图5所示,在框510处,内容显示设备110的VLC接收器412从集成通信设备120接收以组合可见光形式发射的光信号。As shown in FIG. 5 , at
在框520处,VLC接收器412将光信号转换成与内容显示设备110的位置相对应的内容。根据本公开的实施例,以组合可见光形式发射的光信号用于承载内容数据。At
在一些示例实施例中,框520处的步骤的一种示例实现可以包括:由VLC接收器412接收与内容显示设备的位置相对应的光信号。通过光电二极管414将光信号转换成电信号。该电信号经由AD转换器418、信号处理模块420以及解调模块422进行处理,继而获取内容数据信号。然后,显示设备110显示与该内容数据信号相关联的内容,例如与用户的当前视场相适应的VR/AR影像内容。In some example embodiments, an example implementation of the steps at
在一些示例实施例中,内容显示设备110还包括无线信号发射器。无线信号发射器可以利用LTE、LTE-A、5G、Wi-Fi、蓝牙、ZigBee、长距离通信(LoRa)等任何适当的、无论是目前已知的或将来开发的无线通信技术和标准。本公开的范围在此方面不受限制。In some example embodiments, the
而且,在示例实施例中,内容显示设备110的VLC接收器412可以被配置为例如利用第一通信地址来执行下行链路数据传输,比如接收以组合光形式发射的光信号,无线信号发射器可以利用与第一通信地址不同的第二通信地址来执行上行链路数据传输,例如向服务器发送注册请求、服务请求、内容数据信号请求等。Also, in an example embodiment, the
根据本公开的示例实施例的内容显示设备具有适于反射组合可见光的变形,特别地,通过将VLC接收器布置在与变形相对应的位置,使得通过处理组合可见光就可以同时实现定位和下行链路数据传输的功能。与分别采用两个独立系统来提供定位功能和无线通信功能的传统设备相比,这样的内容显示设备具有更低的重量、更小的体积,并且耗费更低的成本。The content display device according to the exemplary embodiment of the present disclosure has a deformation suitable for reflecting combined visible light, in particular, by arranging the VLC receiver at a position corresponding to the deformation, so that positioning and downlinking can be simultaneously achieved by processing the combined visible light function of data transmission. Such a content display device has a lower weight, a smaller volume, and a lower cost than conventional devices that employ two separate systems to provide positioning functions and wireless communication functions, respectively.
此外,根据本公开的示例实施例的内容显示设备可以通过灵活的双向高速通信机制实现交互式通信。由于上/下行数据传输分别利用不同的无线通信技术,将要求高数据速率的下行链路数据传输配置为利用VLC技术,而将对数据速率和带宽要求不高的上行链路数据传输配置为利用其它无线通信技术,不仅可以有助于减小延迟,使诸如VR/AR视频等影像内容被顺畅显示,实现与VR/AR视频应用的实时交互,还可以有效降低VR/AR体验场所所需的无线路由器的数目,从而显著提升用户在观看VR/AR视频时的体验。In addition, the content display device according to the exemplary embodiment of the present disclosure can realize interactive communication through a flexible two-way high-speed communication mechanism. Since uplink/downlink data transmission utilizes different wireless communication technologies, the downlink data transmission requiring high data rate is configured to utilize VLC technology, while the uplink data transmission requiring less data rate and bandwidth is configured to utilize VLC technology. Other wireless communication technologies can not only help reduce delays, enable image content such as VR/AR videos to be displayed smoothly, and realize real-time interaction with VR/AR video applications, but also effectively reduce the time required for VR/AR experience venues. The number of wireless routers can significantly improve the user experience when watching VR/AR videos.
图6A示出了根据本公开的示例实施例的集成通信设备的示意图。集成通信设备可以由如图1中所示的集成通信设备120实现。如图6A所示,集成通信设备120包括VLC发射器612和组合光投影仪614。在示例实施例中,集成通信设备120还可以包括至少一个摄像机616。6A shows a schematic diagram of an integrated communication device according to an example embodiment of the present disclosure. The integrated communication device may be implemented by
至少一个摄像机616可以是专门设计的红外摄像机或任何适当的摄像机。在示例实施例中,至少一个摄像机可以被布置为独立于集成通信设备120。特别地,在允许的情况下,还可以采用双摄像机的布置。At least one
根据本公开的示例实施例,集成通信设备120可以是支持光电转换的光电通信设备。应当理解,集成通信设备120还可以包括诸如数字模拟转换器等其它物理的或虚拟的元件或组件,并且所示出的元件或实体的数目仅仅是示例。为了讨论方便,下面以包括摄像机的集成通信设备作为示例进行描述。但是,应当注意,所描述的所有特征同样适用于摄像机独立存在的实施例。According to an example embodiment of the present disclosure, the
图6B示出了根据本公开的示例实施例的VLC发射器的示意图。VLC发射器可以由图6A中所示的VLC发射器612实现。如图6B所示,VLC发射器612包括调制模块622、信号处理模块624、数字-模拟(DA)转换器626、放大及偏置模块628、以及发光二极管(LED)630。应当理解,图6B所示的VLC发射器612仅仅是示例,VLC发射器还可以包括未示出的附加组件或模块,比如,结构光成像组件等,本公开的范围在此方面不受限制。6B shows a schematic diagram of a VLC transmitter according to an example embodiment of the present disclosure. The VLC transmitter may be implemented by the
图7示出了根据本公开的示例实施例的用于在集成通信设备处实施的方法700的流程图。为了方便讨论,下面将结合图6A和6B从集成通信设备120的角度描述方法700。FIG. 7 shows a flowchart of a
在框710处,VLC发射器612将内容数据信号调制成光信号。例如,根据本公开的示例实施例,可以由VLC发射器612的调制模块622对从内容数据信号的源,例如,媒体服务器130获取的内容数据信号进行调制,并经由信号处理模块624、DA转换器626以及放大及偏置模块628进行处理以获取光信号。At
在框720处,VLC发射器612以可见光形式发射光信号。例如,根据本公开的示例实施例,可以使用LED 630作为可见光的光源。但是应当理解,也可以使用其它光源来发射光信号,诸如白炽灯、日光灯等。而且,光源的数目仅仅是示例,本公开的范围在此方面不受限制。At
在框730处,组合光投影仪614将可见光与图案特征组合,以获取组合可见光。仅就可见光与图案特征的组合方面,应用了已知的结构光原理,因而实现组合的具体方式将不在此赘述。At
在框740处,组合光投影仪614投射组合可见光。作为示例,投射组合可见光的范围可以被限制在一定的空间范围内,比如用户进行VR/AR体验的场所。At
在一些实施例中,至少一个摄像机616可以接收内容显示设备(例如,内容显示设备的壳体的变形)反射的组合可见光,以及基于反射的组合可见光的图案特征的变化,确定内容显示设备的位置信息。In some embodiments, at least one
在一些实施例中,至少一个摄像机616可以将图案特征的变化与参考图案特征相比较,并且基于比较结果,确定出内容显示设备的位置信息。在本公开的上下文中,参考图案特征可以是原始的、未经扭曲或未被改变的图案特征。此外,如上所述,在计算位置信息方面,很多算法是已知的,因此不在此赘述。附加地或备选地,在示例实施例中,可以采用双摄像机的布置,这将提供更高的定位精确度和可靠性。In some embodiments, the at least one
附加地或备选地,在用户动作幅度较大的情形中,可以首先由至少一个摄像机616执行范围较广而精度较低的定位,以确定用户的活动范围。进而,通过如图7示出的方法700在所确定的活动范围内进行范围较小而精度较高的定位。以此方式,集成通信设备120可以实现范围广、精度高的多层次定位功能。Additionally or alternatively, in a situation where the user's motion range is relatively large, a relatively wide-ranging and relatively low-accuracy positioning may first be performed by at least one
在一些示例实施例中,集成通信设备120还可以根据所确定的位置信息,向媒体服务器130请求与内容显示设备110的位置信息相对应的内容数据信号。In some example embodiments, the
附加地或备选地,集成通信设备120还可以基于一定时间段内反射的组合可见光的图案特征的变化,确定内容显示设备的运动速度。Additionally or alternatively, the
附加地或备选地,集成通信设备120还可以根据内容显示设备110的位置信息是否改变来决定是否向媒体服务器130请求与位置信息相对应的内容数据信号。在这样的实施例中,至少一个摄像机616检测内容显示设备110的位置信息的变化情况。如果内容显示设备110的位置信息改变,意味着用户的视场发生变化,则向媒体服务器130请求相对应的内容数据信号,以与当前视场相适应。相反,如果位置信息没有改变,意味着用户的视场尚未发生变化,则无需发送请求。Additionally or alternatively, the
根据本公开的实施例的集成通信设备及其采用的通信机制通过形成并投射组合可见光,不仅可以对空间范围内的所有人或物体进行跟踪或定位,还可以向作为接收方的内容显示设备传输光信号。因而,可以同时受益于VLC技术的高数据速率和结构光技术的高精确度定位。By forming and projecting combined visible light, the integrated communication device and the communication mechanism adopted according to the embodiments of the present disclosure can not only track or locate all persons or objects within a spatial range, but also transmit to the content display device as the recipient. light signal. Thus, it is possible to simultaneously benefit from the high data rate of VLC technology and the high precision positioning of structured light technology.
图8示出了根据本公开的示例实施例的媒体服务器的示意图。媒体服务器可以被实现为图1所示的媒体服务器130。Figure 8 shows a schematic diagram of a media server according to an example embodiment of the present disclosure. The media server may be implemented as the
在本公开的上下文中,媒体服务器可以利用任何适当的机器来实现,并且可以配备有足够的资源。例如,如图8所示,媒体服务器130可以包括至少一个处理器812和至少一个存储器814。例如,存储器814可以被实现为独立冗余磁盘阵列(RAID),以用于存储频繁使用的内容数据。媒体服务器130可以通过局域网(例如,吉比特以太网)与通信系统中的集成通信设备120通信。此外,媒体服务器130经由路由交换设备150与通信系统中的无线路由器140通信。在示例实施例中,媒体服务器130还可以经由互联网与远程节点,例如应用服务器、门户服务器、内容服务器或云端服务器通信。本公开的范围在此方面不受限制。In the context of the present disclosure, the media server may be implemented using any suitable machine and may be equipped with sufficient resources. For example, as shown in FIG. 8 , the
图9示出了根据本公开的示例实施例的用于在媒体服务器处实施的方法900的流程图。为了方便讨论,下面将结合图8从媒体服务器130的角度描述900。应当理解,方法900还可以包括未示出的附加动作,本公开的范围在此方面不受限制。Figure 9 shows a flow diagram of a
在框910处,媒体服务器130针对内容显示设备110设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与第一通信地址不同的第二通信地址。取决于内容显示设备110所使用的无线通信技术,通信地址可以包括IP地址或者任意其它类型的无线通信地址,例如与蓝牙相关联的设备地址、与ZigBee相关联的设备地址等。At
在一些实施例中,内容显示设备110的VLC接收器412经由第一通信地址从例如集成通信设备120接收以可见光形式发射的光信号,而内容显示设备110的无线信号发射器经由第二通信地址执行上行链路数据传输,例如向媒体服务器130发送注册请求、服务请求、用于交互的信令、数据信号请求等。In some embodiments, the
在一些附加的示例实施例中,方法900还可以将关于内容显示设备110的配置(例如,第一通信地址)告知集成通信设备120和媒体服务器130,以使得集成通信设备120和媒体服务器130可以利用第一通信地址与内容显示设备110通信。In some additional example embodiments, the
在图9的示例中,在框920处,媒体服务器130可以向集成通信设备120发送第一通信地址。In the example of FIG. 9 , at block 920 , the
可选地,在框930处,媒体服务器130接收到来自集成通信设备120的针对与内容显示设备110的位置信息相对应的内容数据信号的请求。Optionally, at
可选地,在框940处,响应于来自集成通信设备120的请求,媒体服务器130将内容数据信号提供给集成通信设备120,以使得集成通信设备120向第一通信地址发送内容数据信号。Optionally, at
在一些实施例中,针对与内容显示设备的位置信息相对应的内容数据信号的请求包括内容显示设备110的位置信息。媒体服务器130根据该位置信息来检索相对应的内容数据信号。In some embodiments, the request for the content data signal corresponding to the location information of the content display device includes the location information of the
在一些实施例中,媒体服务器130的存储器814可以存储一定的多媒体文件,例如VR/AR视频流、电影等。当存储器814存储有集成通信设备120所请求的内容数据时,媒体服务器130可以在本地取回与位置信息相对应的内容数据,并提供给集成通信设备120。或者,当存储器814没有存储所请求的内容数据时,响应于来自集成通信设备120的请求,媒体服务器130可以从互联网中的远程节点请求取回与位置信息相对应的内容数据。远程节点可以是例如门户服务器、应用服务器、内容服务器等远程服务器或云端服务器,本公开的范围在此方面不受限制。In some embodiments, the
应当理解,方法900还可以包括未示出的附加动作,本公开的范围在此方面不受限制。It should be understood that
根据本公开的示例实施例的媒体服务器可以为不同的无线通信技术设置不同的通信地址。通过将第一通信地址设置用于VLC技术,而将第二通信地址设置用于其它无线通信技术,使得上/下行链路数据传输可以利用不同的无线通信技术来实现。以此方式,不仅可以解决网络带宽不足、数据速率低等问题,还可以实现灵活、高速的交互式通信机制。The media server according to the exemplary embodiment of the present disclosure may set different communication addresses for different wireless communication technologies. By setting the first communication address for the VLC technology and setting the second communication address for other wireless communication technologies, the uplink/downlink data transmission can be implemented using different wireless communication technologies. In this way, not only the problems of insufficient network bandwidth and low data rate can be solved, but also a flexible and high-speed interactive communication mechanism can be realized.
图10示出了适合实现本公开的示例实施例的设备1000的框图。设备1000可以实施在图1所示的内容显示设备110、集成通信设备120、媒体服务器130处或者它们的一部分。10 shows a block diagram of a
如图10所示,设备1000包括一个或多个处理器1010、耦合到处理器1010的一个或多个存储器1020、耦合到处理器1010的通信模块1040以及耦合到通信模块1040的通信接口(未示出)。存储器1020至少存储程序1030。As shown in FIG. 10,
通信模块1040用于双向通信。通信模块1040具有用于促进通信的至少一个天线。通信接口可以表示对通信必要的任何接口。The
处理器1010可以是适用于本地技术环境的任何合适的类型,并且可以包括以下中的一项或多项:通用计算机、专用计算机、微处理器、数字信号控制器(DSP)以及基于多核处理器架构的处理器。设备1000可以包括多个处理器,诸如在时间上从属于同步主处理器的时钟的专用集成电路芯片。The
存储器1020可以包括一个或多个非易失性存储器和一个或多个易失性存储器。非易失性存储器的示例包括但不限于只读存储器(ROM)1024、电可编程只读存储器(EPROM)、闪速存储器、硬盘、光盘(CD)、数字视频盘(DVD)、以及其它磁存储装置和/或光学存储装置。易失性存储器的示例包括但不限于随机存取存储器(RAM)1022以及将不在断电期间维持的其它易失性存储器。
计算机程序1030包括由相关联的处理器1010执行的计算机可执行指令。程序1040可以被存储在ROM 1024中。处理器1010可以通过将程序1030加载到RAM 1022中来执行任意适当的动作和处理。The
本公开的示例实施例可以借助于程序1030来实施,从而设备1000可以执行如本文中参考图1-9所讨论的任何过程。本公开的示例实施例还可以由硬件或软件和硬件的组合来实施。Example embodiments of the present disclosure may be implemented with
在一些实施例中,程序1030可以有形地被包含在计算机可读介质中,该计算机可读介质可以被包括在设备1000(诸如,存储器1020)中或者可由设备1000访问的其它存储设备。设备1000可以将程序1030从计算机可读介质加载到RAM 1022以供执行。计算机可读介质可以包括任何类型的有形非易失性存储器,诸如ROM、EPROM、闪速存储器、硬盘、CD、DVD等。In some embodiments,
一般而言,本公开的各种示例实施例可以在硬件或专用电路、软件、逻辑,或其任何组合中实施。某些方面可以在硬件中实施,而其它方面可以在可以由控制器、微处理器或其它计算设备执行的固件或软件中实施。当本公开的实施例的各方面被图示或描述为框图、流程图或使用某些其它图形表示时,将理解此处描述的方框、装置、系统、技术或方法可以作为非限制性的示例在硬件、软件、固件、专用电路或逻辑、通用硬件或控制器或其它计算设备,或其某些组合中实施。In general, the various example embodiments of the present disclosure may be implemented in hardware or special purpose circuits, software, logic, or any combination thereof. Some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software, which may be executed by a controller, microprocessor or other computing device. While aspects of the embodiments of the present disclosure are illustrated or described as block diagrams, flowcharts, or using some other graphical representation, it is to be understood that the blocks, apparatus, systems, techniques, or methods described herein may be taken as non-limiting Examples are implemented in hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controllers or other computing devices, or some combination thereof.
本公开还提供被有形地存储在非暂态计算机可读存储介质上的至少一个计算机程序产品。计算机程序产品包括计算机可执行指令,诸如被包括在程序模块中的那些,在目标真实或者虚拟处理器上的设备中被执行以实现如上面参考图1-9所述的方法。一般而言,程序模块包括例程、程序、库、对象、类、组件、数据结构等,其执行特定的任务或者实现特定的抽象数据结构。在各种示例实施例中,程序模块的功能可以在所描述的程序模块之间合并或者分割。用于程序模块的机器可执行指令可以在本地或者分布式设备内执行。在分布式设备中,程序模块可以位于本地和远端存储介质二者中。The present disclosure also provides at least one computer program product tangibly stored on a non-transitory computer-readable storage medium. A computer program product includes computer-executable instructions, such as those included in program modules, executed in a device on a target real or virtual processor to implement the method as described above with reference to FIGS. 1-9 . Generally, program modules include routines, programs, libraries, objects, classes, components, data structures, etc. that perform particular tasks or implement particular abstract data structures. In various example embodiments, the functionality of the program modules may be combined or divided among the described program modules. Machine-executable instructions for program modules may be executed within local or distributed devices. In a distributed facility, program modules may be located in both local and remote storage media.
用于实现本公开的方法的计算机程序代码可以用一种或多种编程语言编写。这些计算机程序代码可以提供给通用计算机、专用计算机或其它可编程的数据处理装置的处理器,使得程序代码在被计算机或其它可编程的数据处理装置执行的时候,引起在流程图和/或框图中规定的功能/操作被实施。程序代码可以完全在计算机上、部分在计算机上、作为独立的软件包、部分在计算机上且部分在远端计算机上或完全在远端计算机或服务器上执行。Computer program code for implementing the methods of the present disclosure may be written in one or more programming languages. The computer program code may be provided to a processor of a general purpose computer, special purpose computer or other programmable data processing apparatus such that the program code, when executed by the computer or other programmable data processing apparatus, results in the flowchart and/or block diagrams The functions/operations specified in are implemented. The program code may execute entirely on the computer, partly on the computer, as a stand-alone software package, partly on the computer and partly on a remote computer or entirely on the remote computer or server.
在本公开的上下文中,计算机程序代码或者相关数据可以由任意适当载体承载,以使得设备、装置或者处理器能够执行上文描述的各种处理和操作。载体的示例包括信号、计算机可读介质、等等。In the context of the present disclosure, computer program code or related data may be carried by any suitable carrier to enable a device, apparatus or processor to perform the various processes and operations described above. Examples of carriers include signals, computer-readable media, and the like.
信号的示例可以包括电、光、无线电、声音或其它形式的传播信号,诸如载波、红外信号等。Examples of signals may include electrical, optical, radio, acoustic, or other forms of propagated signals, such as carrier waves, infrared signals, and the like.
计算机可读介质可以是计算机可读信号介质或计算机可读存储介质。计算机可读介质可以包括但不限于电子的、磁的、光学的、电磁的、红外的或半导体系统、装置或设备,或其任意合适的组合。计算机可读存储介质的更详细示例包括带有一根或多根导线的电气连接、便携式计算机磁盘、硬盘、随机存储存取器(RAM)、只读存储器(ROM)、可擦除可编程只读存储器(EPROM或闪存)、光纤、便携式光盘只读存储器(CD-ROM)、光存储设备、磁存储设备,或其任意合适的组合。The computer-readable medium may be a computer-readable signal medium or a computer-readable storage medium. Computer-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or devices, or any suitable combination thereof. More detailed examples of computer readable storage media include electrical connections with one or more wires, portable computer disks, hard disks, random memory access (RAM), read only memory (ROM), erasable programmable read only Memory (EPROM or flash memory), fiber optics, portable compact disc read only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination thereof.
另外,尽管操作以特定顺序被描绘,但这并不应该理解为要求此类操作以示出的特定顺序或以相继顺序完成,或者执行所有图示的操作以获取期望结果。在某些情况下,多任务或并行处理会是有益的。同样地,尽管上述讨论包含了某些特定的实施细节,但这并不应解释为限制任何发明或权利要求的范围,而应解释为对可以针对特定发明的特定实施例的描述。本说明书中在分开的实施例的上下文中描述的某些特征也可以整合实施在单个实施例中。反之,在单个实施例的上下文中描述的各种特征也可以分离地在多个实施例或在任意合适的子组合中实施。Additionally, although operations are depicted in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in a sequential order, or that all illustrated operations be performed to obtain desired results. In some cases, multitasking or parallel processing can be beneficial. Likewise, although the above discussion contains some specific implementation details, these should not be construed as limiting the scope of any invention or claims, but rather as descriptions of specific embodiments that may be directed to specific inventions. Certain features that are described in this specification in the context of separate embodiments can also be implemented in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.
尽管已经以特定于结构特征和/或方法动作的语言描述了主题,但是应当理解,所附权利要求中限定的主题并不限于上文描述的特定特征或动作。相反,上文描述的特定特征和动作是作为实现权利要求的示例形式而被公开的。Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.
已经对技术的各种示例实施例进行了描述。作为以上的替代或者补充,对以下示例进行描述。在以下任何示例中所述的特征可以与本文所述的其它示例中的任何示例一起使用。Various example embodiments of the technology have been described. As an alternative to or in addition to the above, the following examples are described. Features described in any of the examples below may be used with any of the other examples described herein.
示例1.一种内容显示设备,包括:位于所述内容显示设备的壳体的变形,所述变形适于反射组合可见光并且使所述组合可见光的图案特征发生变化以用于定位所述内容显示设备;以及可见光通信(VLC)接收器,被布置在所述壳体中的与所述变形相对应的位置,并且被配置为:将以所述组合可见光形式发射的光信号转换成与所述内容显示设备的位置相对应的内容。Example 1. A content display device comprising: a deformation in a housing of the content display device adapted to reflect combined visible light and change a pattern characteristic of the combined visible light for positioning the content display a device; and a visible light communication (VLC) receiver, disposed in the housing at a position corresponding to the deformation, and configured to: convert an optical signal emitted in the combined visible light form into an optical signal corresponding to the combined visible light The content displays the content corresponding to the location of the device.
示例2.根据示例1的设备,其中将以所述组合可见光形式发射的光信号并转换成与所述内容显示设备的位置相对应的内容包括:接收与所述内容显示设备的位置相对应的所述光信号;将所述光信号转换成电信号;解调制所述电信号以获取内容数据信号;以及显示与所述内容数据信号相关联的所述内容。Example 2. The device of Example 1, wherein converting the light signal emitted in the combined visible light form into content corresponding to the location of the content display device comprises: receiving an optical signal corresponding to the location of the content display device converting the optical signal into an electrical signal; demodulating the electrical signal to obtain a content data signal; and displaying the content associated with the content data signal.
示例3.根据示例1的设备,其中所述变形包括形成在所述内容显示设备的所述壳体的表面的凸起结构和凹陷结构中的至少一项。Example 3. The device of Example 1, wherein the deformation includes at least one of a raised feature and a recessed feature formed on a surface of the housing of the content display device.
示例4.根据示例1所述的设备,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 4. The apparatus of Example 1, wherein the pattern features include at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例5.根据示例1所述的设备,其中所述VLC接收器被配置为利用第一通信地址执行下行链路数据传输,并且其中所述内容显示设备还包括:无线信号发射器,被配置为利用与所述第一通信地址不同的第二通信地址执行上行链路数据传输。Example 5. The device of Example 1, wherein the VLC receiver is configured to perform downlink data transmission using the first communication address, and wherein the content display device further comprises: a wireless signal transmitter configured to Uplink data transmission is performed using a second communication address different from the first communication address.
示例6.一种集成通信设备,包括:可见光通信(VLC)发射器,被配置为:将内容数据信号调制成光信号;以及以可见光形式发射所述光信号;组合光投影仪,被配置为:将所述可见光与图案特征相组合,以获取组合可见光;以及投射所述组合可见光。Example 6. An integrated communication device comprising: a visible light communication (VLC) transmitter configured to: modulate a content data signal into an optical signal; and transmit the optical signal in visible light; a combined light projector configured to : combining the visible light with pattern features to obtain combined visible light; and projecting the combined visible light.
示例7.根据示例6所述的设备,还包括:至少一个摄像机,被配置为:接收由内容显示设备反射的所述组合可见光;以及基于反射的所述组合可见光的图案特征的变化,确定所述内容显示设备的位置信息。Example 7. The device of Example 6, further comprising: at least one camera configured to: receive the combined visible light reflected by the content display device; and determine the combined visible light based on a change in a pattern characteristic of the reflected combined visible light The above content displays the location information of the device.
示例8.根据示例7所述的设备,其中所述VLC发射器还被配置为:从媒体服务器获取与所确定的所述位置信息相对应的内容数据信号。Example 8. The apparatus of example 7, wherein the VLC transmitter is further configured to obtain a content data signal corresponding to the determined location information from a media server.
示例9.根据示例7所述的设备,其中确定所述内容显示设备的位置信息包括:将所述图案特征的变化与参考图案特征相比较;以及基于所述比较的结果,计算所述内容显示设备在多个自由度上的所述位置信息。Example 9. The device of Example 7, wherein determining the location information of the content display device comprises: comparing a change in the pattern feature to a reference pattern feature; and calculating the content display based on a result of the comparison the position information of the device in multiple degrees of freedom.
示例10.根据示例6所述的设备,其中所述VLC发射器包括作为所述可见光的光源的发光二极管(LED)。Example 10. The apparatus of Example 6, wherein the VLC emitter comprises a light emitting diode (LED) as a light source for the visible light.
示例11.根据示例6所述的设备,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 11. The apparatus of Example 6, wherein the pattern features include at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例12.一种媒体服务器,包括:至少一个处理器;以及至少一个存储器,包括计算机程序代码;所述至少一个存储器和所述计算机程序代码被配置为与所述至少一个处理器一起促使所述媒体服务器:针对根据示例5所述的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与所述第一通信地址不同的第二通信地址。Example 12. A media server comprising: at least one processor; and at least one memory including computer program code; the at least one memory and the computer program code configured to, with the at least one processor, cause the Media server: setting a first communication address for downlink data transmission and a second communication address different from the first communication address for uplink data transmission for the content display device according to Example 5.
示例13.根据示例12所述的媒体服务器,其中所述至少一个存储器和所述计算机程序代码被配置为与所述至少一个处理器一起促使所述媒体服务器:向根据示例6-11所述的集成通信设备发送所述第一通信地址;以及响应于来自所述集成通信设备的针对与所述内容显示设备的位置信息相对应的内容数据信号的请求,将所述内容数据信号提供给所述集成通信设备,以使得所述集成通信设备向所述第一通信地址发送所述内容数据信号。Example 13. The media server of example 12, wherein the at least one memory and the computer program code are configured to, with the at least one processor, cause the media server to: an integrated communication device transmits the first communication address; and in response to a request from the integrated communication device for a content data signal corresponding to location information of the content display device, providing the content data signal to the content display device An integrated communication device such that the integrated communication device transmits the content data signal to the first communication address.
示例14.一种内容显示系统,包括:根据示例1-5中任一项所述的内容显示设备、根据示例6-11中任一项所述的集成通信设备、以及根据示例12-13中任一项所述的媒体服务器。Example 14. A content display system comprising: the content display device according to any one of Examples 1-5, the integrated communication device according to any one of Examples 6-11, and the content display device according to any one of Examples 12-13 The media server of any one.
示例15.一种用于显示内容的方法,包括:从集成通信设备接收以组合可见光形式发射的光信号,所述光信号是基于所述内容显示设备的位置信息而发送的,所述内容显示设备的位置信息是利用位于所述内容显示设备的壳体的变形而被确定的;以及将所述光信号转换成与所述内容显示设备的位置相对应的内容。Example 15. A method for displaying content, comprising receiving, from an integrated communications device, an optical signal emitted in combined visible light, the optical signal being transmitted based on location information of the content display device, the content displaying The location information of the device is determined using deformation of the housing of the content display device; and the light signal is converted into content corresponding to the location of the content display device.
示例16.根据示例15所述的方法,其中将所述光信号转换成与所述内容显示设备的位置相对应的内容包括:将所述光信号转换成电信号;解调制所述电信号以获取内容数据信号;以及显示与所述内容数据信号相关联的所述内容。Example 16. The method of Example 15, wherein converting the optical signal to content corresponding to the location of the content display device comprises: converting the optical signal to an electrical signal; demodulating the electrical signal to acquiring a content data signal; and displaying the content associated with the content data signal.
示例17.根据示例15所述的方法,其中所述变形包括形成在所述内容显示设备的所述壳体的表面的凸起结构和凹陷结构中的至少一项。Example 17. The method of Example 15, wherein the deforming includes at least one of raised and recessed structures formed on a surface of the housing of the content display device.
示例18.根据示例15所述的方法,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 18. The method of Example 15, wherein the pattern features include at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例19.根据示例15所述的方法,还包括:利用第一通信地址执行下行链路数据传输;以及利用与所述第一通信地址不同的第二通信地址执行上行链路数据传输。Example 19. The method of Example 15, further comprising: performing downlink data transmission using a first communication address; and performing uplink data transmission using a second communication address different from the first communication address.
示例20.一种用于通信的方法,包括:将内容数据信号调制成光信号;以可见光形式发射所述光信号;将所述可见光与图案特征相组合,以获取组合可见光;以及投射所述组合可见光。Example 20. A method for communicating, comprising: modulating a content data signal into an optical signal; emitting the optical signal in visible light; combining the visible light with pattern features to obtain combined visible light; and projecting the Combined visible light.
示例21.根据示例20所述的方法,还包括:接收由内容显示设备反射的所述组合可见光;以及基于反射的所述组合可见光的图案特征的变化,确定所述内容显示设备的位置信息。Example 21. The method of Example 20, further comprising: receiving the combined visible light reflected by a content display device; and determining location information of the content display device based on a change in a pattern characteristic of the reflected combined visible light.
示例22.根据示例20所述的方法,还包括:从媒体服务器获取与所确定的所述位置信息相对应的内容数据信号。Example 22. The method of example 20, further comprising obtaining a content data signal corresponding to the determined location information from a media server.
示例23.根据示例20所述的方法,其中确定所述内容显示设备的位置信息包括:将所述图案特征的变化与参考图案特征相比较;以及基于所述比较的结果,计算所述内容显示设备在多个自由度上的所述位置信息。Example 23. The method of Example 20, wherein determining the location information of the content display device comprises: comparing a change in the pattern feature to a reference pattern feature; and calculating the content display based on a result of the comparison the position information of the device in multiple degrees of freedom.
示例24.根据示例20所述的方法,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 24. The method of Example 20, wherein the pattern features include at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例25.一种用于通信的方法,包括:针对根据示例5所述的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与所述第一通信地址不同的第二通信地址。Example 25. A method for communication, comprising: setting a first communication address for downlink data transmission with respect to the content display device of Example 5, and for uplink data transmission with the first communication address. A second communication address with a different communication address.
示例26.根据示例25所述的方法,包括:向根据示例6-11所述的集成通信设备发送所述第一通信地址;以及响应于来自所述集成通信设备的针对与所述内容显示设备的位置信息相对应的内容数据信号的请求,将所述内容数据信号提供给所述集成通信设备,以使得所述集成通信设备向所述第一通信地址发送所述内容数据信号。Example 26. The method of example 25, comprising: sending the first communication address to the integrated communication device of examples 6-11; and in response to a request from the integrated communication device for communication with the content display device The content data signal corresponding to the location information of the device is requested, and the content data signal is provided to the integrated communication device, so that the integrated communication device sends the content data signal to the first communication address.
示例27.一种用于显示内容的装置,包括:用于从集成通信设备接收以组合可见光形式发射的光信号的部件,所述光信号是基于所述内容显示设备的位置信息而发送的,所述内容显示设备的位置信息是利用位于所述内容显示设备的壳体的变形而被确定的;以及用于将所述光信号转换成与所述内容显示设备的位置相对应的内容的部件。Example 27. An apparatus for displaying content, comprising means for receiving, from an integrated communication device, an optical signal emitted in combined visible light, the optical signal being transmitted based on location information of the content display device, position information of the content display device is determined using deformation of a housing of the content display device; and means for converting the light signal into content corresponding to the position of the content display device .
示例28.根据示例27的装置,其中用于转换的部件包括:用于将所述光信号转换成电信号的部件;用于解调制所述电信号以获取内容数据信号的部件;以及用于显示与所述内容数据信号相关联的所述内容的部件。Example 28. The apparatus of Example 27, wherein the means for converting comprises: means for converting the optical signal into an electrical signal; means for demodulating the electrical signal to obtain a content data signal; and for A component that displays the content associated with the content data signal.
示例29.根据示例27所述的装置,其中所述变形包括形成在所述内容显示设备的所述壳体的表面的凸起结构和凹陷结构中的至少一项。Example 29. The apparatus of Example 27, wherein the deformation includes at least one of raised and recessed structures formed on a surface of the housing of the content display device.
示例30.根据示例27所述的装置,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 30. The apparatus of Example 27, wherein the pattern features comprise at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例31.根据示例27所述的装置,还包括:用于利用第一通信地址执行下行链路数据传输的部件;以及用于利用与所述第一通信地址不同的第二通信地址执行上行链路数据传输的部件。Example 31. The apparatus of example 27, further comprising: means for performing downlink data transmission using a first communication address; and performing uplink using a second communication address different from the first communication address components for data transmission.
示例32.一种用于通信的装置,包括:用于将内容数据信号调制成光信号的部件;用于以可见光形式发射所述光信号的部件;用于将所述可见光与图案特征相组合,以获取组合可见光的部件;以及用于投射所述组合可见光的部件。Example 32. An apparatus for communicating, comprising: means for modulating a content data signal into an optical signal; means for emitting the optical signal in visible light; combining the visible light with pattern features , to obtain means for combining visible light; and means for projecting said combined visible light.
示例33.根据示例32所述的装置,还包括:用于接收由内容显示设备反射的所述组合可见光的部件;以及用于基于反射的所述组合可见光的图案特征的变化,确定所述内容显示设备的位置信息的部件。Example 33. The apparatus of Example 32, further comprising: means for receiving the combined visible light reflected by a content display device; and for determining the content based on a change in a pattern characteristic of the reflected combined visible light A widget that displays location information for a device.
示例34.根据示例32所述的装置,还包括:用于从媒体服务器获取与所确定的所述位置信息相对应的内容数据信号的部件。Example 34. The apparatus of example 32, further comprising means for obtaining a content data signal corresponding to the determined location information from a media server.
示例35.根据示例32所述的装置,其中用于确定的部件包括:用于将所述图案特征的变化与参考图案特征相比较的部件;以及用于基于所述比较的结果,计算所述内容显示设备在多个自由度上的所述位置信息的部件。Example 35. The apparatus of Example 32, wherein the means for determining comprises: means for comparing a change in the pattern feature to a reference pattern feature; and calculating the A component of the position information of the content display device in multiple degrees of freedom.
示例36.根据示例32所述的装置,其中所述图案特征包括条纹图案、斑点图案、圆圈图案和栅格图案中的至少一项。Example 36. The apparatus of Example 32, wherein the pattern features include at least one of a stripe pattern, a spot pattern, a circle pattern, and a grid pattern.
示例37.一种用于通信的装置,包括:用于针对根据示例5所述的内容显示设备设置用于下行链路数据传输的第一通信地址,以及用于上行链路数据传输的与所述第一通信地址不同的第二通信地址的部件。Example 37. An apparatus for communicating, comprising: for setting a first communication address for downlink data transmission for the content display device of example 5, and for uplink data transmission and all A component with a second communication address that is different from the first communication address.
示例38.根据示例37所述的装置,还包括:用于向根据示例6-11所述的集成通信设备发送所述第一通信地址的部件;以及用于如下操作的部件:响应于来自所述集成通信设备的针对与所述内容显示设备的位置信息相对应的内容数据信号的请求,将所述内容数据信号提供给所述集成通信设备,以使得所述集成通信设备向所述第一通信地址发送所述内容数据信号。Example 38. The apparatus of Example 37, further comprising: means for sending the first communications address to the integrated communications device of Examples 6-11; and means for: responsive to the a request from the integrated communication device for a content data signal corresponding to the location information of the content display device, the content data signal is provided to the integrated communication device, so that the integrated communication device sends the information to the first The communication address transmits the content data signal.
示例39.一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序包括指令,所述指令在由设备上的处理器执行时,促使所述设备执行根据示例15-19中的任一项所述的方法。Example 39. A computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the methods according to Examples 15-19. The method of any one.
示例40.一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序包括指令,所述指令在由设备上的处理器执行时,促使所述设备执行根据示例20-24中的任一项所述的方法。Example 40. A computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the methods according to Examples 20-24. The method of any one.
示例41.一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序包括指令,所述指令在由设备上的处理器执行时,促使所述设备执行根据示例25-26中的任一项所述的方法。Example 41. A computer-readable storage medium having stored thereon a computer program comprising instructions that, when executed by a processor on a device, cause the device to perform the methods according to Examples 25-26. The method of any one.
Claims (32)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910362300.7A CN111866411B (en) | 2019-04-30 | 2019-04-30 | Content display apparatus, method, device, and computer-readable storage medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910362300.7A CN111866411B (en) | 2019-04-30 | 2019-04-30 | Content display apparatus, method, device, and computer-readable storage medium |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111866411A true CN111866411A (en) | 2020-10-30 |
| CN111866411B CN111866411B (en) | 2023-06-23 |
Family
ID=72965736
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910362300.7A Active CN111866411B (en) | 2019-04-30 | 2019-04-30 | Content display apparatus, method, device, and computer-readable storage medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111866411B (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009008932A (en) * | 2007-06-28 | 2009-01-15 | Dainippon Printing Co Ltd | Image projection system |
| CN102868448A (en) * | 2012-08-24 | 2013-01-09 | 中兴通讯股份有限公司 | Visible light communication data transmission method and device, and visible light communication data receiving method and device |
| US20140153923A1 (en) * | 2012-12-01 | 2014-06-05 | Qualcomm Incorporated | Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling |
| CN104363382A (en) * | 2014-04-24 | 2015-02-18 | 北京国承万通信息科技有限公司 | A method and device for transmitting/obtaining information by using visible light signal |
| CN104769861A (en) * | 2012-11-07 | 2015-07-08 | 高通股份有限公司 | Methods and apparatus for communicating information using visible light signals and/or radio signals |
| US20150373503A1 (en) * | 2014-06-20 | 2015-12-24 | Qualcomm Incorporated | Method and apparatus for positioning system enhancement with visible light communication |
| CN207117844U (en) * | 2016-11-02 | 2018-03-16 | 大辅科技(北京)有限公司 | More VR/AR equipment collaborations systems |
-
2019
- 2019-04-30 CN CN201910362300.7A patent/CN111866411B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2009008932A (en) * | 2007-06-28 | 2009-01-15 | Dainippon Printing Co Ltd | Image projection system |
| CN102868448A (en) * | 2012-08-24 | 2013-01-09 | 中兴通讯股份有限公司 | Visible light communication data transmission method and device, and visible light communication data receiving method and device |
| CN104769861A (en) * | 2012-11-07 | 2015-07-08 | 高通股份有限公司 | Methods and apparatus for communicating information using visible light signals and/or radio signals |
| US20140153923A1 (en) * | 2012-12-01 | 2014-06-05 | Qualcomm Incorporated | Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling |
| CN104823391A (en) * | 2012-12-01 | 2015-08-05 | 高通股份有限公司 | Methods and apparatus for communications using visible light communications signaling in combination with wireless radio signaling |
| CN104363382A (en) * | 2014-04-24 | 2015-02-18 | 北京国承万通信息科技有限公司 | A method and device for transmitting/obtaining information by using visible light signal |
| US20150373503A1 (en) * | 2014-06-20 | 2015-12-24 | Qualcomm Incorporated | Method and apparatus for positioning system enhancement with visible light communication |
| CN207117844U (en) * | 2016-11-02 | 2018-03-16 | 大辅科技(北京)有限公司 | More VR/AR equipment collaborations systems |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111866411B (en) | 2023-06-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12164824B2 (en) | Interactive projection input and output device | |
| US10218440B2 (en) | Method for visible light communication using display colors and pattern types of display | |
| US10003741B2 (en) | System for processing data from an omnidirectional camera with multiple processors and/or multiple sensors connected to each processor | |
| Saha et al. | Survey on optical camera communications: challenges and opportunities | |
| US11789150B2 (en) | Localization apparatus and method | |
| US9843725B2 (en) | Omnidirectional camera with multiple processors and/or multiple sensors connected to each processor | |
| US20160205362A1 (en) | Smart led lighting device and system thereof | |
| JP7082994B2 (en) | Communication systems, display control devices, communication terminals and programs that enable large-capacity supplemental downlink using optical communication. | |
| WO2020031153A1 (en) | System for optical wireless communication to extended reality immersion devices | |
| JP2024019243A (en) | transmitting device | |
| WO2022048845A1 (en) | A receiving system for high speed and large coverage optical wireless communication | |
| US20250267197A1 (en) | Systems and methods for sharing content in an extended reality environment | |
| Chhaglani et al. | Evaluating LED-camera communication for drones | |
| US8988485B2 (en) | Dynamic wireless configuration for video conference environments | |
| JP2003069507A (en) | Space division multiplexing / space division multiple access wireless optical communication system | |
| CN111866411B (en) | Content display apparatus, method, device, and computer-readable storage medium | |
| US20190212135A1 (en) | Methods And Systems For 3D Scanning | |
| US10356319B2 (en) | Panoramic portals for connecting remote spaces | |
| CN116830483A (en) | Apparatus and method for exchanging data in a hybrid optical wireless communication system | |
| CN117133228A (en) | LED large screen display control system | |
| CN114556809B (en) | Optical wireless communication systems and devices | |
| US12535947B2 (en) | Interactive projection input and output device | |
| CN112153442A (en) | Playing method, device, terminal, television equipment, storage medium and electronic equipment | |
| CN112152713B (en) | Display method, display device, terminal, display device, storage medium and electronic device | |
| Zhang | Accelerating Vision Systems on Mobile Devices |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| CP03 | Change of name, title or address |
Address after: 201206 Pudong New Area Jinqiao Ning Road, Shanghai, No. 388 Patentee after: Nokia Communications (Shanghai) Co., Ltd. Country or region after: China Patentee after: NOKIA SOLUTIONS AND NETWORKS OY Country or region after: Finland Address before: 201206 Pudong New Area Jinqiao Ning Road, Shanghai, No. 388 Patentee before: NOKIA SHANGHAI BELL Co.,Ltd. Country or region before: China Patentee before: NOKIA SOLUTIONS AND NETWORKS OY Country or region before: Finland |