[go: up one dir, main page]

CN115097973A - Desktop holographic display all-in-one machine device, method, computer program product and storage medium - Google Patents

Desktop holographic display all-in-one machine device, method, computer program product and storage medium Download PDF

Info

Publication number
CN115097973A
CN115097973A CN202210786441.3A CN202210786441A CN115097973A CN 115097973 A CN115097973 A CN 115097973A CN 202210786441 A CN202210786441 A CN 202210786441A CN 115097973 A CN115097973 A CN 115097973A
Authority
CN
China
Prior art keywords
holographic
display
unit
glasses
motion capture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202210786441.3A
Other languages
Chinese (zh)
Inventor
刘嘉兴
许秋子
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ruilishi Technology Kunming Co ltd
Shenzhen Realis Multimedia Technology Co Ltd
Original Assignee
Ruilishi Technology Kunming Co ltd
Shenzhen Realis Multimedia Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ruilishi Technology Kunming Co ltd, Shenzhen Realis Multimedia Technology Co Ltd filed Critical Ruilishi Technology Kunming Co ltd
Priority to CN202210786441.3A priority Critical patent/CN115097973A/en
Publication of CN115097973A publication Critical patent/CN115097973A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G02B30/34Stereoscopes providing a stereoscopic pair of separated images corresponding to parallactically displaced views of the same object, e.g. 3D slide viewers
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0354Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of 2D relative movements between the device, or an operating part thereof, and a plane or surface, e.g. 2D mice, trackballs, pens or pucks
    • G06F3/03545Pens or stylus

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Optics & Photonics (AREA)
  • Holo Graphy (AREA)

Abstract

The invention discloses a desktop holographic display all-in-one machine, which comprises: the holographic display device body is used for integrating the infrared optical motion capture unit and the holographic display unit in structure and function; the interaction control unit comprises holographic tracking glasses and an interaction control pen, and is used for providing watching and controlling holographic 3D content and watching a display picture through the holographic tracking glasses; and the computing unit is used for operating the holographic content and the motion capture software, and different computing units can be flexibly configured according to the complexity of the operated holographic content. The desktop all-in-one machine equipment is provided with the independent computing unit, so that the equipment is more flexible to use, can adapt to various different application scenes, continuously updates the iterative computing unit according to the requirements of different contents, simultaneously combines the binocular high-speed infrared optical motion capture camera and the 3D display screen, adds the IMU position and pose sensor, and can also ensure the accurate stability of the output of infrared optical motion capture data.

Description

桌面全息显示一体机设备、方法、计算机程序产品及存储介质Desktop holographic display all-in-one device, method, computer program product and storage medium

技术领域technical field

本发明涉及显示领域,尤其涉及一种桌面全息显示一体机设备、方法、计算机程序产品及存储介质。The present invention relates to the field of display, in particular to a desktop holographic display integrated machine device, method, computer program product and storage medium.

背景技术Background technique

全息显示技术(Front-Projected Holographic Display)也称虚拟成像技术,是利用干涉和衍射原理记录并再现物体真实的三维图像的技术,具有能够满足人眼视觉的全部感知,甚至观看者可以不借助头盔、眼镜等辅助装置进行观看三维图像的优点。随着显示技术不断的发展,全息显示技术获得了越来越多的关注。Holographic display technology (Front-Projected Holographic Display), also known as virtual imaging technology, is a technology that uses the principles of interference and diffraction to record and reproduce the real three-dimensional image of an object. , glasses and other auxiliary devices for viewing the advantages of three-dimensional images. With the continuous development of display technology, holographic display technology has gained more and more attention.

当前市场上桌面级3D显示系统多采用偏振式显示原理,显示亮度不够,而且大部分产品采用分体式结构,光学动捕定位部分与显示载体分离,安装使用麻烦,且不稳定。在目前市场中的一体化产品中,产品大都采用计算单元与显示一体化设计,计算单元配置固定,不利根据不同使用场景更改配置。本发明针对以上缺陷,提出一种桌面一体化全息显示设备,既满足了动作捕捉设备与显示一体化,又避免了固定计算单元,限制用户使用场景的问题。At present, desktop-level 3D display systems on the market mostly use the principle of polarized display, and the display brightness is not enough, and most of the products use a split structure, and the optical motion capture positioning part is separated from the display carrier, which is troublesome to install and use, and is unstable. In the current integrated products in the market, most of the products adopt the integrated design of the computing unit and the display, and the configuration of the computing unit is fixed, which is not conducive to changing the configuration according to different usage scenarios. Aiming at the above defects, the present invention proposes a desktop integrated holographic display device, which not only satisfies the integration of the motion capture device and the display, but also avoids the problem of fixed computing units and limiting user usage scenarios.

发明内容SUMMARY OF THE INVENTION

鉴于上述现有技术的不足,本发明的目的在于提供一种桌面全息显示一体机设备、方法、计算机程序产品及存储介质,用以适应各种不同的应用场景,根据不同内容的需要不断更新迭代计算单元。In view of the above-mentioned deficiencies of the prior art, the purpose of the present invention is to provide a desktop holographic display all-in-one device, method, computer program product and storage medium to adapt to various application scenarios, and to continuously update and iterate according to the needs of different contents computing unit.

有鉴于此,本申请第一方面提供了一种桌面全息显示一体机设备,包括:全息显示设备主体,用于将红外光学动作捕捉单元与全息显示单元在结构和功能上融合为一体,所述红外光学动作捕捉单元与全息显示单元采用共同主板供电,所述全息显示设备主体中内置带重力感应IMU模块,当设备倾斜时可以感应设备的倾斜角度,将设备倾斜角度实时输出给全息内容,以实时调整显示的画面;In view of this, the first aspect of the present application provides a desktop holographic display all-in-one device, including: a holographic display device main body, which is used to integrate the infrared optical motion capture unit and the holographic display unit into one in structure and function, the said The infrared optical motion capture unit and the holographic display unit are powered by a common motherboard. The main body of the holographic display device has a built-in IMU module with gravity sensing. When the device is tilted, it can sense the tilt angle of the device and output the tilt angle of the device to the holographic content in real time. Real-time adjustment of the displayed screen;

交互控制单元,包括全息追踪眼镜和交互控制笔,用于提供观看和控制全息3D内容,并通过全息追踪眼镜观看显示画面,所述全息追踪眼镜采用主动立体技术,通过控制左右眼镜片的开关与显示画面同步,间隔显示左右眼画面,造成视觉上的立体效果;The interactive control unit, including holographic tracking glasses and an interactive control pen, is used to provide viewing and control of holographic 3D content, and to view the display screen through the holographic tracking glasses. The display screen is synchronized, and the left and right eye images are displayed at intervals, resulting in a three-dimensional visual effect;

计算单元,用于运行全息内容和动作捕捉软件,可根据运行的全息内容复杂度,灵活配置不同的计算单元。The computing unit is used for running the holographic content and motion capture software, and different computing units can be flexibly configured according to the complexity of the running holographic content.

所述红外光学动作捕捉单元,包括红外光学双目捕捉相机,所述红外光学双目捕捉相机位于全息显示单元上端,用于实时捕捉全息追踪眼镜的位置信息,通过捕捉结果判断全息追踪眼镜是否在捕捉范围内,以实时调整全息显示设备的状态。The infrared optical motion capture unit includes an infrared optical binocular capture camera. The infrared optical binocular capture camera is located at the upper end of the holographic display unit and is used to capture the position information of the holographic tracking glasses in real time, and determine whether the holographic tracking glasses are in the Capture the range to adjust the state of the holographic display device in real time.

当全息追踪眼镜在捕捉区域出现时,全息画面显示为3D模式,当全息追踪眼镜离开捕捉区域时,全息画面显示为2D模式。When the holographic tracking glasses appear in the capture area, the holographic screen is displayed in 3D mode, and when the holographic tracking glasses leave the capture area, the holographic screen is displayed in 2D mode.

所述全息显示单元由主动立体显示屏体和全息控制模块构成,全息控制模块包括位姿传感器、3D信号发射器、供电模块。The holographic display unit is composed of an active stereoscopic display screen body and a holographic control module, and the holographic control module includes a pose sensor, a 3D signal transmitter, and a power supply module.

所述主动立体显示屏体采用高刷新率LED屏体,全息控制模块控制屏体的显示画面以及显示频率,通过3D信号发射器与全息追踪眼镜连接,控制眼镜的左右眼镜片的开关与显示画面频率相同,以便在观看者视野内形成3D图像。The active stereoscopic display screen adopts a high refresh rate LED screen body, and the holographic control module controls the display screen and display frequency of the screen body, and is connected to the holographic tracking glasses through a 3D signal transmitter to control the switch and display screen of the left and right glasses of the glasses. The frequencies are the same to form a 3D image within the viewer's field of view.

所述交互控制单元通过交互控制笔来操作控制显示的虚拟物体,交互控制笔由光学标记点和IMU传感器组成,用于通过红外光学动作捕捉单元捕捉交互控制笔上的光学标记点和IMU信息获取交互控制笔在空间中的位置信息,并将信息传输至全息内容。The interactive control unit operates and controls the displayed virtual object through an interactive control pen. The interactive control pen is composed of an optical marker and an IMU sensor, and is used to capture the optical marker on the interactive control pen and obtain IMU information through an infrared optical motion capture unit. Interactively control the position information of the pen in space and transmit the information to the holographic content.

本申请第二方面提供了一种桌面全息显示方法,包括:A second aspect of the present application provides a desktop holographic display method, including:

通过位于全息显示单元上端的红外光学动作捕捉单元获取全息追踪眼镜和交互控制笔在动作捕捉空间中的三维位置信息,判断全息追踪眼镜是否在捕捉范围内,当全息追踪眼镜在捕捉区域出现时,全息画面显示为3D模式,否则,显示为2D模式;同时将全息追踪眼镜和交互控制笔的三维位置信息以及全息显示单元的倾斜角度传输给计算单元;Obtain the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space through the infrared optical motion capture unit located at the upper end of the holographic display unit, and determine whether the holographic tracking glasses are within the capture range. When the holographic tracking glasses appear in the capture area, The holographic screen is displayed in 3D mode, otherwise, it is displayed in 2D mode; at the same time, the three-dimensional position information of the holographic tracking glasses and the interactive control pen and the inclination angle of the holographic display unit are transmitted to the computing unit;

将所述全息追踪眼镜和交互控制笔在所述动作捕捉空间中的三维位置信息同步给全息显示单元,并通过交互控制笔来操作控制显示的虚拟物体;Synchronizing the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space to the holographic display unit, and operating and controlling the displayed virtual object through the interactive control pen;

根据全息显示单元的倾斜角度、所述全息追踪眼镜和交互控制笔在所述动作捕捉空间中的三维位置信息实时调整画面的显示角度,以显示出用户视角对应的出屏的全息立体画面。According to the tilt angle of the holographic display unit, the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space, the display angle of the screen is adjusted in real time to display the holographic stereoscopic screen corresponding to the user's perspective.

所述全息显示单元上集成有位姿传感器,用户可根据自身的坐姿以及身高调整显示屏的倾斜角度,随着屏体的倾斜,实时测量屏体的倾斜角度,以便实时调整画面的显示角度。The holographic display unit is integrated with a pose sensor, and the user can adjust the inclination angle of the display screen according to his own sitting posture and height. With the inclination of the screen body, the inclination angle of the screen body is measured in real time, so as to adjust the display angle of the screen in real time.

本申请第三方面提供了一种非易失性计算机可读存储介质,所述非易失性计算机可读存储介质存储有计算机可执行指令,该计算机可执行指令被一个或多个处理器执行时,可使得所述一个或多个处理器执行第二方面及第二方面中任意一种可能的实现方式中所述的方法。A third aspect of the present application provides a non-volatile computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being executed by one or more processors , the one or more processors can be caused to perform the method described in the second aspect and any one possible implementation manner of the second aspect.

本申请第四方面提供了一种计算机程序产品,其特征在于,所述计算机程序产品包括存储在非易失性计算机可读存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被处理器执行时,使所述处理器执行第二方面及第二方面中任意一种可能的实现方式中所述的方法。A fourth aspect of the present application provides a computer program product, wherein the computer program product includes a computer program stored on a non-volatile computer-readable storage medium, the computer program includes program instructions, and when the When the program instructions are executed by the processor, the processor is caused to execute the method described in the second aspect and any possible implementation manner of the second aspect.

本申请提供了一种桌面全息显示一体机设备,包括:全息显示设备主体,用于将红外光学动作捕捉单元与全息显示单元在结构和功能上融合为一体,所述红外光学动作捕捉单元与全息显示单元采用共同主板供电,所述全息显示设备主体中内置带重力感应IMU模块,当设备倾斜时可以感应设备的倾斜角度,将设备倾斜角度实时输出给全息内容,以实时调整显示的画面;交互控制单元,包括全息追踪眼镜和交互控制笔,用于提供观看和控制全息3D内容,并通过全息追踪眼镜观看显示画面,所述全息追踪眼镜采用主动立体技术,通过控制左右眼镜片的开关与显示画面同步,间隔显示左右眼画面,造成视觉上的立体效果;计算单元,用于运行全息内容和动作捕捉软件,可根据运行的全息内容复杂度,灵活配置不同的计算单元。通过该方案,相比市场上的同类产品,具有独立计算单元,使设备使用更灵活,能够适应各种不同的应用场景,根据不同内容的需要不断更新迭代计算单元,同时采用双目高速红外光学动作捕捉相机和3D显示屏结合并增加IMU位姿传感器,形成一体化机身,操作方便,也能保障红外光学动作捕捉数据输出的准确稳定性。The application provides a desktop holographic display all-in-one device, including: a holographic display device main body for integrating an infrared optical motion capture unit and a holographic display unit in structure and function, the infrared optical motion capture unit and the holographic display unit. The display unit is powered by a common motherboard. The main body of the holographic display device has a built-in IMU module with gravity sensing. When the device is tilted, the tilt angle of the device can be sensed, and the tilt angle of the device can be output to the holographic content in real time to adjust the displayed screen in real time; interaction; The control unit, including holographic tracking glasses and an interactive control pen, is used to provide viewing and control of holographic 3D content, and to view the display screen through the holographic tracking glasses, which adopt active stereo technology, and control the switching and display of the left and right glasses. The picture is synchronized, and the left and right eye pictures are displayed at intervals, resulting in a visual stereo effect; the computing unit is used to run the holographic content and motion capture software, and different computing units can be flexibly configured according to the complexity of the running holographic content. Through this solution, compared with similar products on the market, it has an independent computing unit, which makes the device more flexible to use, can adapt to various application scenarios, and continuously update the iterative computing unit according to the needs of different contents. The motion capture camera is combined with the 3D display screen and the IMU pose sensor is added to form an integrated body, which is easy to operate and can also ensure the accurate and stable output of infrared optical motion capture data.

附图说明Description of drawings

下面将结合附图及实施例对本发明作进一步说明,附图中:The present invention will be further described below in conjunction with the accompanying drawings and embodiments, in which:

图1为本发明提供的一种桌面全息显示一体机设备的结构图;1 is a structural diagram of a desktop holographic display all-in-one device provided by the present invention;

图2为本发明提供的一种桌面全息显示方法流程图;2 is a flowchart of a desktop holographic display method provided by the present invention;

图3为本发明提供的一种桌面全息显示设备示意图;3 is a schematic diagram of a desktop holographic display device provided by the present invention;

具体实施方式Detailed ways

本申请实施例提供了一种全息显示方法、系统、计算机程序产品及存储介质,用以提高全息显示的效果。Embodiments of the present application provide a holographic display method, system, computer program product and storage medium, so as to improve the effect of holographic display.

下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行描述。在本申请中,“至少一个”是指一个或者多个,“多个”是指两个或两个以上。“和/或”,描述关联对象的关联关系,表示可以存在三种关系,例如,A和/或B,可以表示:单独存在A,同时存在A和B,单独存在B的情况,其中A,B可以是单数或者复数。字符“/”一般表示前后关联对象是一种“或”的关系。“以下至少一项(个)”或其类似表达,是指的这些项中的任意组合,包括单项(个)或复数项(个)的任意组合。例如,a,b或c中的至少一项(个),可以表示:a,b,c,a和b,a和c,b和c或a和b和c,其中a、b和c可以是单个,也可以是多个。值得注意的是,“至少一项(个)”还可以解释成“一项(个)或多项(个)”。The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings in the embodiments of the present application. In this application, "at least one" means one or more, and "plurality" means two or more. "And/or", which describes the association relationship of the associated objects, indicates that there can be three kinds of relationships, for example, A and/or B, which can indicate: the existence of A alone, the existence of A and B at the same time, and the existence of B alone, where A, B can be singular or plural. The character "/" generally indicates that the associated objects are an "or" relationship. "At least one item(s) below" or similar expressions thereof refer to any combination of these items, including any combination of single item(s) or plural items(s). For example, at least one (a) of a, b or c, can represent: a, b, c, a and b, a and c, b and c or a and b and c, where a, b and c can be It can be single or multiple. It is worth noting that "at least one item(s)" can also be interpreted as "one item(s) or more(s)".

需要说明的是,本申请中,“示例性的”或者“例如”等词用于表示作例子、例证或说明。本申请中被描述为“示例性的”或者“例如”的任何实施例或设计方案不应被解释为比其他实施例或设计方案更优选或更具优势。确切而言,使用“示例性的”或者“例如”等词旨在以具体方式呈现相关概念。It should be noted that, in this application, words such as "exemplary" or "for example" are used to represent examples, illustrations or illustrations. Any embodiment or design described in this application as "exemplary" or "such as" should not be construed as preferred or advantageous over other embodiments or designs. Rather, the use of words such as "exemplary" or "such as" is intended to present the related concepts in a specific manner.

本申请实施例中出现的第一、第二等描述,仅作示意与区分描述对象之用,没有次序之分,也不表示本申请实施例中对设备个数的特别限定,不能构成对本申请实施例的任何限制。The descriptions of the first, second, etc. appearing in the embodiments of the present application are only used for illustration and distinguishing the description objects, and have no order. any limitations of the examples.

现有的桌面级3D显示系统大部分产品采用分体式结构,光学动捕定位部分与显示载体分离,安装使用麻烦,且不稳定。而在目前市场中的一体化产品中,大都采用计算单元与显示一体化设计,计算单元配置固定。本申请则避免了上述问题,提出一种桌面全息显示一体机设备,即将显示单元与动作捕捉单元固定在一起,同时可以根据需求随时更换计算单元,具体参见如下实施例1。Most of the existing desktop-level 3D display systems use a split structure, and the optical motion capture positioning part is separated from the display carrier, which is troublesome to install and use and unstable. In the current integrated products in the market, most of them adopt the integrated design of the computing unit and the display, and the configuration of the computing unit is fixed. The present application avoids the above problems, and proposes an all-in-one desktop holographic display device, that is, the display unit and the motion capture unit are fixed together, and the computing unit can be replaced at any time according to requirements.

实施例1:Example 1:

本申请提供了一种桌面全息显示一体机设备,请参见图1,该设备100包括:The present application provides an all-in-one desktop holographic display device, please refer to FIG. 1 , the device 100 includes:

全息显示设备主体101,用于将红外光学动作捕捉单元1011与全息显示单元1012在结构和功能上融合为一体,红外光学动作捕捉单元1011与全息显示单元1012采用共同主板供电,全息显示设备主体中内置带重力感应IMU模块,当设备倾斜时可以感应设备的倾斜角度,将设备倾斜角度实时输出给全息内容,以实时调整显示的画面;The main body 101 of the holographic display device is used to integrate the infrared optical motion capture unit 1011 and the holographic display unit 1012 in structure and function. The infrared optical motion capture unit 1011 and the holographic display unit 1012 are powered by a common motherboard. The built-in IMU module with gravity sensing can sense the tilt angle of the device when the device is tilted, and output the tilt angle of the device to the holographic content in real time to adjust the displayed screen in real time;

其中,红外光学动作捕捉单元1011,包括红外光学双目捕捉相机,红外光学双目捕捉相机位于全息显示单元1012上端,用于实时捕捉全息追踪眼镜的位置信息,通过捕捉结果判断全息追踪眼镜是否在捕捉范围内,以实时调整全息显示设备的状态。The infrared optical motion capture unit 1011 includes an infrared optical binocular capture camera. The infrared optical binocular capture camera is located at the upper end of the holographic display unit 1012 and is used to capture the position information of the holographic tracking glasses in real time, and determine whether the holographic tracking glasses are in the Capture the range to adjust the state of the holographic display device in real time.

具体说来,全息显示设备主体101将红外光学双目捕捉相机与3D显示屏体结合,采用共同主板供电设计,双目相机和3D显示屏体采用同一电源。全息显示设备主体101中内置带重力感应IMU模块,当设备倾斜时可以感应设备的倾斜角度,将设备倾斜角度实时输出给全息内容,实时调整显示的画面。全息显示单元1012上部的红外光学相机实时捕捉全息追踪3D眼镜,通过捕捉结果判断全息追踪3D眼镜是否在捕捉范围内来实时调整全息显示设备状态。当全息追踪眼镜1021在捕捉区域出现时,画面显示为3D模式。当全息追踪眼镜1021离开捕捉区域时,画面显示为2D模式。Specifically, the main body 101 of the holographic display device combines the infrared optical binocular capture camera with the 3D display screen body, and adopts a common motherboard power supply design, and the binocular camera and the 3D display screen body use the same power supply. The main body 101 of the holographic display device has a built-in IMU module with gravity sensing, which can sense the tilt angle of the device when the device is tilted, output the tilt angle of the device to the holographic content in real time, and adjust the displayed screen in real time. The infrared optical camera on the upper part of the holographic display unit 1012 captures the holographic tracking 3D glasses in real time, and adjusts the state of the holographic display device in real time by judging whether the holographic tracking 3D glasses are within the capture range through the capture result. When the holographic tracking glasses 1021 appear in the capture area, the screen is displayed in 3D mode. When the holographic tracking glasses 1021 leave the capture area, the picture is displayed in 2D mode.

全息显示设备主体101与计算单元103通过USB连接线,将光学相机捕捉到的数据、位姿传感器获取的数据传输至计算单元,经过处理的数据传输至全息内容,从而完成交互控制及全息3D观看。The main body 101 of the holographic display device and the computing unit 103 transmit the data captured by the optical camera and the data obtained by the pose sensor to the computing unit through the USB cable, and the processed data is transferred to the holographic content, thereby completing the interactive control and holographic 3D viewing .

红外光学动作捕捉单元1011采用被动式红外光学动捕,该部分提供动作捕捉定位功能。通过精确设计的位置关系,将两个高速红外摄像头安置在全息显示单元1012上,在镜头外围采用大功率红外LED灯提供红外光源。全息追踪眼镜1021上反光标记点会反射红外光,反射后的红外光被红外摄像头捕获,通过高速相机拍摄图像处理为灰度图,获取全息追踪眼镜1021上的反光球的二维坐标。通过两个镜头拍摄的两幅画面,获取同一时刻反光球的不同二维坐标,通过二维转三维算法计算出反光球在空间中的三维坐标。将获取的位置信息提供给全息显示内容,来获取正确的立体显示画面。The infrared optical motion capture unit 1011 adopts passive infrared optical motion capture, and this part provides the function of motion capture and positioning. Two high-speed infrared cameras are placed on the holographic display unit 1012 through a precisely designed positional relationship, and a high-power infrared LED lamp is used at the periphery of the lens to provide an infrared light source. The reflective marking points on the holographic tracking glasses 1021 will reflect infrared light, and the reflected infrared light is captured by the infrared camera, and the image is captured by the high-speed camera and processed into a grayscale image to obtain the two-dimensional coordinates of the reflective sphere on the holographic tracking glasses 1021 . Two pictures taken by two lenses are used to obtain different two-dimensional coordinates of the reflective ball at the same time, and the three-dimensional coordinates of the reflective ball in space are calculated through a 2D-to-3D algorithm. The acquired position information is provided to the holographic display content to acquire the correct stereoscopic display image.

全息显示单元1012由主动立体显示屏体和全息控制模块构成,全息控制模块包括位姿传感器、3D信号发射器、供电模块等。The holographic display unit 1012 is composed of an active stereoscopic display body and a holographic control module, and the holographic control module includes a pose sensor, a 3D signal transmitter, a power supply module, and the like.

主动立体显示屏体采用高刷新率LED屏体,全息控制模块控制屏体的显示画面以及显示频率,通过3D信号发射器与全息追踪眼镜1021连接,控制眼镜的左右眼镜片的开关与显示画面频率相同,以便在观看者视野内形成3D图像。集成设计的供电模块同时给红外光学相机和显示屏体提供电源,在屏体上集成位姿传感器,用户可以根据自身的坐姿以及身高调整显示屏倾斜角度,随着屏体的倾斜,实时测量屏体的倾斜角度。将倾斜数据传输至计算单元中的全息内容中,全息内容获取位姿数据后实时调整画面显示角度,配合全息追踪眼镜1021完成优秀的视觉体验。The active stereoscopic display body adopts a high refresh rate LED screen body. The holographic control module controls the display screen and display frequency of the screen body. It is connected to the holographic tracking glasses 1021 through a 3D signal transmitter to control the switching of the left and right glasses of the glasses and the display screen frequency. the same in order to form a 3D image within the viewer's field of view. The integrated power supply module provides power to the infrared optical camera and the display body at the same time. The position sensor is integrated on the screen body. Users can adjust the tilt angle of the display screen according to their own sitting posture and height. body tilt angle. The tilt data is transmitted to the holographic content in the computing unit. After the holographic content acquires the pose data, the screen display angle is adjusted in real time, and the holographic tracking glasses 1021 are used to achieve an excellent visual experience.

交互控制单元102,包括全息追踪眼镜1021和交互控制笔1022,用于提供观看和控制全息3D内容,并通过全息追踪眼镜1021观看显示画面,全息追踪眼镜1021采用主动立体技术,通过控制左右眼镜片的开关与显示画面同步,间隔显示左右眼画面,造成视觉上的立体效果;当全息追踪眼镜1021在捕捉区域出现时,全息画面显示为3D模式,当全息追踪眼镜1021离开捕捉区域时,全息画面显示为2D模式。The interactive control unit 102 includes holographic tracking glasses 1021 and an interactive control pen 1022, which are used to provide viewing and control of holographic 3D content, and to view the display screen through the holographic tracking glasses 1021. The holographic tracking glasses 1021 adopt active stereo technology, and control the left and right glasses When the holographic tracking glasses 1021 appear in the capture area, the holographic screen is displayed in 3D mode, and when the holographic tracking glasses 1021 leave the capture area, the holographic screen Displayed in 2D mode.

同时利用眼镜上的跟踪标记点与红外光学动作捕捉单元1011,控制画面的显示角度从而达到更加立体的效果,使虚拟物体在视觉上显示于屏幕之外,获得出屏的立体效果。At the same time, the tracking marks on the glasses and the infrared optical motion capture unit 1011 are used to control the display angle of the screen to achieve a more three-dimensional effect, so that the virtual object is visually displayed outside the screen, and the three-dimensional effect of the screen is obtained.

通过交互控制笔1022来操作控制显示的虚拟物体,交互控制笔1022由光学标记点和IMU传感器组成,通过红外光学动作捕捉单元1011捕捉笔上的光学标记点和IMU信息从而获取交互控制笔1022在空间中的位置信息,同时将信息传输至全息内容。交互控制笔1022中的光学标记点被全息显示设备主体101中的红外光学相机捕捉后获取到标记点的三维坐标数据,交互控制笔1022中的IMU模块根据笔在空间中的姿态提供旋转信息,经过算法整合将光学三维坐标和IMU旋转信息融合,输出交互控制笔1022在空间中的位姿数据。The virtual object displayed is operated and controlled by the interactive control pen 1022. The interactive control pen 1022 is composed of optical markers and an IMU sensor. The infrared optical motion capture unit 1011 captures the optical markers on the pen and the IMU information to obtain the information of the interactive control pen 1022. location information in space, while transmitting information to holographic content. After the optical marking point in the interactive control pen 1022 is captured by the infrared optical camera in the holographic display device main body 101, the three-dimensional coordinate data of the marking point is obtained, and the IMU module in the interactive control pen 1022 provides rotation information according to the posture of the pen in space, After algorithm integration, the optical three-dimensional coordinates and the IMU rotation information are fused, and the pose data of the interactive control pen 1022 in space is output.

计算单元103,用于运行全息内容和动作捕捉软件,为计算全息追踪眼镜1021和交互控制笔1022空间位置提供计算支持,可根据运行的全息内容复杂度,灵活配置不同的计算单元,即计算单元不是固定不变的,可以随时根据需求更换或者更新不同的计算配置。The computing unit 103 is used for running the holographic content and motion capture software, and provides computing support for calculating the spatial position of the holographic tracking glasses 1021 and the interactive control pen 1022, and can flexibly configure different computing units according to the complexity of the running holographic content, namely the computing unit It is not fixed, and different computing configurations can be replaced or updated at any time according to needs.

本实施例提出了一种新的桌面级全息3D显示设备,相比市场上的同类产品,本方案具有独立的计算单元,使设备使用更灵活。能够适应各种不同的应用场景,根据不同内容的需要不断更新迭代计算单元。采用双目高速红外光学动作捕捉相机和3D显示屏结合并增加IMU位姿传感器,形成一体化机身,操作方便。采用全息显示光学动捕设备一体化设计,也能保障红外光学动作捕捉数据输出的准确稳定性。This embodiment proposes a new desktop-level holographic 3D display device. Compared with similar products on the market, this solution has an independent computing unit, which makes the device more flexible to use. It can adapt to various application scenarios, and continuously update the iterative computing unit according to the needs of different content. The binocular high-speed infrared optical motion capture camera is combined with the 3D display screen and the IMU pose sensor is added to form an integrated body, which is easy to operate. The integrated design of holographic display optical motion capture equipment can also ensure the accuracy and stability of infrared optical motion capture data output.

实施例2:Example 2:

更进一步的,基于上述硬件结构模块,本申请本申请基于实施例1的设备还提供了一种桌面全息显示方法,该全息显示方法基于上述实施例中的各个结构系统模块,有益效果参见上述实施例,此处不再赘述。请参见图2,该方法可以包括:Further, based on the above-mentioned hardware structural modules, the present application also provides a desktop holographic display method based on the device in Embodiment 1. The holographic display method is based on each structural system module in the above-mentioned embodiment. For beneficial effects, refer to the above-mentioned implementation. For example, it will not be repeated here. Referring to Figure 2, the method can include:

步骤201:通过位于全息显示单元上端的红外光学动作捕捉单元获取全息追踪眼镜和交互控制笔在动作捕捉空间中的三维位置信息,判断全息追踪眼镜是否在捕捉范围内,当全息追踪眼镜在捕捉区域出现时,全息画面显示为3D模式,否则,显示为2D模式;同时将全息追踪眼镜和交互控制笔的三维位置信息以及全息显示单元的倾斜角度传输给计算单元;Step 201: Obtain the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space through the infrared optical motion capture unit located at the upper end of the holographic display unit, and determine whether the holographic tracking glasses are within the capture range, and when the holographic tracking glasses are in the capture area When it appears, the holographic screen is displayed in 3D mode, otherwise, it is displayed in 2D mode; at the same time, the three-dimensional position information of the holographic tracking glasses and the interactive control pen and the inclination angle of the holographic display unit are transmitted to the computing unit;

步骤202:将全息追踪眼镜和交互控制笔在动作捕捉空间中的三维位置信息同步给全息显示单元,并通过交互控制笔来操作控制显示的虚拟物体;Step 202: Synchronize the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space to the holographic display unit, and operate and control the displayed virtual object through the interactive control pen;

步骤203:根据全息显示单元的倾斜角度、全息追踪眼镜和交互控制笔在动作捕捉空间中的三维位置信息实时调整画面的显示角度,以显示出用户视角对应的出屏的全息立体画面。Step 203 : Adjust the display angle of the screen in real time according to the tilt angle of the holographic display unit, the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space, so as to display the holographic stereoscopic screen corresponding to the user's perspective.

实施例3:Example 3:

上述实施例1-2从模块化功能实体的角度对本申请实施例中的桌面全息显示设备和方法进行了详细描述,在本申请所提供的几个实施例中,应该理解到,所揭露的系统,装置和方法,可以通过其它的方式实现。例如,以上所描述的装置实施例仅仅是示意性的,例如,该模块的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,例如多个单元或组件可以结合或者可以集成到另一个系统,或一些特征可以忽略,或不执行。另一点,所显示或讨论的相互之间的耦合或直接耦合或通信连接可以是通过一些接口,装置或单元的间接耦合或通信连接,可以是电性,机械或其它的形式。The above embodiments 1-2 describe in detail the desktop holographic display device and method in the embodiments of the present application from the perspective of modular functional entities. Among the several embodiments provided in the present application, it should be understood that the disclosed system , the device and method can be implemented in other ways. For example, the device embodiments described above are only illustrative. For example, the division of the modules is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined or may be Integration into another system, or some features can be ignored, or not implemented. On the other hand, the shown or discussed mutual coupling or direct coupling or communication connection may be through some interfaces, indirect coupling or communication connection of devices or units, and may be in electrical, mechanical or other forms.

图3是本申请实施例提供的一种桌面全息显示设备的示意图,该桌面全息显示设备400可因配置或性能不同而产生比较大的差异,可以包括一个或一个以上处理器(cemtrml processimg umits,CPU)410(例如,一个或一个以上处理器)和存储器420,一个或一个以上存储应用程序433或数据432的存储介质430(例如一个或一个以上海量存储设备)。其中,存储器420和存储介质430可以是短暂存储或持久存储。存储在存储介质430的程序可以包括一个或一个以上模块(图示没标出),每个模块可以包括对桌面全息显示设备400中的一系列指令操作。更进一步地,处理器410可以设置为与存储介质430通信,在全息显示设备400上执行存储介质430中的一系列指令操作。3 is a schematic diagram of a desktop holographic display device provided by an embodiment of the present application. The desktop holographic display device 400 may vary greatly due to different configurations or performances, and may include one or more processors (cemtrml processimg umits, CPU) 410 (eg, one or more processors) and memory 420, one or more storage media 430 (eg, one or more mass storage devices) storing application programs 433 or data 432. Among them, the memory 420 and the storage medium 430 may be short-term storage or persistent storage. The program stored in the storage medium 430 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the desktop holographic display device 400 . Furthermore, the processor 410 may be configured to communicate with the storage medium 430 to execute a series of instruction operations in the storage medium 430 on the holographic display device 400 .

桌面全息显示设备400还可以包括一个或一个以上电源440,一个或一个以上有线或无线网络接口430,一个或一个以上输入输出接口460,和/或,一个或一个以上操作系统431,例如Wimdows Serve,Nmc OS X,Umix,Limux,FreeBSD等等。本领域技术人员可以理解,图3示出的桌面全息显示设备结构并不构成对桌面全息显示设备的限定,可以包括比图示更多或更少的部件,或者组合某些部件,或者不同的部件布置。The desktop holographic display device 400 may also include one or more power supplies 440, one or more wired or wireless network interfaces 430, one or more input and output interfaces 460, and/or, one or more operating systems 431, such as Wimdows Server , Nmc OS X, Umix, Limux, FreeBSD and many more. Those skilled in the art can understand that the structure of the desktop holographic display device shown in FIG. 3 does not constitute a limitation on the desktop holographic display device, and may include more or less components than those shown in the figure, or combine some components, or different Component placement.

本申请还提供一种计算机可读存储介质,该计算机可读存储介质可以为非易失性计算机可读存储介质,该计算机可读存储介质也可以为易失性计算机可读存储介质,所述计算机可读存储介质中存储有指令,当所述指令在计算机上运行时,使得计算机执行所述桌面全息显示方法的步骤。The present application also provides a computer-readable storage medium. The computer-readable storage medium may be a non-volatile computer-readable storage medium. The computer-readable storage medium may also be a volatile computer-readable storage medium. Instructions are stored in the computer-readable storage medium, and when the instructions are executed on the computer, make the computer execute the steps of the desktop holographic display method.

所属领域的技术人员可以清楚地了解到,为描述的方便和简洁,上述描述的系统,装置和单元的具体工作过程,可以参考前述方法实施例中的对应过程,在此不再赘述。Those skilled in the art can clearly understand that, for the convenience and brevity of description, the specific working process of the system, device and unit described above may refer to the corresponding process in the foregoing method embodiments, which will not be repeated here.

所述集成的单元如果以软件功能单元的形式实现并作为独立的产品销售或使用时,可以存储在一个计算机可读取存储介质中。基于这样的理解,本申请的技术方案本质上或者说对现有技术做出贡献的部分或者该技术方案的全部或部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机,服务器,或者网络设备等)执行本申请各个实施例所述方法的全部或部分步骤。而前述的存储介质包括:U盘、移动硬盘、只读存储器(remd-omly nenory,RON)、随机存取存储器(rmmdon mccess nenory,RMN)、磁碟或者光盘等各种可以存储程序代码的介质。The integrated unit, if implemented in the form of a software functional unit and sold or used as an independent product, may be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the present application can be embodied in the form of software products in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, and the computer software products are stored in a storage medium , including several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of the present application. The aforementioned storage medium includes: U disk, mobile hard disk, read-only memory (remd-omly nenory, RON), random access memory (rmmdon mccess nenory, RMN), magnetic disk or optical disk and other media that can store program codes .

在本申请所提供的实施例中,应该理解到,所揭露的方法,在没有超过本申请的精神和范围内,可以通过其他的方式实现。当前的实施例只是一种示范性的例子,不应该作为限制,所给出的具体内容不应该限制本申请的目的。例如,一些特征可以忽略,或不执行。In the embodiments provided in the present application, it should be understood that the disclosed methods may be implemented in other manners without exceeding the spirit and scope of the present application. The current embodiment is an illustrative example and should not be taken as a limitation, and the specific content given should not limit the purpose of this application. For example, some features can be ignored, or not implemented.

本申请方案所公开的技术手段不仅限于上述实施方式所公开的技术手段,还包括由以上技术特征任意组合所组成的技术方案。应当指出,对于本技术领域的普通技术人员来说,在不脱离本申请原理的前提下,还可以做出若干改进和润饰,这些改进和润饰也视为本申请的保护范围。The technical means disclosed in the solution of the present application are not limited to the technical means disclosed in the above embodiments, but also include technical solutions composed of any combination of the above technical features. It should be pointed out that for those skilled in the art, without departing from the principles of the present application, several improvements and modifications can also be made, and these improvements and modifications are also regarded as the protection scope of the present application.

以上对本申请实施例所提供的一种全息显示方法、系统、计算机程序产品及存储介质进行了详细介绍,本文中应用了具体个例对本申请的原理及实施方式进行了阐述,以上实施例的说明只是用于帮助理解本申请的方法及其核心思想;同时,对于本领域的一般技术人员,依据本申请的思想,在具体实施方式及应用范围上均会有改变之处,综上所述,本说明书内容不应理解为对本申请的限制。尽管参照前述实施例对本申请进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本申请各实施例技术方案的精神和范围。A holographic display method, system, computer program product and storage medium provided by the embodiments of the present application have been described in detail above. The principles and implementations of the present application are described with specific examples in this paper. It is only used to help understand the method of the present application and its core idea; at the same time, for those of ordinary skill in the art, according to the idea of the present application, there will be changes in the specific embodiments and application scope. In summary, The contents of this specification should not be construed as limiting the application. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: it is still possible to modify the technical solutions described in the foregoing embodiments, or perform equivalent replacements to some of the technical features; and these Modifications or substitutions do not make the essence of the corresponding technical solutions deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

1. A desktop holographic display all-in-one machine device, comprising:
the holographic display device comprises a holographic display device main body, a holographic display unit and a control unit, wherein the holographic display device main body is used for integrating an infrared optical motion capture unit and the holographic display unit in structure and function, the infrared optical motion capture unit and the holographic display unit are powered by a common main board, a gravity sensing IMU (inertial measurement unit) module is arranged in the holographic display device main body, when the device inclines, the inclination angle of the device can be sensed, and the inclination angle of the device is output to holographic content in real time so as to adjust a displayed picture in real time;
the interactive control unit comprises holographic tracking glasses and an interactive control pen, and is used for providing watching and controlling holographic 3D content and watching a display picture through the holographic tracking glasses, the holographic tracking glasses adopt an active stereo technology, and the left and right eye pictures are displayed at intervals by controlling switches of left and right glasses lenses to be synchronous with the display picture, so that a visual stereo effect is caused;
and the computing unit is used for operating the holographic content and the motion capture software, and different computing units can be flexibly configured according to the complexity of the operated holographic content.
2. The apparatus of claim 1,
the infrared optical motion capturing unit comprises an infrared optical binocular capturing camera, the infrared optical binocular capturing camera is located at the upper end of the holographic display unit and used for capturing position information of the holographic tracking glasses in real time, and whether the holographic tracking glasses are in a capturing range is judged through a capturing result so as to adjust the state of the holographic display equipment in real time.
3. The device of claim 2, wherein the holographic representation is displayed in a 3D mode when the holographic tracking glasses are present in the capture area and in a 2D mode when the holographic tracking glasses are removed from the capture area.
4. The apparatus according to claim 1, wherein the holographic display unit is composed of an active stereoscopic display screen body and a holographic control module, and the holographic control module comprises a pose sensor, a 3D signal emitter and a power supply module.
5. The apparatus of claim 4,
the active three-dimensional display screen body adopts a high-refresh-rate LED screen body, the holographic control module controls the display picture and the display frequency of the screen body, the active three-dimensional display screen body is connected with holographic tracking glasses through a 3D signal transmitter, and the switches of the left and right glasses of the glasses are controlled to be the same as the display picture frequency, so that a 3D image is formed in the visual field of a viewer.
6. The device of claim 1, wherein the interactive control unit operates the virtual object for controlling the display by means of an interactive control pen, the interactive control pen being composed of an optical marker and an IMU sensor for capturing the optical marker and IMU information on the interactive control pen by means of an infrared optical motion capturing unit to obtain position information of the interactive control pen in space and transmitting the information to the holographic content.
7. A desktop holographic display method, comprising:
acquiring three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space through an infrared optical motion capture unit positioned at the upper end of the holographic display unit, and judging whether the holographic tracking glasses are in a capture range, wherein when the holographic tracking glasses appear in a capture area, a holographic picture is displayed in a 3D mode, and otherwise, the holographic picture is displayed in a 2D mode; meanwhile, the three-dimensional position information of the holographic tracking glasses and the interactive control pen and the inclination angle of the holographic display unit are transmitted to the computing unit;
synchronizing the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space to a holographic display unit, and operating and controlling the displayed virtual object through the interactive control pen;
and adjusting the display angle of the picture in real time according to the inclination angle of the holographic display unit, the three-dimensional position information of the holographic tracking glasses and the interactive control pen in the motion capture space so as to display the outgoing holographic stereo picture corresponding to the user visual angle.
8. The desktop holographic display method of claim 7, wherein a pose sensor is integrated on the holographic display unit, so that a user can adjust the tilt angle of the display screen according to his own sitting posture and height, and the tilt angle of the screen body is measured in real time along with the tilt of the screen body, so as to adjust the display angle of the picture in real time.
9. A non-transitory computer-readable storage medium storing computer-executable instructions that, when executed by one or more processors, cause the one or more processors to perform the method of any one of claims 7-8.
10. A computer program product, characterized in that the computer program product comprises a computer program stored on a non-volatile computer-readable storage medium, the computer program comprising program instructions which, when executed by a processor, cause the processor to carry out the method of any one of claims 7 to 8.
CN202210786441.3A 2022-07-04 2022-07-04 Desktop holographic display all-in-one machine device, method, computer program product and storage medium Pending CN115097973A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210786441.3A CN115097973A (en) 2022-07-04 2022-07-04 Desktop holographic display all-in-one machine device, method, computer program product and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210786441.3A CN115097973A (en) 2022-07-04 2022-07-04 Desktop holographic display all-in-one machine device, method, computer program product and storage medium

Publications (1)

Publication Number Publication Date
CN115097973A true CN115097973A (en) 2022-09-23

Family

ID=83296230

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210786441.3A Pending CN115097973A (en) 2022-07-04 2022-07-04 Desktop holographic display all-in-one machine device, method, computer program product and storage medium

Country Status (1)

Country Link
CN (1) CN115097973A (en)

Similar Documents

Publication Publication Date Title
CN115398314B (en) A cross-reality system for mapping using multi-resolution frame descriptors
US9684994B2 (en) Modifying perspective of stereoscopic images based on changes in user viewpoint
CN102591449B (en) The fusion of the low latency of virtual content and real content
CN106454311B (en) A kind of LED three-dimensional imaging system and method
US10523918B2 (en) System and method for depth map
JP6391685B2 (en) Orientation and visualization of virtual objects
US9354718B2 (en) Tightly coupled interactive stereo display
US9602809B2 (en) Storage medium storing display control program for providing stereoscopic display desired by user with simpler operation, display control device, display control method, and display control system
CN114600064A (en) Cross-reality system with location services
CN109146965A (en) Information processing unit and computer program
US9430878B2 (en) Head mounted display and control method thereof
US20060250391A1 (en) Three dimensional horizontal perspective workstation
CN115244493A (en) Cross reality system for large-scale environment reconstruction
CN105791800B (en) Three-dimensional display system and stereo display method
AU2014281863A1 (en) Shared and private holographic objects
CN115516364A (en) tool bridge
CN113206991A (en) Holographic display method, system, computer program product and storage medium
CN102004623B (en) Three-dimensional image display device and method
CN106168855B (en) Portable MR glasses, mobile phone and MR glasses system
JP2020154430A (en) Device with multiple markers
CN108509173A (en) Image shows system and method, storage medium, processor
US10082672B2 (en) Display apparatus and method of displaying using electromechanical faceplate
JP7198149B2 (en) Information processing device and device information derivation method
CN204578692U (en) Three-dimensional display system
CN108427194A (en) A kind of display methods and equipment based on augmented reality

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination