[go: up one dir, main page]

CN107817894A - Display processing method and device - Google Patents

Display processing method and device Download PDF

Info

Publication number
CN107817894A
CN107817894A CN201610821120.7A CN201610821120A CN107817894A CN 107817894 A CN107817894 A CN 107817894A CN 201610821120 A CN201610821120 A CN 201610821120A CN 107817894 A CN107817894 A CN 107817894A
Authority
CN
China
Prior art keywords
content
displayed
terminal
display
layout structure
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201610821120.7A
Other languages
Chinese (zh)
Inventor
孙薇
赵冬晓
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
ZTE Corp
Original Assignee
ZTE Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ZTE Corp filed Critical ZTE Corp
Priority to CN201610821120.7A priority Critical patent/CN107817894A/en
Priority to PCT/CN2017/070886 priority patent/WO2018045699A1/en
Publication of CN107817894A publication Critical patent/CN107817894A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/14Digital output to display device ; Cooperation and interconnection of the display device with other functional units
    • G06F3/1423Digital output to display device ; Cooperation and interconnection of the display device with other functional units controlling a plurality of local displays, e.g. CRT and flat panel display

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

本发明公开一种显示处理方法,包括:终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别;当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容。本发明还公开一种显示处理装置。本发明实现了VR设备能够识别到终端显示屏上的任一类型的显示内容,使用户在使用所述VR设备时不会再错过所述终端上的来电或短信等内容。

The invention discloses a display processing method, comprising: when a terminal is adapted to a VR virtual reality device, the terminal judges whether the content to be displayed on its display screen can be recognized by the VR device; when the content to be displayed cannot When recognized by the VR device, the terminal reconstructs the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device; the terminal displays the layout structure on the display screen according to the reconstructed layout structure The content to be displayed. The invention also discloses a display processing device. The present invention realizes that the VR device can recognize any type of display content on the terminal display screen, so that the user will not miss the incoming calls or short messages on the terminal when using the VR device.

Description

显示处理方法及装置Display processing method and device

技术领域technical field

本发明涉及虚拟现实技术领域,尤其涉及一种显示处理方法及装置。The present invention relates to the field of virtual reality technology, in particular to a display processing method and device.

背景技术Background technique

常见的VR(虚拟现实)设备,例如VR眼镜,往往需要与各种终端进行配合才能使用,且终端上需要安装与所使用的VR设备匹配的应用并启动后,才能与该VR设备进行交互。Common VR (Virtual Reality) devices, such as VR glasses, often need to be used in conjunction with various terminals, and the terminal needs to install and start an application that matches the VR device used before it can interact with the VR device.

由于类似VR眼镜的VR设备,只能对左右分屏且与VR眼镜的镜片相同形状(如椭圆形)的显示布局界面上的内容进行识别,因而,对于终端显示屏上的显示内容,在其布局结构满足VR设备识别条件时,用户通过VR设备能够查看到终端上的显示内容,而在其布局结构不满足VR设备识别条件时,用户通过VR设备就不能查看到终端上的显示内容。例如终端上播放的三维视频,是VR眼镜能够识别出的,此时,用户通过VR眼镜就能观看该视频,而对于终端上的来电或短信等内容,由于不能被VR眼镜识别,因而在终端显示来电或短信等内容时,用户使用VR眼镜是看不到这些内容的,可能就会错过这些来电或短信,由此给用户带来一定的麻烦。Since VR devices similar to VR glasses can only recognize the content on the display layout interface with left and right split screens and the same shape (such as ellipse) as the lens of the VR glasses, therefore, for the display content on the terminal display screen, in its When the layout structure meets the VR device identification conditions, users can view the display content on the terminal through the VR device, but when the layout structure does not meet the VR device identification conditions, the user cannot view the display content on the terminal through the VR device. For example, the 3D video played on the terminal can be recognized by VR glasses. At this time, the user can watch the video through the VR glasses, but the content such as incoming calls or text messages on the terminal cannot be recognized by the VR glasses. When displaying content such as incoming calls or text messages, the user cannot see these contents using VR glasses, and may miss these incoming calls or text messages, which will bring certain troubles to the user.

因而,如何在终端配合VR设备使用时,能够通过VR设备查看到终端显示屏上的任一类型的显示内容,是目前需要解决的一个技术问题。Therefore, how to view any type of displayed content on the display screen of the terminal through the VR device when the terminal is used with the VR device is a technical problem that needs to be solved at present.

上述内容仅用于辅助理解本发明的技术方案,并不代表承认上述内容是现有技术。The above content is only used to assist in understanding the technical solution of the present invention, and does not mean that the above content is admitted as prior art.

发明内容Contents of the invention

本发明提供一种显示处理方法及装置,旨在解决在终端配合VR设备使用时,通过VR设备查看不到终端显示屏上特定类型的显示内容的技术问题。The present invention provides a display processing method and device, aiming to solve the technical problem that when a terminal is used with a VR device, a specific type of display content on a terminal display screen cannot be viewed through the VR device.

为实现上述目的,本发明提供一种显示处理方法,所述显示处理方法包括:In order to achieve the above object, the present invention provides a display processing method, the display processing method comprising:

终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别;When the terminal is adapted to a VR virtual reality device, the terminal judges whether the content to be displayed on its display screen can be recognized by the VR device;

当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;When the content to be displayed cannot be recognized by the VR device, the terminal reconstructs the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device;

所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容。The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure.

优选地,所述显示处理方法还包括:Preferably, the display processing method further includes:

在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当所述终端检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。During the period when the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, update the content to be displayed according to the touch operation .

优选地,当预置的VR交互开关被打开时,所述终端确定其当前适配于VR设备中;所述显示处理方法还包括:Preferably, when the preset VR interaction switch is turned on, the terminal determines that it is currently adapted to a VR device; the display processing method further includes:

所述终端通过设置其上的传感器和/或摄像头,检测并判断其当前是否适配于VR设备中,且当确定其当前适配于VR设备中时,打开所述VR交互开关。The terminal detects and judges whether it is currently adapted to the VR device by setting a sensor and/or camera on it, and turns on the VR interaction switch when it is determined that it is currently adapted to the VR device.

优选地,所述终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别包括:Preferably, when the terminal is adapted to a VR virtual reality device, the terminal judging whether the content to be displayed on its display screen can be recognized by the VR device includes:

所述终端适配于VR设备中时,所述终端获取其显示屏上的待显示内容的布局结构;When the terminal is adapted to a VR device, the terminal obtains the layout structure of the content to be displayed on its display screen;

在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。When the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape, it is determined that the content to be displayed can be recognized by the VR device; Wherein, the content in the display area of the two specified shapes overlaps completely after translation.

优选地,所述当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构包括:Preferably, when the content to be displayed cannot be recognized by the VR device, the terminal reconstructing the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device includes:

当所述待显示内容不能被所述VR设备识别时,所述终端根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;When the content to be displayed cannot be recognized by the VR device, the terminal classifies each display item contained in the layout structure according to the acquired layout structure and the preset rearrangement rules, and rearranges them in a specified order. Row;

将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。The rearranged display items are arranged in the same layout in the two display areas of specified shapes, so as to obtain a layout structure that can be recognized by the VR device.

优选地,所述待显示内容包括但不限于以下类型:Preferably, the content to be displayed includes but is not limited to the following types:

来电、短信、网页、视频、图片、应用页面。Incoming calls, text messages, web pages, videos, pictures, application pages.

为实现上述目的,本发明还提供一种显示处理装置,所述显示处理装置包括:To achieve the above object, the present invention also provides a display processing device, which includes:

判断模块,用于在终端适配于VR虚拟现实设备中时,判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别;A judging module, configured to judge whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to a VR virtual reality device;

重构模块,用于当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;A reconstruction module, configured to reconstruct the layout structure of the content to be displayed into a layout structure recognizable by the VR device when the content to be displayed cannot be recognized by the VR device;

显示模块,用于按照重构后的布局结构在所述显示屏上显示所述待显示内容。A display module, configured to display the content to be displayed on the display screen according to the reconstructed layout structure.

优选地,所述显示处理装置还包括:Preferably, the display processing device further includes:

响应模块,用于在按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。A response module, configured to update the content to be displayed according to the touch operation when a touch operation on the display screen is detected during displaying the content to be displayed on the display screen according to the reconstructed layout structure.

优选地,所述显示处理装置还包括:Preferably, the display processing device further includes:

检测模块,用于通过设置在所述终端上的传感器和/或摄像头,检测并判断所述终端当前是否适配于VR设备中,且当确定所述终端当前适配于VR设备中时,打开所述VR交互开关;The detection module is configured to detect and judge whether the terminal is currently adapted to a VR device through a sensor and/or a camera provided on the terminal, and when it is determined that the terminal is currently adapted to a VR device, open The VR interactive switch;

确定模块,用于当预置的VR交互开关被打开时,确定所述终端当前适配于VR设备中。A determining module, configured to determine that the terminal is currently adapted to a VR device when a preset VR interaction switch is turned on.

优选地,所述判断模块包括:Preferably, the judging module includes:

获取单元,用于在所述终端适配于VR设备中时,获取所述终端显示屏上的待显示内容的布局结构;An acquisition unit, configured to acquire the layout structure of the content to be displayed on the display screen of the terminal when the terminal is adapted to the VR device;

确定单元,用于在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。A determination unit, configured to determine that the content to be displayed can be displayed when the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape. The aforementioned VR device recognition; wherein, the content in the display area of the two specified shapes completely overlaps after being translated.

优选地,所述重构模块包括:Preferably, the reconstruction module includes:

重排单元,用于当所述待显示内容不能被所述VR设备识别时,根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;a rearrangement unit, configured to classify each display item included in the layout structure according to the acquired layout structure and preset rearrangement rules when the content to be displayed cannot be recognized by the VR device Rearrange the specified order;

配置单元,用于将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。The configuration unit is configured to respectively arrange the rearranged display items in the same layout in the display areas of the two specified shapes, so as to obtain a layout structure that can be recognized by the VR device.

优选地,所述待显示内容包括但不限于以下类型:Preferably, the content to be displayed includes but is not limited to the following types:

来电、短信、网页、视频、图片、应用页面。Incoming calls, text messages, web pages, videos, pictures, application pages.

本发明提出的显示处理方法及装置,在终端适配于VR设备中时,实时判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别,当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构,以在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,用户通过所述VR设备能够查看到所述待显示内容,从而使所述VR设备能够识别到所述终端显示屏上的任一类型的显示内容,而用户在使用所述VR设备时也不会再错过所述终端上的来电或短信等内容。The display processing method and device proposed by the present invention judge in real time whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to the VR device, and when the content to be displayed cannot be recognized by the VR device When the VR device is identified, the layout structure of the content to be displayed is reconstructed into a layout structure that can be recognized by the VR device, so that the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure. During the display of content, the user can view the content to be displayed through the VR device, so that the VR device can recognize any type of display content on the terminal display screen, and the user is using the VR device Also will not miss content such as the incoming call or short message on the described terminal again.

附图说明Description of drawings

图1为本发明显示处理方法第一实施例的流程示意图;Fig. 1 is a schematic flow chart of the first embodiment of the display processing method of the present invention;

图2为图1中步骤S10的细化流程示意图;FIG. 2 is a schematic diagram of a refinement process of step S10 in FIG. 1;

图3为图1中步骤S20的细化流程示意图;FIG. 3 is a schematic diagram of a refinement process of step S20 in FIG. 1;

图4(a)-(b)为本发明中重构前后的布局结构示意图;Figure 4 (a)-(b) is a schematic diagram of the layout structure before and after reconstruction in the present invention;

图5为本发明中列表重构后双排排列的布局结构示意图;Fig. 5 is a schematic diagram of the layout structure of a double-row arrangement after list reconstruction in the present invention;

图6为本发明显示处理方法第二实施例的流程示意图;FIG. 6 is a schematic flowchart of a second embodiment of the display processing method of the present invention;

图7为本发明显示处理装置第一实施例的功能模块示意图;7 is a schematic diagram of the functional modules of the first embodiment of the display processing device of the present invention;

图8为本发明显示处理装置第二实施例的功能模块示意图;FIG. 8 is a schematic diagram of the functional modules of the second embodiment of the display processing device of the present invention;

图9为本发明显示处理装置第三实施例的功能模块示意图。FIG. 9 is a schematic diagram of functional modules of a third embodiment of a display processing device according to the present invention.

本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the purpose of the present invention, functional characteristics and advantages will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

具体实施方式Detailed ways

应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

本发明提供一种显示处理方法,如图1所示,示出了本发明显示处理方法第一实施例的流程示意图,所述显示处理方法包括:The present invention provides a display processing method, as shown in FIG. 1 , which shows a schematic flow chart of the first embodiment of the display processing method of the present invention. The display processing method includes:

S10、终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别;S10. When the terminal is adapted to a VR virtual reality device, the terminal judges whether the content to be displayed on its display screen can be recognized by the VR device;

所述显示处理方法可在终端上实施,所述VR设备可以为VR眼镜等设备,所述终端可以为能够播放所述VR设备支持观看的片源的设备,例如手机、平板电脑等。所述待显示内容包括但不限于以下类型:来电、短信、网页、视频、图片、应用页面,还可以为终端显示界面上显示的其他类型的显示内容,在此不再一一列举。The display processing method can be implemented on a terminal, the VR device can be a device such as VR glasses, and the terminal can be a device capable of playing the movie source supported by the VR device, such as a mobile phone, a tablet computer, and the like. The content to be displayed includes but is not limited to the following types: incoming calls, text messages, web pages, videos, pictures, application pages, and other types of display content displayed on the terminal display interface, which will not be listed here.

进一步地,当预置的VR交互开关被打开时,所述终端确定其当前适配于VR设备中。所述VR交互开关设置在所述终端上,且默认被关闭,当所述终端需要与所述VR设备配合使用时,打开所述VR交互开关后,所述终端即可适配于所述VR设备中。用户可在所述终端上指定位置手动打开所述VR交互开关,也可由所述终端在特定条件下自动打开所述VR交互开关。只要所述VR交互开关处于打开状态,则所述终端即认为其处于与所述VR设备交互的场景,并提供与该场景匹配的功能。用户可在不使用所述VR设备时,手动将所述VR交互开关关闭,此后,所述终端恢复正常运行,并提供常规功能。Further, when the preset VR interaction switch is turned on, the terminal determines that it is currently adapted to the VR device. The VR interactive switch is set on the terminal and is turned off by default. When the terminal needs to be used in conjunction with the VR device, after the VR interactive switch is turned on, the terminal can be adapted to the VR in the device. The user can manually turn on the VR interactive switch at a designated position on the terminal, or the terminal can automatically turn on the VR interactive switch under certain conditions. As long as the VR interaction switch is turned on, the terminal considers that it is in a scene interacting with the VR device, and provides functions matching the scene. The user can manually turn off the VR interaction switch when the VR device is not in use, and then the terminal resumes normal operation and provides normal functions.

进一步地,参照图2,上述步骤S10包括:Further, referring to FIG. 2, the above step S10 includes:

S11、所述终端适配于VR设备中时,所述终端获取其显示屏上的待显示内容的布局结构;S11. When the terminal is adapted to a VR device, the terminal acquires a layout structure of content to be displayed on its display screen;

S12、在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。S12. When the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape, determine that the content to be displayed can be displayed by the VR device Recognized; where the contents of the display areas of the two specified shapes completely overlap after translation.

所述终端在确定其当前适配于所述VR设备中后,将从缓存的显示数据中实时获取其显示屏上的待显示内容的布局结构(即布局设置),其中,布局结构包括待显示的各个显示项,例如文本、图片、视频、按钮、列表、图标等,以及各个显示项在所述显示屏上显示区域的显示位置。After the terminal determines that it is currently adapted to the VR device, it will obtain the layout structure (ie layout setting) of the content to be displayed on its display screen in real time from the cached display data, wherein the layout structure includes the content to be displayed Each display item, such as text, picture, video, button, list, icon, etc., and the display position of each display item in the display area on the display screen.

由于所述VR设备只能较好地识别所述显示区域上的左右两个大小相同且对称的、形状与所述VR设备中镜片形状相同的显示区域的内容,因而,在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域、且两个指定形状的显示区域中的内容平移后能够完全重叠时(如图4(b)所示的布局结构),可确定所述待显示内容能够被所述VR设备识别,否则,则不能被所述VR设备识别。其中,所述指定形状是指与所述VR设备中镜片形状相同的形状,常见的形状为椭圆形或圆形。Since the VR device can only better recognize the contents of the two left and right display areas on the display area that are identical in size and symmetrical, and have the same shape as the glasses in the VR device, therefore, in the content to be displayed The layout structure of the display screen is to divide the display area of the display screen into two left and right display areas of the same size and symmetrical specified shape, and when the content in the display area of the specified shape can completely overlap after being translated (as shown in Figure 4 In the layout structure shown in (b), it can be determined that the content to be displayed can be recognized by the VR device, otherwise, it cannot be recognized by the VR device. Wherein, the specified shape refers to the same shape as the lens in the VR device, and the common shape is ellipse or circle.

如果所述待显示内容能够被所述VR设备识别,则所述终端按照原有的布局结构在所述显示屏上直接展示所述待显示内容即可,此时,用户通过所述VR设备就能观看到所述待显示内容。而在所述待显示内容不能被所述VR设备识别时,用户通过所述VR设备是不能观看到所述待显示内容的。If the content to be displayed can be recognized by the VR device, then the terminal can directly display the content to be displayed on the display screen according to the original layout structure. The content to be displayed can be watched. When the content to be displayed cannot be recognized by the VR device, the user cannot watch the content to be displayed through the VR device.

S20、当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;S20. When the content to be displayed cannot be recognized by the VR device, the terminal reconstructs the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device;

进一步地,参照图3,上述步骤S20包括:Further, referring to FIG. 3, the above step S20 includes:

S21、当所述待显示内容不能被所述VR设备识别时,所述终端根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;S21. When the content to be displayed cannot be recognized by the VR device, the terminal classifies each display item included in the layout structure according to the acquired layout structure and the preset rearrangement rules, and then sorts them according to the specified order rearrangement;

S22、将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。S22. Arranging the rearranged display items in the same layout in the two display areas of specified shapes, so as to obtain a layout structure that can be recognized by the VR device.

在所述待显示内容不能被所述VR设备识别时,所述终端需要对所述待显示内容现有的布局结构进行重构,以使重构后得到的布局结构能够满足所述VR设备的识别要求。When the content to be displayed cannot be recognized by the VR device, the terminal needs to reconstruct the existing layout structure of the content to be displayed, so that the layout structure obtained after reconstruction can meet the requirements of the VR device. Identification requirements.

具体地,所述终端根据获取到的布局结构,将所述布局结构中包含的各个显示项按照预置的重排规则先进行分类,例如将文本、图片、视频等划分为显示类,将按钮、列表、图标等划分为可操作类等;之后再按照指定的排序规则进行重排,例如在同一个椭圆形显示区域内,将显示类的各个显示项按照在原布局结构中从上到下、从左到右的顺序依次排列后设置在该椭圆形显示区域的左侧,将可操作类的各个显示项按照在原布局结构中从上到下、从左到右的顺序依次排列后设置在该椭圆形显示区域的右侧,并尽可能地使所有的显示项均匀覆盖该椭圆形显示区域,如图4所示;最后,将各个显示项在该椭圆形显示区域内的布局设置复制到另一个椭圆形显示区域,从而得到能够被所述VR设备识别的布局结构。Specifically, according to the acquired layout structure, the terminal first classifies each display item contained in the layout structure according to preset rearrangement rules, for example, classifying text, pictures, videos, etc. into display categories, and classifying buttons into , lists, icons, etc. are divided into operable categories, etc.; and then rearranged according to the specified sorting rules. Arranged in sequence from left to right and set on the left side of the elliptical display area, arrange the display items of the operable class in sequence from top to bottom and from left to right in the original layout structure and set them in this The right side of the elliptical display area, and try to make all the display items evenly cover the elliptical display area, as shown in Figure 4; finally, copy the layout settings of each display item in the elliptical display area to another An oval display area, so as to obtain a layout structure that can be recognized by the VR device.

需要说明的是,在重构布局结构时,可以只将必要的显示类显示项,以及指引用户进行下一步操作的可操作类显示项进行重排,而其他非必要的显示项不再设置在重构后的布局结构中,也即,不再显示非必要的显示项。对于显示项为列表时,可将列表中的各个子项进行双排排列,如图5所示。It should be noted that when reconstructing the layout structure, only the necessary display items and the operable display items that guide the user to the next operation can be rearranged, while other non-essential display items are no longer set in the In the refactored layout structure, that is, non-essential display items are no longer displayed. When the display item is a list, each sub-item in the list can be arranged in double rows, as shown in FIG. 5 .

S30、所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容。S30. The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure.

得到所述待显示内容重构后的布局结构后,在需要展示所述待显示内容时,所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容,由于按照重构后的布局结构显示的内容能够被所述VR设备识别,从而使用户通过所述VR设备能够查看到所述待显示内容。After obtaining the reconstructed layout structure of the content to be displayed, when the content to be displayed needs to be displayed, the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure. The content displayed in the structured layout structure can be recognized by the VR device, so that the user can view the content to be displayed through the VR device.

本发明提出的显示处理方法,在终端适配于VR设备中时,实时判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别,当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构,以在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,用户通过所述VR设备能够查看到所述待显示内容,从而使所述VR设备能够识别到所述终端显示屏上的任一类型的显示内容,而用户在使用所述VR设备时也不会再错过所述终端上的来电或短信等内容。The display processing method proposed by the present invention judges in real time whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to the VR device, and when the content to be displayed cannot be recognized by the VR device When the device is identified, reconstruct the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device, so that the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure During this period, the user can view the content to be displayed through the VR device, so that the VR device can recognize any type of display content on the terminal display screen, and the user also uses the VR device Never miss an incoming call or text message on said terminal again.

进一步地,基于上述第一实施例提出本发明显示处理方法第二实施例,在本实施例中,参照图6,所述显示处理方法还包括:Further, based on the first embodiment above, a second embodiment of the display processing method of the present invention is proposed. In this embodiment, referring to FIG. 6, the display processing method further includes:

S40、在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当所述终端检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。S40. During the period when the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, update the content to be displayed according to the touch operation Display content.

在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,用户通过所述VR设备能够查看到所述显示屏上显示的各个显示项,如果这些显示项中包含可操作的显示项,例如按钮,则当用户在所述显示屏上点击该按钮后,所述终端即可检测到所述显示屏上的该触摸操作,之后,所述终端根据该触摸操作对显示屏上的显示内容进行更新。During the period when the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, the user can view each display item displayed on the display screen through the VR device, if any of these display items contains an operable display item, such as a button, after the user clicks the button on the display screen, the terminal can detect the touch operation on the display screen, and then the terminal can detect the touch operation according to the touch operation Update the display on the display.

具体地,在对原有布局结构进行重构时,需要对重构后的布局结构中的各个显示项分别分配新的标签号,这些标签号对每一个显示项来说是唯一识别的,且需要将重构后的布局结构中的显示项的标签号与原有布局结构中同一显示项的标签号进行一一映射。Specifically, when reconstructing the original layout structure, it is necessary to assign new label numbers to each display item in the reconstructed layout structure, and these label numbers are uniquely identified for each display item, and It is necessary to perform one-to-one mapping between the label numbers of the display items in the reconstructed layout structure and the label numbers of the same display items in the original layout structure.

在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当用户在所述终端的显示屏上点击某个可操作类的显示项后,所述终端能够获取到该显示项在重构后的布局结构中的标签号,并通过映射得到该显示项在原布局结构中的标签号,进而触发映射得到的标签号对应的响应事件,使得所述终端刷新当前的显示内容或者跳转页面。During the period when the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the user clicks a display item of an operable category on the display screen of the terminal, the terminal can Obtain the label number of the display item in the reconstructed layout structure, and obtain the label number of the display item in the original layout structure through mapping, and then trigger a response event corresponding to the label number obtained through mapping, so that the terminal refreshes the current display content or jump to the page.

本发明提出的显示处理方法,能够使VR设备识别到原来不能识别的终端显示内容,且在用户不从所述VR设备中取出所述终端的条件下,能够对用户在所述终端上的触摸操作作出正确响应,在不使用户错过所述终端提供的任何显示内容的同时,为用户使用所述终端进行操作带来极大的便利。The display processing method proposed by the present invention can make the VR device recognize the display content of the terminal that cannot be recognized originally, and under the condition that the user does not take out the terminal from the VR device, the user's touch on the terminal can The operation responds correctly, and while the user does not miss any display content provided by the terminal, it brings great convenience for the user to operate the terminal.

进一步地,基于上述第二实施例提出本发明显示处理方法第三实施例,在本实施例中,所述显示处理方法还包括:Further, based on the second embodiment above, a third embodiment of the display processing method of the present invention is proposed. In this embodiment, the display processing method further includes:

所述终端通过设置其上的传感器和/或摄像头,检测并判断其当前是否适配于VR设备中,且当确定其当前适配于VR设备中时,打开所述VR交互开关。The terminal detects and judges whether it is currently adapted to the VR device by setting a sensor and/or camera on it, and turns on the VR interaction switch when it is determined that it is currently adapted to the VR device.

可以理解的是,当所述终端判断出其未被放置在所述VR设备中时,则关闭所述VR交互开关。本实施例中,设置在所述终端上的传感器可以为接近传感器、重力传感器、压力传感器中的一个或多个,设置在所述终端上的摄像头可以为前置摄像头。It can be understood that when the terminal determines that it is not placed in the VR device, the VR interaction switch is turned off. In this embodiment, the sensor set on the terminal may be one or more of a proximity sensor, a gravity sensor, and a pressure sensor, and the camera set on the terminal may be a front camera.

以所述终端上设置有接近传感器、重力传感器、前置摄像头为例,当重力传感器检测到所述终端相对于水平面是竖着垂直放置时,所述终端打开接近传感器,且当接近传感器检测到所述终端与所述VR设备的距离为0并持续指定时间之后,再打开前置摄像头,如果前置摄像头采集到的图像为全黑,则认为所述终端已被放置在所述VR设备中。Take the terminal equipped with a proximity sensor, a gravity sensor, and a front camera as an example, when the gravity sensor detects that the terminal is vertically placed relative to the horizontal plane, the terminal turns on the proximity sensor, and when the proximity sensor detects After the distance between the terminal and the VR device is 0 for a specified time, turn on the front camera, and if the image captured by the front camera is completely black, it is considered that the terminal has been placed in the VR device .

以所述终端上设置有压力传感器、重力传感器为例,当压力传感器检测到所述终端的边框四周有均匀的压力,且重力传感器检测到所述终端相对于水平面是竖着垂直放置时,则认为所述终端已被放置在所述VR设备中。Taking the terminal provided with a pressure sensor and a gravity sensor as an example, when the pressure sensor detects that there is uniform pressure around the frame of the terminal, and the gravity sensor detects that the terminal is vertically placed relative to the horizontal plane, then The terminal is considered to have been placed in the VR device.

本发明提出的显示处理方法,可由终端通过设置其上的传感器和/或摄像头,自动检测并判断其当前是否适配于VR设备中,以在确定其当前适配于VR设备中时,打开所述VR交互开关,而无需用户在需要时手工打开所述VR交互开关,简化了用户操作,且更加自动化、智能化。In the display processing method proposed by the present invention, the terminal can automatically detect and judge whether it is currently adapted to the VR device by setting the sensor and/or camera on it, so that when it is determined that it is currently adapted to the VR device, open all The above-mentioned VR interactive switch does not require the user to manually turn on the VR interactive switch when needed, which simplifies user operations and is more automatic and intelligent.

本发明还提供一种显示处理装置,如图7所示,示出了本发明显示处理装置第一实施例的功能模块示意图,所述显示处理装置包括:The present invention also provides a display processing device, as shown in FIG. 7 , which shows a schematic diagram of the functional modules of the first embodiment of the display processing device of the present invention. The display processing device includes:

判断模块100,用于在终端适配于VR虚拟现实设备中时,判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别;A judging module 100, configured to judge whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to a VR virtual reality device;

确定模块200,用于当预置的VR交互开关被打开时,确定所述终端当前适配于VR设备中。The determining module 200 is configured to determine that the terminal is currently adapted to a VR device when a preset VR interaction switch is turned on.

所述显示处理装置设置在终端上,所述VR设备可以为VR眼镜等设备,所述终端可以为能够播放所述VR设备支持观看的片源的设备,例如手机、平板电脑等。所述待显示内容包括但不限于以下类型:来电、短信、网页、视频、图片、应用页面,还可以为终端显示界面上显示的其他类型的显示内容,在此不再一一列举。The display processing device is set on a terminal, the VR device may be a device such as VR glasses, and the terminal may be a device capable of playing the movie sources supported by the VR device, such as a mobile phone or a tablet computer. The content to be displayed includes but is not limited to the following types: incoming calls, text messages, web pages, videos, pictures, application pages, and other types of display content displayed on the terminal display interface, which will not be listed here.

所述VR交互开关设置在所述终端上,且默认被关闭,当所述终端需要与所述VR设备配合使用时,打开所述VR交互开关后,所述终端即可适配于所述VR设备中。用户可在所述终端上指定位置手动打开所述VR交互开关,也可由所述终端在特定条件下自动打开所述VR交互开关。只要所述VR交互开关处于打开状态,则所述终端即认为其处于与所述VR设备交互的场景,并提供与该场景匹配的功能。用户可在不使用所述VR设备时,手动将所述VR交互开关关闭,此后,所述终端恢复正常运行,并提供常规功能。The VR interactive switch is set on the terminal and is turned off by default. When the terminal needs to be used in conjunction with the VR device, after the VR interactive switch is turned on, the terminal can be adapted to the VR in the device. The user can manually turn on the VR interactive switch at a designated position on the terminal, or the terminal can automatically turn on the VR interactive switch under certain conditions. As long as the VR interaction switch is turned on, the terminal considers that it is in a scene interacting with the VR device, and provides functions matching the scene. The user can manually turn off the VR interaction switch when the VR device is not in use, and then the terminal resumes normal operation and provides normal functions.

进一步地,所述判断模块100包括:Further, the judging module 100 includes:

获取单元,用于在所述终端适配于VR设备中时,获取所述终端显示屏上的待显示内容的布局结构;An acquisition unit, configured to acquire the layout structure of the content to be displayed on the display screen of the terminal when the terminal is adapted to the VR device;

确定单元,用于在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。A determination unit, configured to determine that the content to be displayed can be displayed when the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape. The aforementioned VR device recognition; wherein, the content in the display area of the two specified shapes completely overlaps after being translated.

所述终端的确定模块200在确定所述终端当前适配于所述VR设备中后,判断模块100的获取单元将从缓存的显示数据中实时获取其显示屏上的待显示内容的布局结构(即布局设置),其中,布局结构包括待显示的各个显示项,例如文本、图片、视频、按钮、列表、图标等,以及各个显示项在所述显示屏上显示区域的显示位置。After the determining module 200 of the terminal determines that the terminal is currently adapted to the VR device, the acquiring unit of the judging module 100 will acquire the layout structure of the content to be displayed on the display screen in real time from the cached display data ( That is, layout setting), wherein the layout structure includes each display item to be displayed, such as text, picture, video, button, list, icon, etc., and the display position of each display item in the display area on the display screen.

由于所述VR设备只能较好地识别所述显示区域上的左右两个大小相同且对称的、形状与所述VR设备中镜片形状相同的显示区域的内容,因而,在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域、且两个指定形状的显示区域中的内容平移后能够完全重叠时(如图4(b)所示的布局结构),所述确定单元可确定所述待显示内容能够被所述VR设备识别,否则,则不能被所述VR设备识别。其中,所述指定形状是指与所述VR设备中镜片形状相同的形状,常见的形状为椭圆形或圆形。Since the VR device can only better recognize the contents of the two left and right display areas on the display area that are identical in size and symmetrical, and have the same shape as the glasses in the VR device, therefore, in the content to be displayed The layout structure of the display screen is to divide the display area of the display screen into two left and right display areas of the same size and symmetrical specified shape, and when the content in the display area of the specified shape can completely overlap after being translated (as shown in Figure 4 In the layout structure shown in (b), the determination unit may determine that the content to be displayed can be recognized by the VR device, otherwise, it cannot be recognized by the VR device. Wherein, the specified shape refers to the same shape as the lens in the VR device, and the common shape is ellipse or circle.

如果所述待显示内容能够被所述VR设备识别,则所述终端按照原有的布局结构在所述显示屏上直接展示所述待显示内容即可,此时,用户通过所述VR设备就能观看到所述待显示内容。而在所述待显示内容不能被所述VR设备识别时,用户通过所述VR设备是不能观看到所述待显示内容的。If the content to be displayed can be recognized by the VR device, then the terminal can directly display the content to be displayed on the display screen according to the original layout structure. The content to be displayed can be watched. When the content to be displayed cannot be recognized by the VR device, the user cannot watch the content to be displayed through the VR device.

重构模块300,用于当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;A reconstruction module 300, configured to reconstruct the layout structure of the content to be displayed into a layout structure recognizable by the VR device when the content to be displayed cannot be recognized by the VR device;

进一步地,所述重构模块300包括:Further, the reconstruction module 300 includes:

重排单元,用于当所述待显示内容不能被所述VR设备识别时,根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;a rearrangement unit, configured to classify each display item included in the layout structure according to the acquired layout structure and preset rearrangement rules when the content to be displayed cannot be recognized by the VR device Rearrange the specified order;

配置单元,用于将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。The configuration unit is configured to respectively arrange the rearranged display items in the same layout in the display areas of the two specified shapes, so as to obtain a layout structure that can be recognized by the VR device.

在所述待显示内容不能被所述VR设备识别时,所述终端需要对所述待显示内容现有的布局结构进行重构,以使重构后得到的布局结构能够满足所述VR设备的识别要求。When the content to be displayed cannot be recognized by the VR device, the terminal needs to reconstruct the existing layout structure of the content to be displayed, so that the layout structure obtained after reconstruction can meet the requirements of the VR device. Identification requirements.

具体地,所述终端的重构模块300根据获取到的布局结构,由所述重排单元将所述布局结构中包含的各个显示项按照预置的重排规则先进行分类,例如将文本、图片、视频等划分为显示类,将按钮、列表、图标等划分为可操作类等;之后再按照指定的排序规则进行重排,例如在同一个椭圆形显示区域内,将显示类的各个显示项按照在原布局结构中从上到下、从左到右的顺序依次排列后设置在该椭圆形显示区域的左侧,将可操作类的各个显示项按照在原布局结构中从上到下、从左到右的顺序依次排列后设置在该椭圆形显示区域的右侧,并尽可能地使所有的显示项均匀覆盖该椭圆形显示区域,如图4所示;最后,由所述配置单元将各个显示项在该椭圆形显示区域内的布局设置复制到另一个椭圆形显示区域,从而得到能够被所述VR设备识别的布局结构。Specifically, according to the acquired layout structure, the terminal's reconstruction module 300 uses the rearrangement unit to classify each display item contained in the layout structure according to preset rearrangement rules, for example, text, Pictures, videos, etc. are divided into display categories, and buttons, lists, icons, etc. are divided into operable categories, etc.; and then rearranged according to the specified sorting rules. Items are arranged in order from top to bottom and from left to right in the original layout structure, and then set on the left side of the oval display area, and each display item of the operable class is arranged in the order of top to bottom and from left to right in the original layout structure. The sequence from left to right is set on the right side of the elliptical display area, and as far as possible, all display items cover the elliptical display area evenly, as shown in Figure 4; finally, the configuration unit will The layout settings of each display item in the elliptical display area are copied to another elliptical display area, so as to obtain a layout structure that can be recognized by the VR device.

需要说明的是,在重构布局结构时,所述重排单元可以只将必要的显示类显示项,以及指引用户进行下一步操作的可操作类显示项进行重排,而其他非必要的显示项不再设置在重构后的布局结构中,也即,不再显示非必要的显示项。对于显示项为列表时,所述重排单元可将列表中的各个子项进行双排排列,如图5所示。It should be noted that when reconstructing the layout structure, the rearrangement unit can only rearrange the necessary display items and the operable display items that guide the user to the next operation, while other non-essential display items Items are no longer set in the refactored layout structure, i.e. non-essential display items are no longer displayed. When the display item is a list, the rearrangement unit can arrange each sub-item in the list in double rows, as shown in FIG. 5 .

显示模块400,用于按照重构后的布局结构在所述显示屏上显示所述待显示内容。The display module 400 is configured to display the content to be displayed on the display screen according to the reconstructed layout structure.

得到所述待显示内容重构后的布局结构后,在需要展示所述待显示内容时,所述终端的显示模块400按照重构后的布局结构在所述显示屏上显示所述待显示内容,由于按照重构后的布局结构显示的内容能够被所述VR设备识别,从而使用户通过所述VR设备能够查看到所述待显示内容。After obtaining the reconstructed layout structure of the content to be displayed, when the content to be displayed needs to be displayed, the display module 400 of the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure , because the content displayed according to the reconstructed layout structure can be recognized by the VR device, so that the user can view the content to be displayed through the VR device.

本发明提出的显示处理装置,在终端适配于VR设备中时,实时判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别,当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构,以在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,用户通过所述VR设备能够查看到所述待显示内容,从而使所述VR设备能够识别到所述终端显示屏上的任一类型的显示内容,而用户在使用所述VR设备时也不会再错过所述终端上的来电或短信等内容。The display processing device proposed by the present invention judges in real time whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to the VR device, and when the content to be displayed cannot be recognized by the VR device When the device is identified, reconstruct the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device, so that the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure During this period, the user can view the content to be displayed through the VR device, so that the VR device can recognize any type of display content on the terminal display screen, and the user also uses the VR device Never miss an incoming call or text message on said terminal again.

进一步地,基于上述显示处理装置第一实施例提出本发明显示处理装置第二实施例,在本实施例中,参照图8,所述显示处理装置还包括:Further, based on the above-mentioned first embodiment of the display processing device, a second embodiment of the display processing device of the present invention is proposed. In this embodiment, referring to FIG. 8, the display processing device further includes:

响应模块500,用于在按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。A response module 500, configured to update the content to be displayed according to the touch operation when the touch operation on the display screen is detected during displaying the content to be displayed on the display screen according to the reconstructed layout structure .

在所述终端的显示模块400按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,用户通过所述VR设备能够查看到所述显示屏上显示的各个显示项,如果这些显示项中包含可操作的显示项,例如按钮,则当用户在所述显示屏上点击该按钮后,所述终端的响应模块500即可检测到所述显示屏上的该触摸操作,之后,所述终端的响应模块500根据该触摸操作对显示屏上的显示内容进行更新。During the period when the display module 400 of the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, the user can view each display item displayed on the display screen through the VR device, if These display items include operable display items, such as buttons, and when the user clicks the button on the display screen, the response module 500 of the terminal can detect the touch operation on the display screen, and then , the response module 500 of the terminal updates the display content on the display screen according to the touch operation.

具体地,在对原有布局结构进行重构时,需要对重构后的布局结构中的各个显示项分别分配新的标签号,这些标签号对每一个显示项来说是唯一识别的,且需要将重构后的布局结构中的显示项的标签号与原有布局结构中同一显示项的标签号进行一一映射。Specifically, when reconstructing the original layout structure, it is necessary to assign new label numbers to each display item in the reconstructed layout structure, and these label numbers are uniquely identified for each display item, and It is necessary to perform one-to-one mapping between the label numbers of the display items in the reconstructed layout structure and the label numbers of the same display items in the original layout structure.

在所述终端的显示模块400按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当用户在所述终端的显示屏上点击某个可操作类的显示项后,所述终端的响应模块500能够获取到该显示项在重构后的布局结构中的标签号,并通过映射得到该显示项在原布局结构中的标签号,进而触发映射得到的标签号对应的响应事件,使得所述终端的显示模块400刷新当前的显示内容或者跳转页面。When the display module 400 of the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the user clicks a display item of an operable category on the display screen of the terminal, The response module 500 of the terminal can obtain the label number of the display item in the reconstructed layout structure, and obtain the label number of the display item in the original layout structure through mapping, and then trigger a response corresponding to the label number obtained by mapping event, so that the display module 400 of the terminal refreshes the current display content or jumps to a page.

本发明提出的显示处理装置,能够使VR设备识别到原来不能识别的终端显示内容,且在用户不从所述VR设备中取出所述终端的条件下,能够对用户在所述终端上的触摸操作作出正确响应,在不使用户错过所述终端提供的任何显示内容的同时,为用户使用所述终端进行操作带来极大的便利。The display processing device proposed by the present invention can make the VR device recognize the display content of the terminal that could not be recognized originally, and under the condition that the user does not take out the terminal from the VR device, it can control the user's touch on the terminal The operation responds correctly, and while the user does not miss any display content provided by the terminal, it brings great convenience for the user to operate the terminal.

进一步地,基于上述显示处理装置第二实施例提出本发明显示处理装置第三实施例,在本实施例中,参照图9,所述显示处理装置还包括:Further, based on the second embodiment of the above-mentioned display processing device, a third embodiment of the display processing device of the present invention is proposed. In this embodiment, referring to FIG. 9 , the display processing device further includes:

检测模块600,用于通过设置在所述终端上的传感器和/或摄像头,检测并判断所述终端当前是否适配于VR设备中,且当确定所述终端当前适配于VR设备中时,打开所述VR交互开关;The detection module 600 is configured to detect and judge whether the terminal is currently adapted to the VR device through a sensor and/or camera arranged on the terminal, and when it is determined that the terminal is currently adapted to the VR device, Turn on the VR interaction switch;

可以理解的是,当所述终端的检测模块600判断出所述终端未被放置在所述VR设备中时,则关闭所述VR交互开关。本实施例中,设置在所述终端上的传感器可以为接近传感器、重力传感器、压力传感器中的一个或多个,设置在所述终端上的摄像头可以为前置摄像头。It can be understood that when the detection module 600 of the terminal determines that the terminal is not placed in the VR device, the VR interaction switch is turned off. In this embodiment, the sensor set on the terminal may be one or more of a proximity sensor, a gravity sensor, and a pressure sensor, and the camera set on the terminal may be a front camera.

以所述终端上设置有接近传感器、重力传感器、前置摄像头为例,当重力传感器检测到所述终端相对于水平面是竖着垂直放置时,所述终端的检测模块600打开接近传感器,且当接近传感器检测到所述终端与所述VR设备的距离为0并持续指定时间之后,再打开前置摄像头,如果前置摄像头采集到的图像为全黑,则所述检测模块600确定所述终端已被放置在所述VR设备中。Taking the terminal provided with a proximity sensor, a gravity sensor, and a front camera as an example, when the gravity sensor detects that the terminal is vertically placed relative to a horizontal plane, the detection module 600 of the terminal turns on the proximity sensor, and when After the proximity sensor detects that the distance between the terminal and the VR device is 0 for a specified time, the front camera is turned on, and if the image collected by the front camera is completely black, the detection module 600 determines that the terminal has been placed in said VR device.

以所述终端上设置有压力传感器、重力传感器为例,当压力传感器检测到所述终端的边框四周有均匀的压力,且重力传感器检测到所述终端相对于水平面是竖着垂直放置时,则所述检测模块600确定所述终端已被放置在所述VR设备中。Taking the terminal provided with a pressure sensor and a gravity sensor as an example, when the pressure sensor detects that there is uniform pressure around the frame of the terminal, and the gravity sensor detects that the terminal is vertically placed relative to the horizontal plane, then The detection module 600 determines that the terminal has been placed in the VR device.

本发明提出的显示处理装置,可由终端通过设置其上的传感器和/或摄像头,自动检测并判断其当前是否适配于VR设备中,以在确定其当前适配于VR设备中时,打开所述VR交互开关,而无需用户在需要时手工打开所述VR交互开关,简化了用户操作,且更加自动化、智能化。The display processing device proposed by the present invention can automatically detect and judge whether it is currently adapted to a VR device by the terminal through the sensor and/or camera installed on it, so that when it is determined that it is currently adapted to a VR device, open all The above-mentioned VR interactive switch does not require the user to manually turn on the VR interactive switch when needed, which simplifies user operations and is more automatic and intelligent.

以上仅为本发明的优选实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and are not intended to limit the patent scope of the present invention. Any equivalent structure or equivalent process conversion made by using the description of the present invention and the contents of the accompanying drawings, or directly or indirectly used in other related technical fields , are all included in the scope of patent protection of the present invention in the same way.

Claims (12)

1.一种显示处理方法,其特征在于,所述显示处理方法包括:1. A display processing method, characterized in that, the display processing method comprises: 终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别;When the terminal is adapted to a VR virtual reality device, the terminal judges whether the content to be displayed on its display screen can be recognized by the VR device; 当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;When the content to be displayed cannot be recognized by the VR device, the terminal reconstructs the layout structure of the content to be displayed into a layout structure that can be recognized by the VR device; 所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容。The terminal displays the content to be displayed on the display screen according to the reconstructed layout structure. 2.如权利要求1所述的显示处理方法,其特征在于,所述显示处理方法还包括:2. The display processing method according to claim 1, further comprising: 在所述终端按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当所述终端检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。During the period when the terminal displays the content to be displayed on the display screen according to the reconstructed layout structure, when the terminal detects a touch operation on the display screen, update the content to be displayed according to the touch operation . 3.如权利要求1或2所述的显示处理方法,其特征在于,当预置的VR交互开关被打开时,所述终端确定其当前适配于VR设备中;所述显示处理方法还包括:3. The display processing method according to claim 1 or 2, wherein when the preset VR interaction switch is turned on, the terminal determines that it is currently adapted to a VR device; the display processing method further includes : 所述终端通过设置其上的传感器和/或摄像头,检测并判断其当前是否适配于VR设备中,且当确定其当前适配于VR设备中时,打开所述VR交互开关。The terminal detects and judges whether it is currently adapted to the VR device by setting a sensor and/or camera on it, and turns on the VR interaction switch when it is determined that it is currently adapted to the VR device. 4.如权利要求1所述的显示处理方法,其特征在于,所述终端适配于VR虚拟现实设备中时,所述终端判断其显示屏上的待显示内容是否能够被所述VR设备识别包括:4. The display processing method according to claim 1, wherein when the terminal is adapted to a VR virtual reality device, the terminal judges whether the content to be displayed on its display screen can be recognized by the VR device include: 所述终端适配于VR设备中时,所述终端获取其显示屏上的待显示内容的布局结构;When the terminal is adapted to a VR device, the terminal obtains the layout structure of the content to be displayed on its display screen; 在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。When the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape, it is determined that the content to be displayed can be recognized by the VR device; Wherein, the content in the display area of the two specified shapes overlaps completely after translation. 5.如权利要求4所述的显示处理方法,其特征在于,所述当所述待显示内容不能被所述VR设备识别时,所述终端将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构包括:5. The display processing method according to claim 4, wherein when the content to be displayed cannot be recognized by the VR device, the terminal reconstructs the layout structure of the content to be displayed as the The layout structure that can be recognized by the VR device includes: 当所述待显示内容不能被所述VR设备识别时,所述终端根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;When the content to be displayed cannot be recognized by the VR device, the terminal classifies each display item contained in the layout structure according to the acquired layout structure and the preset rearrangement rules, and rearranges them in a specified order. Row; 将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。The rearranged display items are arranged in the same layout in the two display areas of specified shapes, so as to obtain a layout structure that can be recognized by the VR device. 6.如权利要求1所述的显示处理方法,其特征在于,所述待显示内容包括但不限于以下类型:6. The display processing method according to claim 1, wherein the content to be displayed includes but is not limited to the following types: 来电、短信、网页、视频、图片、应用页面。Incoming calls, text messages, web pages, videos, pictures, application pages. 7.一种显示处理装置,其特征在于,所述显示处理装置包括:7. A display processing device, characterized in that the display processing device comprises: 判断模块,用于在终端适配于VR虚拟现实设备中时,判断所述终端显示屏上的待显示内容是否能够被所述VR设备识别;A judging module, configured to judge whether the content to be displayed on the display screen of the terminal can be recognized by the VR device when the terminal is adapted to a VR virtual reality device; 重构模块,用于当所述待显示内容不能被所述VR设备识别时,将所述待显示内容的布局结构重构为所述VR设备能够识别的布局结构;A reconstruction module, configured to reconstruct the layout structure of the content to be displayed into a layout structure recognizable by the VR device when the content to be displayed cannot be recognized by the VR device; 显示模块,用于按照重构后的布局结构在所述显示屏上显示所述待显示内容。A display module, configured to display the content to be displayed on the display screen according to the reconstructed layout structure. 8.如权利要求7所述的显示处理装置,其特征在于,所述显示处理装置还包括:8. The display processing device according to claim 7, wherein the display processing device further comprises: 响应模块,用于在按照重构后的布局结构在所述显示屏上显示所述待显示内容期间,当检测到所述显示屏上的触摸操作时,根据所述触摸操作更新待显示内容。A response module, configured to update the content to be displayed according to the touch operation when a touch operation on the display screen is detected during displaying the content to be displayed on the display screen according to the reconstructed layout structure. 9.如权利要求7或8所述的显示处理装置,其特征在于,所述显示处理装置还包括:9. The display processing device according to claim 7 or 8, wherein the display processing device further comprises: 检测模块,用于通过设置在所述终端上的传感器和/或摄像头,检测并判断所述终端当前是否适配于VR设备中,且当确定所述终端当前适配于VR设备中时,打开所述VR交互开关;The detection module is configured to detect and judge whether the terminal is currently adapted to a VR device through a sensor and/or a camera provided on the terminal, and when it is determined that the terminal is currently adapted to a VR device, open The VR interactive switch; 确定模块,用于当预置的VR交互开关被打开时,确定所述终端当前适配于VR设备中。A determining module, configured to determine that the terminal is currently adapted to a VR device when a preset VR interaction switch is turned on. 10.如权利要求7所述的显示处理装置,其特征在于,所述判断模块包括:10. The display processing device according to claim 7, wherein the judging module comprises: 获取单元,用于在所述终端适配于VR设备中时,获取所述终端显示屏上的待显示内容的布局结构;An acquisition unit, configured to acquire the layout structure of the content to be displayed on the display screen of the terminal when the terminal is adapted to the VR device; 确定单元,用于在所述待显示内容的布局结构为将所述显示屏的显示区域均分为左右两个相同大小且对称的指定形状的显示区域时,确定所述待显示内容能够被所述VR设备识别;其中,两个指定形状的显示区域中的内容平移后完全重叠。A determination unit, configured to determine that the content to be displayed can be displayed when the layout structure of the content to be displayed is such that the display area of the display screen is equally divided into two left and right display areas of the same size and symmetrical specified shape. The aforementioned VR device recognition; wherein, the content in the display area of the two specified shapes completely overlaps after being translated. 11.如权利要求10所述的显示处理装置,其特征在于,所述重构模块包括:11. The display processing device according to claim 10, wherein the reconstruction module comprises: 重排单元,用于当所述待显示内容不能被所述VR设备识别时,根据获取到的布局结构以及预置的重排规则,将所述布局结构中包含的各个显示项进行分类后按照指定顺序重排;a rearrangement unit, configured to classify each display item included in the layout structure according to the acquired layout structure and preset rearrangement rules when the content to be displayed cannot be recognized by the VR device Rearrange the specified order; 配置单元,用于将重排后的显示项以相同的布局分别配置在所述两个指定形状的显示区域,以得到所述VR设备能够识别的布局结构。The configuration unit is configured to respectively arrange the rearranged display items in the same layout in the display areas of the two specified shapes, so as to obtain a layout structure that can be recognized by the VR device. 12.如权利要求7所述的显示处理装置,其特征在于,所述待显示内容包括但不限于以下类型:12. The display processing device according to claim 7, wherein the content to be displayed includes but is not limited to the following types: 来电、短信、网页、视频、图片、应用页面。Incoming calls, text messages, web pages, videos, pictures, application pages.
CN201610821120.7A 2016-09-12 2016-09-12 Display processing method and device Pending CN107817894A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201610821120.7A CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device
PCT/CN2017/070886 WO2018045699A1 (en) 2016-09-12 2017-01-11 Display processing method and apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201610821120.7A CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device

Publications (1)

Publication Number Publication Date
CN107817894A true CN107817894A (en) 2018-03-20

Family

ID=61561336

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201610821120.7A Pending CN107817894A (en) 2016-09-12 2016-09-12 Display processing method and device

Country Status (2)

Country Link
CN (1) CN107817894A (en)
WO (1) WO2018045699A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110362203A (en) * 2019-07-11 2019-10-22 Oppo广东移动通信有限公司 Information processing method, device, storage medium and augmented reality equipment
CN114286077A (en) * 2021-01-08 2022-04-05 海信视像科技股份有限公司 Virtual reality equipment and VR scene image display method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
CN104270623A (en) * 2014-09-28 2015-01-07 联想(北京)有限公司 Display method and electronic device
CN105900051A (en) * 2014-01-06 2016-08-24 三星电子株式会社 Electronic device and event display method in virtual reality mode

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2499102B (en) * 2013-01-11 2013-12-25 Mvr Global Ltd Head-mounted display device
US20160019720A1 (en) * 2014-07-15 2016-01-21 Ion Virtual Technology Corporation Method for Viewing Two-Dimensional Content for Virtual Reality Applications
KR102244222B1 (en) * 2014-09-02 2021-04-26 삼성전자주식회사 A method for providing a visual reality service and apparatuses therefor
CN105528207B (en) * 2015-12-03 2018-12-25 北京小鸟看看科技有限公司 A kind of virtual reality system and the method and apparatus for wherein showing Android application image
CN105447898B (en) * 2015-12-31 2018-12-25 北京小鸟看看科技有限公司 The method and apparatus of 2D application interface are shown in a kind of virtual reality device
CN106126145A (en) * 2016-06-29 2016-11-16 联想(北京)有限公司 A kind of display packing and electronic equipment

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120302289A1 (en) * 2011-05-27 2012-11-29 Kang Heejoon Mobile terminal and method of controlling operation thereof
CN105900051A (en) * 2014-01-06 2016-08-24 三星电子株式会社 Electronic device and event display method in virtual reality mode
CN104270623A (en) * 2014-09-28 2015-01-07 联想(北京)有限公司 Display method and electronic device

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110362203A (en) * 2019-07-11 2019-10-22 Oppo广东移动通信有限公司 Information processing method, device, storage medium and augmented reality equipment
CN114286077A (en) * 2021-01-08 2022-04-05 海信视像科技股份有限公司 Virtual reality equipment and VR scene image display method
CN114286077B (en) * 2021-01-08 2024-05-17 海信视像科技股份有限公司 Virtual reality device and VR scene image display method

Also Published As

Publication number Publication date
WO2018045699A1 (en) 2018-03-15

Similar Documents

Publication Publication Date Title
US9996983B2 (en) Manipulation of virtual object in augmented reality via intent
CN108024079B (en) Screen recording method, device, terminal and storage medium
US10949490B2 (en) Method and apparatus for displaying webpage content
CN106453962B (en) Camera shooting control method of double-screen intelligent terminal
US20160246371A1 (en) Manipulation of virtual object in augmented reality via thought
CN103631483B (en) Positioning method and positioning device
CN112073798B (en) Data transmission method and equipment
CN107479691A (en) A kind of exchange method and its intelligent glasses and storage device
US20190220681A1 (en) Information terminal device, information processing system, and computer-readable non-transitory recording medium storing display control program
CN110609653A (en) Dual-system device and writing method, device and interactive smart tablet therefor
WO2022041606A1 (en) Method and apparatus for adjusting display position of control
CN106547429B (en) Display method and device for electronic terminal
WO2020078215A1 (en) Video-based information acquisition method and device
CN104504083A (en) Image confirming method and device based on image searching
JP2017505081A (en) Method and apparatus for prompting device connection
CN105700771A (en) Display apparatus and display method thereof
CN106896931A (en) A kind of input method error correction method and device
JP2017508223A (en) Page display method and apparatus, and electronic device
CN113435926A (en) Advertisement display method and device, storage medium and electronic device
CN107817894A (en) Display processing method and device
CN106020690A (en) Video picture screenshot method, device and mobile terminal
WO2019119643A1 (en) Interaction terminal and method for mobile live broadcast, and computer-readable storage medium
CN109040729A (en) Image white balance correcting, device, storage medium and terminal
CN106155533B (en) A kind of information processing method and projection device
CN105956078A (en) Question searching method and device of intelligent equipment

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20180320