[go: up one dir, main page]

CN115049773B - Method, device and application for implementing real-time editing based on extended virtual window - Google Patents

Method, device and application for implementing real-time editing based on extended virtual window Download PDF

Info

Publication number
CN115049773B
CN115049773B CN202210783384.3A CN202210783384A CN115049773B CN 115049773 B CN115049773 B CN 115049773B CN 202210783384 A CN202210783384 A CN 202210783384A CN 115049773 B CN115049773 B CN 115049773B
Authority
CN
China
Prior art keywords
virtual
viewport
window
screen content
engine
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202210783384.3A
Other languages
Chinese (zh)
Other versions
CN115049773A (en
Inventor
周子乔
秦睿子
刘浩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Yiyuqianxiang Technology Co ltd
Original Assignee
Hangzhou Yiyuqianxiang Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Yiyuqianxiang Technology Co ltd filed Critical Hangzhou Yiyuqianxiang Technology Co ltd
Priority to CN202210783384.3A priority Critical patent/CN115049773B/en
Publication of CN115049773A publication Critical patent/CN115049773A/en
Application granted granted Critical
Publication of CN115049773B publication Critical patent/CN115049773B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/00Three-dimensional [3D] image rendering
    • G06T15/005General purpose rendering architectures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/20Editing of three-dimensional [3D] images, e.g. changing shapes or colours, aligning objects or positioning parts

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Architecture (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Processing Or Creating Images (AREA)

Abstract

本申请提出了一种基于扩展虚幻窗口实现实时编辑的方法、装置及应用,在虚拟引擎内创建一一对应虚拟空间的视口的至少一虚幻窗口;将对应每个视口的虚拟画面内容显示在对应的所述虚幻窗口内,并传入对应的视口渲染数据,其中所述视口渲染数据至少包括渲染方式、视口朝向以及视口矩阵;虚拟引擎基于所述视口渲染数据和虚拟画面内容渲染对应虚拟空间的视口,并投射在对应的视口上,可在虚拟引擎内通过扩展虚幻窗口的方式实现实时查看虚拟画面内容的效果,提高虚拟画面内容的设计效率。

The present application proposes a method, device and application for achieving real-time editing based on an extended virtual window, wherein at least one virtual window corresponding to a viewport of a virtual space is created in a virtual engine; the virtual screen content corresponding to each viewport is displayed in the corresponding virtual window, and the corresponding viewport rendering data is transmitted, wherein the viewport rendering data at least includes a rendering mode, a viewport orientation and a viewport matrix; the virtual engine renders the viewport of the corresponding virtual space based on the viewport rendering data and the virtual screen content, and projects it on the corresponding viewport, so that the effect of real-time viewing of the virtual screen content can be achieved by extending the virtual window in the virtual engine, thereby improving the design efficiency of the virtual screen content.

Description

Method, device and application for realizing real-time editing based on extended ghost window
Technical Field
The application relates to the field of virtual engines, in particular to a method, a device and an application for realizing real-time editing based on an extended ghost window.
Background
The naked eye full-immersion type mixed reality product refers to a product in which a user experiences a full-immersion virtual picture in a real physical space without wearing any auxiliary equipment. To achieve the above effect, it is often necessary to configure the projection device to present a full-immersion virtual space of a real scale in a real physical space, while the picture content of the virtual space is implemented by a powerful virtual engine behind.
At present, when virtual picture contents of a virtual space are designed, when virtual picture contents such as map data, object materials or blueprints are modified in a virtual engine, a rendering picture can be checked in the virtual space only after clicking operation in the virtual engine, and the virtual space and the virtual engine are often separated by a distance, so that a designer needs to return to the virtual space to check the modified contents after modifying the contents on the virtual engine each time, and the efficiency of the whole design process is very low.
Disclosure of Invention
The embodiment of the application provides a method, a device and an application for realizing real-time editing based on an extended ghost window, which can realize the effect of viewing virtual picture contents in real time by taking the ghost window as real-time response equipment in a virtual engine in a mode of extending the ghost window, and improve the design efficiency of the virtual picture contents.
In a first aspect, an embodiment of the present application provides a method for implementing real-time editing based on extended virtual windows, where the method includes creating at least one virtual window corresponding to a viewport of a virtual space in a virtual engine, displaying virtual frame content corresponding to each viewport in the corresponding virtual window, and transmitting corresponding viewport rendering data, where the viewport rendering data at least includes a rendering mode, a viewport orientation, and a viewport matrix, and the virtual engine renders the viewport of the corresponding virtual space based on the viewport rendering data and the virtual frame content, and projects the viewport on the corresponding viewport.
In a second aspect, the embodiment of the application provides a device for realizing real-time editing in a virtual space based on an extended virtual window, which comprises a virtual window extension unit, an editing unit and a rendering unit, wherein the virtual window extension unit is used for creating at least one virtual window of a visual port of a one-to-one corresponding virtual space in a virtual engine, the editing unit is used for displaying virtual picture content corresponding to each visual port in the corresponding virtual window and transmitting corresponding visual port rendering data, the visual port rendering data at least comprises a rendering mode, visual port orientation and a visual port matrix, and the rendering unit is used for enabling the virtual engine to render the visual port of the corresponding virtual space based on the visual port rendering data and the virtual picture content and cast the visual port on the corresponding visual port.
In a third aspect, an embodiment of the present application provides an electronic device, including a memory, and a processor, where the memory stores a computer program, and the processor is configured to run the computer program to implement a method for editing in real time in a virtual space based on an extended ghost window.
In a fourth aspect, an embodiment of the present application provides a readable storage medium having stored therein a computer program including program code for controlling a process to execute a process including a method for implementing real-time editing in a virtual space based on an extended ghost window according to the above.
The main contributions and innovation points of the invention are as follows:
According to the embodiment of the application, the virtual window corresponding to the real view port of each virtual space is introduced into the virtual engine, the view port rendering data is utilized to convert the edited picture content into the virtual picture content which can be displayed in the virtual window, the effect of real-time editing and real-time viewing is realized, an operator can edit the virtual picture content such as map object materials or blueprints in the virtual engine in real time without repeatedly switching back and forth in a server and the virtual space controlled by the virtual engine, and the problem that the content can only be passively received in the virtual space and can not be actively modified and viewed in time is solved.
The details of one or more embodiments of the application are set forth in the accompanying drawings and the description below to provide a more thorough understanding of the other features, objects, and advantages of the application.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate embodiments of the application and together with the description serve to explain the application and do not constitute a limitation on the application. In the drawings:
FIG. 1 is a schematic diagram of multiple view ports of a virtual space provided by an embodiment of the present application;
FIG. 2 is a flow chart of a method for implementing real-time editing based on an extended ghost window according to an embodiment of the present application;
FIG. 3 is a block diagram of an apparatus for implementing real-time editing in a virtual space based on an extended ghost window in accordance with an embodiment of the present application;
fig. 4 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the application.
Detailed Description
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, the same numbers in different drawings refer to the same or similar elements, unless otherwise indicated. The implementations described in the following exemplary embodiments do not represent all implementations consistent with one or more embodiments of the present specification. Rather, they are merely examples of apparatus and methods consistent with aspects of one or more embodiments of the present description as detailed in the accompanying claims.
It should be noted that in other embodiments, the steps of the corresponding method are not necessarily performed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than described in this specification. Furthermore, a single step described in this specification may be described as being split into multiple steps in other embodiments, while multiple steps described in this specification may be described as being combined into a single step in other embodiments.
Example 1
Virtual space for projecting virtual picture content. In an embodiment of the present disclosure, the virtual space includes a plurality of view ports, and virtual picture content corresponding to each view port is projected into the corresponding view port to form a fully immersive virtual space together. The scheme aims at realizing real-time editing of virtual picture contents in a virtual space.
Referring to fig. 3, the method for implementing real-time editing based on the extended ghost window provided by the present scheme includes:
creating at least one illusive window of the viewport of the one-to-one virtual space in the virtual engine;
Displaying virtual picture content corresponding to each viewport in the corresponding virtual window, and transmitting corresponding viewport rendering data, wherein the viewport rendering data at least comprises a rendering mode, a viewport orientation and a viewport matrix;
And the virtual engine renders the viewport of the corresponding virtual space based on the viewport rendering data and the virtual picture content and projects the viewport on the corresponding viewport.
It should be noted that, in the "at least one illusion window creating a view port corresponding to a virtual space in a virtual engine", the number of illusion windows is equal to the number of view ports in the virtual space, and each view port corresponds to one illusion window.
In a specific application scenario, as shown in fig. 1, the virtual space includes five view ports, i.e., a ground view port, a southeast view port, a south view port, a west view port, and a north view port, wherein the eastern view port, the southwest view port, the west view port, and the north view port are sequentially arranged according to the southeast and northwest directions, and the ground view port is disposed on the bottom planes of the eastern view port, the south view port, the west view port, and the north view port so as to jointly enclose a bowl-shaped space. The projection device can turn to different view port directions and project corresponding virtual picture contents. At this time, five illusive windows corresponding to the ground view port, the east view port, the south view port, the west view port, and the north view, respectively, are created in the virtual engine.
Editing of the virtual engine may be performed within a virtual engine editor. And the illusion window is directly displayed in the virtual space, and a designer edits the virtual engine in the virtual space and can feed back on the illusion window in real time.
In the step of displaying the virtual picture content corresponding to each view port in the corresponding illusive window, editing the picture content in an editor of a virtual engine, converting the picture content into virtual picture content, and filling the virtual picture content into the corresponding illusive window by using a rendering interface.
It is noted that the operator can edit the virtual screen content in the editor of the virtual engine, including but not limited to replacing, modifying, deleting or adding any map data, object material or blueprint virtual screen content, the corresponding virtual screen content is displayed in the illusion window, so that the operator can see the modified screen in the virtual engine.
It should be noted that, the virtual frame content is the content that has been rendered by the viewport rendering data, so that the operator can play the virtual frame in the virtual space in the editor of the virtual engine. In some embodiments, virtual picture content is filled into the illusive window through a rendering interface.
Unlike the scene where VR or AR devices are required to be worn, in the virtual space, the view port of the virtual space and the viewing angle of the observer in the virtual space are unbinding, the observer can freely move in the virtual space, and the virtual picture content displayed in the virtual space is correspondingly visually changed according to the coordinate position of the observer. Specifically, when the observer approaches a specific view port, the virtual picture content projected by the view port should be wider, and when the observer approaches the specific view port, the virtual picture content projected by the view port is narrower, so that the observer can feel spatial stereoscopic impression in the virtual space, and the change of the virtual picture content needs to be controlled according to the view port matrix transmitted by the scheme.
In the step of generating the virtual picture content, not only the view port matrix of each view port will influence the rendering result, but also the direction and rendering mode of each view port will influence the rendering result. Therefore, the scheme can transmit corresponding viewport rendering data when each illusion window is rendered, and the viewport rendering data at least comprises a rendering mode, a viewport orientation and a viewport matrix.
The rendering mode is a virtual engine rendering view port mode, which can be selected as PERSPECTIVE perspective projection, the view port orientation is the orientation of the rendered view port, for example, the view port orientation for the east view port is eastern, so as to distinguish and determine each view port, the view port matrix is view angle transformation information related to the observation coordinates of a user, the view port matrix is automatically created by the observation coordinate information of the user in a virtual space and the view port window size, and the schematic representation of the view port matrix is as follows:
it should be noted that, the matrix elements in the viewport matrix are automatically calculated according to parameters such as the size of the viewport window and the observed coordinate information, so that the numerical value of a single matrix element is only illustrated and has no practical meaning.
Therefore, the virtual engine needs to acquire the observation coordinate information of the user, and calculate the view port matrix of the current view port based on the view port window size of the current view port and the observation coordinate information.
In the step of displaying the virtual picture content corresponding to each visual port in the corresponding virtual window and transmitting the virtual picture content into the corresponding visual port rendering data, the observation coordinate information of a user is obtained, the visual port matrix is obtained by combining the visual ports corresponding to the current virtual window, and the virtual picture content is obtained by processing the edited picture content by using the visual port matrix.
In addition, it should be noted that, in order for the virtual engine to process the editing picture content according to the viewport matrix to obtain the virtual picture content, the virtual engine needs to reload the rendered class of the editor of the virtual engine first, and then transmits the virtual picture content into the viewport matrix.
In the step of rendering the viewport of the corresponding virtual space by the virtual engine based on the viewport rendering data and the virtual picture content and projecting the viewport onto the corresponding viewport, the viewport needing to be rendered is determined based on the viewport rendering data, and the virtual picture content is projected onto the corresponding viewport.
In an embodiment of the present disclosure, the virtual space includes five view ports, including a ground view port, an eastern view port, a south view port, a west view port, and a north view port, and the corresponding optical-mechanical devices may be respectively oriented in five directions, i.e., forward east, forward south, forward west, forward north, and ground, so as to project the virtual image content onto the corresponding view ports.
In addition, the window size of the view port window and the virtual window are inconsistent with the window size of the virtual engine editor, and the view port matrix and the virtual window cannot be adapted. That is, in the editor of the virtual engine, the view port matrix is automatically generated according to the size of the corresponding view port window, and if the size of the view port window is inconsistent with the size of the editor of the virtual engine, the virtual screen content is distorted.
In order to solve the problem, in the step of displaying the virtual picture content corresponding to each view port in the corresponding virtual window, a virtual engine creates a virtual window with the same view port size proportion as the view port, edits the picture content by using the view port matrix processing to obtain virtual picture content, renders the virtual picture content into the virtual window, and processes and fills the picture of the virtual window into the window according to the size proportion of the window body of a virtual engine editor.
In this scheme, the virtual engine editor sets a function of refreshing the size ratio of the virtual picture content to the size ratio of the window of the virtual engine editor. Because the virtual picture content is generated by the corresponding view port matrix, when the virtual engine projects the virtual picture content onto the corresponding view port, the picture content matched with the size of the view port can still be obtained.
Illustratively, assume that the ground view is a square and the window of the virtual engine editor is rectangular. At this time, when the virtual engine renders the virtual window corresponding to the ground view port, the virtual engine creates a 3840×3840 virtual window, and edits the picture content by using the view port matrix to obtain virtual picture content and render the virtual picture content into the virtual window, so that the content rendered onto the ground view port can be ensured to be square, and the virtual picture content is compressed to 3840×2160 format and is filled into the window body of the virtual engine editor. This allows the ground-taking pixels to be compressed within the phantom window 3840 x 2160 when the virtual engine performs projection restoration within the virtual space, but restored to the square area when projected.
According to the scheme, the virtual engine is used as a real-time responder of the virtual engine in a mode of expanding the virtual window, so that the effect that virtual picture contents can be checked in real time on an editor of the virtual engine is achieved. In addition, the scheme can finish 3D display of the complex editing process to the maximum extent by means of the powerful editing function of the virtual engine.
The scheme can realize real-time 3D display, so the scheme has very good application in some specific scenes. For example, the project of tiny part assembly in the education field can reach the teaching person through this scheme and only need select a tiny object in virtual engine through mouse keyboard, borrow the illusion from the function of taking, the object of choosing has different special effects, and the mobile control is also very meticulous convenient simultaneously. The trainee's understanding of the manner of operation can be enhanced.
Example two
Based on the same conception, referring to fig. 3, the application also provides a device for realizing real-time editing in a virtual space based on the extended ghost window, which comprises:
The virtual window expansion unit is used for creating at least one virtual window of the view port of the one-to-one corresponding virtual space in the virtual engine;
the editing unit is used for displaying virtual picture content corresponding to each viewport in the corresponding virtual window and transmitting corresponding viewport rendering data, wherein the viewport rendering data at least comprises a rendering mode, a viewport orientation and a viewport matrix;
And the rendering unit is used for enabling the virtual engine to render the view port of the corresponding virtual space based on the view port rendering data and the virtual picture content and projecting the view port on the corresponding view port.
The device for realizing real-time editing in the virtual space based on the extended ghost window can be realized in the virtual engine as a plug-in, and the same technical content as that of the first embodiment in the second embodiment is detailed in the description of the first embodiment, and is not described in detail herein.
Example III
The present embodiment also provides an electronic device, referring to fig. 4, comprising a memory 404 and a processor 402, the memory 404 having stored therein a computer program, the processor 402 being arranged to run the computer program to perform any of the above steps in an embodiment of a method of real-time editing within a virtual space based on an extended ghost window.
In particular, the processor 402 may include a Central Processing Unit (CPU), or an application specific integrated circuit (ApplicationSpecificIntegratedCircuit, abbreviated as ASIC), or may be configured as one or more integrated circuits that implement embodiments of the present application.
The memory 404 may include, among other things, mass storage 404 for data or instructions. By way of example, and not limitation, memory 404 may comprise a hard disk drive (HARDDISKDRIVE, abbreviated HDD), a floppy disk drive, a solid state drive (SolidStateDrive, abbreviated SSD), flash memory, an optical disk, a magneto-optical disk, a magnetic tape, or a Universal Serial Bus (USB) drive, or a combination of two or more of these. Memory 404 may include removable or non-removable (or fixed) media, where appropriate. Memory 404 may be internal or external to the data processing apparatus, where appropriate. In a particular embodiment, the memory 404 is a Non-Volatile (Non-Volatile) memory. In particular embodiments, memory 404 includes Read-only memory (ROM) and Random Access Memory (RAM). Where appropriate, the ROM may be a mask-programmed ROM, a programmable ROM (ProgrammableRead-only memory, abbreviated PROM), an erasable PROM (ErasableProgrammableRead-only memory, abbreviated EPROM), an electrically erasable PROM (ElectricallyErasableProgrammableRead-only memory, abbreviated EEPROM), an electrically rewritable ROM (ElectricallyAlterableRead-only memory, abbreviated EAROM) or a FLASH memory (FLASH), or a combination of two or more of these. The RAM may be a static random access memory (StaticRandom-access memory, abbreviated SRAM) or a dynamic random access memory (DynamicRandomAccessMemory, abbreviated DRAM) where the DRAM may be a fast page mode dynamic random access memory 404 (FastPageModeDynamicRandomAccessMemory, abbreviated FPMDRAM), an extended data output dynamic random access memory (ExtendedDateOutDynamicRandomAccessMemory, abbreviated EDODRAM), a synchronous dynamic random access memory (SynchronousDynamicRandom-access memory, abbreviated SDRAM), or the like, where appropriate.
Memory 404 may be used to store or cache various data files that need to be processed and/or used for communication, as well as possible computer program instructions for execution by processor 402.
The processor 402 implements the real-time editing method in virtual space based on the extended phantom window by reading and executing the computer program instructions stored in the memory 404 to implement any of the above embodiments.
Optionally, the electronic apparatus may further include a transmission device 406 and an input/output device 408, where the transmission device 406 is connected to the processor 402 and the input/output device 408 is connected to the processor 402.
The transmission device 406 may be used to receive or transmit data via a network. Specific examples of the network described above may include a wired or wireless network provided by a communication provider of the electronic device. In one example, the transmission device includes a network adapter (Network Interface Controller, simply referred to as a NIC) that can connect to other network devices through the base station to communicate with the internet. In one example, the transmission device 406 may be a Radio Frequency (RF) module, which is configured to communicate with the internet wirelessly.
The input-output device 408 is used to edit content or the like, and the information output may be virtual screen content on an extended window, content projected on a viewport, or the like.
Alternatively, in the present embodiment, the above-mentioned processor 402 may be configured to execute the following steps by a computer program:
creating at least one illusive window of the viewport of the one-to-one virtual space in the virtual engine;
Displaying virtual picture content corresponding to each viewport in the corresponding virtual window, and transmitting corresponding viewport rendering data, wherein the viewport rendering data at least comprises a rendering mode, a viewport orientation and a viewport matrix;
And the virtual engine renders the viewport of the corresponding virtual space based on the viewport rendering data and the virtual picture content and projects the viewport on the corresponding viewport.
It should be noted that, specific examples in this embodiment may refer to examples described in the foregoing embodiments and alternative implementations, and this embodiment is not repeated herein.
In general, the various embodiments may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. Some aspects of the invention may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as non-limiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
Embodiments of the invention may be implemented by computer software executable by a data processor of a mobile device, such as in a processor entity, or by hardware, or by a combination of software and hardware. Computer software or programs (also referred to as program products) including software routines, applets, and/or macros can be stored in any apparatus-readable data storage medium and they include program instructions for performing particular tasks. The computer program product may include one or more computer-executable components configured to perform embodiments when the program is run. The one or more computer-executable components may be at least one software code or a portion thereof. In addition, in this regard, it should be noted that any blocks of the logic flows as illustrated may represent program steps, or interconnected logic circuits, blocks and functions, or a combination of program steps and logic circuits, blocks and functions. The software may be stored on a physical medium such as a memory chip or memory block implemented within a processor, a magnetic medium such as a hard disk or floppy disk, and an optical medium such as, for example, a DVD and its data variants, a CD, etc. The physical medium is a non-transitory medium.
It should be understood by those skilled in the art that the technical features of the above embodiments may be combined in any manner, and for brevity, all of the possible combinations of the technical features of the above embodiments are not described, however, they should be considered as being within the scope of the description provided herein, as long as there is no contradiction between the combinations of the technical features.
The foregoing examples illustrate only a few embodiments of the application, which are described in greater detail and are not to be construed as limiting the scope of the application. It should be noted that it will be apparent to those skilled in the art that several variations and modifications can be made without departing from the spirit of the application, which are all within the scope of the application. Accordingly, the scope of the application should be assessed as that of the appended claims.

Claims (8)

1.一种基于扩展虚幻窗口实现实时编辑的方法,其特征在于,包括:1. A method for implementing real-time editing based on an extended virtual window, comprising: 在虚拟引擎内创建一一对应虚拟空间的视口的至少一虚幻窗口;Creating at least one virtual window in the virtual engine that corresponds one-to-one to the viewport of the virtual space; 将对应每个视口的虚拟画面内容显示在对应的所述虚幻窗口内,并传入对应的视口渲染数据,其中所述视口渲染数据至少包括渲染方式、视口朝向以及视口矩阵,所述渲染方式为虚拟引擎渲染视口的方式,所述视口朝向为被渲染的视口的朝向,所述视口矩阵为相关于用户的观察坐标的视角变换信息,视口矩阵通过用户在虚拟空间的观察坐标信息以及视口窗体大小自动创建得到;Displaying the virtual screen content corresponding to each viewport in the corresponding virtual window, and passing in the corresponding viewport rendering data, wherein the viewport rendering data at least includes a rendering mode, a viewport orientation, and a viewport matrix, wherein the rendering mode is a mode in which the virtual engine renders the viewport, the viewport orientation is an orientation of the rendered viewport, and the viewport matrix is perspective transformation information related to the user's observation coordinates, and the viewport matrix is automatically created according to the user's observation coordinate information in the virtual space and the viewport window size; 基于所述视口渲染数据确定需要渲染的视口,将所述虚拟画面内容投射到对应的视口上,操作人员在虚拟引擎的编辑器内编辑虚拟画面内容,包括替换、修改、删除或增加任何地图数据、物体材质或者蓝图类的虚拟画面内容,对应的虚拟画面内容会被展示在虚幻窗口内。The viewport to be rendered is determined based on the viewport rendering data, and the virtual screen content is projected onto the corresponding viewport. The operator edits the virtual screen content in the editor of the virtual engine, including replacing, modifying, deleting or adding any map data, object materials or blueprint-type virtual screen content. The corresponding virtual screen content will be displayed in the Unreal window. 2.根据权利要求1所述的基于扩展虚幻窗口实现实时编辑的方法,其特征在于,每一所述视口对应一虚幻窗口。2. The method for implementing real-time editing based on an extended virtual window according to claim 1, wherein each of the viewports corresponds to a virtual window. 3.根据权利要求1所述的基于扩展虚幻窗口实现实时编辑的方法,其特征在于,在“将对应每个视口的虚拟画面内容显示在对应的所述虚幻窗口内,并传入对应的视口渲染数据”步骤中,获取用户的观察坐标信息并结合当前虚幻窗口对应的视口得到视口矩阵,利用所述视口矩阵处理编辑画面内容得到虚拟画面内容。3. According to the method for realizing real-time editing based on extending the virtual window as described in claim 1, it is characterized in that in the step of "displaying the virtual screen content corresponding to each viewport in the corresponding virtual window, and transferring the corresponding viewport rendering data", the user's observation coordinate information is obtained and combined with the viewport corresponding to the current virtual window to obtain the viewport matrix, and the viewport matrix is used to process the editing screen content to obtain the virtual screen content. 4.根据权利要求1所述的基于扩展虚幻窗口实现实时编辑的方法,其特征在于,在虚拟引擎的编辑内编辑画面内容,所述编辑画面内容转换为虚拟画面内容,并利用渲染接口将所述虚拟画面内容填充至对应的所述虚幻窗口内。4. According to the method for realizing real-time editing based on extending the virtual window according to claim 1, it is characterized in that the screen content is edited in the editor of the virtual engine, the edited screen content is converted into virtual screen content, and the virtual screen content is filled into the corresponding virtual window using a rendering interface. 5.根据权利要求1所述的基于扩展虚幻窗口实现实时编辑的方法,其特征在于,在“将对应每个视口的虚拟画面内容显示在对应的所述虚幻窗口内”步骤中,虚拟引擎自创建同于所述视口的视口尺寸比例的中间窗口,利用所述视口矩阵处理编辑画面内容得到虚拟画面内容并渲染到所述中间窗口内,将所述中间窗口的画面根据所述虚幻窗口的尺寸比例填充到所述虚幻窗口内。5. According to the method for realizing real-time editing based on extending the virtual window as described in claim 1, it is characterized in that in the step of "displaying the virtual screen content corresponding to each viewport in the corresponding virtual window", the virtual engine creates an intermediate window with the same viewport size ratio as the viewport, uses the viewport matrix to process the editing screen content to obtain the virtual screen content and renders it into the intermediate window, and fills the screen of the intermediate window into the virtual window according to the size ratio of the virtual window. 6.一种基于扩展虚幻窗口实现在虚拟空间内实时编辑的装置,其特征在于,包括:6. A device for implementing real-time editing in a virtual space based on an extended virtual window, characterized in that it comprises: 虚幻窗口扩展单元,用于在虚拟引擎内创建一一对应虚拟空间的视口的至少一虚幻窗口;A virtual window extension unit, used to create at least one virtual window in a virtual engine that corresponds one-to-one to a viewport of the virtual space; 编辑单元,用于将对应每个视口的虚拟画面内容显示在对应的所述虚幻窗口内,并传入对应的视口渲染数据,其中所述视口渲染数据至少包括渲染方式、视口朝向以及视口矩阵,所述渲染方式为虚拟引擎渲染视口的方式,所述视口朝向为被渲染的视口的朝向,所述视口矩阵为相关于用户的观察坐标的视角变换信息,视口矩阵通过用户在虚拟空间的观察坐标信息以及视口窗体大小自动创建得到;An editing unit, used to display the virtual screen content corresponding to each viewport in the corresponding virtual window, and to input the corresponding viewport rendering data, wherein the viewport rendering data at least includes a rendering mode, a viewport orientation, and a viewport matrix, wherein the rendering mode is a mode in which the virtual engine renders the viewport, the viewport orientation is an orientation of the rendered viewport, and the viewport matrix is perspective transformation information related to the user's observation coordinates, and the viewport matrix is automatically created according to the user's observation coordinate information in the virtual space and the viewport window size; 渲染单元,基于所述视口渲染数据确定需要渲染的视口,将所述虚拟画面内容投射到对应的视口上;操作人员在虚拟引擎的编辑器内编辑虚拟画面内容,包括替换、修改、删除或增加任何地图数据、物体材质或者蓝图类的虚拟画面内容,对应的虚拟画面内容会被展示在虚幻窗口内。The rendering unit determines the viewport to be rendered based on the viewport rendering data, and projects the virtual screen content onto the corresponding viewport; the operator edits the virtual screen content in the editor of the virtual engine, including replacing, modifying, deleting or adding any map data, object material or blueprint-type virtual screen content, and the corresponding virtual screen content will be displayed in the unreal window. 7.一种电子装置,包括存储器和处理器,其特征在于,所述存储器中存储有计算机程序,所述处理器被设置为运行所述计算机程序以执行权利要求1到5任一所述的基于扩展虚幻窗口实现在虚拟空间内实时编辑的方法。7. An electronic device comprising a memory and a processor, wherein a computer program is stored in the memory, and the processor is configured to run the computer program to execute the method for realizing real-time editing in a virtual space based on an extended virtual window as described in any one of claims 1 to 5. 8.一种可读存储介质,其特征在于,所述可读存储介质中存储有计算机程序,所述计算机程序包括用于控制过程以执行过程的程序代码,所述过程包括根据权利要求1到5任一所述的基于扩展虚幻窗口实现在虚拟空间内实时编辑的方法。8. A readable storage medium, characterized in that a computer program is stored in the readable storage medium, and the computer program includes a program code for controlling a process to execute a process, and the process includes a method for realizing real-time editing in a virtual space based on an extended virtual window according to any one of claims 1 to 5.
CN202210783384.3A 2022-07-05 2022-07-05 Method, device and application for implementing real-time editing based on extended virtual window Active CN115049773B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202210783384.3A CN115049773B (en) 2022-07-05 2022-07-05 Method, device and application for implementing real-time editing based on extended virtual window

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202210783384.3A CN115049773B (en) 2022-07-05 2022-07-05 Method, device and application for implementing real-time editing based on extended virtual window

Publications (2)

Publication Number Publication Date
CN115049773A CN115049773A (en) 2022-09-13
CN115049773B true CN115049773B (en) 2025-03-25

Family

ID=83164849

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202210783384.3A Active CN115049773B (en) 2022-07-05 2022-07-05 Method, device and application for implementing real-time editing based on extended virtual window

Country Status (1)

Country Link
CN (1) CN115049773B (en)

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014008185A1 (en) * 2012-07-02 2014-01-09 Sony Computer Entertainment Inc. Methods and systems for interaction with an expanded information space
CN103729888A (en) * 2013-12-31 2014-04-16 成都有尔科技有限公司 3D projecting device convenient to debug and debugging method thereof
CN107358659B (en) * 2017-07-21 2021-06-22 福建星网视易信息系统有限公司 Multi-picture fusion display method based on 3D technology and storage device
CN110620917A (en) * 2019-10-22 2019-12-27 上海第二工业大学 Virtual reality cross-screen stereoscopic display method
CN112040092B (en) * 2020-09-08 2021-05-07 杭州时光坐标影视传媒股份有限公司 Real-time virtual scene LED shooting system and method
CN114035681A (en) * 2021-10-29 2022-02-11 王朋 3D active stereo interactive immersive virtual reality CAVE system
CN114247136B (en) * 2021-12-24 2025-07-29 网易(杭州)网络有限公司 Virtual scene manufacturing method and device, electronic equipment and storage medium

Also Published As

Publication number Publication date
CN115049773A (en) 2022-09-13

Similar Documents

Publication Publication Date Title
CN107358649B (en) Processing method and device of terrain file
EP3170151B1 (en) Blending between street view and earth view
JP5242789B2 (en) Mapping of graphics instructions to related graphics data in performance analysis
CN112686939B (en) Depth image rendering method, device, equipment and computer readable storage medium
CN108133454B (en) Image switching method, device, system and interactive device for spatial geometric model
CN112929627B (en) Virtual reality scene implementation method and device, storage medium and electronic equipment
CN116243831B (en) Virtual cloud exhibition hall interaction method and system
US9401044B1 (en) Method for conformal visualization
CN111429553B (en) Animation preview method, device, computer equipment and storage medium
CN113112581A (en) Texture map generation method, device and equipment for three-dimensional model and storage medium
WO2021135320A1 (en) Video generation method and apparatus, and computer system
CN114895796B (en) Space interaction method and device based on panoramic image and application
CN111414104A (en) Electronic map local display method and device
CN118735770A (en) Method, device, equipment, medium and program for integrating continuous panoramic images with BIM
US20240212282A1 (en) Image rendering method and apparatus, device, and medium
JP2023540890A (en) Method and device for providing interior design market platform service using realistic scene images based on virtual space content data
CN115049773B (en) Method, device and application for implementing real-time editing based on extended virtual window
CN109816761B (en) Graph conversion method, graph conversion device, storage medium and electronic equipment
RU2422902C2 (en) Two-dimensional/three-dimensional combined display
CN114004920A (en) Method and device for adding flame special effect in picture
CN117557711B (en) Method, device, computer equipment and storage medium for determining visual field
CN111930282A (en) Data editing method and platform based on QGIS and electronic equipment
CN114299202B (en) Processing method and device, storage medium and terminal for virtual scene production
CN111402369A (en) Interactive advertisement processing method and device, terminal equipment and storage medium
CN118505873A (en) 3D rendering method, device, computer equipment and storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant