Background
The AR (Augmented Reality) technology is a technology that skillfully fuses virtual information and a real world, and applies virtual information such as characters, images, three-dimensional models, music, videos and the like generated by a computer to the real world after analog simulation by using various technical means such as multimedia, three-dimensional modeling, real-time tracking and registration, intelligent interaction, sensing and the like, wherein the two kinds of information complement each other, thereby realizing the enhancement of the real world.
At present, with the continuous development of network online education, new requirements are provided for teaching tools, the traditional teaching tools such as a projection, a blackboard, a whiteboard or a plane 2d video cannot meet the requirement of a teacher on the explanation of a three-dimensional space scene or a four-dimensional space scene, the teacher can only guide the student to imagine the relevant space and time scene through more language descriptions, students can understand the teaching tools only by having certain space-time imagination, and the teaching quality and the teaching effect are greatly influenced.
Disclosure of Invention
An object of the embodiments of the present application is to provide an online teaching system and a control method thereof, so as to implement the combination with the augmented reality technology, make knowledge points in the course of teaching by teachers more vivid and vivid, be more beneficial to students to understand, and effectively improve the quality and effect of teaching.
A first aspect of an embodiment of the present application provides an online teaching system, including a server, at least one student device, and at least one teaching device, which are in communication connection, wherein: the at least one teaching device is used for acquiring teaching data from a server according to preset operation, displaying the teaching data, and instructing the server to send the teaching data to the at least one student device; the teaching data comprises conventional teaching data and augmented reality data; the server is used for storing the teaching data and realizing information interaction between the at least one teaching device and the at least one student device; the at least one student device is used for receiving the teaching data.
In one possible embodiment, the server includes one or more of a single server, a server cluster, and a cloud server.
In a possible implementation, the server includes a streaming server.
A second aspect of the embodiments of the present application provides a teaching apparatus, which is applicable to the first aspect of the embodiments of the present application and a teaching system of any embodiment of the embodiments of the present application, and includes: the loading module is used for acquiring teaching data from the server according to preset operation, wherein the teaching data comprises conventional teaching data and augmented reality data; the display module is connected with the loading module and used for displaying the teaching data; and the sending module is connected with the display module and used for indicating the server to send the teaching data to the at least one student device.
In a possible implementation manner, the teaching apparatus further includes: and the control module is connected with the display module and used for adjusting the display state of the teaching data in the display module according to the received operation instruction.
In a possible implementation manner, the teaching apparatus further includes: the acquisition module is connected with the display module and is used for acquiring audio and video data in a teaching scene and display data of the display module; and the transmission module is connected with the acquisition module and used for uploading the audio and video data and the display data to the server.
In a possible implementation manner, the teaching apparatus further includes: and the modeling module is connected with the transmission module and used for constructing a three-dimensional model and uploading the three-dimensional model to the server through the transmission module.
In one possible embodiment, the augmented reality data includes one or more of a three-dimensional model, audio, and video animation.
A third aspect of the embodiments of the present application provides a teaching method, which is applicable to the second aspect of the embodiments of the present application and teaching equipment of any embodiment of the embodiments of the present application, and includes: acquiring teaching data from a server according to preset operation, wherein the teaching data comprises conventional teaching data and augmented reality data; displaying the teaching data; instructing the server to send the instructional data to the at least one student device.
In a possible implementation manner, the method further comprises the steps of adjusting a viewpoint inclination angle of the augmented reality data according to a first instruction when the first instruction is received; when a second instruction is received, adjusting the display position of the augmented reality data according to the second instruction; and when a third instruction is received, adjusting the display size of the augmented reality data according to the third instruction.
This application combines augmented reality technique to carry out vivid's demonstration to the knowledge of needs space-time supplementary description, can adjust the display effect as required during the mr explains, records the demonstration of knowledge point and mr's explanation process, and the student learns through watching the video of live broadcast or recording, understands and masters relevant knowledge, has effectively improved teaching quality and teaching effect.
Detailed Description
The technical solutions in the embodiments of the present application will be described below with reference to the drawings in the embodiments of the present application.
In the description of the present application, the terms "first," "second," and the like are used for distinguishing between descriptions and do not denote an order of magnitude, nor are they to be construed as indicating or implying relative importance.
In the description of the present application, the terms "comprises" and "comprising," and any variations thereof, are intended to cover a non-exclusive inclusion, such that a process, method, system, article, or apparatus that comprises a list of steps or elements is not necessarily limited to those steps or elements expressly listed, but may include other steps or elements not expressly listed or inherent to such process, method, article, or apparatus.
In the description of the present application, the terms "mounted," "disposed," "provided," "connected," and "configured" are to be construed broadly unless expressly stated or limited otherwise. For example, it may be a fixed connection, a removable connection, or a unitary construction; can be mechanically or electrically connected; either directly or indirectly through intervening media, or may be internal to two devices, elements or components. The specific meaning of the above terms in the present application can be understood by those of ordinary skill in the art as appropriate.
Please refer to fig. 1, which is a schematic structural diagram of an online education system 100 according to an embodiment of the present application. The online teaching system 100 includes a server 110, student devices 120 and teaching devices 130, where the number of the student devices 120 may be one or more, and the number of the teaching devices 130 may be one or more, and fig. 1 illustrates one student device 120 and one teaching device 130 as an example. The at least one student device 120 is connected to the server 110, the server 110 is connected to the at least one teaching device 130, and the teaching device 130 is an electronic device with an augmented reality function, or may be an electronic device capable of uploading pre-made augmented reality data to the server 110 and displaying the augmented reality data.
In one possible embodiment, the online teaching system 100 can be applied to a remote teaching scenario, the user of the teaching device 130 can be a teacher, such as a teacher and assistant, or a teacher and a manager, and the user of the student device 120 can be a student. The at least one teaching device 130 is used for obtaining teaching data from the server 110 according to preset operation and displaying the teaching data, and instructing the server 110 to send the teaching data to the at least one student device 120, wherein the teaching data comprises conventional teaching data and augmented reality data, the conventional teaching data comprises but is not limited to teaching materials, lectures, courseware and the like, and the augmented reality data comprises but is not limited to one or more of three-dimensional models, audio and video animations. The server 110 is used for storing teaching data, realizing information interaction between at least one teaching device 130 and at least one student device 120, receiving an instruction sent by at least one teaching device 130, and selecting teaching data corresponding to the received instruction from a database. At least one student device 120 is for receiving instructional data.
In one possible embodiment, the server 110 includes one or more of a single server, a cluster of servers, and a cloud server.
In a possible embodiment, the server 110 includes a data server and an intermediate server, wherein the data server is configured to store teaching data required for a teacher to give lessons, and the intermediate server is configured to receive the teaching data uploaded by the at least one teaching device 130 and send corresponding teaching data to the at least one student device 120 according to an instruction sent by the at least one teaching device 130.
In a possible implementation manner, when the teaching needs to be performed in a live broadcasting manner, the intermediate server may be a streaming server, so that smoothness and real-time performance of a live broadcasting effect can be ensured. When needing to carry out the teaching through the recorded broadcast mode, intermediate server usually can be ordinary server, perhaps just directly adopts data server also, under this kind of condition, the student can download the teaching data in advance to student's equipment local, directly watches, also can watch on line, does not do this and does not describe repeatedly.
In one possible implementation, the teaching device 130 includes at least one processor, a memory, the processor and the memory are connected by a bus, the memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor to cause the at least one processor to execute the online teaching system control method as in the following embodiments. In a possible embodiment, the teaching device 130 further includes a display screen, a mouse and a keyboard, wherein the display screen is used for displaying teaching data.
Fig. 2 is a schematic structural diagram of a teaching apparatus 130 according to an embodiment of the present application. The teaching apparatus 130 includes: the loading module 131, the display module 132, the sending module 133, the control module 134, the collecting module 135, the transmitting module 136 and the modeling module 137, wherein the loading module 131 is configured to obtain pre-stored teaching data from the server 110 when a user performs a preset operation, the teaching data includes conventional teaching data and augmented reality data, the conventional teaching data includes but is not limited to teaching materials, lectures, courseware and the like, and in a possible embodiment, the conventional teaching data may be stored in an electronic document format, including but not limited to a PPT format, a DOC format, a PDF format and the like, and may also be stored in a picture format.
The augmented reality data includes but is not limited to one or more of a three-dimensional model, audio and video animation, the augmented reality data is set according to conventional teaching data, corresponding relation exists between the augmented reality data and knowledge points in the conventional teaching data, and three-dimensional state display can be performed on the knowledge points in two-dimensional state in the conventional teaching data. In one possible embodiment, the augmented reality data may be acquired by a 3D scanner or may be generated by a 3D-GAN model.
In a possible implementation manner, the preset operation performed by the user may be to select a teaching material or a courseware lecture required by the lecture by clicking with a mouse, select a knowledge point on the teaching material or the courseware lecture by clicking with a mouse, or scan a two-dimensional image of the knowledge point on the teaching material by using a camera.
The display module 132 is connected to the loading module 131 for displaying the conventional teaching data and the augmented reality data, and in a possible embodiment, the display module 132 may be an electronic display screen. The sending module 133 is connected to the display module 132, and is used for instructing the server 110 to send the teaching data to at least one student device 120. The control module 134 is connected to the display module 132, and is configured to adjust the display states of the conventional teaching data and the augmented reality data in the display module 132 according to the received operation instruction.
The acquisition module 135 is connected to the display module 132 and configured to acquire audio and video data in a teaching scene and display data of the display module 132, and the transmission module 136 is connected to the acquisition module 135 and configured to upload the acquired audio and video data and display data to the server 110 for storage. The audio/video data refers to the recorded sound and video of the teacher during the teaching process, and the display data refers to the teaching data displayed on the display module 132 during the teaching process and the display state of the teaching data. In one embodiment, the acquisition module 135 may include a microphone, a camera, and the like.
In one possible embodiment, the control module 134 may include a mouse and a keyboard, and the user may make the loading module 131 obtain the required general teaching data from the server 110 by mouse click selection or keyboard input search, and display the general teaching data on the display module 132. The user may also operate the mouse or the keyboard according to the lecture progress, and the control module 134 controls the conventional teaching data on the display module 132 to turn pages back and forth according to the received operation instruction.
In one possible embodiment, the user may select a knowledge point in the conventional teaching data by mouse clicking, and the loading module 131 obtains the augmented reality data corresponding to the knowledge point from the server 110 and displays the augmented reality data in the display module 132 in a default state.
In a possible implementation manner, the user may perform a left-button dragging operation on the mouse, and the control module 134 receives the first instruction and adjusts the viewpoint tilt angle of the augmented reality data in the display module 132 according to the first instruction. The user may perform a right-click dragging operation on the mouse, and the control module 134 receives the first instruction and adjusts the display position of the augmented reality data in the display module 132 according to the second instruction. The user can perform a scroll wheel operation on the mouse, and the control module 134 receives the first instruction and adjusts the display size of the augmented reality data in the display module 132 according to the third instruction.
In a possible embodiment, the teaching device 130 further includes a modeling module 137, and the modeling module 137 is connected to the transmission module 136, and is configured to construct a three-dimensional model, and upload the three-dimensional model to the server 110 through the transmission module 136. In one possible embodiment, the user may set a lecture courseware or the like through the modeling module 137 and upload it to the server 110 through the transmission module 136 before starting a lecture, and store it as general teaching data. The modeling module 137 may include a palette component, an AR component, and the like.
In a possible implementation manner, the modeling module 137 may construct a corresponding three-dimensional model according to knowledge points in the conventional teaching data, configure attributes such as color, size, and view angle of the three-dimensional model according to an operation instruction of a user, generate three-dimensional model data and animation scene data in which the three-dimensional model is combined with time, upload the data to the server 110 through the transmission module 136, and store the data as augmented reality data. In one possible embodiment, the augmented reality data, such as a 3D-GAN model, may be generated using a deep learning trained neural network model.
Fig. 3 is a schematic flow chart of a control method of an online teaching system according to an embodiment of the present application, and the method can be executed by the teaching device 130 shown in fig. 1 and fig. 2 to achieve vivid display of teaching knowledge points and improve teaching quality and effect. The method comprises the following steps:
step 210: and acquiring teaching data from the server according to preset operation.
In the above steps, the teaching data includes conventional teaching data and augmented reality data.
In a possible embodiment, before obtaining the teaching data from the server according to the preset operation, the method further includes: constructing a three-dimensional model according to conventional teaching data; carrying out attribute configuration on the three-dimensional model; and uploading the configured three-dimensional model to a server.
In a possible implementation manner, a lesson can be prepared in advance before the course begins, conventional teaching data such as lectures, courseware, interactive questions and the like are set according to course arrangement and uploaded to a server for storage, a three-dimensional model is built according to teaching material knowledge points, an animation scene combining the three-dimensional model and time is created, and attribute configuration is performed on the three-dimensional model, wherein the attribute configuration includes but is not limited to configuration of size, temperature, humidity, color, visual angle and the like, can be attribute configuration of the whole model, can also be attribute configuration of local models, and the configured three-dimensional model is uploaded to the server. In a possible implementation manner, the two-dimensional images conforming to the knowledge points can be recorded into a training set, and the mapping relation between the two-dimensional images of the knowledge points and the augmented reality data is established through a neural network model identified by a deep learning training image.
In a possible embodiment, the preset operation includes scanning the two-dimensional image, and when the user performs the preset operation, the method obtains pre-stored teaching data from the server, and includes: acquiring a two-dimensional image; identifying characteristic information of the two-dimensional image; and acquiring augmented reality data corresponding to the two-dimensional image according to the characteristic information. The augmented reality data includes one or more of a three-dimensional model, audio, video animation. In a possible implementation manner, the two-dimensional image may be a knowledge point in the conventional teaching data displayed on the display screen or a knowledge point on the paper teaching material, or may be a two-dimensional code, a barcode, or other identifier preset near the knowledge point.
In a possible embodiment, the preset operation includes scanning the two-dimensional image, and when the user performs the preset operation, the method obtains pre-stored teaching data from the server, and includes: and acquiring conventional teaching data corresponding to the preset keywords from the server.
In a possible implementation manner, the two-dimensional image of the knowledge point on the teaching material can be scanned through the camera, so that augmented reality data corresponding to the two-dimensional image and pre-stored in the server can be obtained, conventional teaching data such as teaching materials or courseware lectures required by teaching can be obtained through mouse click selection or keyboard input preset keyword search, the knowledge point on the teaching materials and the courseware lectures can be selected through mouse click, and accordingly augmented reality data corresponding to the knowledge point and pre-stored in the server can be obtained.
Step 220: and displaying the teaching data.
In the above steps, the acquired teaching data is displayed on a display screen according to a preset state.
Step 230: the instruction server sends the teaching data to at least one student device.
In the above step, a first signal is sent to the server, and the first signal is used for enabling the server to send the teaching data to at least one student device.
In a possible implementation manner, the method may further include adjusting display data of the teaching data according to the received operation instruction, where the display data refers to teaching data displayed on the display screen during the course of the teacher giving lessons and a display state of the teaching data.
In a possible embodiment, adjusting the display data of the teaching data according to the received operation command includes: when a first instruction is received, adjusting a viewpoint inclination angle of augmented reality data according to the first instruction; when a second instruction is received, adjusting the display position of the augmented reality data according to the second instruction; and when the third instruction is received, adjusting the display size of the augmented reality data according to the third instruction.
In a possible implementation manner, the display position of the augmented reality data can be adjusted by dragging the right button of the mouse, the viewpoint inclination angle of the augmented reality data can be adjusted by dragging the left button of the mouse, the display size of the augmented reality data can be adjusted by rolling a mouse pulley, the three-dimensional model can be selected by clicking the three-dimensional model through the left button of the mouse, so that the selected whole three-dimensional model or the local edge of the three-dimensional model is highlighted, and the three-dimensional model can be clicked through the right button of the mouse, so that the attribute of the three-dimensional model is.
An embodiment of the present invention further provides a storage medium readable by an electronic device, including: a program that, when run on an electronic device, causes the electronic device to perform all or part of the procedures of the methods in the above-described embodiments. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD), a Solid State Drive (SSD), or the like. The storage medium may also comprise a combination of memories of the kind described above.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments are referred to each other, and each embodiment focuses on the differences from the other embodiments. The above description is only a preferred embodiment of the present application, and is only for the purpose of illustrating the technical solutions of the present application, and not for the purpose of limiting the present application. Any modification, equivalent replacement, improvement or the like, which would be obvious to one of ordinary skill in the art and would be within the spirit and principle of the present application, should be included within the scope of the present application.