[go: up one dir, main page]

CN109413405B - A data processing method, terminal, server and computer storage medium - Google Patents

A data processing method, terminal, server and computer storage medium Download PDF

Info

Publication number
CN109413405B
CN109413405B CN201811163283.6A CN201811163283A CN109413405B CN 109413405 B CN109413405 B CN 109413405B CN 201811163283 A CN201811163283 A CN 201811163283A CN 109413405 B CN109413405 B CN 109413405B
Authority
CN
China
Prior art keywords
video data
model
terminal
data
indication information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN201811163283.6A
Other languages
Chinese (zh)
Other versions
CN109413405A (en
Inventor
夏炀
李虎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN201811163283.6A priority Critical patent/CN109413405B/en
Publication of CN109413405A publication Critical patent/CN109413405A/en
Application granted granted Critical
Publication of CN109413405B publication Critical patent/CN109413405B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Mobile Radio Communication Systems (AREA)
  • Testing, Inspecting, Measuring Of Stereoscopic Televisions And Televisions (AREA)

Abstract

本发明实施例公开了一种数据处理方法、终端、服务器和计算机存储介质。所述方法包括:获得三维视频数据;检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算(MEC)服务器。

Figure 201811163283

The embodiments of the present invention disclose a data processing method, a terminal, a server and a computer storage medium. The method includes: obtaining three-dimensional video data; when detecting that a predetermined condition is met, storing the three-dimensional video data, processing the three-dimensional video data according to preset rules, and sending the processed three-dimensional video data to mobile edge computing (MEC) server.

Figure 201811163283

Description

一种数据处理方法、终端、服务器和计算机存储介质A data processing method, terminal, server and computer storage medium

技术领域technical field

本发明涉及数据处理技术,具体涉及一种数据处理方法、终端、服务器和计算机存储介质。The present invention relates to data processing technology, in particular to a data processing method, terminal, server and computer storage medium.

背景技术Background technique

随着移动通信网络的不断发展,移动通信网络的传输速率飞速提高,从而给三维视频业务的产生和发展提供了有力的技术支持。三维视频数据包括二维图像数据(例如RGB数据)和深度数据(Depth数据),在三维视频数据的传输过程中是需要分别二维视频数据和深度数据。然而,三维视频数据的数据采集量非常大,因此需要传输的数据量也非常大,数据传输过程中需要较高的技术支持,因此需要移动通信网络具有较快的数据传输速率,以及较稳定的数据传输环境。并且,由于数据量较大,移动边缘计算(MEC)服务器建模耗时很长。With the continuous development of the mobile communication network, the transmission rate of the mobile communication network is rapidly increasing, thus providing strong technical support for the generation and development of the 3D video service. The three-dimensional video data includes two-dimensional image data (eg, RGB data) and depth data (Depth data). In the transmission process of the three-dimensional video data, the two-dimensional video data and the depth data need to be separated. However, the data collection volume of 3D video data is very large, so the amount of data to be transmitted is also very large, and high technical support is required in the data transmission process, so the mobile communication network needs to have a fast data transmission rate and a relatively stable data transfer environment. Also, due to the large amount of data, the modeling of mobile edge computing (MEC) servers takes a long time.

发明内容SUMMARY OF THE INVENTION

为解决上述技术问题,本发明实施例提供了一种数据处理方法、终端、服务器和计算机存储介质。To solve the above technical problems, embodiments of the present invention provide a data processing method, a terminal, a server, and a computer storage medium.

本发明实施例提供了一种数据处理方法,应用于终端;所述方法包括:An embodiment of the present invention provides a data processing method, which is applied to a terminal; the method includes:

获得三维视频数据;Obtain 3D video data;

检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算MEC服务器。When it is detected that a predetermined condition is met, the 3D video data is stored, the 3D video data is processed according to a preset rule, and the processed 3D video data is sent to the mobile edge computing MEC server.

上述方案中,所述检测到满足预定条件,包括:检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。In the above solution, the detecting that the predetermined condition is met includes: detecting the transmission quality information of the communication channel with the MEC server, and determining that the predetermined condition is met when the transmission quality information does not meet the preset transmission standard.

上述方案中,所述按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算MEC服务器,包括:In the above scheme, the process of processing the 3D video data according to the preset rules and sending the processed 3D video data to the mobile edge computing MEC server includes:

按预设规则对所述三维视频数据进行分割处理,获得多个子数据,发送所述多个子数据至所述MEC服务器;或者,Perform segmentation processing on the 3D video data according to preset rules to obtain multiple sub-data, and send the multiple sub-data to the MEC server; or,

按预设规则对所述三维视频数据进行压缩处理,发送压缩处理后的所述三维视频数据至MEC服务器。The 3D video data is compressed according to a preset rule, and the compressed 3D video data is sent to the MEC server.

上述方案中所述方法还包括:接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;The method described in the above solution further includes: receiving first indication information from the MEC server; the first indication information is used to instruct the terminal to continue to transmit other 3D video data;

基于所述第一指示信息获得其他三维视频数据,向所述MEC服务器发送所述其他三维视频数据。Obtain other 3D video data based on the first indication information, and send the other 3D video data to the MEC server.

上述方案中,所述方法还包括:接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;In the above solution, the method further includes: receiving second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data;

基于所述第二指示信息重新发送所述三维视频数据。The three-dimensional video data is resent based on the second indication information.

本发明实施例还提供了一种数据处理方法,应用于MEC服务器;所述方法包括:接收来自终端的三维视频数据,基于所述三维视频数据建立初始模型;The embodiment of the present invention also provides a data processing method, which is applied to the MEC server; the method includes: receiving 3D video data from a terminal, and establishing an initial model based on the 3D video data;

将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;Matching the initial model with a model in a preset model set; the preset model set includes an overall model of a plurality of target objects;

基于匹配结果向所述终端发送指示信息。Send indication information to the terminal based on the matching result.

上述方案中,所述方法还包括:获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;In the above solution, the method further includes: obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target object;

基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。Establish an overall model of the target object based on the plurality of sample data; or, establish local models of different parts of the target object based on the plurality of sample data, and generate an overall model of different target objects based on the local models of different parts of the target object. .

上述方案中,所述基于匹配结果向所述终端发送指示信息,包括:In the above solution, the sending of indication information to the terminal based on the matching result includes:

当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。When the matching result is that the initial model matches the model in the preset model set, first indication information is sent to the terminal, where the first indication information is used to instruct the terminal to continue to transmit other 3D video data .

上述方案中,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,所述方法还包括:基于所述三维视频数据和所述模型建立对应于所述三维视频数据的第一模型。In the above solution, when the matching result is that the initial model matches the model in the preset model set, the method further includes: establishing a corresponding model corresponding to the three-dimensional video data based on the three-dimensional video data and the model the first model.

上述方案中,所述基于匹配结果向所述终端发送指示信息,包括:当所述匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。In the above solution, the sending indication information to the terminal based on the matching result includes: when the matching result is that the initial model does not match the model in the preset model set, sending a second indication to the terminal information, the second indication information is used to instruct the terminal to resend the 3D video data.

上述方案中,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,所述方法还包括:基于所述三维视频数据更新匹配的模型。In the above solution, when the matching result is that the initial model matches the model in the preset model set, the method further includes: updating the matched model based on the three-dimensional video data.

本发明实施例还提供了一种终端,所述终端包括:获取单元、检测单元、存储单元、处理单元和第一通讯单元;其中,An embodiment of the present invention further provides a terminal, where the terminal includes: an acquisition unit, a detection unit, a storage unit, a processing unit, and a first communication unit; wherein,

所述获取单元,用于获得三维视频数据;the obtaining unit, for obtaining three-dimensional video data;

所述检测单元,用于检测是否满足预定条件;The detection unit is used to detect whether a predetermined condition is met;

所述存储单元,用于所述检测单元检测到满足预定条件时,存储所述三维视频数据The storage unit is configured to store the three-dimensional video data when the detection unit detects that a predetermined condition is met

所述处理单元,用于所述检测单元检测到满足预定条件时,按预设规则对所述三维视频数据进行处理;the processing unit, configured to process the 3D video data according to a preset rule when the detection unit detects that a predetermined condition is met;

所述第一通讯单元,用于发送所述处理单元处理后的所述三维视频数据至MEC服务器。The first communication unit is configured to send the 3D video data processed by the processing unit to the MEC server.

上述方案中,所述检测单元,用于检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。In the above solution, the detection unit is configured to detect the transmission quality information of the communication channel with the MEC server, and when the transmission quality information does not meet the preset transmission standard, it is determined that the detection meets the predetermined condition.

上述方案中,所述处理单元,用于按预设规则对所述三维视频数据进行分割处理,获得多个子数据;In the above solution, the processing unit is configured to perform segmentation processing on the 3D video data according to a preset rule to obtain a plurality of sub-data;

所述第一通讯单元,用于发送所述多个子数据至所述MEC服务器;或者,the first communication unit, configured to send the plurality of sub-data to the MEC server; or,

所述处理单元,用于按预设规则对所述三维视频数据进行压缩处理;the processing unit, configured to compress the three-dimensional video data according to a preset rule;

所述第一通讯单元,用于发送压缩处理后的所述三维视频数据至MEC服务器。The first communication unit is used for sending the compressed three-dimensional video data to the MEC server.

上述方案中,所述第一通讯单元,还用于接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;In the above solution, the first communication unit is further configured to receive first indication information from the MEC server; the first indication information is used to instruct the terminal to continue transmitting other 3D video data;

所述获取单元,还用于基于所述第一指示信息获得其他三维视频数据;The obtaining unit is further configured to obtain other three-dimensional video data based on the first indication information;

所述第一通讯单元,还用于向所述MEC服务器发送所述其他三维视频数据。The first communication unit is further configured to send the other three-dimensional video data to the MEC server.

上述方案中,所述第一通讯单元,还用于接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;In the above solution, the first communication unit is further configured to receive second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data;

所述第一通讯单元,还用于基于所述第二指示信息重新发送所述存储单元存储的所述三维视频数据。The first communication unit is further configured to resend the three-dimensional video data stored in the storage unit based on the second indication information.

本发明实施例还提供了一种MEC服务器,所述服务器包括第二通讯单元、建模单元和匹配单元;其中,An embodiment of the present invention further provides an MEC server, where the server includes a second communication unit, a modeling unit, and a matching unit; wherein,

所述第二通讯单元,用于接收来自终端的三维视频数据;the second communication unit for receiving 3D video data from the terminal;

所述建模单元,用于基于所述第二通讯单元接收的所述三维视频数据建立初始模型;the modeling unit, configured to establish an initial model based on the three-dimensional video data received by the second communication unit;

所述匹配单元,用于将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;The matching unit is used to match the initial model with the models in the preset model set; the preset model set includes the overall model of a plurality of target objects;

所述第二通讯单元,还用于基于匹配单元获得的匹配结果向所述终端发送指示信息。The second communication unit is further configured to send indication information to the terminal based on the matching result obtained by the matching unit.

上述方案中,所述建模单元,还用于获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。In the above solution, the modeling unit is also used to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target object; establishing an overall model of the target object based on the plurality of sample data; or, establishing local models of different parts of the target object based on the plurality of sample data, and generating an overall model of different target objects based on the local models of different parts of the different target objects.

上述方案中,所述第二通讯单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。In the above solution, the second communication unit is further configured to send the first indication information to the terminal when the matching result obtained by the matching unit is that the initial model matches the model in the preset model set, The first indication information is used to instruct the terminal to continue to transmit other three-dimensional video data.

上述方案中,所述建模单元,还用于当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据和所述模型建立对应于所述三维视频数据的第一模型。In the above solution, the modeling unit is further configured to, when the matching result is that the initial model matches a model in a preset model set, create a model corresponding to the model based on the three-dimensional video data and the model. A first model of 3D video data.

上述方案中,所述第二通讯单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。In the above solution, the second communication unit is further configured to send second indication information to the terminal when the matching result obtained by the matching unit is that the initial model does not match the model in the preset model set , the second indication information is used to instruct the terminal to resend the 3D video data.

上述方案中,所述建模单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据更新匹配的模型。In the above solution, the modeling unit is further configured to update the matched model based on the 3D video data when the matching result obtained by the matching unit is that the initial model matches the model in the preset model set.

本发明实施例还提供了一种计算机存储介质,其上存储有计算机指令,该指令被处理器执行时实现本发明实施例所述的应用于终端的数据处理方法的步骤;或者,该指令被处理器执行时实现本发明实施例所述的应用于MEC服务器的数据处理方法的步骤。The embodiments of the present invention further provide a computer storage medium, which stores computer instructions, and when the instructions are executed by the processor, implements the steps of the data processing method applied to the terminal described in the embodiments of the present invention; or, the instructions are When executed by the processor, the steps of the data processing method applied to the MEC server according to the embodiment of the present invention are implemented.

本发明实施例还提供了一种终端,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本发明实施例所述的应用于终端的数据处理方法的步骤。An embodiment of the present invention further provides a terminal, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the application described in the embodiment of the present invention when the processor executes the program The steps of the data processing method for the terminal.

本发明实施例还提供了一种MEC服务器,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述程序时实现本发明实施例所述的应用于MEC服务器的数据处理方法的步骤。An embodiment of the present invention further provides an MEC server, including a memory, a processor, and a computer program stored in the memory and running on the processor, where the processor implements the method described in the embodiments of the present invention when the processor executes the program. Steps of the data processing method applied to the MEC server.

本发明实施例还提供了一种芯片,包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有所述芯片的设备执行本发明实施例所述的应用于终端的数据处理方法的步骤;或者,执行本发明实施例所述的应用于MEC服务器的数据处理方法的步骤。An embodiment of the present invention further provides a chip, including: a processor for calling and running a computer program from a memory, so that a device installed with the chip executes the data processing method applied to a terminal according to the embodiment of the present invention or, perform the steps of the data processing method applied to the MEC server according to the embodiment of the present invention.

本发明实施例还提供了一种计算机程序产品,包括计算机程序指令,该计算机程序指令使得计算机执行本发明实施例所述的应用于终端的数据处理方法的步骤;或者,该计算机程序指令使得计算机执行本发明实施例所述的应用于MEC服务器的数据处理方法的步骤。The embodiments of the present invention further provide a computer program product, including computer program instructions, the computer program instructions cause the computer to execute the steps of the data processing method applied to the terminal described in the embodiments of the present invention; or, the computer program instructions cause the computer The steps of the data processing method applied to the MEC server according to the embodiment of the present invention are executed.

本发明实施例还提供了一种计算机程序,所述计算机程序使得计算机执行本发明实施例所述的应用于终端的数据处理方法的步骤;或者,所述计算机程序使得计算机执行本发明实施例所述的应用于MEC服务器的数据处理方法的步骤。The embodiment of the present invention further provides a computer program, the computer program causes the computer to execute the steps of the data processing method applied to the terminal described in the embodiment of the present invention; or, the computer program causes the computer to execute the steps of the embodiment of the present invention. The steps of the described data processing method applied to the MEC server.

本发明实施例提供了的数据处理方法、终端、服务器和计算机存储介质,应用于终端的方法包括:获得三维视频数据;检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至MEC服务器。应用于MEC服务器的方法包括:接收来自终端的三维视频数据,基于所述三维视频数据建立初始模型;将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;基于匹配结果向所述终端发送指示信息。采用本发明实施例的技术方案,通过服务器中预置的多个目标对象的整体模型,一方面服务器可基于获得的一帧三维视频数据便可与预置的模型进行匹配,可基于匹配的模型快速建立目标对象的模型,大大缩短了建模耗时;另一方面由于服务器中预置了模型,因此降低了数据传输过程中所需要的技术支持的要求,即可以不需要较快的数据传输速率以及稳定的数据传输环境,适用于各种通信场景;另外,由于服务器中预置了模型,因此也可以无需传输终端采集的全部三维视频数据进行建模,在一定程度上也减少了需要传输的数据量。并且,本实施例通过终端存储发出的三维视频数据,适用于满足预定条件(例如传输质量不佳)的场景。The data processing method, terminal, server, and computer storage medium provided by the embodiments of the present invention, the method applied to the terminal includes: obtaining three-dimensional video data; when detecting that a predetermined condition is met, storing the three-dimensional video data, and processing the three-dimensional video data according to a preset rule. The 3D video data is processed and the processed 3D video data is sent to the MEC server. The method applied to the MEC server includes: receiving three-dimensional video data from a terminal, and establishing an initial model based on the three-dimensional video data; matching the initial model with a model in a preset model set; an overall model including a plurality of target objects; and sending indication information to the terminal based on the matching result. By adopting the technical solution of the embodiment of the present invention, through the overall models of multiple target objects preset in the server, on the one hand, the server can match the preset model based on one frame of 3D video data obtained, and can match the model based on the matching model. Quickly build the model of the target object, which greatly shortens the modeling time; on the other hand, because the model is preset in the server, the requirements for technical support in the data transmission process are reduced, that is, faster data transmission is not required. The speed and stable data transmission environment are suitable for various communication scenarios; in addition, because the model is preset in the server, it is also possible to model without transmitting all the 3D video data collected by the terminal, which also reduces the need for transmission to a certain extent. amount of data. In addition, this embodiment stores the 3D video data sent by the terminal, and is suitable for scenarios that meet predetermined conditions (eg, poor transmission quality).

附图说明Description of drawings

图1为本发明实施例的数据处理方法应用的系统架构示意图;1 is a schematic diagram of a system architecture to which a data processing method according to an embodiment of the present invention is applied;

图2为本发明实施例的数据处理方法的流程示意图一;2 is a schematic flowchart 1 of a data processing method according to an embodiment of the present invention;

图3为本发明实施例的数据处理方法的流程示意图二;3 is a second schematic flowchart of a data processing method according to an embodiment of the present invention;

图4为本发明实施例的数据处理方法的流程示意图三;4 is a third schematic flowchart of a data processing method according to an embodiment of the present invention;

图5为本发明实施例的数据处理方法的流程示意图四;5 is a fourth schematic flowchart of a data processing method according to an embodiment of the present invention;

图6为本发明实施例的数据处理方法的流程示意图五;FIG. 6 is a schematic flowchart 5 of a data processing method according to an embodiment of the present invention;

图7为本发明实施例的终端的一种组成结构示意图;7 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present invention;

图8为本发明实施例的服务器的一种组成结构示意图;8 is a schematic diagram of a composition structure of a server according to an embodiment of the present invention;

图9为本发明实施例的数据处理设备的硬件组成结构示意图。FIG. 9 is a schematic structural diagram of a hardware composition of a data processing device according to an embodiment of the present invention.

具体实施方式Detailed ways

在对本发明实施例的技术方案进行详细说明之前,首先对本发明实施例的数据处理方法应用的系统架构进行简单说明。本发明实施例的数据处理方法应用于三维视频数据的相关业务,该业务例如是三维视频数据分享的业务,或者基于三维视频数据的直播业务等等。在这种情况下,由于三维视频数据的数据量较大,分别传输的深度数据和二维视频数据在数据传输过程中需要较高的技术支持,因此需要移动通信网络具有较快的数据传输速率,以及较稳定的数据传输环境。Before the technical solutions of the embodiments of the present invention are described in detail, the system architecture to which the data processing methods of the embodiments of the present invention are applied is briefly described first. The data processing method of the embodiment of the present invention is applied to a service related to 3D video data, such as a service of sharing 3D video data, or a live broadcast service based on 3D video data, and the like. In this case, due to the large amount of 3D video data, the depth data and 2D video data transmitted respectively require high technical support in the data transmission process, so the mobile communication network needs to have a faster data transmission rate , and a more stable data transmission environment.

图1为本发明实施例的数据处理方法应用的系统架构示意图;如图1所示,系统可包括终端、基站、MEC服务器、业务处理服务器、核心网和互联网(Internet)等;MEC服务器与业务处理服务器之间通过核心网建立高速通道以实现数据同步。FIG. 1 is a schematic diagram of a system architecture of an application of a data processing method according to an embodiment of the present invention; as shown in FIG. 1 , the system may include a terminal, a base station, an MEC server, a service processing server, a core network, and the Internet (Internet), etc.; the MEC server and the service A high-speed channel is established between the processing servers through the core network to achieve data synchronization.

以图1所示的两个终端交互的应用场景为例,MEC服务器A为部署于靠近终端A(发送端)的MEC服务器,核心网A为终端A所在区域的核心网;相应的,MEC服务器B为部署于靠近终端B(接收端)的MEC服务器,核心网B为终端B所在区域的核心网;MEC服务器A和MEC服务器B可与业务处理服务器之间分别通过核心网A和核心网B建立高速通道以实现数据同步。Taking the application scenario of the interaction between two terminals shown in Figure 1 as an example, the MEC server A is the MEC server deployed near the terminal A (sender), and the core network A is the core network in the area where the terminal A is located; correspondingly, the MEC server B is the MEC server deployed near the terminal B (receiving end), and the core network B is the core network in the area where the terminal B is located; Establish high-speed channels for data synchronization.

其中,终端A发送的三维视频数据传输到MEC服务器A后,由MEC服务器A通过核心网A将数据同步至业务处理服务器;再由MEC服务器B从业务处理服务器获取终端A发送的三维视频数据,并发送至终端B进行呈现。Wherein, after the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A synchronizes the data to the service processing server through core network A; and then MEC server B obtains the 3D video data sent by terminal A from the service processing server, and sent to terminal B for presentation.

这里,如果终端B与终端A通过同一个MEC服务器来实现传输,此时终端B和终端A直接通过一个MEC服务器实现三维视频数据的传输,不需要业务处理服务器的参与,这种方式称为本地回传方式。具体地,假设终端B与终端A通过MEC服务器A实现三维视频数据的传输,终端A发送的三维视频数据传输到MEC服务器A后,由MEC服务器A发送三维视频数据至终端B进行呈现。Here, if terminal B and terminal A realize transmission through the same MEC server, then terminal B and terminal A directly realize the transmission of 3D video data through an MEC server without the participation of the service processing server. This method is called local return method. Specifically, it is assumed that terminal B and terminal A transmit 3D video data through MEC server A. After the 3D video data sent by terminal A is transmitted to MEC server A, MEC server A sends the 3D video data to terminal B for presentation.

这里,终端可基于网络情况、或者终端自身的配置情况、或者自身配置的算法选择接入4G网络的演进型基站(eNB),或者接入5G网络的下一代演进型基站(gNB),从而使得eNB通过长期演进(Long Term Evolution,LTE)接入网与MEC服务器连接,使得gNB通过下一代接入网(NG-RAN)与MEC服务器连接。Here, the terminal may select an evolved base station (eNB) to access the 4G network, or a next-generation evolved base station (gNB) to access the 5G network based on the network conditions, or the configuration of the terminal itself, or an algorithm configured by itself, so that the The eNB is connected to the MEC server through a Long Term Evolution (Long Term Evolution, LTE) access network, so that the gNB is connected to the MEC server through a Next Generation Access Network (NG-RAN).

这里,MEC服务器部署于靠近终端或数据源头的网络边缘侧,所谓靠近终端或者靠近数据源头,不仅是逻辑位置上,还在地理位置上靠近终端或者靠近数据源头。区别于现有的移动通信网络中主要的业务处理服务器部署于几个大城市中,MEC服务器可在一个城市中部署多个。例如在某写字楼中,用户较多,则可在该写字楼附近部署一个MEC服务器。Here, the MEC server is deployed on the edge of the network close to the terminal or data source. The so-called close to the terminal or close to the data source is not only logically located, but also geographically close to the terminal or close to the data source. Different from the existing mobile communication network where the main service processing servers are deployed in several large cities, multiple MEC servers can be deployed in one city. For example, in an office building with many users, an MEC server can be deployed near the office building.

其中,MEC服务器作为具有融合网络、计算、存储、应用核心能力的边缘计算网关,为边缘计算提供包括设备域、网络域、数据域和应用域的平台支撑。其联接各类智能设备和传感器,就近提供智能联接和数据处理业务,让不同类型的应用和数据在MEC服务器中进行处理,实现业务实时、业务智能、数据聚合与互操作、安全与隐私保护等关键智能服务,有效提升业务的智能决策效率。Among them, the MEC server, as an edge computing gateway with core capabilities of integrating network, computing, storage and application, provides platform support for edge computing including device domain, network domain, data domain and application domain. It connects various smart devices and sensors, provides smart connection and data processing services nearby, and allows different types of applications and data to be processed in the MEC server to achieve real-time business, business intelligence, data aggregation and interoperability, security and privacy protection, etc. Key intelligent services can effectively improve the efficiency of intelligent business decision-making.

本发明实施例提供了一种数据处理方法,应用于终端中,终端可以是例如手机、平板电脑等移动终端,也可以是电脑等类型的终端。图2为本发明实施例的数据处理方法的流程示意图一;如图2所示,所述方法包括:An embodiment of the present invention provides a data processing method, which is applied to a terminal, and the terminal may be a mobile terminal such as a mobile phone and a tablet computer, or a terminal of a type such as a computer. FIG. 2 is a schematic flowchart 1 of a data processing method according to an embodiment of the present invention; as shown in FIG. 2 , the method includes:

步骤101:获得三维视频数据。Step 101: Obtain three-dimensional video data.

步骤102:检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算MEC服务器。Step 102 : when it is detected that a predetermined condition is met, store the 3D video data, process the 3D video data according to preset rules, and send the processed 3D video data to the mobile edge computing MEC server.

本实施例中,作为一种实施方式,所述获得三维视频数据,包括:所述终端从至少能够采集深度数据的采集组件获得三维视频数据;所述采集组件能够与至少一个终端建立通信链路以使对应终端获得所述三维视频数据。In this embodiment, as an implementation manner, the obtaining of 3D video data includes: the terminal obtains 3D video data from a collection component capable of collecting at least depth data; the collection component can establish a communication link with at least one terminal so that the corresponding terminal obtains the three-dimensional video data.

具体的,本实施方式中,由于能够采集深度数据的采集组件相对比较昂贵,终端并不具备三维视频数据的采集功能,而是通过独立于终端的采集组件采集三维视频数据,再通过采集组件和终端中的通信组件建立通信链路,使得终端获得采集组件采集的三维视频数据。其中,所述采集组件具体可通过以下至少之一实现:深度摄像头、双目摄像头、3D结构光摄像模组、飞行时间(TOF,Time Of Flight)摄像模组。Specifically, in this embodiment, since the acquisition component capable of collecting depth data is relatively expensive, the terminal does not have the acquisition function of 3D video data, but collects 3D video data through the acquisition component independent of the terminal, and then collects the 3D video data through the acquisition component and The communication component in the terminal establishes a communication link, so that the terminal obtains the three-dimensional video data collected by the collecting component. Wherein, the acquisition component can be specifically implemented by at least one of the following: a depth camera, a binocular camera, a 3D structured light camera module, and a Time Of Flight (TOF, Time Of Flight) camera module.

这里,采集组件能够与至少一个终端建立通信链路以将采集得到的三维视频数据传输至所述至少一个终端,以使对应终端获得三维视频数据,这样能够实现一个采集组件采集的三维视频数据共享给至少一个终端,从而实现采集组件的共享。Here, the collection component can establish a communication link with at least one terminal to transmit the collected 3D video data to the at least one terminal, so that the corresponding terminal can obtain the 3D video data, so that the 3D video data collected by one collection component can be shared. To at least one terminal, so as to realize the sharing of acquisition components.

作为另一种实施方式,终端自身具备三维视频数据的采集功能,可以理解,终端设置有至少能够采集深度数据的采集组件,例如设置有以下组件至少之一:深度摄像头、双目摄像头、3D结构光摄像模组、TOF摄像模组,以采集三维视频数据。As another embodiment, the terminal itself has the function of collecting 3D video data. It can be understood that the terminal is provided with a collection component capable of collecting depth data at least, for example, at least one of the following components is provided: a depth camera, a binocular camera, a 3D structure Optical camera module and TOF camera module to collect 3D video data.

其中,获得的三维视频数据包括二维视频数据和深度数据;所述二维视频数据用于表征平面图像,例如可以是RGB数据;深度数据表征采集组件所针对的采集对象的表面与采集组件之间的距离。Wherein, the obtained three-dimensional video data includes two-dimensional video data and depth data; the two-dimensional video data is used to represent a plane image, such as RGB data; distance between.

本实施例中,所述检测到满足预定条件,包括:检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。In this embodiment, the detecting that the predetermined condition is met includes: detecting the transmission quality information of the communication channel with the MEC server, and determining that the predetermined condition is met when the transmission quality information does not meet the preset transmission standard.

这里,所述传输质量信息包括传输速率和/或丢包率;当所述传输速率低于第一预设阈值时,可表明传输质量信息未达到预设传输标准;和/或,当丢包率高于第二预设阈值时,也可以表明传输质量信息未达到预设传输标准。Here, the transmission quality information includes the transmission rate and/or the packet loss rate; when the transmission rate is lower than the first preset threshold, it may indicate that the transmission quality information does not meet the preset transmission standard; and/or, when the packet loss When the rate is higher than the second preset threshold, it may also indicate that the transmission quality information does not meet the preset transmission standard.

本实施例适用于终端与MEC服务器之间的通信通道质量不佳的应用场景,即通信通道的传输速率和/或传输稳定性不满足预设条件的场景,例如,通信通道的传输速率低于第一预设阈值,数据传输的丢包率高于第二预设阈值。在这种低速和/或高延迟的场景下,终端一方面对三维视频数据进行处理后传输处理后的三维视频数据,另一方面本地存储三维视频数据,以便于在三维视频数据传输过程中出现错误,可重新传输存储的三维视频数据。This embodiment is applicable to the application scenario where the quality of the communication channel between the terminal and the MEC server is poor, that is, the scenario where the transmission rate and/or transmission stability of the communication channel do not meet the preset conditions, for example, the transmission rate of the communication channel is lower than The first preset threshold, the packet loss rate of data transmission is higher than the second preset threshold. In such a low-speed and/or high-latency scenario, the terminal processes the 3D video data and transmits the processed 3D video data on the one hand, and stores the 3D video data locally on the other hand, so that the 3D video data can appear during the transmission of the 3D video data. error, the stored 3D video data can be retransmitted.

作为一种实施方式,所述按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算MEC服务器,包括:按预设规则对所述三维视频数据进行分割处理,获得多个子数据,发送所述多个子数据至所述MEC服务器;或者,按预设规则对所述三维视频数据进行压缩处理,发送压缩处理后的所述三维视频数据至MEC服务器。As an embodiment, the processing the 3D video data according to preset rules and sending the processed 3D video data to the mobile edge computing MEC server includes: processing the 3D video data according to preset rules. Segmentation processing, obtaining multiple sub-data, and sending the multiple sub-data to the MEC server; or, performing compression processing on the 3D video data according to a preset rule, and sending the compressed 3D video data to the MEC server.

本实施例中,由于通信通道的传输质量不佳(未达到预设传输标准),则在发出待传输的三维视频数据之前,对三维视频数据进行处理,以减小传输的数据量。作为一种实施方式,可与对三维视频数据进行分割处理,获得多个子数据;在每次传输时传输一个子数据,从而能够满足当前通信通道的传输质量,通过减小数据传输量以保证数据的成功传输。这里,作为一种示例,对三维视频数据进行分割可以是按照区域进行分割,即每个子数据对应于一个区域的二维视频数据和深度数据。作为另一种实施方式,还可以按照预设压缩算法对三维视频数据进行压缩处理,从而减少三维视频数据的数据量。In this embodiment, since the transmission quality of the communication channel is not good (the preset transmission standard is not met), before sending the 3D video data to be transmitted, the 3D video data is processed to reduce the amount of transmitted data. As an embodiment, the 3D video data can be divided and processed to obtain multiple sub-data; one sub-data is transmitted in each transmission, so as to satisfy the transmission quality of the current communication channel, and the data transmission volume can be reduced to ensure the data of successful transmission. Here, as an example, the segmentation of the three-dimensional video data may be performed by regions, that is, each sub-data corresponds to two-dimensional video data and depth data of one region. As another implementation manner, the 3D video data may also be compressed according to a preset compression algorithm, thereby reducing the data amount of the 3D video data.

在一实施例中,如图3所示,所述方法还包括:In one embodiment, as shown in FIG. 3 , the method further includes:

步骤103a:接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;基于所述第一指示信息获得其他三维视频数据,向所述MEC服务器发送所述其他三维视频数据。Step 103a: Receive first indication information from the MEC server; the first indication information is used to instruct the terminal to continue to transmit other 3D video data; obtain other 3D video data based on the first indication information, and send it to the The MEC server sends the other three-dimensional video data.

本实施例中,若MEC服务器基于第一数据建模成功,也即成功建立模型,则向终端发送第一指示信息,第一指示信息表明在先传输的三维视频数据建模成功,可继续采集并传输其他三维视频数据。In this embodiment, if the MEC server succeeds in modeling based on the first data, that is, the model is successfully established, the MEC server sends first indication information to the terminal. The first indication information indicates that the previously transmitted 3D video data has been successfully modeled, and the collection can continue. And transmit other 3D video data.

在一实施例中,如图3所示,所述方法还包括:In one embodiment, as shown in FIG. 3 , the method further includes:

步骤103b:接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;基于所述第二指示信息重新发送所述三维视频数据。Step 103b: Receive second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data; and based on the second indication information, resend the 3D video data.

本实施例中,若MEC服务器基于三维视频数据建模未成功,则向终端发送第二指示信息,第二指示信息表明在先传输的三维视频数据不能够成功建模,需要重新传输存储的三维视频数据。In this embodiment, if the modeling based on the 3D video data is unsuccessful, the MEC server sends second indication information to the terminal. The second indication information indicates that the previously transmitted 3D video data cannot be successfully modeled, and the stored 3D video data needs to be retransmitted. video data.

实际应用中,可基于终端的存储能力决定存储的数据量;可以理解,在接收到MEC服务器的第一指示信息后,可基于终端的存储能力决定是否删除已存储的三维视频数据。作为一种实施方式,可在接收到第一指示信息后,删除已存储的三维视频数据。作为另一种实施方式,可检测终端的剩余存储空间;若剩余存储空间小于预设阈值时,可按照三维视频数据的存储时间的先后顺序删除已存储的三维视频数据。In practical applications, the amount of stored data can be determined based on the storage capability of the terminal; it can be understood that after receiving the first indication information from the MEC server, it can be determined whether to delete the stored 3D video data based on the storage capability of the terminal. As an implementation manner, after receiving the first indication information, the stored 3D video data may be deleted. As another implementation manner, the remaining storage space of the terminal can be detected; if the remaining storage space is less than a preset threshold, the stored 3D video data can be deleted in the order of storage time of the 3D video data.

采用本发明实施例的技术方案,通过服务器中预置的多个目标对象的整体模型,一方面服务器可基于获得的一帧三维视频数据便可与预置的模型进行匹配,可基于匹配的模型快速建立目标对象的模型,大大缩短了建模耗时;另一方面由于服务器中预置了模型,因此降低了数据传输过程中所需要的技术支持的要求,即可以不需要较快的数据传输速率以及稳定的数据传输环境,适用于各种通信场景;另外,由于服务器中预置了模型,因此也可以无需传输终端采集的全部三维视频数据进行建模,在一定程度上也减少了需要传输的数据量。并且,本实施例通过终端存储发出的三维视频数据,适用于满足预定条件(例如传输质量不佳)的场景。By adopting the technical solution of the embodiment of the present invention, through the overall models of multiple target objects preset in the server, on the one hand, the server can match the preset model based on one frame of 3D video data obtained, and can match the model based on the matching model. Quickly build the model of the target object, which greatly shortens the modeling time; on the other hand, because the model is preset in the server, the requirements for technical support in the data transmission process are reduced, that is, faster data transmission is not required. The speed and stable data transmission environment are suitable for various communication scenarios; in addition, because the model is preset in the server, it is also possible to model without transmitting all the 3D video data collected by the terminal, which also reduces the need for transmission to a certain extent. amount of data. In addition, this embodiment stores the 3D video data sent by the terminal, and is suitable for scenarios that meet predetermined conditions (eg, poor transmission quality).

本发明实施例还提供了一种数据处理方法,应用于服务器,该服务器具体为图1中所示的MEC服务器。图4为本发明实施例的数据处理方法的流程示意图三;如图4所示,所述方法包括:An embodiment of the present invention further provides a data processing method, which is applied to a server, and the server is specifically the MEC server shown in FIG. 1 . FIG. 4 is a third schematic flowchart of a data processing method according to an embodiment of the present invention; as shown in FIG. 4 , the method includes:

步骤201:接收来自终端的三维视频数据,基于所述三维视频数据建立初始模型。Step 201: Receive 3D video data from a terminal, and establish an initial model based on the 3D video data.

步骤202:将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型。Step 202 : Match the initial model with a model in a preset model set; the preset model set includes overall models of multiple target objects.

步骤203:基于匹配结果向所述终端发送指示信息。Step 203: Send indication information to the terminal based on the matching result.

本实施例中,作为一种实施方式,接收的三维视频数据包括二维视频数据和深度数据;作为另一种实施方式,接收的三维视频数据中也可仅包括深度数据。则服务器基于接收到三维视频数据中的深度数据进行建模,获得初始模型。In this embodiment, as an implementation, the received three-dimensional video data includes two-dimensional video data and depth data; as another implementation, the received three-dimensional video data may also include only depth data. Then, the server performs modeling based on the depth data in the received 3D video data to obtain an initial model.

本实施例中,服务器预先设置了模型集合,模型集合中包括多个目标对象的整体模型。其中,目标对象可以是真实人物、虚拟人物、真实动物、虚拟动物等等,本实施例中不针对目标对象的类别进行限定。实际应用中,模型集合中可包括多个子模型集合,每个子模型集合可针对一种类别的目标对象。例如,针对真实人物预先设置有对应的一个子模型集合;针对某一类的真实动物,例如狗,可预先设置有对应的一个子模型集合等等。In this embodiment, the server presets a model set, and the model set includes the overall models of multiple target objects. Wherein, the target object may be a real person, a virtual person, a real animal, a virtual animal, etc., and the category of the target object is not limited in this embodiment. In practical applications, the model set may include multiple sub-model sets, and each sub-model set may target a type of target object. For example, a corresponding sub-model set may be preset for a real person; a corresponding sub-model set may be preset for a certain type of real animal, such as a dog, and so on.

在一实施例中,如图5所示,所述方法还包括:In one embodiment, as shown in FIG. 5 , the method further includes:

步骤204:获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据。Step 204: Obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target object.

步骤205:基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。Step 205 : establishing an overall model of the target object based on the plurality of sample data; or, establishing local models of different parts of the target object based on the plurality of sample data, and generating different target objects based on the local models of different parts of the different target objects the overall model.

本实施例中,服务器根据获得的多个样本数据建立整体模型。作为第一种实施方式,获得的样本数据为对应于目标对象的整体数据。例如目标对象为真实人物,则样本数据为真实人物的整体数据。作为另一种实施方式,获得的样本数据为对应于目标对象的不同部位的局部数据。例如目标对象为真实人物,该真实人物可包括头部区域、躯干区域(躯干区域还可以具体划分为肩部区域、胸部区域和腰部区域等等)和四肢区域(四肢区域还可以具体划分为手臂区域、手部区域、腿部区域和脚部区域等等)等等,则样本数据可以是针对真实人物的上述不同部位的局部区域。In this embodiment, the server establishes an overall model according to the obtained multiple sample data. As a first embodiment, the obtained sample data is overall data corresponding to the target object. For example, if the target object is a real person, the sample data is the overall data of the real person. As another implementation manner, the obtained sample data is local data corresponding to different parts of the target object. For example, the target object is a real person, and the real person may include a head area, a torso area (the torso area can also be specifically divided into a shoulder area, a chest area, a waist area, etc.) and a limb area (the limb area can also be specifically divided into arms area, hand area, leg area, foot area, etc.), etc.), the sample data may be local areas for the above-mentioned different parts of a real person.

需要说明的是,本实施例的多个样本数据对应于不同的目标对象,甚至对应于不同的目标对象的不同的部位;可以理解,本实施例中针对不同的目标对象建立整体模型。It should be noted that the plurality of sample data in this embodiment correspond to different target objects, and even correspond to different parts of different target objects; it can be understood that an overall model is established for different target objects in this embodiment.

作为一种实施方式,当样本数据为对应于目标对象的整体数据时,则基于该整体数据建立对应的目标对象的整体模型。As an implementation manner, when the sample data is overall data corresponding to the target object, an overall model of the corresponding target object is established based on the overall data.

作为另一种实施方式,当样本数据为对应于目标对象的不同部位的局部数据时,则基于该局部数据建立对应的目标对象的局部模型;进一步可基于不同的目标对象的不同部位的局部模型进行排列组合,例如获得的目标对象A的局部模型a1和局部模型a2;获得目标对象B的局部模型b1和局部模型b2,则一方面可基于局部模型a1和局部模型a2建立目标对象A的整体模型,基于局部模型b1和局部模型b2建立目标对象B的整体模型,另一方面还可基于局部模型a1和局部模型b2建立一个整体模型,基于局部模型b1和局部模型a2建立另一个整体模型。本实施例可基于局部模型获得更多数量的目标对象的整体模型,从而有助于模型匹配。As another implementation, when the sample data is local data corresponding to different parts of the target object, a local model of the corresponding target object is established based on the local data; further, the local models of different parts of the target object can be based on For example, the local model a1 and local model a2 of target object A are obtained; the local model b1 and local model b2 of target object B are obtained, on the one hand, the overall target object A can be established based on the local model a1 and local model a2. model, based on the local model b1 and the local model b2 to establish the overall model of the target object B, on the other hand, it can also establish an overall model based on the local model a1 and the local model b2, and establish another overall model based on the local model b1 and the local model a2. In this embodiment, a larger number of overall models of the target object can be obtained based on the local models, thereby facilitating model matching.

本实施例中,样本数据可仅包括深度数据;或者也可以包括深度数据和二维视频数据。任何可建立三维模型的数据均在本发明实施例的保护范围之内。In this embodiment, the sample data may only include depth data; or may also include depth data and two-dimensional video data. Any data that can build a three-dimensional model falls within the protection scope of the embodiments of the present invention.

可以理解,步骤204和步骤205在步骤202之前执行,也即在将所述初始模型与预置的模型集合中的模型进行匹配之前,进行模型集合中的整体模型的建立。It can be understood that steps 204 and 205 are performed before step 202, that is, before the initial model is matched with the models in the preset model set, the establishment of the overall model in the model set is performed.

本实施例中,服务器将所述初始模型与预置的模型集合中模型进行匹配。In this embodiment, the server matches the initial model with the model in the preset model set.

作为一种实施方式,服务器将初始模型与预置的模型集合中的整体模型进行匹配。本实施例适用于接收的三维视频数据为对应于目标对象的整体数据的场景,即作为一种示例,终端将采集的对应于目标对象整体的三维视频数据全部传输至服务器,则服务器接收到的三维视频数据为对应于目标对象整体的三维视频数据,服务器基于三维视频数据建立的初始模型为对应于目标对象整体的初始模型。As an embodiment, the server matches the initial model with the overall model in the preset model set. This embodiment is applicable to a scenario where the received 3D video data is the overall data corresponding to the target object, that is, as an example, if the terminal transmits all the collected 3D video data corresponding to the entire target object to the server, the server receives The three-dimensional video data is the three-dimensional video data corresponding to the entirety of the target object, and the initial model established by the server based on the three-dimensional video data is the initial model corresponding to the entirety of the target object.

作为另一种实施方式,服务器将初始模型与预置的模型集合中的组成整体模型的局部模型进行匹配。本实施例适用于接收的三维视频数据为对应于目标对象的部位的局部数据的场景,即作为一种示例,终端将采集的对应于目标对象的各部位的三维视频数据分别传输至服务器,则服务器需要将接收到的对应于各部位的三维视频数据进行分别建模处理,即这里获得的初始模型为对应于目标对象的各部位的初始模型。As another implementation manner, the server matches the initial model with the partial models constituting the overall model in the preset model set. This embodiment is applicable to a scene in which the received 3D video data is local data corresponding to the parts of the target object, that is, as an example, the terminal transmits the collected 3D video data corresponding to each part of the target object to the server respectively, then The server needs to separately model the received 3D video data corresponding to each part, that is, the initial model obtained here is the initial model corresponding to each part of the target object.

本实施例中,所述将所述初始模型与预置的模型集合中的模型进行匹配,包括:提取所述初始模型的特征参数,将所述初始模型的特征参数与所述模型集合中的模型的特征参数进行匹配,获得匹配率。In this embodiment, the matching of the initial model with the models in the preset model set includes: extracting characteristic parameters of the initial model, and matching the characteristic parameters of the initial model with the models in the model set The feature parameters of the model are matched to obtain the matching rate.

具体的,无论是对应于目标对象整体的初始模型,或是对应于目标对象的各部位的初始模型,在进行初始模型与预置的模型集合中的模型进行匹配过程中,作为一种实施方式,提取所述初始模型的特征参数,将提取出的特征参数与模型集合中的各模型的特征参数进行匹配;若提取出的特征参数与某一模型的特征参数的匹配率超过预设阈值,则可表明匹配成功;相应的,若提取出的特征参数与模型集合中的任一模型的特征参数的匹配率均未超过预设阈值,则可表明匹配失败。其中,特征参数具体可以是表征轮廓特征点和/或骨骼关键点的参数。Specifically, whether it is an initial model corresponding to the entire target object or an initial model corresponding to each part of the target object, in the process of matching the initial model with the models in the preset model set, as an implementation manner , extract the characteristic parameters of the initial model, and match the extracted characteristic parameters with the characteristic parameters of each model in the model set; if the matching rate between the extracted characteristic parameters and the characteristic parameters of a certain model exceeds a preset threshold, It can indicate that the matching is successful; correspondingly, if the matching rate between the extracted feature parameter and the feature parameter of any model in the model set does not exceed the preset threshold, it can indicate that the matching fails. The feature parameters may specifically be parameters representing contour feature points and/or bone key points.

在一实施例中,如图6所示,所述方法还包括:In one embodiment, as shown in FIG. 6 , the method further includes:

步骤203a:当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。Step 203a: when the matching result is that the initial model matches the model in the preset model set, send first indication information to the terminal, where the first indication information is used to instruct the terminal to continue to transmit other 3D video data.

本实施例中,若MEC服务器确定初始模型与预置的模型集合中的模型匹配,也即成功建立对应于所述三维视频数据的模型,则向终端发送第一指示信息,第一指示信息表明在先传输的三维视频数据能够成功建模,可继续传输下一个三维视频数据。In this embodiment, if the MEC server determines that the initial model matches the model in the preset model set, that is, the model corresponding to the 3D video data is successfully established, the MEC server sends first indication information to the terminal, and the first indication information indicates that The previously transmitted 3D video data can be successfully modeled, and the next 3D video data can be transmitted.

在本发明的一种实施方式中,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据和匹配的模型生成第一模型。In an embodiment of the present invention, when the matching result is that the initial model matches a model in a preset model set, a first model is generated based on the three-dimensional video data and the matched model.

本实施例中,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,表明服务器中已存储有对应的目标对象的整体模型;但该整体模型往往与三维视频数据所对应的目标对象并不完全一致;则本实施例基于三维视频数据(包括二维视频数据和深度数据)对匹配的模型进行调整优化,可以理解,在匹配的模型的基础上,仅需要做相应的调整便可以得到与目标对象对应的第一模型;相比于参照三维视频数据生成模型的方式,本发明实施例能够大大缩短模型建立的耗时。In this embodiment, when the matching result is that the initial model matches the model in the preset model set, it indicates that the overall model of the corresponding target object has been stored in the server; however, the overall model often matches the 3D video data. The corresponding target objects are not completely consistent; then this embodiment adjusts and optimizes the matched model based on the three-dimensional video data (including the two-dimensional video data and the depth data). It can be understood that on the basis of the matched model, it is only necessary to do The first model corresponding to the target object can be obtained by corresponding adjustment; compared with the method of generating a model by referring to 3D video data, the embodiment of the present invention can greatly shorten the time-consuming of model establishment.

在本发明的一种实施方式中,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,所述方法还包括:基于所述三维视频数据更新匹配的模型。本实施方式可以对匹配的模型(也即某个目标对象对应的整体模型)进行优化,具体是基于获得的三维视频数据中的深度数据和二维视频数据对模型进行优化;优化的方式可以是针对模型中与初始模型中的特征参数不匹配的特征参数参照初始模型参数的特征参数进行调整,以使模型更准确、更加接近于目标对象。In an embodiment of the present invention, when the matching result is that the initial model matches a model in a preset model set, the method further includes: updating the matched model based on the three-dimensional video data. This embodiment can optimize the matched model (that is, the overall model corresponding to a certain target object), and specifically optimize the model based on the depth data and the two-dimensional video data in the obtained 3D video data; the optimization method can be: The feature parameters in the model that do not match the feature parameters in the initial model are adjusted with reference to the feature parameters of the initial model parameters, so that the model is more accurate and closer to the target object.

在一实施例中,如图6所示,所述方法还包括:步骤203b:当所述匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。In an embodiment, as shown in FIG. 6 , the method further includes: Step 203b: when the matching result is that the initial model does not match the model in the preset model set, send the first information to the terminal. Second indication information, where the second indication information is used to instruct the terminal to resend the 3D video data.

本实施例中,若MEC服务器确定初始模型与预置的模型集合中的模型不匹配,可以理解服务器未成功建立对应于三维视频数据的模型,则向终端发送第二指示信息,第二指示信息表明在先传输的三维视频数据不能够成功建模,需要重新传输对应于的三维视频数据。In this embodiment, if the MEC server determines that the initial model does not match the model in the preset model set, it can be understood that the server has not successfully established a model corresponding to the 3D video data, and then sends the second indication information to the terminal. The second indication information It indicates that the previously transmitted 3D video data cannot be successfully modeled, and the corresponding 3D video data needs to be retransmitted.

采用本发明实施例的技术方案,通过服务器中预置的多个目标对象的整体模型,一方面服务器可基于获得的一帧三维视频数据便可与预置的模型进行匹配,可基于匹配的模型快速建立目标对象的模型,大大缩短了建模耗时;另一方面由于服务器中预置了模型,因此降低了数据传输过程中所需要的技术支持的要求,即可以不需要较快的数据传输速率以及稳定的数据传输环境,适用于各种通信场景;另外,由于服务器中预置了模型,因此也可以无需传输终端采集的全部三维视频数据进行建模,在一定程度上也减少了需要传输的数据量。并且,本实施例通过终端存储发出的三维视频数据,适用于满足预定条件(例如传输质量不佳)的场景。By adopting the technical solution of the embodiment of the present invention, through the overall models of multiple target objects preset in the server, on the one hand, the server can match the preset model based on one frame of 3D video data obtained, and can match the model based on the matching model. Quickly build the model of the target object, which greatly shortens the modeling time; on the other hand, because the model is preset in the server, the requirements for technical support in the data transmission process are reduced, that is, faster data transmission is not required. The speed and stable data transmission environment are suitable for various communication scenarios; in addition, because the model is preset in the server, it is also possible to model without transmitting all the 3D video data collected by the terminal, which also reduces the need for transmission to a certain extent. amount of data. In addition, this embodiment stores the 3D video data sent by the terminal, and is suitable for scenarios that meet predetermined conditions (eg, poor transmission quality).

为实现本发明实施例终端侧的方法,本发明实施例还提供了一种终端。图7为本发明实施例的终端的一种组成结构示意图;如图7所示,所述终端包括:获取单元31、检测单元32、存储单元33、处理单元34和第一通讯单元35;其中,To implement the method on the terminal side of the embodiment of the present invention, the embodiment of the present invention further provides a terminal. FIG. 7 is a schematic diagram of a composition structure of a terminal according to an embodiment of the present invention; as shown in FIG. 7 , the terminal includes: an acquisition unit 31, a detection unit 32, a storage unit 33, a processing unit 34 and a first communication unit 35; wherein ,

所述获取单元31,用于获得三维视频数据;The obtaining unit 31 is used to obtain three-dimensional video data;

所述检测单元32,用于检测是否满足预定条件;The detection unit 32 is used to detect whether a predetermined condition is met;

所述存储单元33,用于所述检测单元32检测到满足预定条件时,存储所述三维视频数据;The storage unit 33 is configured to store the three-dimensional video data when the detection unit 32 detects that a predetermined condition is met;

所述处理单元34,用于所述检测单元32检测到满足预定条件时,按预设规则对所述三维视频数据进行处理;The processing unit 34 is configured to process the 3D video data according to a preset rule when the detection unit 32 detects that a predetermined condition is met;

所述第一通讯单元35,用于发送所述处理单元34处理后的所述三维视频数据至MEC服务器。The first communication unit 35 is configured to send the 3D video data processed by the processing unit 34 to the MEC server.

本实施例中,所述检测单元32,用于检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。In this embodiment, the detection unit 32 is configured to detect the transmission quality information of the communication channel with the MEC server, and when the transmission quality information does not meet the preset transmission standard, it is determined that the detection meets the predetermined condition.

在一实施例中,所述处理单元34,用于按预设规则对所述三维视频数据进行分割处理,获得多个子数据;In one embodiment, the processing unit 34 is configured to perform segmentation processing on the 3D video data according to preset rules to obtain multiple sub-data;

所述第一通讯单元35,用于发送所述多个子数据至所述MEC服务器;或者,The first communication unit 35 is configured to send the multiple sub-data to the MEC server; or,

所述处理单元34,用于按预设规则对所述三维视频数据进行压缩处理;The processing unit 34 is configured to perform compression processing on the three-dimensional video data according to preset rules;

所述第一通讯单元35,用于发送压缩处理后的所述三维视频数据至MEC服务器。The first communication unit 35 is configured to send the compressed 3D video data to the MEC server.

作为一种实施方式,所述第一通讯单元35,还用于接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;As an implementation manner, the first communication unit 35 is further configured to receive first indication information from the MEC server; the first indication information is used to instruct the terminal to continue transmitting other 3D video data;

所述获取单元31,还用于基于所述第一指示信息获得其他三维视频数据;The obtaining unit 31 is further configured to obtain other three-dimensional video data based on the first indication information;

所述第一通讯单元35,还用于向所述MEC服务器发送所述其他三维视频数据。The first communication unit 35 is further configured to send the other three-dimensional video data to the MEC server.

作为另一种实施方式,所述第一通讯单元35,还用于接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;As another implementation manner, the first communication unit 35 is further configured to receive second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data;

所述第一通讯单元35,还用于基于所述第二指示信息重新发送所述存储单元33存储的所述三维视频数据。The first communication unit 35 is further configured to resend the three-dimensional video data stored in the storage unit 33 based on the second indication information.

本发明实施例中,所述终端中的获取单元31、检测单元32和处理单元34,在实际应用中可由所述终端中的处理器,比如中央处理器(CPU,Central Processing Unit)、数字信号处理器(DSP,Digital Signal Processor)、微控制单元(MCU,Microcontroller Unit)或可编程门阵列(FPGA,Field-Programmable Gate Array)等实现;所述终端中的第一通讯单元35,在实际应用中可通过通信模组(包含:基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现;所述终端中的存储单元33,在实际应用中可通过存储器实现。In this embodiment of the present invention, the acquisition unit 31, the detection unit 32, and the processing unit 34 in the terminal can be implemented by a processor in the terminal, such as a central processing unit (CPU, Central Processing Unit), a digital signal, in practical applications. Processor (DSP, Digital Signal Processor), Microcontroller Unit (MCU, Microcontroller Unit) or Programmable Gate Array (FPGA, Field-Programmable Gate Array), etc.; the first communication unit 35 in the terminal, in practical application The terminal can be implemented by a communication module (including: basic communication suite, operating system, communication module, standardized interface and protocol, etc.) and a transceiver antenna; the storage unit 33 in the terminal can be implemented by a memory in practical applications.

需要说明的是:上述实施例提供的终端在进行数据处理时,仅以上述各程序模块的划分进行举例说明,实际应用中,可以根据需要而将上述处理分配由不同的程序模块完成,即将终端的内部结构划分成不同的程序模块,以完成以上描述的全部或者部分处理。另外,上述实施例提供的终端与数据处理方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that: when the terminal provided in the above embodiment performs data processing, only the division of the above program modules is used as an example for illustration. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the terminal and the data processing method embodiments provided by the above embodiments belong to the same concept, and the specific implementation process thereof is detailed in the method embodiments, which will not be repeated here.

相应地,为实现本发明实施例服务器侧的方法,本发明实施例还提供了一种服务器,具体为MEC服务器。图8为本发明实施例的服务器的一种组成结构示意图;如图8所示,所述服务器包括第二通讯单元41、建模单元42和匹配单元43;其中,Correspondingly, in order to implement the method on the server side of the embodiment of the present invention, the embodiment of the present invention further provides a server, specifically an MEC server. FIG. 8 is a schematic diagram of a composition structure of a server according to an embodiment of the present invention; as shown in FIG. 8 , the server includes a second communication unit 41, a modeling unit 42 and a matching unit 43; wherein,

所述第二通讯单元41,用于接收来自终端的三维视频数据;The second communication unit 41 is used to receive 3D video data from the terminal;

所述建模单元42,用于基于所述第二通讯单元41接收的所述三维视频数据建立初始模型;The modeling unit 42 is configured to establish an initial model based on the three-dimensional video data received by the second communication unit 41;

所述匹配单元43,用于将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;The matching unit 43 is configured to match the initial model with a model in a preset model set; the preset model set includes a plurality of overall models of target objects;

所述第二通讯单元41,还用于基于匹配单元43获得的匹配结果向所述终端发送指示信息。The second communication unit 41 is further configured to send indication information to the terminal based on the matching result obtained by the matching unit 43 .

在一实施例中,所述建模单元42,还用于获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。In one embodiment, the modeling unit 42 is further configured to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target object. ; Establish an overall model of the target object based on the plurality of sample data; Or, establish a local model of different parts of the target object based on the plurality of sample data, and generate the overall model of the different target objects based on the local models of different parts of the target object Model.

作为一种实施方式,所述第二通讯单元41,还用于当所述匹配单元43获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。As an implementation manner, the second communication unit 41 is further configured to send a first communication message to the terminal when the matching result obtained by the matching unit 43 is that the initial model matches the model in the preset model set Indication information, where the first indication information is used to instruct the terminal to continue to transmit other 3D video data.

在一实施例中,所述建模单元42,还用于当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据和所述模型建立对应于所述三维视频数据的第一模型。In one embodiment, the modeling unit 42 is further configured to establish a correspondence between the three-dimensional video data and the model when the matching result is that the initial model matches the model in the preset model set. on the first model of the 3D video data.

在一实施例中,所述建模单元42,还用于当所述匹配单元43获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据更新匹配的模型。In one embodiment, the modeling unit 42 is further configured to update based on the three-dimensional video data when the matching result obtained by the matching unit 43 is that the initial model matches the model in the preset model set matching model.

作为另一种实施方式,所述第二通讯单元41,还用于当所述匹配单元43获得的匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。As another implementation manner, the second communication unit 41 is further configured to send a message to the terminal when the matching result obtained by the matching unit 43 is that the initial model does not match the model in the preset model set Send second indication information, where the second indication information is used to instruct the terminal to resend the 3D video data.

本发明实施例中,所述服务器中建模单元42和匹配单元43,在实际应用中可由所述服务器中的处理器,比如CPU、DSP、MCU或FPGA等实现;所述服务器中的第二通讯单元41,在实际应用中可通过通信模组(包含:基础通信套件、操作系统、通信模块、标准化接口和协议等)及收发天线实现。In this embodiment of the present invention, the modeling unit 42 and the matching unit 43 in the server may be implemented by a processor in the server, such as a CPU, DSP, MCU, or FPGA, in practical applications; the second in the server The communication unit 41 can be implemented by a communication module (including a basic communication suite, an operating system, a communication module, standardized interfaces and protocols, etc.) and a transceiver antenna in practical applications.

需要说明的是:上述实施例提供的服务器在进行数据处理时,仅以上述各程序模块的划分进行举例说明,实际应用中,可以根据需要而将上述处理分配由不同的程序模块完成,即将服务器的内部结构划分成不同的程序模块,以完成以上描述的全部或者部分处理。另外,上述实施例提供的服务器与数据处理方法实施例属于同一构思,其具体实现过程详见方法实施例,这里不再赘述。It should be noted that: when the server provided by the above embodiment performs data processing, only the division of the above program modules is used as an example for illustration. The internal structure is divided into different program modules to complete all or part of the processing described above. In addition, the server provided by the above embodiments and the data processing method embodiments belong to the same concept, and the specific implementation process is detailed in the method embodiments, which will not be repeated here.

基于上述设备的硬件实现,本发明实施例还提供了一种数据处理设备,图9为本发明实施例的数据处理设备的硬件组成结构示意图,如图9所示,数据处理设备包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序;作为第一种实施方式,数据处理设备为终端时,位于终端的处理器执行所述程序时实现:获得三维视频数据;检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至MEC服务器。Based on the hardware implementation of the above device, an embodiment of the present invention further provides a data processing device. FIG. 9 is a schematic diagram of a hardware structure of the data processing device according to an embodiment of the present invention. As shown in FIG. 9 , the data processing device includes a memory, a processing A device and a computer program stored on the memory and running on the processor; as a first embodiment, when the data processing device is a terminal, when the processor located in the terminal executes the program, it realizes: obtaining three-dimensional video data; detecting When a predetermined condition is met, the 3D video data is stored, the 3D video data is processed according to a preset rule, and the processed 3D video data is sent to the MEC server.

在一实施例中,位于终端的处理器执行所述程序时实现:检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。In one embodiment, when the processor in the terminal executes the program, it realizes: detecting the transmission quality information of the communication channel with the MEC server, and when the transmission quality information does not meet the preset transmission standard, it is determined to detect that condition.

在一实施例中,位于终端的处理器执行所述程序时实现:按预设规则对所述三维视频数据进行分割处理,获得多个子数据,发送所述多个子数据至所述MEC服务器;或者,按预设规则对所述三维视频数据进行压缩处理,发送压缩处理后的所述三维视频数据至MEC服务器。In one embodiment, when the processor located in the terminal executes the program, it realizes: dividing the 3D video data according to a preset rule, obtaining a plurality of sub-data, and sending the plurality of sub-data to the MEC server; or , compressing the 3D video data according to a preset rule, and sending the compressed 3D video data to the MEC server.

在一实施例中,位于终端的处理器执行所述程序时实现:接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;基于所述第一指示信息获得其他三维视频数据,向所述MEC服务器发送所述其他三维视频数据。In one embodiment, when the processor located in the terminal executes the program, it realizes: receiving first indication information from the MEC server; the first indication information is used to instruct the terminal to continue to transmit other 3D video data; based on The first indication information obtains other three-dimensional video data, and sends the other three-dimensional video data to the MEC server.

在一实施例中,位于终端的处理器执行所述程序时实现:接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;基于所述第二指示信息重新发送所述三维视频数据。In one embodiment, when the processor located in the terminal executes the program, it realizes: receiving second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data; The three-dimensional video data is resent based on the second indication information.

作为第二种实施方式,数据处理设备为MEC服务器时,位于服务器的处理器执行所述程序时实现:接收来自终端的三维视频数据,基于所述三维视频数据建立初始模型;将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;基于匹配结果向所述终端发送指示信息。As a second implementation manner, when the data processing device is an MEC server, when the processor located in the server executes the program, it realizes: receiving 3D video data from the terminal, establishing an initial model based on the 3D video data; Matching with the models in the preset model set; the preset model set includes the overall models of multiple target objects; based on the matching result, the indication information is sent to the terminal.

在一实施例中,位于MEC服务器的处理器执行所述程序时实现:获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。In one embodiment, when the processor located in the MEC server executes the program, it realizes: obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or corresponding to different parts of the target object based on the multiple sample data to establish an overall model of the target object; or, based on the multiple sample data to establish local models of different parts of the target object, and generate different targets based on the local models of different parts of the different target objects. The overall model of the object.

在一实施例中,位于MEC服务器的处理器执行所述程序时实现:当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。In one embodiment, when the processor located in the MEC server executes the program, it realizes: when the matching result is that the initial model matches the model in the preset model set, sending first indication information to the terminal , the first indication information is used to instruct the terminal to continue to transmit other 3D video data.

在一实施例中,位于MEC服务器的处理器执行所述程序时实现:当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据和所述模型建立对应于所述三维视频数据的第一模型。In one embodiment, when the processor located in the MEC server executes the program, it realizes: when the matching result is that the initial model matches the model in the preset model set, based on the three-dimensional video data and the The model builds a first model corresponding to the three-dimensional video data.

在一实施例中,位于MEC服务器的处理器执行所述程序时实现:当所述匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。In one embodiment, when the processor located in the MEC server executes the program, it realizes: when the matching result is that the initial model does not match the model in the preset model set, sending a second indication to the terminal information, the second indication information is used to instruct the terminal to resend the 3D video data.

在一实施例中,位于MEC服务器的处理器执行所述程序时实现:当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据更新匹配的模型。In one embodiment, when the processor located in the MEC server executes the program, it realizes: when the matching result is that the initial model matches the model in the preset model set, update the matched model based on the three-dimensional video data. Model.

可以理解,数据处理设备(终端或服务器)还包括通信接口;数据处理设备(终端或服务器)中的各个组件通过总线系统耦合在一起。可理解,总线系统用于实现这些组件之间的连接通信。总线系统除包括数据总线之外,还包括电源总线、控制总线和状态信号总线。It can be understood that the data processing device (terminal or server) also includes a communication interface; various components in the data processing device (terminal or server) are coupled together through a bus system. It can be understood that the bus system is used to realize the connection communication between these components. In addition to the data bus, the bus system also includes a power bus, a control bus and a status signal bus.

可以理解,本实施例中的存储器可以是易失性存储器或非易失性存储器,也可包括易失性和非易失性存储器两者。其中,非易失性存储器可以是只读存储器(ROM,ReadOnly Memory)、可编程只读存储器(PROM,Programmable Read-Only Memory)、可擦除可编程只读存储器(EPROM,Erasable Programmable Read-Only Memory)、电可擦除可编程只读存储器(EEPROM,Electrically Erasable Programmable Read-Only Memory)、磁性随机存取存储器(FRAM,ferromagnetic random access memory)、快闪存储器(Flash Memory)、磁表面存储器、光盘、或只读光盘(CD-ROM,Compact Disc Read-Only Memory);磁表面存储器可以是磁盘存储器或磁带存储器。易失性存储器可以是随机存取存储器(RAM,RandomAccess Memory),其用作外部高速缓存。通过示例性但不是限制性说明,许多形式的RAM可用,例如静态随机存取存储器(SRAM,Static Random Access Memory)、同步静态随机存取存储器(SSRAM,Synchronous Static Random Access Memory)、动态随机存取存储器(DRAM,Dynamic Random Access Memory)、同步动态随机存取存储器(SDRAM,SynchronousDynamic Random Access Memory)、双倍数据速率同步动态随机存取存储器(DDRSDRAM,Double Data Rate Synchronous Dynamic Random Access Memory)、增强型同步动态随机存取存储器(ESDRAM,Enhanced Synchronous Dynamic Random Access Memory)、同步连接动态随机存取存储器(SLDRAM,SyncLink Dynamic Random Access Memory)、直接内存总线随机存取存储器(DRRAM,Direct Rambus Random Access Memory)。本发明实施例描述的存储器旨在包括但不限于这些和任意其它适合类型的存储器。It can be understood that the memory in this embodiment may be a volatile memory or a non-volatile memory, and may also include both volatile and non-volatile memory. Among them, the non-volatile memory may be a read-only memory (ROM, ReadOnly Memory), a programmable read-only memory (PROM, Programmable Read-Only Memory), an erasable programmable read-only memory (EPROM, Erasable Programmable Read-Only Memory) Memory), Electrically Erasable Programmable Read-Only Memory (EEPROM, Electrically Erasable Programmable Read-Only Memory), Magnetic Random Access Memory (FRAM, ferromagnetic random access memory), Flash Memory, Magnetic Surface Memory, Optical disk, or Compact Disc Read-Only Memory (CD-ROM); the magnetic surface memory can be a magnetic disk memory or a magnetic tape memory. The volatile memory may be a random access memory (RAM, Random Access Memory), which is used as an external cache memory. By way of example and not limitation, many forms of RAM are available, such as Static Random Access Memory (SRAM), Synchronous Static Random Access Memory (SSRAM), Dynamic Random Access Memory Memory (DRAM, Dynamic Random Access Memory), Synchronous Dynamic Random Access Memory (SDRAM, SynchronousDynamic Random Access Memory), Double Data Rate Synchronous Dynamic Random Access Memory (DDRSDRAM, Double Data Rate Synchronous Dynamic Random Access Memory), Enhanced Synchronous Dynamic Random Access Memory (ESDRAM, Enhanced Synchronous Dynamic Random Access Memory), Synchronous Link Dynamic Random Access Memory (SLDRAM, SyncLink Dynamic Random Access Memory), Direct Memory Bus Random Access Memory (DRRAM, Direct Rambus Random Access Memory) . The memory described in the embodiments of the present invention is intended to include, but not be limited to, these and any other suitable types of memory.

上述本发明实施例揭示的方法可以应用于处理器中,或者由处理器实现。处理器可能是一种集成电路芯片,具有信号的处理能力。在实现过程中,上述方法的各步骤可以通过处理器中的硬件的集成逻辑电路或者软件形式的指令完成。上述的处理器可以是通用处理器、DSP,或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组件等。处理器可以实现或者执行本发明实施例中的公开的各方法、步骤及逻辑框图。通用处理器可以是微处理器或者任何常规的处理器等。结合本发明实施例所公开的方法的步骤,可以直接体现为硬件译码处理器执行完成,或者用译码处理器中的硬件及软件模块组合执行完成。软件模块可以位于存储介质中,该存储介质位于存储器,处理器读取存储器中的信息,结合其硬件完成前述方法的步骤。The methods disclosed in the foregoing embodiments of the present invention may be applied to a processor, or implemented by a processor. A processor may be an integrated circuit chip with signal processing capabilities. In the implementation process, each step of the above-mentioned method can be completed by a hardware integrated logic circuit in a processor or an instruction in the form of software. The above-mentioned processors may be general-purpose processors, DSPs, or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, and the like. The processor may implement or execute the methods, steps, and logical block diagrams disclosed in the embodiments of the present invention. A general purpose processor may be a microprocessor or any conventional processor or the like. The steps of the method disclosed in combination with the embodiments of the present invention can be directly embodied as being executed by a hardware decoding processor, or executed by a combination of hardware and software modules in the decoding processor. The software module may be located in a storage medium, the storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps of the foregoing method in combination with its hardware.

本发明实施例还提供了一种芯片,包括处理器,处理器可以从存储器中调用并运行计算机程序,以实现本申请实施例中的方法。Embodiments of the present invention further provide a chip, including a processor, and the processor can call and run a computer program from a memory to implement the methods in the embodiments of the present application.

可选地,芯片还可以包括存储器。其中,处理器可以从存储器中调用并运行计算机程序,以实现本申请实施例中的方法。Optionally, the chip may also include a memory. The processor may call and run the computer program from the memory to implement the method in the embodiments of the present application.

其中,存储器可以是独立于处理器的一个单独的器件,也可以集成在处理器中。Wherein, the memory may be a separate device independent of the processor, or may be integrated in the processor.

可选地,该芯片还可以包括输入接口。其中,处理器可以控制该输入接口与其他设备或芯片进行通信,具体地,可以获取其他设备或芯片发送的信息或数据。Optionally, the chip may further include an input interface. The processor can control the input interface to communicate with other devices or chips, and specifically, can obtain information or data sent by other devices or chips.

可选地,该芯片还可以包括输出接口。其中,处理器可以控制该输出接口与其他设备或芯片进行通信,具体地,可以向其他设备或芯片输出信息或数据。Optionally, the chip may further include an output interface. The processor may control the output interface to communicate with other devices or chips, and specifically, may output information or data to other devices or chips.

可选地,该芯片可应用于本申请实施例中的MEC服务器,并且该芯片可以实现本申请实施例的各个方法中由MEC服务器实现的相应流程,为了简洁,在此不再赘述。Optionally, the chip can be applied to the MEC server in the embodiments of the present application, and the chip can implement the corresponding processes implemented by the MEC server in each method of the embodiments of the present application, which is not repeated here for brevity.

可选地,该芯片可应用于本申请实施例中的终端,并且该芯片可以实现本申请实施例的各个方法中由终端实现的相应流程,为了简洁,在此不再赘述。Optionally, the chip can be applied to the terminal in the embodiment of the present application, and the chip can implement the corresponding processes implemented by the terminal in each method of the embodiment of the present application, which is not repeated here for brevity.

应理解,本申请实施例提到的芯片还可以称为系统级芯片,系统芯片,芯片系统或片上系统芯片等。It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-chip, or a system-on-a-chip, or the like.

本发明实施例还提供了一种计算机存储介质,具体为计算机可读存储介质。其上存储有计算机指令,该计算机指令被处理器执行时实现本发明实施例应用于终端或MEC服务器的数据处理方法,为了简洁,在此不再赘述。Embodiments of the present invention further provide a computer storage medium, specifically a computer-readable storage medium. Computer instructions are stored thereon, and when the computer instructions are executed by the processor, implement the data processing method applied to the terminal or the MEC server according to the embodiment of the present invention, which is not repeated here for brevity.

本申请实施例还提供了一种计算机程序产品,包括计算机程序指令。Embodiments of the present application also provide a computer program product, including computer program instructions.

可选的,该计算机程序产品可应用于本申请实施例中的MEC服务器,并且该计算机程序指令使得计算机执行本申请实施例的各个方法中由MEC服务器实现的相应流程,为了简洁,在此不再赘述。Optionally, the computer program product can be applied to the MEC server in the embodiments of the present application, and the computer program instructions cause the computer to execute the corresponding processes implemented by the MEC server in the various methods of the embodiments of the present application. Repeat.

可选地,该计算机程序产品可应用于本申请实施例中的终端,并且该计算机程序指令使得计算机执行本申请实施例的各个方法中由终端实现的相应流程,为了简洁,在此不再赘述。Optionally, the computer program product can be applied to the terminal in the embodiments of the present application, and the computer program instructions cause the computer to execute the corresponding processes implemented by the terminal in each method of the embodiments of the present application. For the sake of brevity, details are not repeated here. .

本申请实施例还提供了一种计算机程序。The embodiments of the present application also provide a computer program.

可选的,该计算机程序可应用于本申请实施例中的MEC服务器,当该计算机程序在计算机上运行时,使得计算机执行本申请实施例的各个方法中由MEC服务器实现的相应流程,为了简洁,在此不再赘述。Optionally, the computer program can be applied to the MEC server in the embodiments of the present application, and when the computer program runs on the computer, the computer is made to execute the corresponding processes implemented by the MEC server in each method of the embodiments of the present application, for the sake of brevity. , and will not be repeated here.

可选地,该计算机程序可应用于本申请实施例中的终端,当该计算机程序在计算机上运行时,使得计算机执行本申请实施例的各个方法中由终端实现的相应流程,为了简洁,在此不再赘述。Optionally, the computer program can be applied to the terminal in the embodiments of the present application. When the computer program is run on the computer, the computer executes the corresponding processes implemented by the terminal in each method of the embodiments of the present application. This will not be repeated here.

本发明实施例还提供了一种数据处理系统,包括MEC服务器和终端;其中,该终端可以用于实现上述方法中由终端实现的相应的功能,以及该MEC服务器可以用于实现上述方法中由MEC服务器实现的相应的功能,为了简洁,在此不再赘述。An embodiment of the present invention also provides a data processing system, including an MEC server and a terminal; wherein the terminal can be used to implement the corresponding functions implemented by the terminal in the above method, and the MEC server can be used to implement the above method by For the sake of brevity, the corresponding functions implemented by the MEC server will not be repeated here.

在本发明所提供的几个实施例中,应该理解到,所揭露的方法和设备,可以通过其它的方式实现。以上所描述的设备实施例仅仅是示意性的,例如,所述单元的划分,仅仅为一种逻辑功能划分,实际实现时可以有另外的划分方式,如:多个单元或组件可以结合,或可以集成到另一个系统,或一些特征可以忽略,或不执行。另外,所显示或讨论的各组成部分相互之间的耦合、或直接耦合、或通信连接可以是通过一些接口,设备或单元的间接耦合或通信连接,可以是电性的、机械的或其它形式的。In the several embodiments provided by the present invention, it should be understood that the disclosed methods and devices may be implemented in other manners. The device embodiments described above are only illustrative. For example, the division of the units is only a logical function division. In actual implementation, there may be other division methods. For example, multiple units or components may be combined, or Can be integrated into another system, or some features can be ignored, or not implemented. In addition, the coupling, or direct coupling, or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection of devices or units may be electrical, mechanical or other forms. of.

上述作为分离部件说明的单元可以是、或也可以不是物理上分开的,作为单元显示的部件可以是、或也可以不是物理单元,即可以位于一个地方,也可以分布到多个网络单元上;可以根据实际的需要选择其中的部分或全部单元来实现本实施例方案的目的。The unit described above as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place or distributed to multiple network units; Some or all of the units may be selected according to actual needs to achieve the purpose of the solution in this embodiment.

另外,在本发明各实施例中的各功能单元可以全部集成在一个第二处理单元中,也可以是各单元分别单独作为一个单元,也可以两个或两个以上单元集成在一个单元中;上述集成的单元既可以采用硬件的形式实现,也可以采用硬件加软件功能单元的形式实现。In addition, each functional unit in each embodiment of the present invention may all be integrated into one second processing unit, or each unit may be separately used as a unit, or two or more units may be integrated into one unit; The above-mentioned integrated unit may be implemented in the form of hardware, or may be implemented in the form of hardware plus software functional units.

本领域普通技术人员可以理解:实现上述方法实施例的全部或部分步骤可以通过程序指令相关的硬件来完成,前述的程序可以存储于一计算机可读取存储介质中,该程序在执行时,执行包括上述方法实施例的步骤;而前述的存储介质包括:移动存储设备、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Those of ordinary skill in the art can understand that all or part of the steps of implementing the above method embodiments can be completed by program instructions related to hardware, the aforementioned program can be stored in a computer-readable storage medium, and when the program is executed, execute It includes the steps of the above method embodiments; and the aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other media that can store program codes.

或者,本发明上述集成的单元如果以软件功能模块的形式实现并作为独立的产品销售或使用时,也可以存储在一个计算机可读取存储介质中。基于这样的理解,本发明实施例的技术方案本质上或者说对现有技术做出贡献的部分可以以软件产品的形式体现出来,该计算机软件产品存储在一个存储介质中,包括若干指令用以使得一台计算机设备(可以是个人计算机、服务器、或者网络设备等)执行本发明各个实施例所述方法的全部或部分。而前述的存储介质包括:移动存储设备、ROM、RAM、磁碟或者光盘等各种可以存储程序代码的介质。Alternatively, if the above-mentioned integrated unit of the present invention is implemented in the form of a software function module and sold or used as an independent product, it may also be stored in a computer-readable storage medium. Based on this understanding, the technical solutions of the embodiments of the present invention may be embodied in the form of software products in essence or the parts that make contributions to the prior art. The computer software products are stored in a storage medium and include several instructions for A computer device (which may be a personal computer, a server, or a network device, etc.) is caused to execute all or part of the methods described in the various embodiments of the present invention. The aforementioned storage medium includes: a removable storage device, a ROM, a RAM, a magnetic disk or an optical disk and other mediums that can store program codes.

需要说明的是:本发明实施例所记载的技术方案之间,在不冲突的情况下,可以任意组合。It should be noted that the technical solutions described in the embodiments of the present invention may be combined arbitrarily unless there is a conflict.

以上所述,仅为本发明的具体实施方式,但本发明的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本发明揭露的技术范围内,可轻易想到变化或替换,都应涵盖在本发明的保护范围之内。The above are only specific embodiments of the present invention, but the protection scope of the present invention is not limited thereto. Any person skilled in the art can easily think of changes or substitutions within the technical scope disclosed by the present invention. should be included within the protection scope of the present invention.

Claims (26)

1.一种数据处理方法,其特征在于,应用于终端;所述方法包括:1. a data processing method, is characterized in that, is applied to terminal; Described method comprises: 获得三维视频数据;Obtain 3D video data; 检测到满足预定条件时,存储所述三维视频数据,按预设规则对所述三维视频数据中的一帧三维视频数据进行处理以及发送处理后的所述一帧三维视频数据至移动边缘计算MEC服务器;所述一帧三维视频数据用于所述MEC服务器建立用于与预置的模型进行匹配的初始模型;When detecting that a predetermined condition is met, store the 3D video data, process a frame of 3D video data in the 3D video data according to preset rules, and send the processed frame of 3D video data to the mobile edge to calculate the MEC server; the one frame of three-dimensional video data is used by the MEC server to establish an initial model for matching with a preset model; 接收来自所述MEC服务器的指示信息,所述指示信息用于指示所述终端继续传输其他三维视频数据或是重新传输存储的所述一帧三维视频数据;所述指示信息由所述MEC服务器基于所述初始模型与预置的模型的匹配结果发送。Receive indication information from the MEC server, where the indication information is used to instruct the terminal to continue to transmit other 3D video data or to retransmit the stored one frame of 3D video data; the indication information is used by the MEC server based on The matching result between the initial model and the preset model is sent. 2.根据权利要求1所述的方法,其特征在于,所述检测到满足预定条件,包括:2. The method according to claim 1, wherein the detecting that a predetermined condition is met comprises: 检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。The transmission quality information of the communication channel with the MEC server is detected, and when the transmission quality information does not meet the preset transmission standard, it is determined that the predetermined condition is met. 3.根据权利要求1所述的方法,其特征在于,所述按预设规则对所述三维视频数据进行处理以及发送处理后的所述三维视频数据至移动边缘计算MEC服务器,包括:3. method according to claim 1, is characterized in that, described 3D video data is processed by preset rule and described 3D video data after processing is sent to mobile edge computing MEC server, comprising: 按预设规则对所述三维视频数据进行分割处理,获得多个子数据,发送所述多个子数据至所述MEC服务器;或者,Perform segmentation processing on the 3D video data according to preset rules to obtain multiple sub-data, and send the multiple sub-data to the MEC server; or, 按预设规则对所述三维视频数据进行压缩处理,发送压缩处理后的所述三维视频数据至MEC服务器。The 3D video data is compressed according to a preset rule, and the compressed 3D video data is sent to the MEC server. 4.根据权利要求1所述的方法,其特征在于,所述方法还包括:4. The method according to claim 1, wherein the method further comprises: 接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;receiving first indication information from the MEC server; the first indication information is used to instruct the terminal to continue to transmit other 3D video data; 基于所述第一指示信息获得其他三维视频数据,向所述MEC服务器发送所述其他三维视频数据。Obtain other 3D video data based on the first indication information, and send the other 3D video data to the MEC server. 5.根据权利要求1所述的方法,其特征在于,所述方法还包括:5. The method according to claim 1, wherein the method further comprises: 接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;receiving second indication information from the MEC server; the second indication information is used to instruct the terminal to resend the 3D video data; 基于所述第二指示信息重新发送所述三维视频数据。The three-dimensional video data is resent based on the second indication information. 6.一种数据处理方法,其特征在于,应用于MEC服务器;所述方法包括:6. a data processing method, is characterized in that, is applied to MEC server; Described method comprises: 接收来自终端的一帧三维视频数据,基于所述一帧三维视频数据建立初始模型;所述一帧三维视频数据为所述终端对获得的三维视频数据中的一帧三维视频数据进行处理后获得的三维视频数据;Receive one frame of 3D video data from the terminal, and establish an initial model based on the one frame of 3D video data; the one frame of 3D video data is obtained after the terminal processes one frame of 3D video data in the obtained 3D video data 3D video data; 将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;Matching the initial model with a model in a preset model set; the preset model set includes an overall model of a plurality of target objects; 基于匹配结果向所述终端发送指示信息,所述指示信息用于指示所述终端继续传输其他三维视频数据或是重新传输存储的所述一帧三维视频数据。Send indication information to the terminal based on the matching result, where the indication information is used to instruct the terminal to continue to transmit other 3D video data or to retransmit the stored one frame of 3D video data. 7.根据权利要求6所述的方法,其特征在于,所述方法还包括:7. The method according to claim 6, wherein the method further comprises: 获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;Obtaining a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or local data corresponding to different parts of the target object; 基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。Establish an overall model of the target object based on the plurality of sample data; or, establish local models of different parts of the target object based on the plurality of sample data, and generate an overall model of different target objects based on the local models of different parts of the target object. . 8.根据权利要求6所述的方法,其特征在于,所述基于匹配结果向所述终端发送指示信息,包括:8. The method according to claim 6, wherein the sending indication information to the terminal based on the matching result comprises: 当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。When the matching result is that the initial model matches the model in the preset model set, first indication information is sent to the terminal, where the first indication information is used to instruct the terminal to continue to transmit other 3D video data . 9.根据权利要求8所述的方法,其特征在于,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,所述方法还包括:9. The method according to claim 8, wherein when the matching result is that the initial model matches a model in a preset model set, the method further comprises: 基于所述三维视频数据和所述预置的模型集合中与所述初始模型匹配的模型建立对应于所述三维视频数据的第一模型。A first model corresponding to the 3D video data is established based on the 3D video data and a model in the preset model set that matches the initial model. 10.根据权利要求6所述的方法,其特征在于,所述基于匹配结果向所述终端发送指示信息,包括:10. The method according to claim 6, wherein the sending indication information to the terminal based on the matching result comprises: 当所述匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。When the matching result is that the initial model does not match the model in the preset model set, send second indication information to the terminal, where the second indication information is used to instruct the terminal to resend the three-dimensional model video data. 11.根据权利要求8所述的方法,其特征在于,当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,所述方法还包括:11. The method according to claim 8, wherein when the matching result is that the initial model matches a model in a preset model set, the method further comprises: 基于所述三维视频数据更新匹配的模型。The matched model is updated based on the 3D video data. 12.一种终端,其特征在于,所述终端包括:获取单元、检测单元、存储单元、处理单元和第一通讯单元;其中,12. A terminal, characterized in that the terminal comprises: an acquisition unit, a detection unit, a storage unit, a processing unit and a first communication unit; wherein, 所述获取单元,用于获得三维视频数据;the obtaining unit, for obtaining three-dimensional video data; 所述检测单元,用于检测是否满足预定条件;The detection unit is used to detect whether a predetermined condition is met; 所述存储单元,用于所述检测单元检测到满足预定条件时,存储所述三维视频数据;the storage unit, configured to store the three-dimensional video data when the detection unit detects that a predetermined condition is met; 所述处理单元,用于所述检测单元检测到满足预定条件时,按预设规则对所述三维视频数据中的一帧三维视频数据进行处理;The processing unit is configured to process a frame of 3D video data in the 3D video data according to a preset rule when the detection unit detects that a predetermined condition is met; 所述第一通讯单元,用于发送所述处理单元处理后的所述一帧三维视频数据至MEC服务器;所述一帧三维视频数据用于所述MEC服务器建立用于与预置的模型进行匹配的初始模型;还用于接收来自所述MEC服务器的指示信息,所述指示信息用于指示所述终端继续传输其他三维视频数据或是重新传输存储的所述一帧三维视频数据;所述指示信息由所述MEC服务器基于所述初始模型与预置的模型的匹配结果发送。The first communication unit is used to send the one frame of 3D video data processed by the processing unit to the MEC server; matching initial model; also used for receiving indication information from the MEC server, the indication information is used to instruct the terminal to continue to transmit other 3D video data or retransmit the stored one frame of 3D video data; the The indication information is sent by the MEC server based on the matching result between the initial model and the preset model. 13.根据权利要求12所述的终端,其特征在于,所述检测单元,用于检测与MEC服务器之间的通信通道的传输质量信息,当所述传输质量信息未达到预设传输标准时,确定检测到满足预定条件。13. The terminal according to claim 12, wherein the detection unit is configured to detect the transmission quality information of the communication channel with the MEC server, and when the transmission quality information does not reach a preset transmission standard, determine It is detected that the predetermined condition is met. 14.根据权利要求12所述的终端,其特征在于,所述处理单元,用于按预设规则对所述三维视频数据进行分割处理,获得多个子数据;14. The terminal according to claim 12, wherein the processing unit is configured to perform segmentation processing on the 3D video data according to a preset rule to obtain a plurality of sub-data; 所述第一通讯单元,用于发送所述多个子数据至所述MEC服务器;或者,the first communication unit, configured to send the plurality of sub-data to the MEC server; or, 所述处理单元,用于按预设规则对所述三维视频数据进行压缩处理;the processing unit, configured to compress the three-dimensional video data according to a preset rule; 所述第一通讯单元,用于发送压缩处理后的所述三维视频数据至MEC服务器。The first communication unit is used for sending the compressed three-dimensional video data to the MEC server. 15.根据权利要求12所述的终端,其特征在于,所述第一通讯单元,还用于接收来自所述MEC服务器的第一指示信息;所述第一指示信息用于指示所述终端继续传输其他三维视频数据;15. The terminal according to claim 12, wherein the first communication unit is further configured to receive first indication information from the MEC server; the first indication information is used to instruct the terminal to continue transmit other 3D video data; 所述获取单元,还用于基于所述第一指示信息获得其他三维视频数据;The obtaining unit is further configured to obtain other three-dimensional video data based on the first indication information; 所述第一通讯单元,还用于向所述MEC服务器发送所述其他三维视频数据。The first communication unit is further configured to send the other three-dimensional video data to the MEC server. 16.根据权利要求12所述的终端,其特征在于,所述第一通讯单元,还用于接收来自所述MEC服务器的第二指示信息;所述第二指示信息用于指示所述终端重新发送所述三维视频数据;16. The terminal according to claim 12, wherein the first communication unit is further configured to receive second indication information from the MEC server; the second indication information is used to instruct the terminal to restart the sending the three-dimensional video data; 所述第一通讯单元,还用于基于所述第二指示信息重新发送所述存储单元存储的所述三维视频数据。The first communication unit is further configured to resend the three-dimensional video data stored in the storage unit based on the second indication information. 17.一种MEC服务器,其特征在于,所述服务器包括第二通讯单元、建模单元和匹配单元;其中,17. A MEC server, characterized in that the server comprises a second communication unit, a modeling unit and a matching unit; wherein, 所述第二通讯单元,用于接收来自终端的一帧三维视频数据;The second communication unit is used to receive one frame of three-dimensional video data from the terminal; 所述建模单元,用于基于所述第二通讯单元接收的所述一帧三维视频数据建立初始模型;所述一帧三维视频数据为所述终端对获得的三维视频数据中的一帧三维视频数据进行处理后获得的三维视频数据;The modeling unit is configured to establish an initial model based on the one frame of three-dimensional video data received by the second communication unit; the one frame of three-dimensional video data is one frame of three-dimensional video data obtained by the terminal pair. 3D video data obtained after the video data is processed; 所述匹配单元,用于将所述初始模型与预置的模型集合中的模型进行匹配;所述预置模型集合中包括多个目标对象的整体模型;The matching unit is used to match the initial model with the models in the preset model set; the preset model set includes the overall model of a plurality of target objects; 所述第二通讯单元,还用于基于匹配单元获得的匹配结果向所述终端发送指示信息,所述指示信息用于指示所述终端继续传输其他三维视频数据或是重新传输存储的所述一帧三维视频数据。The second communication unit is further configured to send instruction information to the terminal based on the matching result obtained by the matching unit, where the instruction information is used to instruct the terminal to continue to transmit other 3D video data or to retransmit the stored one. frame 3D video data. 18.根据权利要求17所述的服务器,其特征在于,所述建模单元,还用于获得多个样本数据;所述多个样本数据为对应于不同目标对象的整体数据和/或对应于目标对象的不同部位的局部数据;基于所述多个样本数据建立目标对象的整体模型;或者,基于所述多个样本数据建立目标对象的不同部位的局部模型,基于不同目标对象的不同部位的局部模型生成不同目标对象的整体模型。18. The server according to claim 17, wherein the modeling unit is further configured to obtain a plurality of sample data; the plurality of sample data are overall data corresponding to different target objects and/or corresponding to Local data of different parts of the target object; establishing an overall model of the target object based on the plurality of sample data; or, establishing local models of different parts of the target object based on the plurality of sample data, Local models generate global models of different target objects. 19.根据权利要求17所述的服务器,其特征在于,所述第二通讯单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,向所述终端发送第一指示信息,所述第一指示信息用于指示所述终端继续传输其他三维视频数据。19. The server according to claim 17, wherein the second communication unit is further configured to when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set , sending first indication information to the terminal, where the first indication information is used to instruct the terminal to continue to transmit other 3D video data. 20.根据权利要求19所述的服务器,其特征在于,所述建模单元,还用于当所述匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据和所述预置的模型集合中与所述初始模型匹配的模型建立对应于所述三维视频数据的第一模型。20 . The server according to claim 19 , wherein the modeling unit is further configured to, when the matching result is that the initial model matches a model in a preset model set, based on the three-dimensional model. 21 . A first model corresponding to the three-dimensional video data is established by video data and a model matching the initial model in the preset model set. 21.根据权利要求17所述的服务器,其特征在于,所述第二通讯单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型不匹配时,向所述终端发送第二指示信息,所述第二指示信息用于指示所述终端重新发送所述三维视频数据。21. The server according to claim 17, wherein the second communication unit is further configured to be used when the matching result obtained by the matching unit is that the initial model does not match a model in a preset model set is sent to the terminal, where the second indication information is used to instruct the terminal to resend the 3D video data. 22.根据权利要求19所述的服务器,其特征在于,所述建模单元,还用于当所述匹配单元获得的匹配结果为所述初始模型与预置的模型集合中的模型匹配时,基于所述三维视频数据更新匹配的模型。22. The server according to claim 19, wherein the modeling unit is further configured to, when the matching result obtained by the matching unit is that the initial model matches a model in a preset model set, The matched model is updated based on the 3D video data. 23.一种计算机可读存储介质,其上存储有计算机指令,其特征在于,该指令被处理器执行时实现权利要求1至5任一项所述数据处理方法的步骤;或者,该指令被处理器执行时实现权利要求6至11任一项所述数据处理方法的步骤。23. A computer-readable storage medium on which computer instructions are stored, characterized in that, when the instructions are executed by a processor, the steps of the data processing method according to any one of claims 1 to 5 are implemented; The processor implements the steps of the data processing method according to any one of claims 6 to 11 when executed. 24.一种终端,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现权利要求1至5任一项所述数据处理方法的步骤。24. A terminal, comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the processor implements any one of claims 1 to 5 when the processor executes the program. Describe the steps of the data processing method. 25.一种MEC服务器,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述程序时实现权利要求6至11任一项所述数据处理方法的步骤。25. A MEC server comprising a memory, a processor and a computer program stored on the memory and running on the processor, wherein the processor implements any one of claims 6 to 11 when the processor executes the program The steps of the data processing method. 26.一种芯片,其特征在于,包括:处理器,用于从存储器中调用并运行计算机程序,使得安装有所述芯片的设备执行如权利要求1至5任一项所述数据处理方法的步骤;或者,执行权利要求6至11任一项所述数据处理方法的步骤。26. A chip, characterized in that it comprises: a processor for calling and running a computer program from a memory, so that a device equipped with the chip executes the data processing method according to any one of claims 1 to 5. steps; or, perform the steps of the data processing method according to any one of claims 6 to 11.
CN201811163283.6A 2018-09-30 2018-09-30 A data processing method, terminal, server and computer storage medium Expired - Fee Related CN109413405B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201811163283.6A CN109413405B (en) 2018-09-30 2018-09-30 A data processing method, terminal, server and computer storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201811163283.6A CN109413405B (en) 2018-09-30 2018-09-30 A data processing method, terminal, server and computer storage medium

Publications (2)

Publication Number Publication Date
CN109413405A CN109413405A (en) 2019-03-01
CN109413405B true CN109413405B (en) 2020-07-03

Family

ID=65466775

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201811163283.6A Expired - Fee Related CN109413405B (en) 2018-09-30 2018-09-30 A data processing method, terminal, server and computer storage medium

Country Status (1)

Country Link
CN (1) CN109413405B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111371874B (en) * 2020-02-28 2021-10-08 腾讯科技(深圳)有限公司 Industrial data transmission method and device, storage medium and electronic equipment
CN112419483A (en) * 2020-11-24 2021-02-26 中电科新型智慧城市研究院有限公司 A three-dimensional model data transmission method and server

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101106410B (en) * 2006-07-13 2011-05-18 华为技术有限公司 A data retransfer method of multi-input and multi-output system and data transmission terminal device
CN101552660B (en) * 2008-04-01 2012-06-27 中国移动通信集团公司 Method as well as device and communication system for retransmitting streaming media data
KR101632076B1 (en) * 2009-04-13 2016-06-21 삼성전자주식회사 Apparatus and method for transmitting stereoscopic image data according to priority
US8156238B2 (en) * 2009-05-13 2012-04-10 Stmicroelectronics, Inc. Wireless multimedia transport method and apparatus
CN101588595B (en) * 2009-07-07 2012-01-25 董志 Method for dynamically regulating data transfer rate in wireless application service system
CN105681002B (en) * 2015-12-30 2019-03-29 海能达通信股份有限公司 Transfer control method, device, system and the communication equipment of multicast packet
CN108111259A (en) * 2017-12-28 2018-06-01 北京航天晨信科技有限责任公司 One kind is used for narrow band data method for reliable transmission

Also Published As

Publication number Publication date
CN109413405A (en) 2019-03-01

Similar Documents

Publication Publication Date Title
CN108495112B (en) Data transmission method and terminal, and computer storage medium
CN109410319B (en) Data processing method, server and computer storage medium
CN109151430B (en) Data processing method, terminal, server and computer storage medium
CN109194946A (en) Data processing method and device, electronic equipment and storage medium
CN109413405B (en) A data processing method, terminal, server and computer storage medium
CN108600728A (en) Data transmission method and terminal, computer storage medium
CN108683901B (en) Data processing method, MEC server and computer readable storage medium
CN109272576B (en) Data processing method, MEC server, terminal equipment and device
CN109257588A (en) Data transmission method, terminal, server and storage medium
CN109151435B (en) A data processing method, terminal, server and computer storage medium
CN109246409B (en) Data processing method, terminal, server and computer storage medium
CN109413409B (en) A data processing method, MEC server, and terminal device
CN116827750A (en) Network fault and alarm processing methods and devices
CN109147043B (en) Data processing method, server and computer storage medium
CN108632376A (en) Data processing method, terminal, server and computer storage medium
CN109302598B (en) A data processing method, terminal, server and computer storage medium
CN109299323B (en) Data processing method, terminal, server and computer storage medium
US10460153B2 (en) Automatic identity detection
CN108737807B (en) A data processing method, terminal, server and computer storage medium
HK40002771B (en) Data processing method, server and computer storage medium
HK40002771A (en) Data processing method, server and computer storage medium
CN109325997B (en) Model checking method, server and computer storage medium
RU2800627C2 (en) Method of data processing, server and computer storage medium
EP4564879A1 (en) Federated learning method and related device
WO2025177023A1 (en) Systems and methods for reducing uplink traffic

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20200703

CF01 Termination of patent right due to non-payment of annual fee