CN108512814A - media data processing method, device and system - Google Patents

Abstract

The present application discloses a method for processing media data. The method includes: for any client of the current service, performing the following processing: receiving the first media data uploaded by the client; processing the media data corresponding to the pre-configured current service Requirements, process the first media data and obtain second media data; and store the second media data on the network side and obtain the link address of the second media data; and respond to the link from the service server An address acquisition request, sending the obtained one or more link addresses of the current service to the service server, so that the service server can provide any client of the current service with one or more link addresses available to the client. The link address. The application also discloses the corresponding device and system.

Description

Media data processing method, device and system

technical field

The present application relates to the technical field of the Internet, and in particular to a media data processing method, device and system.

Background technique

With the development of computer technology and Internet technology, more and more users need to process the audio and video recorded by themselves or their work needs on more occasions, such as changing pitch, adding background music, audio conversion, and editing video materials Playback, etc. At present, there are many software and technologies for audio and video processing on the market, such as ffmpeg technology, ffmpeg is a set of open source computer programs that can be used to record, convert digital audio and video, and convert them into streams. Adopt LGPL or GPL license. It provides a complete solution for recording, converting and streaming audio and video. It includes libavcodec, a very advanced audio/video codec library. ffmpeg is widely used in various playback software.

Contents of the invention

The example of this application provides a media data processing method, the method includes: for any client of the current service, perform the following processing: receive the first media data uploaded by the client; process the media data corresponding to the pre-configured current service Requirements, process the first media data and obtain the second media data; and store the second media data on the network side and obtain the link address of the second media data; and respond to the link from the service server An address acquisition request, sending the obtained one or more link addresses of the current service to the service server, so that the service server can provide any client of the current service with one or more link addresses available to the client. The link address.

The present application also provides a media data processing method, the method comprising: uploading the first media data generated by the current service to the data processing server; wherein, for the first media data uploaded by any client of the current service, The data processing server processes the first media data according to the pre-configured media data processing requirements corresponding to the current service and obtains the second media data, stores the second media data on the network side and obtains the second media data The link address of the media data; sending a link address acquisition request to the service server; wherein, in response to the link address acquisition request, the service server determines from one or more link addresses of the current service obtained by the data processing server for Each of the link addresses available to the client; receiving each of the link addresses available to the client from the service server; in response to the user's selection operation for any link address in the received link addresses, acquiring the second media data from the network side according to the selected link address; and playing the acquired second media data.

The present application also provides a media data processing device, which includes: an upload processing module that receives the first media data uploaded by any client of the current service; a data processing module that processes the media data corresponding to the pre-configured current service requirements, process the first media data and obtain second media data; store the second media data on the network side and obtain the link address of the second media data, and save the link address in the The information providing module; and the information providing module, in response to the link address acquisition request from the service server, sends the obtained one or more of the link addresses of the current service to the service server, so that the service server sends Any client of the current service provides one or more of the link addresses.

The present application also provides a media data processing system, including: a business server, an upload server, a processing server, and an information providing server, wherein the information providing server is integrated in the processing server or set independently; wherein, the upload server , receiving the first media data uploaded by any client of the current service, and providing the first media data to the processing server; the processing server, according to the pre-configured media data processing requirements corresponding to the current service, Process the first media data and obtain second media data; store the second media data on the network side and obtain the link address of the second media data, and save the link address in the information provider server; the service server, in response to the request for uploading the first media data from any client of the current service, sending a link address acquisition request to the information providing server; the information providing server, responding to the request from the information providing server The link address acquisition request of the service server sends the acquired one or more link addresses of the current service to the service server; the service server provides any client of the current service with a link address for the client One or more of said link addresses are available.

By adopting the above-mentioned technical solution of the present application, the processing of media data and decoupling of products can be realized. At the same time, the data processing server processes asynchronously in the background, and can complete the processing requirements of media data in a relatively short period of time, and in the process of processing, no It will block other operations of the user, thus making the user experience better.

Description of drawings

In order to more clearly illustrate the technical solutions in the examples of the present application, the accompanying drawings that need to be used in the description of the examples will be briefly introduced below. Obviously, the accompanying drawings in the following description are only some examples of the present application. Ordinary technicians can also obtain other drawings based on these drawings without paying creative labor.

FIG. 1 is a schematic diagram of a system architecture involved in the present application;

Fig. 2 is the method flowchart of an example of the present application;

Fig. 3 is a diagram of the media data processing system involved in the present application;

Fig. 4 is the distributed processing involved in this application;

Fig. 5 is the method flowchart of another example of the present application;

Fig. 6 is a message interaction diagram of an example of media data processing in this application;

Fig. 7 is a device structure diagram of an example of the present application;

Fig. 8 is a device structure diagram of another example of the present application; and

Fig. 9 is a device structure diagram of an example of the present application.

Detailed ways

The technical solutions in the examples of the application will be clearly and completely described below in conjunction with the accompanying drawings in the examples of the application. Obviously, the described examples are only some examples of the application, not all examples. Based on the examples in this application, all other examples obtained by persons of ordinary skill in the art without making creative efforts belong to the scope of protection of this application.

In some instances, the product directly installed by the user on the electronic device (the product refers to an application or platform with audio and video processing functions, such as dubbing software, media player or WeChat application, or a product that can display certain media interactive activities web page browser) to process media data, such as audio and video processing. For example: when the user uses the dubbing software, if audio and video processing is required (for example, the audio and video data needs to be processed after a dubbing is completed), the audio and video processing will be performed by the dubbing software. During this processing, the dubbing software is not available. status. It can be seen that the coupling between the current media data processing and the product is high, and the media data processing will affect the use of other functions of the product, and the user will wait for a long time, making the user experience effect poor. At the same time, the module design for media data processing in this product is complicated, so the realization of this product is relatively difficult, and the product testing time will be longer, so that the product development cost will be higher. Furthermore, due to the limited processing capability of the user-side electronic equipment, this product may take a long time to process media data, and the long-time processing process may bring potential risks, such as damage to audio and video source files. Furthermore, if the product’s audio and video requirements change, such as improving its audio and video processing effects or adding audio and video processing functions (such as adding English subtitles to audio and video, etc.), it is also difficult for the product to quickly meet the audio and video processing requirements changes. In addition, if the product is a browser for displaying web pages, the product cannot implement complex audio and video processing, and it is difficult to achieve the audio and video processing effects desired by users.

Based on the above technical problems, the present application proposes a media data processing method, which can be applied to the system architecture shown in FIG. 1 . As shown in Figure 1, this system frame comprises: client 101 and background 102, and background 102 comprises business server 103 (this business server can be website server or application program server), data processing server 104 and storage server 105, client 101 and background 102 can communicate through Internet 106 . Here, the client 101 refers to the aforementioned product, which can be a browser displaying pages of media interactive activities (such as interactive advertising activities, which can be implemented in the form of web pages) or applications (APP) (such as dubbing software, etc.).

Using the client 101, the user may generate media data processing requirements such as pitch shifting, adding background music, audio conversion, clipping and playback of video materials, and the like. In some instances, data processing server 104 packages these processing requirements into processing processes. For multiple clients 101 corresponding to multiple products (that is, multiple services), the media data processing requirements of different types of clients 101 (that is, the processing requirements of different services) can be packaged into different processing processes, and each A service corresponds to a service identifier (such as a project ID), and each service identifier corresponds to a processing process, and the name of the processing process can be associated with the service identifier (for example, the name of the processing process can include the project ID).

The media data processing process for a client 101 is as follows:

After the client 101 uploaded the media data to the data processing server 104 successfully, the data processing server 104 returned the ID of the media data to the client 101, and after a predetermined time, the client 101 inquired about the processing of the media data to the data processing server 104 through the service server 103 state, if the data processing server 104 has processed the media data, it will upload the second media data to the storage server 105 on the network side, obtain the link address (URL) of the second media data and return it to the service server 103, The second media data is processed media data of the media data. The client 101 obtains the second media data from the storage server 105 according to the URL obtained from the service server 103 .

In an example, the media data processing method proposed by the present application is applied to the data processing server 104, as shown in FIG. 2 , the method includes the following steps:

Step 200: For any client of the current service, perform the following steps 201-203:

Step 201: Receive first media data uploaded by the client.

Wherein, the media data may be data such as audio and video, so the first media data may be an audio and video source file. In some instances, the data processing server can receive and temporarily store the media data source file, and the upload server in the data processing server can temporarily store the media data source file locally, so that the bypass processing server in the data processing server can Upload the media data source file stored in the server for processing.

In some instances, sending a verification ticket to the service server in response to a request from the service server for obtaining a verification ticket;

When receiving the first media data, further receive a verification ticket corresponding to the first media data;

Verifying whether the first media data is legal according to the verification ticket;

When the verification result is that the first media data is legal, execute the processing of processing the first media data to obtain the second media data.

In some instances, in response to the current business client's request for uploading source files, the verification server (ticket server) in the data processing server returns an encrypted verification ticket (ticket) to the client as a credential for user identity security to ensure uploading The server is not subject to illegal attacks by illegal users.

In some instances, after receiving the ticket returned by the verification server, the client further sends the media data source file (such as audio and video source files), the ticket, and user identification information (that is, the user ID registered in the corresponding application or activity, Such as QQ number, WeChat number and other instant messaging numbers) and other data are uploaded to the upload server. The upload server parses the ticket to check whether the client's request is legal, and if the request is legal, receives the media data source file and other data. When the upload is successful, the upload server returns the file ID of the media data source file to the client. The file ID can be a part of the ticket data. It consists of information such as the upload date of the video source file. If the request is illegal, the upload server requires the client to resend the request for uploading the source file.

After the client receives the file ID, it sends it to the service server. The service server can be a web server (web server) or an application server, and the service server stores the file ID.

Step 202: Process the first media data to obtain second media data according to the pre-configured media data processing requirements corresponding to the current service.

In some examples, the data processing server packages the media data processing requirements of various services into multiple processing processes in advance, and associates the multiple processing processes with service identifiers of the multiple services respectively. Wherein, the processing of the first media data includes: invoking its associated processing process according to the service identifier carried by the first media data, so that the processing process processes the first media data.

Specifically, the service identifier used by the data processing server may be a project ID. In this way, each service corresponds to a project ID, and the name of the processing process may be associated with the project ID. For example, the name of the process includes the project ID.

Wherein, the data processing server can adopt a powerful audio and video processing technology such as ffmpeg, and the data processing server adopts a multi-process mode, and calls the corresponding processing process according to the project ID corresponding to the current business. Here, the first media data uploaded by the client and received by the data processing server may carry the service identifier of the current service (for example, the audio and video source files carry the project ID). During the processing, the data processing server saves the processing status of the process, file ID and other processing information in real time, and the processing information can be stored in a local cache (cache), or stored in a special cache (cache) server or other storage system ( Such as redis db). Wherein, the processing state can be divided into five kinds: 1, being processed, 2, success, 3, parsing error (referring to the protocol error of parsing audio and video processing request, such as requesting that the protocol parameter of audio and video processing is incorrect), 4 . Processing errors (referring to audio and video processing failures, such as audio and video processing failures caused by unequal audio formats), 5. Upload storage server errors.

Step 203: storing the second media data on the network side and obtaining a link address of the second media data.

In some examples, the data processing server uploads the second media data to a storage server, wherein the storage server stores the second media data and generates the link address; receives the link address from the storage server .

Specifically, after the processing process is completed, the data processing server uploads the processed media data file, that is, the second media data, to a storage server, and the storage server may be a cloud storage server, or a content distribution network ( CDN) server, the cloud storage server or CDN server returns the download address (URL) of the second media data file to the data processing server, wherein, the second media data is after the media data is processed by the media data processing server media data.

In some examples, after the first media data is processed and the second media data is obtained, the processing status is recorded, wherein the processing status is used to indicate whether the processing is successful; wherein, when the processing is successful , storing the second media data on the network side and obtaining the link address; the method further includes: when the processing of the first media data uploaded by a client fails, providing the processing status to the service server, so that the service server provides the processing status to the client.

Step 204: In response to the link address acquisition request from the service server, send the obtained one or more link addresses of the current service to the service server, so that the service server can send any client of the current service One or more of the link addresses available to the client are provided.

In some examples, after receiving the first media data, send the identifier of the first media data to the service server; link the obtained link address of the second media data with the first The identity of the media data is saved correspondingly;

Wherein, the providing the link address to the service server includes:

In response to the query request from the service server, find the corresponding link address according to the identifier of the first media data carried in the query request; and

Send the found link address to the service server.

Here, after the business server learns that the product has successfully uploaded the first media data, it will query the bypass processing server in the data processing server for the processing status of the first media data after a predetermined time. After the bypass processing server completes the processing, the second media data If the download address (that is, the link address) is available, the download address is returned to the service server.

In some examples, after the audio and video source file is successfully uploaded, the client may query the service server for the processing status of the audio and video source file after a predetermined time has elapsed. After the bypass processing server successfully processes the audio and video source file, it can obtain the link address of the corresponding audio and video file (i.e. the second media data), and can return the link address to the service server, and the service server will receive the link address Each link address and the file ID of the corresponding audio and video source file are correspondingly stored. The bypass processing server can also send the processing status (such as: 1, processing, 2, success, 3, parsing error, 4, processing error, 5, upload storage server error, etc.) to the service server to the processing status of the audio and video source file . For a client, the business server can provide the client with the processing status of the audio and video source files uploaded by the client, and can also provide the client with the link addresses of one or more second media data available to the client , the client can acquire the second media data corresponding to the link address from the storage server through any link address.

Here, the link addresses of one or more second media data available to a certain client may include at least one of the following: 1. Uploaded by other users participating in the same interactive activity (such as an advertising interactive activity) with the current user of the client; 2. The link address of each second media data corresponding to each first media data uploaded by each user who pays attention to the current user of the client for a certain media content 3. The link address of each second media data corresponding to each first media data uploaded by each user who is concerned by the current user of the client. 4. The link address of each first media data corresponding to each first media data uploaded by friends of the current user of the client. 2. The link address of the media data, 5. The link address of each second media data corresponding to each first media data uploaded by all users of a certain media content, and so on.

For example, for item 1 above, in an advertising interactive activity, each user participating in the activity can upload audio and video source files through their respective clients, and obtain a link of an audio and video file (that is, the second media data) through background processing The address and the link address corresponding to each user's audio and video files generated in this advertising interaction activity can be provided to a certain user's client, so that the user can play each user's audio and video files.

For another example, for the above item 2, the client is a dubbing software, and the current user of the client uploads an audio and video source file (dubbing work source file) through the dubbing software, and the background processing obtains a link address of a dubbing work and publishes it on In the dubbing software platform, the clients of other users who follow this user can access the link address of this dubbing work and play it, and can also send comments or multimedia interactions on this dubbing work, and then upload their own audio and video source files (for Voice comments or audio-video interactive information published by the dubbing work) to the background, the background can process the link address of each audio-video file, and provide the link address of each audio-video file to the client that publishes the dubbing work. The background can also provide these link addresses (namely the above item 5) to the clients of the users who follow the dubbing works.

For another example, for the above item 3, the client is a dubbing software, and the current user of the client uploads an audio and video source file (dubbing work source file) through the dubbing software, and the background processing obtains a link address of a dubbing work and publishes it on In the dubbing software platform, the clients of other users concerned by this user can also upload their own audio and video source files (dubbing work source files) to the background, and the background can process and obtain the link address of each audio and video file, and upload each audio and video file The link address of the video file is provided to the first client, so that the user can access the dubbing works published by other users concerned. For item 4 above, the user's client terminal can obtain audio and video works or audio and video comments published by each friend.

In this application, the link addresses of one or more second media data available to the above-mentioned client are not limited to the above five situations. The available link addresses of the second media data may be different. In short, the service server may determine the link addresses of the available second media data in the current page of the client according to the service logic.

Here, since the data processing server is in the background, when the client's processing requirement for media data changes, it only needs to adjust the processing process corresponding to the processing requirement in the background to realize the change quickly, without having to make changes to the client's program. Any modification, and processing such as format conversion of media data will not occupy processing resources on the user side, which can improve the performance of the entire system.

Wherein, the processing process can be referred to as a bypass processing process of the client (such as dubbing software, media player or WeChat, etc.), and the processing process does not affect the normal operation of the client, eliminating the need for users to use The client waits to improve user experience.

In some examples, the above-mentioned data processing server 104 may include an upload processing module, a data processing module and an information providing module, and these modules may be integrated in the same server device or distributed in different server devices. For example, the upload processing module may be located in the upload server, the data processing module may be located in the data processing server, and the information providing module may be located in an independent information providing server, or may be located in the same server as the data processing module (such as a data processing server). In this way, in some examples, the data processing server 104 may include: an upload server, a processing server (integrated with a data processing module and an information providing module). In some other examples, the data processing server 104 may include: an upload server, a processing server and an information providing server.

This application proposes a media data processing system. In some examples, the system 300 includes: a business server 301, an upload server 302, a processing server 303, and an information providing server 304, and the information providing server 304 is integrated in the processing server 303 or set independently; wherein, the The upload server 302 receives the first media data uploaded by any client of the current service, and provides the first media data to the processing server 303; the processing server 303, according to the pre-configured media corresponding to the current service Data processing requirements, processing the first media data to obtain second media data; storing the second media data on the network side and obtaining a link address of the second media data, and saving the link address In the information providing server 304; the service server 301, in response to a request for uploading the first media data from any client of the current service, sends a link address acquisition request to the information providing server 304; the information The providing server 304, in response to the link address acquisition request from the service server, sends the acquired one or more link addresses of the current service to the service server 301; the service server 301 sends the current service Any client of the service provides one or more of said link addresses available to the client.

In some examples, the system 300 further includes: a verification server 305; wherein, the service server 301, in response to the request for uploading the first media data, further sends to the verification server 305 a request for obtaining a verification ticket request; the verification server 305, in response to the request for obtaining a verification ticket from the business server 301, sends a verification ticket to the business server 301; the business server 301 further sends the verification ticket to the The client; when the upload server 302 receives the first media data, further receive the verification ticket corresponding to the first media data; check whether the first media data is legal according to the verification ticket; When the result is that the first media data is legal, the first media data is provided to the data processing server 303 .

In some instances, when the processing requirements of multiple clients are large and the processing capacity of a single server may be insufficient, a distributed processing scheme can be adopted, using multiple data processing servers for distributed processing, and the processed result information can be stored uniformly , which is used by the business server to query the processing status. In this case, the system 300 may include multiple groups of the upload server 302 and the processing server 303, wherein each group includes one upload server 302 and one processing server 303, and the information providing server 304 Independently set; the service server 301, in response to a request from any client of the current service to upload the first media data, further receives the first media data from the client, and selects a client for the client. Group the upload server and the processing server 303, and send the first media data to the selected upload server 302; the upload server 302 provides the first media data to the processing server of the same group server 303.

In some instances, the processing server 303 may be called a bypass processing server, and the information providing server 304 may be called an information storage module.

As shown in Figure 4, the distributed processing process involves: N clients (client 1, client 2...client N), a storage server storing the second media data and processing information (including URL and/or processing status) processing information storage module for unified storage. And the distributed processing platform also includes N groups of servers for media data processing, each group includes an upload server and a bypass processing server, as shown in Figure 4, may include: upload server 1 and bypass processing server 1, upload Server 2 and bypass processing server 2, upload server N and bypass processing server N. Since this application mainly involves the distributed processing of media data, the service server and verification server are not shown in the platform. In practical applications, the platform may also include one or more service servers and verification servers, any of which The client can send a request for uploading media data source files to the service server corresponding to the current service, and can also obtain a ticket from the corresponding verification server.

Then, the client sends the ticket, media data source file, project ID and other data to the corresponding business server, and the business server selects an upload server and uploads the ticket, media data source file, project ID and other data to the selected upload server , this selection rule can be as follows: configure the IP address and port number list of each upload server in the business server, when the business server receives a request from the client, the project ID and the total number of upload servers are "modulo valued" Choose one of the upload servers. For example: there are 7 project IDs in total, namely 1000, 1001, ..., 1006, and 5 upload servers in total, whose IP addresses are {"10.127.0.1", "10.127.0.2", "10.127.0.3", "10.127.0.4","10.127.0.5"}, then the upload server corresponding to client 1 is: take the modulo of the project ID of the business currently used by client 1 and the total number of upload servers, 1000%5=0, then determine The identifier of the upload server corresponding to client 1 is 0, and the IP address of the upload server is server[0]=10.127.0.1; similarly, the upload server corresponding to client 2 is: 1001%5=1, then the client is determined The upload server ID corresponding to terminal 2 is 1, and the IP address of the upload server is server[1]=10.127.0.2; similarly, the upload server corresponding to client 3 is: 1002%5=2, then client 3 is determined The corresponding upload server ID is 2, and the IP address of the upload server is server[2]=10.127.0.3; similarly, the upload server corresponding to client 4 is: 1003%5=3, then it is determined that client 4 corresponds to The upload server ID is 3, and the IP address of the upload server is server[3]=10.127.0.4; similarly, the upload server corresponding to client 5 is: 1004%5=4, then determine the upload server corresponding to client 5 The server ID is 4, and the IP address of the upload server is server[4]=10.127.0.5; similarly, the upload server corresponding to client 6 is: 1005%5=0, then determine the corresponding upload server ID of client 6 is 0, the IP address of the upload server is server[0]=10.127.0.1; similarly, the upload server corresponding to client 7 is: 1006%5=1, then it is determined that the upload server ID corresponding to client 7 is 1 , the IP address of the upload server is server[1]=10.127.0.2.

When the above audio and video source files and other data are successfully uploaded, the upload server that receives the data notifies its corresponding bypass processing server to process, the notification carries the project ID, and the bypass processing server calls the project ID according to the project ID The corresponding processing process is processed, and the processed information is centrally placed in the processing information storage module, so that the business server can query the processing status and use it. After the bypass processing server has successfully processed the media data source file, the second media data is uploaded to the storage server, and the storage server returns the link address (URL) (processing information) of the second media data to the bypass processing server, The bypass processing server saves the URL to the processing information storage module.

Using the above-mentioned processing technology solution, the processing of media data and decoupling of products can be realized. At the same time, the data processing server processes asynchronously in the background, which can complete the processing requirements of media data in a short period of time, and will not block during the processing Other operations of the user, so as to make the user experience better. This solution can quickly realize various complex media data processing requirements and improve user experience.

In some instances, for interactive advertising activities (for example, for users to click on an advertisement to enter an active page, that is, a page that interacts with users (users can perform operations such as voice interaction or voice comments on this page), deepen users' understanding of advertisements ) often requires the use of media data processing such as video and audio materials. In general, it takes a lot of time to edit audio and video, add background music, subtitles, and cut audio and video to the required length of time. At the same time, it must After completing all the production of audio and video, it can be uploaded to the storage server for storage, so that it can be called directly in the next use. And adopt the technical scheme of the present application, the client selects an upload server in the distributed processing platform (as shown in Figure 3) by the service server to upload the audio and video source files, and then carry out audio and video processing by the bypass processing server, processing After success, the bypass processing server uploads the second media data to the storage server, and the storage server returns the URL of the second media data to the bypass processing server, and the bypass processing server saves the URL to the processing information storage module. The service server corresponding to the client inquires the link address of the second media data from the processing information storage module, and returns the link address of the second media data to the client according to the request of the client, for the user to use directly in the interactive advertising campaign, such as Users can click on the URL to play the produced audio and video. At the same time, because the time from development to launch of the interactive advertising campaign is relatively short, and the requirements change frequently, the above-mentioned technical solution of this application can quickly meet the needs of development and launch, function updates and demand changes.

In some instances, the above-mentioned technical solutions of the present application can also be used in combination with existing live broadcast platforms or live broadcast events. Generally, after the live broadcast, there will be a demand for clipping and playback of video materials. This application provides a packaged distributed processing platform (as shown in Figure 4), and uploads its video source files to the business server during the live broadcast platform or live broadcast activities. The server selects an upload server in the distributed processing platform, and then the bypass processing server performs audio and video clipping and various function additions, and finally the storage server provides the URL of the processed audio and video files to the bypass processing server for bypass processing The server saves the URL to the processing information storage module. The service server corresponding to the client queries the processing information storage module for the URL of the second media data, and returns the URL of the second media data to the client according to the request of the client, for the user to play the live video.

By adopting the above technical solutions, various complex media data processing requirements can be quickly realized without blocking other operations of the user, and the change of media data processing requirements can be quickly realized. lot of time. Efficient and fast distributed asynchronous processing improves user experience for products that require media data processing. At the same time, by opening the packaged platform entrance to usage scenarios such as live broadcast platforms or live events, audio and video sources can be quickly imported, and live audio and video can be quickly re-produced, multiplexed, and disseminated.

In some examples, the present application also proposes a media data processing method, which can be applied to the client 101, as shown in FIG. 5 , the method includes the following steps:

Step 501: Upload the first media data generated by the current business to the data processing server; wherein, for the first media data uploaded by any client of the current business, the data processing server The media data processing requirements process the first media data to obtain second media data, store the second media data on the network side and obtain a link address of the second media data.

Step 502: Send a link address acquisition request to the service server; wherein, in response to the link address acquisition request, the service server determines from one or more link addresses of the current service obtained by the data processing server that the client is Each of the mentioned link addresses is available.

Step 503: Receive each of the link addresses available to the client from the service server.

Step 504: In response to the user's selection operation on any one of the received link addresses, acquire the second media data from the network side according to the selected link address.

Step 505: Play the acquired second media data.

In some examples, an upload request is sent to the service server; wherein, the service server obtains a verification ticket from the data processing server in response to the upload request; receives the verification ticket from the service server; The verification ticket is uploaded to the data processing server together with the first media data, so that it can verify whether the first media data is legal according to the verification ticket, and when the verification result is that the first media data is legal , executing the process of processing the first media data and obtaining second media data.

In some examples, receiving a processing status from the service server, wherein the processing status is used to indicate whether the data processing server successfully performs the processing on the first media data uploaded by the client; and displaying the processing status.

Fig. 6 shows an interactive diagram of media data processing provided by this application. Wherein, the client is a browser displaying a web page of a media interactive activity (such as a live event), so that its corresponding service server is a web server (webserver); Composition, including verification server (ticket server), upload server and bypass processing server. Here, the media data may be audio and video data.

As shown in Figure 6, the media data processing comprises the following steps:

Step 601: The bypass processing server encapsulates the audio and video processing requirements of the activities that the client can participate in into processing processes corresponding to the processing requirements, wherein each activity corresponds to a project ID, and each processing process can be associated with a project ID save.

Step 602: the client sends a request for uploading audio and video source files to the website server through the above-mentioned active web page. Here, when the user uses the client to participate in the above activities, there will be audio and video processing requirements, such as: recording a piece of audio and video and uploading the audio and video source file through this web page, at this time, the client will send the upload audio and video source to the website server file request.

Step 603: After receiving the above request, the website server obtains a ticket for verifying whether the user request is legal from the verification server.

Step 604: Correspondingly, the verification server returns the ticket to the website server, and the website server returns it to the client.

Step 605: The client uploads the aforementioned data such as the ticket, project ID, audio and video source files, and user identification information to the upload server. Here, when a distributed processing platform is used in the background, the data can be sent to the service server first, and the service server selects an upload server, and then sends the data to the selected upload server.

Here, the audio and video source files may include voice interactions or voice comments recorded by users in interactive advertising campaigns, the above voices need to be processed for effects, etc., or videos recorded in live broadcast activities, which need to be edited and have various functions add etc.

Step 606: The upload server parses the above ticket, if the verification is valid, go to step 608, otherwise go to step 607.

Step 607: The upload server feeds back the result information of upload failure to the client. After receiving the information, the client can resend the request for uploading audio and video source files, and continue to execute the above steps, that is, re-execute steps 601-606 again, or end the current process.

Step 608: The upload server receives data such as audio and video source files uploaded by the client, and temporarily stores the audio and video source files locally for use by the bypass processing server.

Step 609: If the above data is successfully uploaded, the upload server returns the file ID of the audio and video source file to the client.

Step 610: the client sends a request for saving the file ID to the website server.

Step 611: The website server responds to the above request and saves the file ID.

Step 612: The upload server notifies the bypass processing server to process the audio and video source files, and the notification carries data such as project ID, file ID, and audio and video source files.

Step 613: The bypass processing server invokes the packaged audio and video processing process according to the project ID to perform audio and video processing, such as transposing, adding background music, audio conversion, or clipping and playing back video materials.

Step 614: The bypass processing server stores the processing information of the audio and video source files, such as file ID and processing status, in a local cache (cache) in real time, so as to facilitate the query of the client. Wherein, when a distributed processing platform is used in the background, the bypass processing server uniformly stores the above processing information in the processing information storage module.

Step 615: After the bypass processing server successfully processes the audio and video source files, upload the successfully processed audio and video files, that is, the second media data, to a storage server, such as a cloud storage platform. However, when the bypass processing server fails to process the audio and video source files successfully, the audio and video files cannot be uploaded to the storage server, and steps 615-624 are not executed.

Step 616: the storage server stores the audio and video files.

Step 617: The storage server returns the link address (URL) of the audio/video file to the bypass processing server. Here, when a distributed processing platform is used in the background, the storage server returns the URL to the bypass processing server, and the bypass processing server saves the URL to the processing information storage module.

Step 618: The bypass processing server stores the URL in a local cache, and stores it in correspondence with the file ID and the item ID. Similarly, when a distributed processing platform is used in the background, the bypass processing server stores the URL, the file ID and the project ID correspondingly to the processing information storage module.

Step 619: After learning that the audio and video source file is successfully uploaded, the website server inquires the processing status of the audio and video source file and the URL of the audio and video file to the bypass processing server according to the file ID, and whether the URL of the audio and video file is available. Wherein, when a distributed processing platform is used in the background, the website server queries the processing information storage module for the processing status of the audio-video source file and whether the URL of the audio-video file is available according to the file ID.

Step 620: When the processing status is 2, that is, "success", the URL is available, and the bypass processing server returns the URL to the website server; when the processing status is other, no URL is returned. Further, the bypass processing server can feed back the processing status to the website server. Wherein, when returning the URL and processing status, the file ID will be returned to the website server at the same time.

Step 621: After obtaining the URL, the website server saves the file ID and its corresponding URL, and obtains a series of file IDs and URLs, that is, a list of file IDs and URLs. Further, the project ID and file ID of the current business can be stored correspondingly to the URL list, so as to distinguish each audio and video file and its URL generated in different businesses.

Step 622: the client requests the URL from the web server. This request can be sent by the client to the web server after a predetermined time after uploading the audio and video source files (such as automatically refreshing the current page every 10s), or it can be for the user to click on the client Sent by the corresponding control displayed (for example, the user clicks the refresh button on the page).

Step 623: The website server responds to the client's link address acquisition request, and returns URLs related to the client (such as all URLs of the current page) to the client.

Step 624: The client obtains the second media data from the storage server according to any of the above URLs, plays the second media data, and then the user can watch the processed audio and video files. Here, after the client obtains a series of URLs, they can be displayed on the page. Further, in response to the user's selection operation on one of the URLs, the second media data can be obtained from the storage server according to the selected URL.

Based on the method provided by the above examples, the present application also proposes a media data processing device, which can be applied to a data processing server. As shown in Figure 7, the device includes:

The upload processing module 701 receives the first media data uploaded by any client of the current service.

The data processing module 702 processes the first media data and obtains second media data according to the pre-configured media data processing requirements corresponding to the current service; stores the second media data on the network side and obtains the first media data The link address of the second media data, and save the link address in the information providing module.

The information providing module 703, in response to the link address acquisition request from the service server, sends the obtained one or more link addresses of the current service to the service server, so that the service server sends any link address of the current service to the service server. The client provides one or more link addresses.

In some examples, the device further includes: a verification module 704, which sends a verification ticket to the service server in response to a request from the service server for obtaining a verification ticket; wherein, the upload processing module receives the first media data, further receive the verification ticket corresponding to the first media data; check whether the first media data is legal according to the verification ticket; when the verification result is that the first media data is legal, the data The processing module executes the processing of processing the first media data and obtaining the second media data.

In some examples, the data processing module 702 further packages the media data processing requirements of various services into multiple processing processes in advance, and correlates the multiple processing processes with the business identifiers of the multiple services respectively wherein, the data processing module 702 processes the first media data, including: invoking its associated processing process according to the service identifier carried by the first media data, so that the processing process processes the first media data Media data is processed.

In some examples, the upload processing module 701, after receiving the first media data, further sends the identification of the first media data to the client, so that the client sends the first media data An identifier of the media data is sent to the service server; the information providing module 703 further stores the link address of the second media data obtained by the data processing module 702 corresponding to the identifier of the first media data; Wherein, the information providing module 703 sending the one or more link addresses of the current service obtained by the data processing module 702 to the service server includes: obtaining one or more link addresses carried in the link address acquisition request according to the link address A plurality of identifiers of the first media data find corresponding one or more of the link addresses; and send the found one or more of the link addresses to the service server.

In some examples, after the data processing module 702 processes the first media data and obtains the second media data, it further records the processing status in the information providing module, wherein the processing status is used for indicates whether the processing is successful; wherein, the data processing module 702, when the processing is successful, stores the second media data on the network side and obtains the link address; the information providing module 702, when the When the data processing module fails to process the first media data uploaded by any client, it further provides the processing status to the service server, so that the service server provides the processing status to the the client.

In some examples, the device includes multiple groups of upload processing modules 701 and data processing modules 702 , wherein each group includes one upload processing module 701 and one data processing module 702 .

In some examples, the present application also provides a media data processing device, and the device can use a client. As shown in Figure 8, the device 800 includes:

Upload module 801, uploading the first media data generated by the current service to the data processing server; wherein, for the first media data uploaded by any client of the current service, the data processing server corresponds to the pre-configured current service According to the media data processing requirement, the first media data is processed to obtain second media data, and the second media data is stored on the network side to obtain a link address of the second media data.

The first sending module 802 sends a link address acquisition request to the service server; wherein, in response to the link address acquisition request, the service server determines from one or more link addresses of the current service obtained by the data processing server for Each of the above link addresses available on this client.

The first receiving module 803 is configured to receive each of the link addresses available to the client from the service server.

The acquiring module 804 is configured to acquire the second media data from the network side according to the selected link address in response to the user's selection operation on any one of the received link addresses.

A playing module 805, playing the acquired second media data.

In some examples, the device further includes: a second sending module 806, which sends an upload request to the business server; wherein, the business server obtains a verification ticket from the data processing server in response to the upload request; the second receiving Module 807, receiving the verification ticket from the service server; the upload module uploads the verification ticket together with the first media data to the data processing server, so that it can verify all Whether the first media data is legal, and when the verification result is that the first media data is legal, execute the process of processing the first media data and obtaining second media data.

In some examples, the device further includes: a third receiving module 808, configured to receive a processing status from the service server, wherein the processing status is used to instruct the data processing server to process the first media data uploaded by the client whether the process is performed successfully; and display the process status.

The specific methods and principles for each entity in the above system to realize various functions have been described above, and will not be repeated here.

In addition, the devices and modules in each example of the present application may be integrated into one processing unit, or each module may exist separately physically, or two or more devices or modules may be integrated into one unit. The above-mentioned integrated units can be implemented in the form of hardware or in the form of software functional units.

In an embodiment, the above-mentioned media data processing apparatus may run in any computing device for media data processing, and be loaded into the memory of the computing device. As shown in Figure 9, the computing device includes one or more processors (CPUs) 902, a communications module 904, memory 906, a user interface 910, and a communications bus 908 for interconnecting these components.

The processor 902 can receive and send data through the communication module 904 to realize network communication and/or local communication.

User interface 910 includes one or more output devices 912 including one or more speakers and/or one or more visual displays. User interface 910 also includes one or more input devices 914 including, for example, a keyboard, mouse, voice command input unit or speaker, touch screen display, touch sensitive tablet, gesture capture camera or other input buttons or controls, and the like.

The memory 906 can be a high-speed random access memory, such as DRAM, SRAM, DDR RAM, or other random access solid-state storage devices; or a non-volatile memory, such as one or more magnetic disk storage devices, optical disk storage devices, flash memory devices, or other non-volatile solid-state storage devices.

The memory 906 stores an instruction set executable by the processor 902, including:

Operating system 916, including programs for processing various basic system services and for performing hardware-related tasks;

The application 918 may include various application programs for implementing media data processing, such application programs can implement the processing flow in the above examples, for example, may include the device 700 shown in FIG. 7 and/or the device shown in FIG. 8 800.

In some examples, the apparatus 700 may include at least one of the modules 701-704 shown in FIG. 7, and each module 701-704 may store machine-executable instructions. The processor 902 can implement the functions of the above-mentioned modules 701-704 by executing the machine-executable instructions in the modules 701-704 in the memory 906.

In some examples, the apparatus 800 may include at least one of the modules 801-808 shown in FIG. 8, and each module 801-808 may store machine-executable instructions. The processor 902 can implement the functions of the above-mentioned modules 801-808 by executing the machine-executable instructions in the modules 801-808 in the memory 906.

In addition, each example of the present application can be realized by a data processing program executed by a data processing device such as a computer. Obviously, the data processing program constitutes the present invention. In addition, usually a data processing program stored in a storage medium is executed by directly reading the program out of the storage medium or by installing or copying the program into a storage device (such as hard disk and/or memory) of the data processing device. Therefore, such a storage medium also constitutes the present invention. The storage medium can use any type of recording method, such as paper storage medium (such as paper tape, etc.), magnetic storage medium (such as floppy disk, hard disk, flash memory, etc.), optical storage medium (such as CD-ROM, etc.), magneto-optical storage medium ( Such as MO, etc.) etc.

Therefore, the present application also provides a non-volatile storage medium, in which a data processing program is stored, and the data processing program is used to execute any instance of the above-mentioned method in the present application.

The above is only a preferred example of the application, and is not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within the range.

Claims (18)

1. A method for media data processing, the method comprising:

for any client of the current service, the following processing is executed:

receiving first media data uploaded by the client;

processing the first media data according to a media data processing requirement corresponding to a preset current service to obtain second media data; and

storing the second media data at a network side and obtaining a link address of the second media data;

and

and responding to a link address acquisition request from a service server, and sending one or more acquired link addresses of the current service to the service server so that the service server provides one or more available link addresses of any client of the current service to the client.

2. The method of claim 1, further comprising:

sending a validation ticket to the service server in response to a request for obtaining a validation ticket from the service server before receiving the first media data;

when the first media data is received, further receiving a verification bill corresponding to the first media data;

verifying whether the first media data is legal or not according to the verification ticket;

and when the verification result shows that the first media data is legal, executing the processing of processing the first media data and obtaining second media data.

3. The method of claim 1, further comprising: the method comprises the steps that media data processing requirements of various services are respectively packaged into a plurality of processing processes in advance, and the plurality of processing processes are respectively associated with service identifications of the various services;

wherein the processing the first media data comprises: and calling the associated processing process according to the service identifier carried by the first media data so as to process the first media data by the processing process.

4. The method of claim 1, further comprising:

after receiving the first media data, sending the identifier of the first media data to the client, so that the client sends the identifier of the first media data to the service server; and

correspondingly storing the obtained link address of the second media data and the identification of the first media data;

wherein the sending the one or more obtained link addresses of the current service to the service server includes:

searching one or more corresponding link addresses according to one or more first media data identifiers carried by the link address acquisition request; and

and sending the one or more searched link addresses to the service server.

5. The method of claim 1, wherein the storing the second media data on the network side and obtaining the link address of the second media data comprises:

uploading the second media data to a storage server, wherein the storage server stores the second media data and generates the link address;

receiving the link address from the storage server.

6. The method of claim 1, further comprising: recording a processing state after processing the first media data and obtaining second media data, wherein the processing state is used for indicating whether the processing is successful or not;

when the processing is successful, storing the second media data on a network side and obtaining the link address;

the method further comprises the following steps:

and when the processing of the first media data uploaded by any client fails, providing the processing state to the service server so that the service server provides the processing state to the client.

7. A media data processing method is applied to a client, and the method comprises the following steps:

uploading first media data generated by the current service to a data processing server; the data processing server processes the first media data according to a pre-configured media data processing requirement corresponding to the current service to obtain second media data, stores the second media data on a network side and obtains a link address of the second media data;

sending a link address acquisition request to a service server; the service server responds to the link address acquisition request, and determines each link address available for the client from one or more link addresses of the current service acquired by the data processing server;

receiving each link address available to the client from the service server;

responding to the selection operation of a user on any link address in the received link addresses, and acquiring the second media data from a network side according to the selected link address; and

and playing the acquired second media data.

8. The method of claim 7, further comprising:

sending an upload request to the service server; wherein the service server obtains a validation ticket from the data processing server in response to the upload request;

receiving the validation ticket from the business server;

and uploading the verification bill and the first media data to the data processing server together, so that the data processing server verifies whether the first media data is legal or not according to the verification bill, and when the verification result is that the first media data is legal, executing the processing of processing the first media data and obtaining second media data.

9. The method of claim 7, further comprising:

receiving a processing state from the service server, wherein the processing state is used for indicating whether the data processing server successfully processes the first media data uploaded by the client; and

and displaying the processing state.

10. A media data processing apparatus, characterized in that the apparatus comprises:

the uploading processing module is used for receiving first media data uploaded by any client of the current service;

the data processing module is used for processing the first media data according to a media data processing requirement corresponding to a preset current service and obtaining second media data; storing the second media data at a network side, obtaining a link address of the second media data, and storing the link address in the information providing module; and

and the information providing module responds to a link address acquisition request from a service server and sends one or more acquired link addresses of the current service to the service server so that the service server provides one or more link addresses to any client of the current service.

11. The apparatus of claim 10, further comprising:

the verification module responds to a request for obtaining a verification bill from the service server and sends the verification bill to the service server;

when the uploading processing module receives the first media data, a verification bill corresponding to the first media data is further received; verifying whether the first media data is legal or not according to the verification ticket;

and when the verification result shows that the first media data is legal, the data processing module executes the processing of processing the first media data and obtaining second media data.

12. The apparatus of claim 10, wherein,

the data processing module is further used for encapsulating media data processing requirements of various services into a plurality of processing processes in advance respectively and associating the plurality of processing processes with the service identifications of the various services respectively;

wherein, the data processing module processes the first media data, including: and calling the associated processing process according to the service identifier carried by the first media data so as to process the first media data by the processing process.

13. The apparatus of claim 10, wherein,

the uploading processing module further sends the identifier of the first media data to the client after receiving the first media data, so that the client sends the identifier of the first media data to the service server;

the information providing module is further used for correspondingly storing the link address of the second media data obtained by the data processing module and the identifier of the first media data;

wherein, the sending, by the information providing module, one or more link addresses of the current service obtained by the data processing module to the service server includes: searching one or more corresponding link addresses according to one or more first media data identifiers carried by the link address acquisition request; and sending the one or more searched link addresses to the service server.

14. The apparatus according to claim 10, wherein the data processing module further records a processing status in the information providing module after processing the first media data and obtaining a second media data, wherein the processing status is used to indicate whether the processing is successful;

when the processing is successful, the data processing module stores the second media data on a network side and obtains the link address; the information providing module is used for further providing the processing state to the service server when the data processing module fails to process the first media data uploaded by any client, so that the service server provides the processing state to the client.

15. The apparatus of claim 10, wherein the apparatus comprises a plurality of sets of upload processing modules and data processing modules, wherein each set comprises one upload processing module and one data processing module.

16. A media data processing system, comprising: the system comprises a business server, an uploading server, a processing server and an information providing server, wherein the information providing server is integrated in the processing server or is independently arranged; wherein,

the uploading server receives first media data uploaded by any client of the current service and provides the first media data to the processing server;

the processing server processes the first media data according to a media data processing requirement corresponding to a preset current service to obtain second media data; storing the second media data on a network side, obtaining a link address of the second media data, and storing the link address in the information providing server;

the service server responds to a request for uploading the first media data from any client of the current service and sends a link address acquisition request to the information providing server;

the information providing server responds to the link address acquisition request from the service server and sends one or more link addresses of the acquired current service to the service server;

and the service server provides one or more link addresses available for any client of the current service to the client.

17. The system of claim 16, further comprising: an authentication server; wherein,

the service server responds to the request for uploading the first media data and further sends a request for acquiring a verification bill to the verification server;

the verification server responds to the request for obtaining the verification bill from the service server and sends the verification bill to the service server;

the business server further sends the verification bill to the client;

when the uploading server receives the first media data, the uploading server further receives a verification bill corresponding to the first media data; verifying whether the first media data is legal or not according to the verification ticket; and when the verification result is that the first media data is legal, providing the first media data to the data processing server.

18. The system according to claim 16, wherein the system includes a plurality of groups of the upload server and the processing server, wherein each group includes one of the upload server and one of the processing servers, the information providing servers being independently provided;

the service server responds to a request for uploading the first media data from any client of the current service, further receives the first media data from the client, selects a group of the uploading server and the processing server for the client, and sends the first media data to the selected uploading server;

and the uploading server provides the first media data to the processing servers of the same group.