CN112487218B - Content processing method, system, device, computing device and storage medium - Google Patents

Abstract

The present disclosure relates to a content processing method, system, apparatus, computing device, and storage medium, and relates to the field of cloud computing technology. The method includes obtaining, by an access stratum, a first request including content data and a processing command for the content data. The method also includes sending, by the access stratum, a second request to the service stratum in response to the source of the first request meeting the security criterion, wherein the second request includes content data and a processing command, and the second request does not include the source of the first request. The method further includes processing, by the service layer, the content data according to the processing command.

Description

Content processing method, system, device, computing device and storage medium

technical field

The present disclosure relates to the technical field of cloud computing, and in particular to a content processing method, system, device, computing device and storage medium.

Background technique

Content processing may include word processing, video processing, image processing, topic processing, etc. Implementing all content processing functions in a single module gradually becomes tedious and inefficient as the amount of computation increases. Therefore, a properly decoupled content processing method and system architecture are needed.

The approaches described in this section are not necessarily approaches that have been previously conceived or employed. Unless otherwise indicated, it should not be assumed that any approaches described in this section are admitted to be prior art solely by virtue of their inclusion in this section. Similarly, issues mentioned in this section should not be considered to have been recognized in any prior art unless otherwise indicated.

Contents of the invention

According to one aspect of the present disclosure, a content processing method is disclosed. The method includes obtaining, by an access layer, a first request including content data and processing commands for the content data. The method also includes sending, by the access layer, a second request to the service layer in response to the source of the first request meeting a security criterion. The second request includes the content data and the processing command, and the second request does not include the source of the first request. The method further includes processing the content data by the service layer according to the processing command.

According to another aspect of the present disclosure, a content processing system is disclosed. The content processing system includes an access layer. The access layer is used to obtain a first request, the first request includes content data and a processing command for the content data, and sends a second request to the service layer in response to the source of the first request meeting a security index . The second request includes said content data and said processing command, and the second request does not include the source of the first request. The content processing system also includes a service layer. The service layer is configured to process the content data according to the processing command.

According to yet another aspect of the present disclosure, a computing device is disclosed, which may include a processor; and a memory storing a program, the program including instructions, and the program includes instructions for causing the processor to execute the above-mentioned content processing method when executed by the processor.

According to still another aspect of the present disclosure, a computer-readable storage medium storing a program may include instructions causing the server to execute the above-mentioned content processing method when executed by a processor of the server.

According to yet another aspect of the present disclosure, a computer program product is disclosed, including computer instructions that, when executed by a processor of a server, cause the server to perform the above content processing method.

Description of drawings

The drawings exemplarily illustrate the embodiment and constitute a part of the specification, and together with the text description of the specification, serve to explain the exemplary implementation of the embodiment. The illustrated embodiments are for illustrative purposes only and do not limit the scope of the claims. Throughout the drawings, like reference numbers designate similar, but not necessarily identical, elements.

FIG. 1 is a schematic diagram of an exemplary system in which various methods described herein may be implemented, according to an embodiment of the present disclosure;

2 is a flowchart of a content processing method according to an embodiment of the present disclosure;

3 is an example architecture diagram of a content processing system according to an embodiment of the present disclosure;

FIG. 4(a) is a schematic diagram of concurrent processing of a service layer according to an embodiment of the present disclosure;

Fig. 4 (b) is the exemplary functional schematic diagram of the service layer according to the embodiment of the present disclosure;

FIG. 5(a) is a flowchart of a content processing method according to another embodiment of the present disclosure;

Figure 5(b) is an example architecture diagram of a content processing system according to another embodiment of the present disclosure;

Fig. 6 shows a structural block diagram of a content processing device according to an embodiment of the present disclosure;

FIG. 7 shows a structural block diagram of an exemplary server and client that can be used to implement the embodiments of the present disclosure.

Detailed ways

In the present disclosure, unless otherwise stated, using the terms "first", "second", etc. to describe various elements is not intended to limit the positional relationship, temporal relationship or importance relationship of these elements, and such terms are only used for Distinguishes one element from another. In some examples, the first element and the second element may refer to the same instance of the element, and in some cases, they may also refer to different instances based on contextual description.

The terminology used in describing the various described examples in this disclosure is for the purpose of describing particular examples only and is not intended to be limiting. Unless the context clearly indicates otherwise, if the number of elements is not specifically limited, there may be one or more elements. In addition, the term "and/or" used in the present disclosure covers any one and all possible combinations of the listed items.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

FIG. 1 shows a schematic diagram of an exemplary system 100 in which various methods and apparatus described herein may be implemented according to an embodiment of the present disclosure. 1, the system 100 includes one or more client devices 101, 102, 103, 104, 105, and 106, a server 120, and one or more communication networks coupling the one or more client devices to the server 120 110. Client devices 101, 102, 103, 104, 105, and 106 may be configured to execute one or more applications.

In an embodiment of the present disclosure, the server 120 may run one or more services or software applications that enable the method of content processing.

In some embodiments, server 120 may also provide other services or software applications that may include non-virtualized environments and virtualized environments. In some embodiments, these services may be provided as web-based services or cloud services, such as under a software-as-a-service (SaaS) model to users of client devices 101, 102, 103, 104, 105, and/or 106 .

In the configuration shown in FIG. 1 , server 120 may include one or more components that implement the functions performed by server 120 . These components may include software components, hardware components or combinations thereof executable by one or more processors. Users operating client devices 101, 102, 103, 104, 105, and/or 106 may in turn utilize one or more client application programs to interact with server 120 to utilize the services provided by these components. It should be understood that various different system configurations are possible, which may differ from system 100 . Accordingly, FIG. 1 is one example of a system for implementing the various methods described herein, and is not intended to be limiting.

A user may use client devices 101 , 102 , 103 , 104 , 105 and/or 106 to process content. A client device may provide an interface that enables a user of the client device to interact with the client device. The client device can also output information to the user via the interface. Although FIG. 1 depicts only six client devices, those skilled in the art will understand that the present disclosure can support any number of client devices.

Client devices 101, 102, 103, 104, 105, and/or 106 may include various types of computing systems, such as portable handheld devices, general-purpose computers (such as personal computers and laptops), workstation computers, wearable devices, Gaming systems, thin clients, various messaging devices, sensors or other sensing devices, etc. These computing devices can run various types and versions of software applications and operating systems, such as Microsoft Windows, Apple iOS, UNIX-like operating systems, Linux or Linux-like operating systems (such as Google Chrome OS); or include various mobile operating systems , such as Microsoft Windows Mobile OS, iOS, Windows Phone, Android. Portable handheld devices may include cellular phones, smart phones, tablet computers, personal digital assistants (PDAs), and the like. Wearable devices can include head-mounted displays and other devices. Gaming systems may include various handheld gaming devices, Internet-enabled gaming devices, and the like. A client device is capable of executing a variety of different applications, such as various Internet-related applications, communication applications (eg, email applications), Short Message Service (SMS) applications, and may use a variety of communication protocols.

Network 110 can be any type of network known to those skilled in the art that can support data communications using any of a number of available protocols, including but not limited to TCP/IP, SNA, IPX, and the like. By way of example only, the one or more networks 110 may be a local area network (LAN), an Ethernet-based network, a token ring, a wide area network (WAN), the Internet, a virtual network, a virtual private network (VPN), an intranet, an extranet, Public switched telephone network (PSTN), infrared network, wireless network (eg Bluetooth, WIFI) and/or any combination of these and/or other networks.

Server 120 may include one or more general purpose computers, dedicated server computers (e.g., PC (personal computer) servers, UNIX servers, midrange servers), blade servers, mainframe computers, server clusters, or any other suitable arrangement and/or combination . Server 120 may include one or more virtual machines running virtual operating systems, or other computing architectures involving virtualization (eg, one or more flexible pools of logical storage devices that may be virtualized to maintain the server's virtual storage devices). In various embodiments, server 120 may run one or more services or software applications that provide the functionality described below.

The computing system in server 120 may run one or more operating systems including any of the operating systems described above as well as any commercially available server operating systems. Server 120 may also run any of a variety of additional server applications and/or middle-tier applications, including HTTP servers, FTP servers, CGI servers, JAVA servers, database servers, and the like.

In some implementations, server 120 may include one or more applications to analyze and consolidate data feeds and/or event updates received from users of client devices 101 , 102 , 103 , 104 , 105 , and 106 . Server 120 may also include one or more applications to display data feeds and/or real-time events via one or more display devices of client devices 101 , 102 , 103 , 104 , 105 , and 106 .

System 100 may also include one or more databases 130 . In some embodiments, these databases may be used to store data and other information. For example, one or more of databases 130 may be used to store information such as audio files and video files. Data repository 130 may reside in various locations. For example, the data store used by server 120 may be local to server 120, or may be remote from server 120 and may communicate with server 120 via a network-based or dedicated connection. Data repository 130 can be of different types. In some embodiments, the data store used by server 120 may be a database, such as a relational database. One or more of these databases may store, update and retrieve the database and data from the database in response to commands.

In some embodiments, one or more of databases 130 may also be used by applications to store application data. Databases used by applications can be different types of databases such as key-value stores, object stores or regular stores backed by a file system.

The system 100 of FIG. 1 may be configured and operated in various ways to enable application of the various methods and apparatuses described in accordance with this disclosure.

The flow of an example content processing method 200 according to an embodiment of the present disclosure is described below with reference to FIG. 2 .

At step S201, the access layer acquires a first request, where the first request includes content data and a processing command for the content data.

At step S202, the access layer sends the second request to the service layer in response to the source of the first request meeting the security index. The second request includes content data and processing commands, and the second request does not include the source of the first request.

At step S203, the service layer processes the content data according to the processing command.

According to the above method, the access layer can receive the preliminarily processed data, perform safety verification on it, and then pass it to the service layer for calculation. The access layer does not need to pass the data source to the service layer, and the service layer does not need to know the source of the data. As a result, functional decoupling between modules can be achieved, and the workload required for update iterations can be simplified. The security index can be based on the security requirements required by the service, etc., to determine the source of the first request (for example, in the case of an internal request, it is a previous module such as a front-end or presentation layer, or in the case of an external request, it can be a gateway etc.) can access the service layer. By splitting the security check function, only a small number of required interfaces need to be checked for security, reducing the resources required for computing.

The above method can be applied to content processing scenarios. Content data may include text content, picture content, audio content, video content, and may include topics, news, topics, events, and the like. The processing of content data may include editing, clipping, version replacement, modification, embellishment, expansion, etc. of various types of content, and the present disclosure is not limited thereto. Content data may include any data that can carry content and be processed, and A processing command may refer to any desired corresponding processing of content data presented in a certain format. Content data can be processed to obtain desired data.

For example, content processing may include processing event content to display hot events, and using the ability to crawl the entire network to identify the timeliness, scarcity, and richness of related content of events. Content processing can include extracting keywords based on text and title, generating titles based on keywords, and generating or searching corresponding copyright images, dynamic topics, Baidu Encyclopedia, background information, etc. based on text, titles, keywords, etc. . Content processing can include detecting whether images contain low-resolution, solid colors, advertisements, mosaics, etc., undesirable features, detecting typos in text, properly formatted paragraphs and optionally modifying them, detecting blurry video and optionally modifying It processes or searches or generates similar videos, etc.

Furthermore, the above method can be combined with artificial intelligence and further applied to intelligent writing assistants or assisted writing products to process content data automatically or according to user preferences, without requiring users to manually select processing commands. For example, the content processing function can focus on the different stages of the author's creation, and use artificial intelligence computing power to assist the author to complete better articles. Intelligent content processing can be used to achieve the following functions: By displaying hot events and processing the content of events, it can guide the direction of the author's topic selection before creation, and guide the author to create non-homogeneous articles to increase the reading volume of the article ;Able to provide rich writing materials during creation: automatically display the generated relevant content in the corresponding area of the editor according to the text, title, keywords and other content input by the author, reducing the number of times the author jumps out of the page to search for materials on the way of writing, Guarantee the high efficiency of the author's creation; be able to detect the creation quality of the article after creation, remind the author to revise and improve in advance during the editing stage, and improve the final publication quality of the article.

According to some embodiments, the content data may represent pictures. The corresponding processing command may be at least one of the following items: obtain keywords related to the picture, crop the picture, rotate the picture, perform color processing on the picture, obtain the Associated pictures of the picture in question, higher-resolution versions of the picture in question, and copyrighted pictures similar to the picture in question. The above processing commands are typical processing commands for obtaining more desired content data for picture content data, which can significantly improve user experience. The processing commands may not be limited to the above commands, and other processing commands that meet user expectations or artificial intelligence calculation indicators are also possible. For example, the processing command may include replacing a person in the picture, adjusting the atmosphere of the picture, and the like.

According to some embodiments, content data may represent text. The corresponding processing command may be at least one of the following items: performing error correction processing on the text, obtaining keywords related to the text content, and obtaining topics related to the text content. Text processing is an important part of content processing. The above processing commands are typical processing commands for obtaining more desired content data for text content data, which can significantly improve user experience. The processing commands may not be limited to the above commands, and other processing commands that meet user expectations or artificial intelligence calculation indicators are also possible. For example, processing commands may include expanding, simulating, rewriting, etc. text.

According to some embodiments, the content data may represent video. The corresponding processing command may be at least one of the following items: obtain keywords related to the video, crop the video, rotate the video, perform color processing on the video, obtain all Associated videos of the above videos, and obtain higher-resolution versions of the videos. Videos often carry a large amount of content and require large processing resources. The above processing commands are aimed at video content data, which can significantly improve user experience.

According to some embodiments, content data may represent events. The corresponding processing command may be at least one of the following items: obtaining keywords related to the event, obtaining the scarcity of the event, obtaining the topic degree of the event, obtaining pictures related to the event, Obtain videos related to the event, and obtain articles related to the event. Events are atypical content data. The above-mentioned processing of events can intelligently extract the key points, popularity, and value of events, which is beneficial to user experience, especially in the context of users needing to create based on time very useful. For example, keywords can characterize the core features of an event, acquisition scarcity can represent whether there are related articles in the network and the number of clicks on the articles, etc., topic degree can represent whether related creations will bring higher value, related pictures or Videos and the like are beneficial to reduce the user's manual search when creating based on the event, thereby saving resources and improving efficiency.

If the code of the content processing function is coupled in the same module, especially in the same module to complete all functions such as traffic source filtering, business logic and verification, database connection, network call, etc., the front-end request directly reaches the module, which will not work well area distinguishing function. Coupling the code in the same module will also lead to slow development iteration efficiency, and small changes may also affect the functions of other modules, so the test regression cost for each online test is high. In addition, if a simple retry polling strategy is used for long-time-consuming interfaces, the policy service will take a long time, wasting the back-end machine resources, and it is necessary to reduce the time-consuming of the whole process to ensure user experience. Based on this, the present disclosure provides a service architecture design scheme for combining product functions and service dependencies, improves code development efficiency, optimizes time-consuming experience for users, and provides appropriate security checks.

FIG. 3 is an example architecture of a content processing system 300 according to an embodiment of the disclosure.

The content processing system 300 may include an access layer 301 and a service layer 302:

The access layer 301 is configured to obtain the first request. The first request includes content data and a processing command for the content data. The access layer 301 is further configured to send a second request to the service layer 302 in response to the source of the first request satisfying the security criterion. The second request includes content data and processing commands, and the second request does not include the source of the first request.

The service layer 302 is configured to process content data according to processing commands.

Referring again to FIG. 3 , the access layer 301 may obtain the first request from the presentation layer 311 or from the gateway 321 . Requests from the presentation layer can represent requests from the local, internal network, or this product line. Requests from gateway 321 may represent requests from external sources such as external networks or other products. In some embodiments, content processing system 300 may include presentation layer 311 . The presentation layer is configured to parse the front-end request to obtain content data and processing commands; and send the first request to the access layer. In this way, the access layer can obtain pre-processed request commands, further realizing decoupling and lightweight implementation of modules. In other examples, there may be no presentation layer, or the functionality of the presentation layer described herein may be incorporated into a front end, etc., and any other method of obtaining content data and processing commands by the access layer is applicable here.

For long-time-consuming feature calculations, the connection between the access layer and the service layer may have been closed due to timeout. At this time, the producer-consumer model can be adopted. The service layer publishes the calculation results of the corresponding pictures to the asynchronous message queue, and the message queue notifies the presentation layer. After receiving the message, the presentation layer puts the calculation results of picture features into In the cache of the presentation layer. When the front end retries or polls next time, the presentation layer can check the results in the cache and respond directly. Therefore, there is no need to request an additional service layer, which reduces network time consumption and overhead.

In some embodiments, the service layer 302 is further configured to create a message queue in response to the second request timeout after processing the content data according to the processing command to generate result data. The service layer 302 is also configured to send the result data to the presentation layer via a message queue. Therefore, in the case of a large amount of calculation or a busy network, etc., if the request times out, a message queue is established, and the result data is directly sent to the presentation layer. Since the service layer does not need to know the source of the data, it only needs to follow the simple logic of posting to the message queue if it times out, and sending it back if it does not time out. Message queues are created by the service layer after the connection is closed. Since the traffic from the outside has a single network request upper limit, there will be no timeout problem, so there will be no message queue. As a result, long-time-consuming interface polling is no longer required, computing resources are saved, and computing stability is improved.

In some embodiments, the method described in conjunction with FIG. 2 may be implemented at the side of the access layer 301 in FIG. 3 .

Some alternative embodiments of the content processing method described in Fig. 2 will be described below.

According to some embodiments, the first request further includes a service interface identification, and the access layer sending the second request to the service layer includes the access layer sending the second request to the service interface in the service layer. The service interface identifier can indicate the service interface corresponding to the content data and the processing command in the service layer, for example, it is an interface for calling the image processing module or an interface for calling the video processing module. The service interface is obtained from the first request and the request parameters are directly forwarded to the corresponding interface, thus avoiding further calculation of the request and only needing to forward the request according to the routing rules. In this way, the proper distribution of functions is realized, the amount of calculation is reduced, and the decoupling between modules can be further realized.

The extraction of the above service interface identifier can be realized through the presentation layer. According to the architecture of some embodiments of the present disclosure, the presentation layer is the first module that directly interacts with the front end. That is to say, in addition to processing the front-end request to parse the requested data and process commands, the presentation layer can also perform preliminary processing on the request parameters from the front-end to select the service layer capabilities to be called, so that the access layer It is no longer necessary to process the request parameters, and is only responsible for passing the data passed in from the presentation layer to the corresponding service layer based on the capabilities selected by the presentation layer.

According to some embodiments, the content data satisfies at least one of the following: the content data is in a format suitable for processing commands, the content data comes from a user with processing rights, or the content data comes from a logged-in user. This means that the content data has already undergone a preliminary data check before being processed by the method 200 . Thus, the decoupling of modules and the lightweight implementation of each functional module can be further realized.

The above process can be realized through the presentation layer 311 as shown in FIG. 3 . For example, the presentation layer can perform preliminary verification on the content data, judge that the content data is in a format suitable for processing commands (for example, for a picture cropping processing command, the content data is in .JPG or .BMP format, etc.), and judge that the content data comes from the logged-in user (For example, judging the user login status requested from the front end), or the content data comes from a user with processing authority, etc. The presentation layer can also be used to verify the validity of request parameters, format front-end response fields, and manage data logs. Data log management refers to the click volume of a certain function in a certain interface, or the statistics of a certain state, etc. Data log files can be added at specified locations in the presentation layer. For some checks that are strongly coupled with the business, such as user login status, user permissions, etc., the corresponding user data can be obtained and checked at the presentation layer. In the presentation layer, it is also possible to filter whether the request parameter is empty, whether it is the required array type, etc. Of course, the present disclosure is not limited to the scenario of receiving data from the presentation layer 311 , nor does it require that the system 300 must include a presentation layer or a separate module with similar functions. For example, the above-mentioned processing can be realized by the front end and the like. Or, for example, in the scenario where the first request is accepted from the gateway 321, the interface can be defined in advance, so that the request from the external source needs to follow certain rules or the data from the external source needs to undergo certain pre-processing before accessing layer.

According to some embodiments, the content data is an intranet stored version of the content or a link to a location in the intranet where the content to be processed is stored. Such a locally stored version can improve computational efficiency. For example, such processing can also be implemented through the presentation layer 311 as described in FIG. 3 , but as mentioned above, the present disclosure is not limited thereto.

In addition, when interacting with the front-end request, there are some personalized field processing that is separated separately for the convenience of the front-end display, such as the type of resource used by the front-end to distinguish templates, or the splicing of copywriting, etc. Since these processes do not involve field output of core functions, they can also be completed by the presentation layer or the presentation layer in cooperation with the front end.

According to some embodiments, before sending the second request to the service layer, it is checked by the access layer whether the corresponding port of the service layer is available. Sending the second request includes sending the second request to the service layer in response to the status of the corresponding port of the service layer being available. Check availability before invoking services in the service layer. Thus, calls to timeout or faulty service layer machines can be avoided, increasing computing efficiency and stability.

The above process can be realized by, for example, the access layer 301 in FIG. 3 . The access layer can check the availability status of the machines in the service layer. For example, if there are more than a certain number of connection failures, it is considered that the service of the machine is unavailable, and the next request traffic will be allocated to other machines.

The access layer is also able to distribute traffic among different ports and machines in the service layer. For example, the access layer can distribute traffic among different machines or ports according to a random policy to avoid excessive traffic on the same machine. According to some embodiments, sending the second request includes sending the second request to the service layer based on the flow control indicator. The flow control indicator may be the request amount per port or the calculation amount per port based on the machine, calculation amount, or a predetermined allocation strategy. The access layer enables traffic control and load balancing. As a result, on the one hand, the decoupling of the modules can be achieved, and on the other hand, the stability of the system operation can be improved, and problems such as traffic overload and resulting failures can be avoided.

The access layer is located above the service layer and can perform load balancing and routing forwarding for all request traffic. In addition to connecting to the presentation layer, the access layer can also connect to the gateway. Gateways are used to access calls from external sources. When this function is invoked from external sources such as other product lines or teams, this part of the traffic is accessed through the gateway. The gateway can complete the authority inspection of external traffic sources, distinguish sources for flow limiting, and other processing. In order to prevent external traffic from containing various network security issues, the gateway needs to control access rights and prevent unexpected traffic from overwhelming the service, so it is necessary to check and limit the source. The access layer is capable of receiving requests from both the presentation layer and the gateway. After receiving the request, the access layer can assign the same interface to the service layer according to the same routing and forwarding rules.

According to some embodiments, the method further includes, after processing the content data according to the processing command to generate the result data, in response to the second request not timing out, sending the result data by the service layer to the access layer as a response to the second request ; and returning the result data by the access layer to the source of the first request. As a result, the result data can be received directly from the service layer, and the service layer still does not need to know the source of the request, and only needs to send it back, saving the burden on the service layer. Based on the data source information stored in the access layer, such as whether the request originally came from the presentation layer or the gateway, and then return the generated result data, an independent module and a convenient data return mechanism are realized.

According to some embodiments, the first request is received from the presentation layer, and the method further includes, after processing the content data according to the processing command to generate the result data, in response to the second request timeout, creating an message queue. After that, the result data is pushed to the message queue by the service layer. This design adopts the idea of establishing a message queue if the request times out. Because the request from the external source has a single access limit, there will be no timeout problem, so when the timeout occurs, the source must be the presentation layer. At this time, there is no need to judge the source, and a message queue is directly established between the service layer and the presentation layer. Can. Therefore, long time-consuming interface polling is no longer required, the computing resources of each module are saved, and computing efficiency is increased.

The service layer is the core part of the realization of the content computing function. The service layer can connect to relational databases, full-text search engines, caches, etc., or call other third-party services through the network to obtain more data. According to some embodiments, the service layer generates result data by invoking at least one of the following: relational database, full-text search engine, cache, and third-party service. How the resulting data was generated. As a result, desired content can be accurately processed. The service layer will provide different responses according to different content types. For example, for the content of pictures, it is possible to calculate the characteristics of pictures such as sharpness and information entropy, and mark the results of each picture according to the threshold value; it can crop according to the desired picture size, compress and dump the picture to generate a new link; Copyright image retrieval, query similar images in the database according to the label of the image, and provide genuine images to avoid creative risks. For text content, it can identify typos in long and short texts and prompt for corrections, can extract text keywords as topics or titles, and can use text keywords to retrieve related content in the database. For video content, it can calculate video features, check whether the video is blurry, and generate a higher-definition video link. For the content of the event, it is possible to retrieve the scarcity of the corresponding event in the articles of the whole network, and to obtain related articles, dynamics, videos, etc. of the event. It can be understood that the function of the service layer is not limited thereto, and can respond to any content data and corresponding processing commands.

According to some embodiments, the service layer is capable of batch processing multiple content data and multiple processing commands. The concurrent processing capability of the service layer can realize large-scale data processing and increase computing efficiency. The concurrent processing method of the service layer will be described in more detail in conjunction with Fig. 4(a) below. For example, the logic for concurrent processing in the service layer can be described as processing features in parallel first, and then processing content in parallel. Through two-stage parallel processing, the computational efficiency can be further increased. According to some embodiments, the batch processing includes: establishing a plurality of coroutines for a plurality of processing features respectively corresponding to the plurality of processing commands, each coroutine in the plurality of coroutines corresponding to the plurality of processing Each of the processing features; processing the plurality of coroutines in parallel; and within each of the plurality of coroutines, processing the plurality of content data in parallel for the corresponding processing feature.

Here, processing characteristics refer to attributes related to processing. For example, for image processing, features can be image clarity/presence of QR code/image size, etc. For video, it can be resolution, length, etc. For the text, it can be content attributes, typos, fluency, related topics, etc. Computing features first and then processing content can achieve batch processing more efficiently by doing two concurrent processing.

The following takes image computing as an example, and describes the concurrent processing method of the service layer in conjunction with Figure 4(a). It is easy to understand that the concurrent processing method of the service layer is not limited to the calculation of image content, and the content processing and calculation of other types and formats can be handled according to similar ideas and logic.

The interface in the service layer supports batch processing of multiple features and multiple contents. In batch processing, a set of features is specified in the input parameters, which are feature 1, feature 2...feature n, and a set of content is specified, which are content 1, content 2...content m. For example, feature 1 to feature n may be features corresponding to clipping processing, sharpness processing, obtaining similar images with copyright, and extracting keywords, respectively. For example, content 1 to content m may be m different pictures, and these m different pictures need to undergo the above-mentioned processing of feature 1 to feature n respectively. Of course, the content is not limited to pictures, and Fig. 4(b) shows an example functional diagram of the service layer according to an embodiment of the present disclosure.

When multiple features are processed concurrently, the time points for each feature to be turned on are different, and the time difference between sequentially activating multiple processing units constitutes a cycle, which is referred to as "the first cycle C1" here. After the loop ends and concurrency is enabled, multiple processing units can process multiple features at the same time. For example, multiple processing units simultaneously and separately process features such as cropping, definition processing, obtaining copyrighted similar images, and extracting keywords. Specifically, in the first cycle C1, a coroutine is started for each feature for processing, and each feature can be considered to be concurrent at the same time point. Next, a plurality of contents are processed concurrently, and the time difference between the opening time points of each of the contents constitutes a cycle, which is referred to as "the second cycle C2" here. At the end of the second cycle, the corresponding processing units among the multiple processing units perform concurrent processing on multiple contents for each feature. Similarly, in the second loop, within each feature, a coroutine is started for each item in the batch for computation. Thus, the content within each feature can also be considered concurrent. For example, the first processing unit executes the trimming operation on multiple pictures 1 to picture m in parallel, and the second processing unit executes the operation of obtaining copyrighted similar pictures on multiple pictures 1 to picture m in parallel, etc., and these processing units are also can be executed concurrently.

If there is a calculation failure in a certain content of a feature, the corresponding coroutine is closed separately to discard the result, so as to avoid affecting the processing of other coroutines. After waiting for the calculation of the results of all contents of all features to be completed, store the results in the corresponding cache of the service layer. Optionally, before storing the result in the cache corresponding to the service layer, the result may be formatted according to the specification. Thus, when a request for the same content is received next time, the calculation results in the cache can be directly reused. Afterwards, if the request of the access layer has not closed the connection, it will directly respond to the calculation result in this connection. If the request of the access layer has been closed due to timeout, the calculation result can be responded to through the message queue described above.

The flow of an example content processing method 500 according to another embodiment of the present disclosure will be described below with reference to FIG. 5( a ).

At step S501, the front end obtains the front end request and transmits it to the presentation layer. For example, the content to be processed may be sent together with the front-end request, or the content to be processed or a link thereof may be included in the front-end request, and the present disclosure is not limited to the message delivery method here.

At step S502, the presentation layer parses the request from the front end to obtain content data and processing commands, and sends a first request to the access layer. The data delivered to the access layer through the first request may include content data (for example, save a local link of the content data file) and processing commands (for example, cropping or resolution processing). Parsing the request from the front end by the presentation layer may also include preliminary processing of the content data. For example, the preliminary processing may include saving the content to be processed (for example, picture files, etc.) to the intranet, and reading the intranet link of the saved file as content data. The processing of content data by the presentation layer may include standardization (or legality) verification of fine-grained request parameters, including verification of whether the incoming content is in a legal format (for example, for pictures, jpg format, gif format, etc.), Verify the request parameters and verify whether the user is a legal user (whether the user is logged in, user permissions, etc.). The data communicated to the access layer by the first request may include a data source. The data source can indicate to the access layer that the request is from the "presentation layer" and not an external source or external gateway. The data transmitted to the access layer through the first request may optionally further include a service interface identifier, which represents a service interface in the service layer that needs to be invoked. That is to say, the presentation layer also preliminarily processes the request parameters from the front end to select the service layer capabilities to be called, so that the access layer no longer needs to process the request parameters, and is only responsible for the capabilities that have been selected based on the presentation layer Pass the data passed in from the presentation layer to the corresponding service layer.

At step S503, the access layer receives the first request, and based on satisfying the forwarding index, sends the second request to the service layer. The second request may include content data and processing commands for processing by the service layer. For example, the access layer may forward the content data and processing commands in the request to the corresponding interface of the service layer based on predetermined routing rules, or based on the service interface identifier in the request of the presentation layer. There is no need to forward origin information etc. in the request to the service layer. The forwarding indicators in step S503 may include security check and flow control indicators. The access layer can judge whether the source can access the service layer based on the data source, that is, the presentation layer or external source gateway, etc. The access layer can distribute and balance traffic from different sources and to different service layer ports. The access layer may pass the data including content and processing parameters to the corresponding interface of the service layer in response to satisfying the security check and the flow control index.

At step S504, the service layer receives the second request, processes the content data based on the processing command, and generates result data. The service layer can process content data by calling various databases or external functions. The service layer can have many different processing capabilities. For example, for picture content data, cropped pictures or higher-definition pictures can be generated as result data; for text content data, error-corrected text, keywords, related topics, etc. can be generated as result data. It is understood that the present disclosure is not limited thereto.

At step S505, it is determined whether the request times out.

If the request times out, the step goes to S506, and a message queue is established between the service layer and the presentation layer. The service layer pushes the resulting data to a message queue. At step S507, the presentation layer reads the result from the message queue and saves it to the cache. Next, at step S508, the presentation layer sends the result in the cache back to the front end in response to receiving the polling from the front end again.

Afterwards, go to step S509, the data is processed and presented by the front end, and the content processing process ends.

If the request has not timed out, the step goes to S510, and the service layer will directly send the result data back to the access layer in this request, for example, as a response to the second request. After that, the access layer combines the data source information and returns the result data. For example, the access layer combines the data source information stored by itself to indicate whether the request and the corresponding data content come from the presentation layer or the gateway, and sends the data back to the corresponding presentation layer or gateway. In the case of data being passed back to the presentation layer, the presentation layer passes the data back to the front end. The presentation layer does not need to process the data, or the presentation layer can perform splicing, display, personalization, etc. that do not involve core functions. If the data is passed back to the gateway, the resulting data is forwarded by the gateway to the corresponding network device in any manner that would be easily understood by a person skilled in the art, and the data circulation process in the case of the gateway is omitted here. Afterwards, it may turn to step S509 where the front end processes and presents the data, and the content processing process ends.

By decoupling different functional areas in the module, dividing the presentation layer, service layer, etc., each layer is responsible for an independent function point, avoiding mutual involvement in the same module, and each layer can be upgraded independently. The overall process can control traffic sources and forwarding in a more standardized manner, and can provide external interfaces and capabilities after the abstraction of the service layer as a service center. Improve iteration efficiency, reduce R&D costs, and optimize interface time-consuming. Fig. 5(b) shows an example architecture diagram of a content processing system according to another embodiment of the present disclosure.

A content processing device 600 according to another aspect of the present disclosure will be described below with reference to FIG. 6 . The content processing apparatus 600 may include an access layer 601 and a service layer 602 . The access layer 601 may be configured to obtain a first request by the access layer, the first request including content data and a processing command for the content data. The service layer 602 may be configured to send a second request to the service layer in response to the source of the first request meeting a security criterion. The service layer is used to process the content data according to the processing command. The second request includes the content data and the processing command, and the second request does not include the source of the first request.

According to another aspect of the present disclosure, there is also provided a computing device, which may include: a processor; and a memory storing a program, where the program includes instructions for causing the processor to execute the above content processing method when executed by the processor.

According to still another aspect of the present disclosure, there is also provided a computer-readable storage medium storing a program, and the program may include instructions for causing the server to execute the above content processing method when executed by a processor of the server.

Referring to FIG. 7 , a structural block diagram of a computing device 700 that can serve as a server or a client of the present disclosure will now be described, which is an example of a hardware device that can be applied to aspects of the present disclosure.

Computing device 700 may include elements connected to or in communication with bus 702 , possibly via one or more interfaces. For example, computing device 700 may include a bus 702 , one or more processors 704 , one or more input devices 706 , and one or more output devices 708 . Processor(s) 704 may be any type of processor, and may include, but is not limited to, one or more general purpose processors and/or one or more special purpose processors (eg, special processing chips). Processor 704 may process instructions executed within computing device 700, including instructions stored in or on memory, to display graphical information of a GUI on an external input/output device, such as a display device coupled to an interface. In other implementations, multiple processors and/or multiple buses may be used with multiple memories and multiple memories, if desired. Likewise, multiple computing devices may be connected, with each device providing some of the necessary operations (eg, as a server array, a set of blade servers, or a multi-processor system). One processor 704 is taken as an example in FIG. 7 .

Input device 706 may be any type of device capable of entering information into computing device 700 . The input device 706 can receive input numeric or character information, and generate key signal input related to user settings and/or function control of the content processing computing device, and can include but not limited to mouse, keyboard, touch screen, trackpad, trackball , joystick, microphone and/or remote control. Output devices 708 may be any type of device capable of presenting information, and may include, but are not limited to, displays, speakers, video/audio output terminals, vibrators, and/or printers.

Computing device 700 may also include or be connected to a non-transitory storage device 710, which may be any storage device that is non-transitory and that enables data storage, and may include, but is not limited to, a disk drive , optical storage device, solid state memory, floppy disk, flexible disk, hard disk, magnetic tape or any other magnetic medium, optical disk or any other optical medium, ROM (read only memory), RAM (random access memory), cache memory and/or Any other memory chip or cartridge, and/or any other medium from which a computer can read data, instructions and/or code. The non-transitory storage device 710 is detachable from the interface. The non-transitory storage device 710 may have data/programs (including instructions)/codes/modules (for example, access layer 601 and service layer 602 shown in FIG. 6 ) for implementing the above methods and steps.

Computing device 700 may also include a communication device 712 . The communication device 712 may be any type of device or system that enables communication with external devices and/or with a network, and may include, but is not limited to, modems, network cards, infrared communication devices, wireless communication devices, and/or chipsets, such as Bluetooth™ devices, 1301.11 devices, WiFi devices, WiMax devices, cellular communications devices, and/or the like.

Computing device 700 may also include working memory 714, which may be any type of working memory that may store programs (including instructions) and/or data useful for the operation of processor 704, and may include, but is not limited to, random access memory and and/or read-only memory devices.

Software elements (programs) may be located in working memory 714, including but not limited to operating system 716, one or more application programs 718, drivers, and/or other data and code. Instructions for performing the above methods and steps may be included in one or more application programs 718 , and the above methods may be implemented by the processor 704 reading and executing the instructions of the one or more application programs 718 . The executable code or source code of the instructions of the software element (program) may also be downloaded from a remote location.

It should also be understood that various modifications may be made according to specific requirements. For example, custom hardware could also be used, and/or particular elements could be implemented in hardware, software, firmware, middleware, microcode, hardware description languages, or any combination thereof. For example, some or all of the disclosed methods and devices can be implemented by programming hardware (e.g., including Field Programmable Gate Arrays) in assembly language or hardware programming languages (such as VERILOG, VHDL, C++) using logic and algorithms according to the present disclosure. (FPGA) and/or Programmable Logic Circuits of Programmable Logic Array (PLA)) to implement programming.

It should also be understood that the aforementioned methods can be implemented in a server-client mode. For example, a client may receive user-entered data and send the data to a server. The client may also receive the data input by the user, perform part of the processing in the aforementioned method, and send the processed data to the server. The server may receive data from the client, execute the aforementioned method or another part of the aforementioned method, and return the execution result to the client. The client can receive the execution result of the method from the server, and can present it to the user, for example, through an output device. Clients and servers are generally remote from each other and typically interact through a communication network. The relationship of client and server arises by computer programs running on respective computing devices and having a client-server relationship to each other. The server can be a server of a distributed system, or a server combined with a blockchain. The server can also be a cloud server, or an intelligent cloud computing server or an intelligent cloud host with artificial intelligence technology.

It should also be understood that components of computing device 700 may be distributed across a network. For example, some processing may be performed using one processor while other processing may be performed by another processor remote from the one processor. Other components of computing device 700 may be similarly distributed. As such, computing device 700 may be construed as a distributed computing system that performs processing at multiple locations.

Although the embodiments or examples of the present disclosure have been described with reference to the accompanying drawings, it should be understood that the above-mentioned methods, systems and devices are merely exemplary embodiments or examples, and the scope of the present disclosure is not limited by these embodiments or examples, but rather It is limited only by the appended claims and their equivalents. Various elements in the embodiments or examples may be omitted or replaced by equivalent elements thereof. Also, steps may be performed in an order different from that described in the present disclosure. Further, various elements in the embodiments or examples can be combined in various ways. Importantly, as technology advances, many of the elements described herein may be replaced by equivalent elements appearing after this disclosure.

Claims (17)

1. A content processing method, comprising:

Obtaining, by an access layer, a first request comprising content data and a processing command for the content data, wherein the first request is received from a presentation layer;

transmitting, by the access layer, a second request to a service layer in response to a source of the first request meeting a security criterion, wherein the second request includes the content data and the processing command, and the second request does not include the source of the first request; and

processing the content data by the service layer according to the processing command,

the method may further comprise the steps of,

after processing the content data according to the processing command to generate result data, sending, by the service layer to the access layer, the result data as a response to the second request in response to the second request not being timed out; and

the result data is returned by the access layer to the source of the first request,

the method may further comprise the steps of,

creating a message queue between the service layer and the presentation layer in response to the second request timeout after processing the content data according to the processing command to generate result data; and

Pushing, by the service layer, the result data to the message queue.

2. The method of claim 1, wherein the first request further includes a service interface identification indicating a service interface in the service layer corresponding to the content data and the processing command, and

wherein sending, by the access layer, the second request to the service layer includes sending, by the access layer, the second request to the service interface in the service layer.

3. The method of claim 1, wherein prior to sending the second request to the service layer, checking by the access layer whether a corresponding port of the service layer is available, and

and sending the second request to the service layer in response to the state of the corresponding port of the service layer being available.

4. The method of claim 1, wherein sending the second request comprises sending the second request to the service layer based on a flow control indicator.

5. The method of claim 1, wherein the content data satisfies at least one of:

the content data is in a format suitable for the processing command,

The content data comes from a logged-in user, or

The content data is from a user having processing rights.

6. The method of claim 1, wherein the service layer generates the result data by invoking at least one of: relational databases, full text search engines, caches, third party services.

7. The method of claim 1, wherein the service layer is capable of batch processing a plurality of content data and a plurality of processing commands.

8. The method of claim 7, wherein the batch processing comprises:

establishing a plurality of coroutines for a plurality of processing features respectively corresponding to the plurality of processing commands, each coroutine of the plurality of coroutines corresponding to each processing feature of the plurality of processing features;

processing the plurality of coroutines in parallel; and is also provided with

And processing the plurality of content data in parallel for the corresponding processing features in each of the plurality of coroutines.

9. The method of any of claims 1-8, wherein the content data is an intranet-stored version of content or a link to a location in an intranet where the content to be processed is stored.

10. The method of any of claims 1-8, wherein the content data represents a picture, and the processing command is at least one of: obtaining keywords related to the picture, cropping the picture, rotating the picture, performing color processing on the picture, obtaining an associated picture of the picture, obtaining a higher definition version of the picture, and obtaining a copyrighted picture similar to the picture.

11. The method of any of claims 1-8, wherein the content data represents text and the processing command is at least one of: performing error correction processing on the text, acquiring keywords related to the text content, and acquiring topics related to the text content.

12. The method of any of claims 1-8, wherein the content data represents video and the processing command is at least one of: obtaining keywords related to the video, cropping the video, rotating the video, color processing the video, obtaining an associated video of the video, and obtaining a higher definition version of the video.

13. The method of any of claims 1-8, wherein the content data represents an event, and the processing command is at least one of: acquiring keywords related to the event, acquiring scarcity of the event, acquiring topic of the event, acquiring pictures related to the event, acquiring videos related to the event, and acquiring articles related to the event.

14. A content processing system, comprising:

an access layer for

Obtaining a first request comprising content data and a processing command for the content data, wherein the first request is received from a presentation layer;

in response to the source of the first request satisfying a security indicator, sending a second request to a service layer, wherein the second request includes the content data and the processing command, and the second request does not include the source of the first request;

the service layer is used for processing the content data according to the processing command;

a unit for performing the following operations:

after processing the content data according to the processing command to generate result data, sending, by the service layer to the access layer, the result data as a response to the second request in response to the second request not being timed out; and

returning, by the access stratum, the result data to the source of the first request, an

A unit for performing the following operations:

creating a message queue between the service layer and the presentation layer in response to the second request timeout after processing the content data according to the processing command to generate result data; and

Pushing, by the service layer, the result data to the message queue.

15. The content processing system of claim 14, further comprising a presentation layer to:

parsing a front-end request to obtain the content data and the processing command; and

and sending the first request to the access layer.

16. A computing device, comprising:

a processor; and

a memory storing a program comprising instructions that when executed by the processor cause the processor to perform the method of any one of claims 1 to 13.

17. A computer readable storage medium storing a program comprising instructions which, when executed by a processor of a server, cause the server to perform the method of any one of claims 1 to 13.

Images