CN1863211A - Content filtering system and method thereof - Google Patents

Abstract

The invention relates to communication technology, and discloses a content filtering system and method thereof, which enable a mobile network to realize the content filtering function without affecting network performance. In the present invention, before sending the content to the user, the service server first carries the content in the attachment of the filtering request message, or sends it to the filtering device as specified by the uniform resource location in the request message, and requests the filtering device to filter the content Filtering is performed, and the filtered content is sent to the user according to the filtering result of the filtering device. The filtering device implements virus scanning, content classification and content filtering services. Services can be customized by users. Content filtering rules include public rules and user-defined rules.

Description

Content filtering system and method thereof

technical field

The invention relates to communication technology, in particular to content filtering technology.

Background technique

With the development of mobile communication technology, more and more people have User Equipment (User Equipment, "UE" for short) such as mobile phones, and enjoy the convenience of mobile communication services. The UE can be a mobile phone, a notebook computer with a mobile terminal, or a mobile communication device installed on a vehicle, and these devices can perform voice and/or Data communication services, such as phone calls, text messages, faxes, online browsing, and sending and receiving e-mails, etc.

As the functions of the UE are gradually enhanced, and the bandwidth and service quality of the mobile network are increasingly guaranteed, various multimedia services carried out by using the UE and the mobile network are integrating into people's lives. But what followed were all kinds of spam text messages, pornographic pictures, illegal information and other content that harassed people's lives.

In order to avoid the intrusion of illegal information, users hope to take appropriate technical measures to filter bad information on the Internet, which can prevent people from being harmed by bad information and meet the ideological requirements of society. At the same time, by regulating users' online behavior , Improve work efficiency, rationally utilize network resources, and reduce virus damage to the network. This is the fundamental connotation of content filtering technology.

Generally speaking, content filtering technologies include list filtering technology, keyword filtering technology, image filtering technology, template filtering technology, and intelligent filtering technology. Currently, content filtering technologies are mainly divided into two types: gateway-based and agent-based.

The gateway-based content filtering technology implements content filtering by setting a content filtering system at the gateway, as shown in Figure 1, which is a widely used method at present.

Gateway-based content filtering is generally embedded in gateway devices such as special security gateways or firewalls. Such network devices generally have two content filtering methods: static and dynamic. The so-called static filtering means that you can customize trusted sites and forbidden sites. For example, static filtering can block access to "Dating Community" to deny access to "Dating Community" website content. Dynamic filtering is also important because neither the Internet nor the World Wide Web ("the Web") is static. New web pages are being added to the web by the hundreds of millions every year, and new sites and pages appear every minute. Moreover, a Web page is not a single entity, but is composed of many independent components, each of which has its own Uniform Resource Locator (Universal Resource Locator, referred to as "URL"), and the browser can obtain them individually and independently. . Each of these components can be directly accessed through its URL, so they are all filtered objects. Dynamic content filtering can filter the sites containing the keyword by setting the keyword in the URL, so as to determine whether the user should obtain a requested URL, even if the URL is not clearly defined. For example, dynamic filtering can deny access to all sites with the word "Porn" in the URL.

The gateway-based content filtering technology is very popular now, because the gateway processes data on the network layer, and its processing efficiency is high and the speed is fast. The filtering device can analyze the data of all network layers at the application layer and analyze various network protocols. For unrecognized protocol content, the filtering system cannot complete parsing and filtering, and may have a negative impact on network speed. And for some encrypted content, the gateway-based content filtering technology cannot perform content filtering on it. And the filtering rules are single, only unified rules can be set, and different rules cannot be set according to the needs of each user.

In addition to gateway-based content filtering, there is also proxy-based content filtering. Proxy-based content filtering is mainly implemented with dedicated hardware proxy Internet access devices. Generally, the device is configured as a proxy cache server and deployed between enterprise users and the Internet. These optimized dedicated devices can intelligently manage user content requests. When a user requests a URL, the request first reaches the security dedicated device at the corresponding port of the device for authentication and authorization. If the object in the requested page is already in the local cache of the dedicated device, it will directly return the result to the user locally. If it is not in the local cache, the security dedicated device will act as the user's agent and communicate with the source server through the Internet. When the object is returned from the source server, it is stored in the local cache to serve subsequent access requests, and a copy is sent to the accessing user at the same time. The entire process is monitored and recorded for access to report statistics and to provide a basis for corporate planning. Proxy-based content filtering is easy to implement, but requires high hardware processing speed, and like gateway-based content filtering, it will have a negative impact on network speed, and both are serial processing, regardless of the failure of the gateway and proxy will make the network No way.

Contents of the invention

In view of this, the main purpose of the present invention is to provide a content filtering system and method thereof, so that the mobile network does not affect the network performance while realizing the content filtering function.

To achieve the above object, the present invention provides a content filtering system, comprising:

A business server that provides services to users and at least one filtering device that implements the content filtering function;

The service server sends the content to be sent to the user to the filtering device to request filtering, and sends the filtered content to the user according to the filtering result returned by the filtering device.

Wherein, described filter equipment comprises:

A message processing unit for sending and receiving messages and parsing the received messages, a content identification and identification unit for classifying and identifying the specified content in the message according to the rules of content classification and content grading, and a content identification and identification unit for Filtering rules for public content and/or user-defined content, a filtering unit for filtering content that has been classified and identified, and a main control unit;

The main control unit is used to invoke the content identification and identification unit and the filtering unit to filter the specified content in the message according to the message processing unit received from the service server and parsed out from the filtering request process, and send the filtering result to the service server through the message processing unit.

In addition, in the system, the filtering device also includes:

Virus database, used to record virus characteristics;

A virus scanning unit, configured to perform virus scanning on the specified content in the message according to the virus characteristics in the virus database.

In addition, in the system, the filtering device also includes:

A subscription and user rule management unit, configured to manage user subscriptions to virus scanning, content identification and identification, and content filtering services, and manage filtering rules for user-defined content;

The main control unit performs corresponding filtering processing according to the services subscribed by the user in the subscription and user rule management unit.

In addition, the system also includes a remote storage module for storing specified content in the message;

The filtering device acquires the specified content from the remote storage module according to the uniform resource location in the message.

In addition, in the system, the filtering request includes the identification of the service server that initiated the filtering request, the identification number of the filtering request, the identification of the content source requesting filtering, the filtering function requested, the identification of whether the content has been classified, and the request to return filter results.

In addition, in the system, the filtering device further includes an information recording unit, and the main control unit records the filtering result of corresponding filtering processing on the specified content in the message in the information recording unit.

The present invention also provides a content filtering method, comprising the following steps:

The service server that provides services for the user sends a filtering request message to the filtering device, and uses the content to be sent to the user as the specified content in the message to request the filtering device to filter the content;

The filtering device performs corresponding filtering processing on the specified content in the message according to the received filtering request message, and returns the filtering result to the service server;

The service server sends the filtered content to the user according to the filtering result returned by the filtering device.

Wherein, the filtering process includes the following sub-steps:

According to the identification and identification result of the specified content in the message by the content identification and identification unit, match applicable filtering rules, and filter the specified content in the message according to the matched filtering rules.

In addition, in the method, the user subscribes to the filtering device to filter and process the content sent to the user by the service server;

The filtering device performs corresponding filtering processing according to the service subscribed by the user.

In addition, in the method, the services subscribed by the user include virus scanning, content classification, content filtering, and content classification and filtering.

In addition, in the method, the user defines the content filtering rules, and the filtering device filters the specified content in the message according to public content and/or user-defined content filtering rules.

In addition, in the method, the filtering device obtains the specified content from the attachment carried in the message; or

The filtering device acquires the specified content from the remote device according to the uniform resource location of the message.

Through comparison, it can be found that the main difference between the technical solution of the present invention and the prior art is that before the service server sends the content of the service provided by the service server to the user, the service server carries the content in the attachment of the filtering request message , or specified by the URL in the request message, and send it to the filtering device, requesting the filtering device to filter the content, and send the filtered content to the user according to the filtering result of the filtering device. It avoids the impact on network performance due to the concentration of filtering functions at the gateway, and does not need to analyze multiple network protocols, and solves the problem that content filtering cannot be completed for unknown network protocols.

The virus scanning unit contained in the filtering device performs virus scanning on the content requested to be filtered according to the virus database recording virus characteristics, the content identification and identification unit classifies the content requested to be filtered according to the rules of content classification and content classification and identifies the level, The filtering unit for filtering the classified and graded content according to the filtering rules of public content and/or user-defined content enables the filtering device to implement three services of virus scanning, content classification and content filtering. Moreover, through the subscription and user rule management unit, users can subscribe to the filtering device for related services according to their own needs.

Users can customize the content filtering rules according to their own conditions, which meets the individual needs of users. At the same time, since the user-defined content filtering rules are stored in the filtering device in the network, their security is guaranteed.

Description of drawings

FIG. 1 is a schematic diagram of gateway-based content filtering in the prior art;

Fig. 2 is a schematic diagram of the content filtering principle of the mobile network of the present invention;

FIG. 3 is a structural diagram of the content filtering system of the mobile network according to the first embodiment of the present invention;

4 is a flowchart of a content filtering method for a mobile network according to the first embodiment of the present invention;

5 is a flowchart of a method for a user to subscribe to a filtering service in content filtering of a mobile network according to the first embodiment of the present invention;

6 is a flowchart of a method for user-defined content filtering rules in content filtering of a mobile network according to the first embodiment of the present invention;

7 is a structural diagram of the content filtering system of the mobile network according to the second embodiment of the present invention;

8 is a schematic diagram of a filtering request message in a mobile network content filtering method according to the second embodiment of the present invention;

Fig. 9 is a flowchart of a content filtering method for a mobile network according to the third embodiment of the present invention.

Detailed ways

In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings.

The core of the present invention is that when a user requests a corresponding service server to provide the required content for a certain service, the service server first sends the content to be sent to the user to the filtering device to request filtering; the filtering device The filter request message performs corresponding filter processing on its specified content, and returns the filter result to the service server; the service server sends the filtered content to the user according to the filter result returned by the filter device, as shown in Figure 2.

The content filtering system of the mobile network according to the first embodiment of the present invention will be described below according to the principles of the present invention.

As shown in Fig. 3, the content filtering system of the mobile network of the present invention includes a service server and at least one filtering device. Among them, the filtering device also includes a message processing unit, a main control unit, a content identification and identification unit, a filtering unit, a virus scanning unit, a subscription and user rule management unit, an information recording unit, and corresponding virus databases, content classification and content classification rule bases , public content filtering rule base and user-defined content filtering rule base.

Wherein, the message processing unit is used for sending and receiving messages and analyzing the received messages to obtain the filtering request of the service server.

The main control unit calls each processing unit to process the content according to the filtering request, records the processing results of each processing module in the information recording unit, and transmits the final result to the service server through the message processing unit.

The virus scanning unit is used to scan the specified content for viruses according to the virus characteristics in the virus database, and judge whether the content carries a virus by identifying the unique identifier of the virus.

The virus database records various "appearance characteristics" of computer viruses, so that the virus scanning unit can distinguish virus programs from general programs, and then detect and kill them in time. Therefore, the data in the virus database is sometimes called "virus signature code". The library needs to be updated from time to time so that the system is protected from the latest viruses as much as possible.

The content recognition and identification unit is used to classify the specified content in the message according to the rules of content classification and content grading, and identify different levels of content, and further use the method of semantic description to identify according to the results of its classification and grading. Each identified content is assigned a corresponding content description to distinguish the content category and corresponding level.

Content classification and content grading rules are based on the content transmitted through the mobile network, such as voice, text, pictures, video, streaming media, etc., according to the characteristics of these contents, the rules for analyzing and classifying the content; for each type of content, according to the relevant country Different laws or standards or guidelines are used to classify different content according to different levels.

The filtering unit is used to filter classified and graded content according to public content and/or user-defined content filtering rules, combined with user information.

Public content filtering rules include national mandatory rules and operator/service provider rules. National mandatory rules are formulated to protect national security and social stability, and are used to prohibit violations of national laws and hidden dangers to national security and social stability. content spread across the web. Carrier/service provider rules are rules set by mobile network operators or mobile service providers to prevent some users from being exposed to inappropriate content.

The Subscription and User Rules snap-in is used to manage user subscriptions to virus scanning, content recognition and identification, and content filtering services, and manage user-defined content filtering rules.

User-defined content filtering rules are rules that users set to block some content according to their personal preferences, such as rules set by users themselves that do not need to receive any pictures, or rules set by others for users, such as filtering set by parents for children rule.

The information recording unit is used for recording the filtering result of corresponding filtering processing on the specified content.

Specifically, before the service server sends the content to the user, it first sends the content to the filtering device to request filtering. The filtering device receives and parses the message from the user through the message processing unit, and then the main control unit based on the parsed filtering request and The filtering service item subscribed by the user calls the virus scanning unit and/or the content identification unit and/or the filtering unit to process the specified content in the message accordingly, and the main control unit records the processed result in the information recording unit, and passes The message processing unit sends the processed result to the service server. Users can subscribe to required services through the subscription and user rule management unit, including virus scanning service, content identification and identification service, and content filtering service. According to the service subscribed by the user, the main control unit calls the corresponding unit to process its content. Users can also formulate or change their custom content filtering rules through the subscription and user rules snap-in.

The system of this embodiment has been described above, and the content filtering method of the mobile network of this embodiment will be described in detail below.

As shown in FIG. 4, in step 401, the service server sends a filtering request to the filtering device.

Specifically, firstly, users need to subscribe to filtering services, such as virus scanning services, content identification and identification services, content filtering services, and so on. As shown in FIG. 5 , in step 510, the user himself or others, such as a guardian, wishes to subscribe to a certain filtering service, and sends a request for subscribing to the filtering service to the filtering device. In step 520, the filtering device verifies whether the service subscriber has the right to subscribe to the filtering service, if yes, proceeds to step 530, if not, proceeds to step 550, the operation fails, and the filtering device returns the failure reason. In step 530, the filtering device further verifies whether the user is suitable for this service, and if it is suitable, enters step 540, and the filtering device records and manages the user's subscription filtering service information through the subscription and user rule management unit, and returns the subscription success to the user, the service The opened message; if the user is not suitable for this service, then also enter step 550, this operation fails, and the filtering device returns the failure reason.

When the service server needs to send content to the user, it sends a filter request message to the filter device according to the filter service subscribed by the user. The filter request message includes the service server identifier (RequestEnable) that initiates the filter request, and the identification number (JobID) of the filter request. , the requested filtering function (Function), whether the content has been classified (Classification), the filtering result that is required to be returned (Result), and the attachment containing the requested filtering content. Wherein, the requested filtering function may identify the required filtering service, for example, 1 indicates that only the virus scanning service is requested, 2 indicates that the content classification service is requested, 3 indicates that the content filtering service is requested, and 4 indicates that the content classification and filtering service is requested. In addition, when the flag of whether the content has been classified is 0, it indicates that the content has not been classified, and when it is 1, it indicates that the content has been classified.

Then enter step 402, the filtering device receives and parses the filtering request message from the service server through the message processing unit.

Then enter step 403, the control unit judges whether the service server has requested virus scanning according to the analyzed filtering request, if so, enter step 404, if not, then directly enter step 405.

In step 404, the filtering device scans the content to be filtered for viruses through the virus scanning unit, judges whether the content carries a virus, if so, filters part of the content carrying the virus, and transmits the scanning result to the main control unit.

In step 405 , the main control unit further judges whether the filtering request includes content identification and labeling request, and if so, proceeds to step 406 , otherwise, proceeds to step 407 .

In step 406, the filter device judges whether the content has been classified through the identification of whether the content has been classified. If not, the content identification and identification unit classifies the specified content according to the rules of content classification and content classification, and identifies the content of the content. Different grades, and further according to the results of classification and grading, the content is identified, and the identification results are sent to the main control unit.

In step 407, the main control unit judges whether the filtering request includes a content filtering request, and if so, proceeds to step 408; otherwise, proceeds to step 411.

In step 408, the filtering device further judges whether the user has custom content filtering rules, and if so, proceeds to step 409; otherwise, proceeds to step 410.

In step 409, the filtering device filters the classified and graded content through the filtering unit according to the public content filtering rules and user-defined content filtering rules, and returns the filtering result to the main control unit. Wherein, the user-defined filtering rule is a content filtering rule defined by the user in advance according to his/her preference. When filtering, the filtering unit first matches the applicable filtering rules according to the identification and identification results of the specified content in the message by the content identification and identification unit, and then filters the specified content in the message according to the matched filtering rules .

The specific process of customizing content filtering rules is shown in FIG. 6 . In step 610 , the user himself or others, such as guardians, set customizing content filtering rules. In step 620, the filtering device judges whether the setter has the authority to set content filtering rules for the user, if yes, then proceeds to step 640, if not, then proceeds to step 630, the operation fails, and informs the rule setter that the rule setter does not have such authority. In step 640, the filtering device verifies whether the set self-defined content filtering rules comply with the classification principle, and if so, proceeds to step 660, otherwise, proceeds to step 650, the operation fails, and the reason for the failure is notified to the rule setter. In step 660, the filtering device judges whether the self-defined content filtering rule conflicts with the set rule, and if so, proceeds to step 670; otherwise, proceeds to step 680. In step 670, the filtering device asks the setter whether it is necessary to replace the set rules. If no replacement is required, the current setting is ended. Otherwise, it also enters step 680 to filter the custom content newly set by the user. The rules are updated to the user-defined filtering rule library. Since users can customize content filtering rules according to their own conditions, the individual needs of users are met. At the same time, user-defined content filtering rules are stored in filtering devices in the network, ensuring their security.

In step 410, the filtering device only filters the classified and graded content according to the public content filtering rules through the filtering unit, and returns the filtering result to the main control unit.

In step 411, the main control unit records the processing results of each unit in the information recording unit, and sends it to the service server through the message processing unit. The service server sends the filtered content to the user according to the received filtering result. The present invention avoids the impact on network performance due to the concentration of filtering functions at the gateway by performing content filtering in the filtering device, and does not need to analyze various network protocols, and solves the problem that content filtering cannot be completed for unknown network protocols question.

The mobile network content filtering system and method of the second embodiment of the present invention are roughly the same as the first embodiment, the only difference is that in the first embodiment, the mobile network content filtering system includes a service server and at least one filtering device, and the The content is in the attachment carried by the filtering request message, and in this embodiment, the content filtering system of the mobile network not only includes a service server and at least one filtering device, but also includes a remote storage module for storing the content to be filtered, as shown in Fig. As shown in 7, the filtering request message includes not only the identification of the service server that initiated the filtering request, the identification number of the filtering request, the requested filtering function, the identification of whether the content has been classified, and the filtering result required to be returned, but also the filtered content Source identifier (Source), as shown in FIG. 8 , the filtering device obtains the content to be filtered from the remote storage module according to the URL in the filtered content source identifier.

The mobile network content filtering system and method of the third embodiment of the present invention are substantially the same as the first embodiment, the only difference being that in this embodiment, the service server completes different filtering operations through different filtering devices. As shown in FIG. 9, in step 910, the service server requests the filtering device 1 for virus scanning and content identification and identification.

Then enter step 920, the filtering device 1 scans the content for viruses according to its content filtering request.

Then enter step 930, the filtering device 1 performs content identification and identification on the content according to the content filtering request, and the specific implementation of virus scanning and content identification and identification is the same as that of the first embodiment, and will not be repeated here.

Then enter step 940, the filtering device 1 returns the results of virus scanning and content identification and identification to the service server.

Then enter step 950, the service server sends the content after virus scanning and content identification and identification to the filtering device 2, and requests the filtering device 2 to filter the content.

Then enter step 960, where the filtering device 2 performs content filtering, and the specific implementation method is the same as that of the first embodiment.

Then enter step 970, the filtering device 2 returns the filtered content result to the service server, and the service server sends the filtered content to the user.

The service server mentioned in the above embodiments is a specific executor of service logic, and may have different names in different systems, for example, it may be called a service enabler in a mobile service platform.

Although the present invention has been illustrated and described with reference to certain preferred embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the present invention. The spirit and scope of the invention.

Claims (13)

1. A content filtering system, characterized in that, comprising: A business server that provides services to users and at least one filtering device that implements the content filtering function; The service server sends the content to be sent to the user to the filtering device to request filtering, and sends the filtered content to the user according to the filtering result returned by the filtering device. 2. The content filtering system according to claim 1, wherein the filtering device comprises: A message processing unit for sending and receiving messages and parsing the received messages, a content identification and identification unit for classifying and identifying the specified content in the message according to the rules of content classification and content grading, and a content identification and identification unit for Filtering rules for public content and/or user-defined content, a filtering unit for filtering content that has been classified and identified, and a main control unit; The main control unit is used to invoke the content identification and identification unit and the filtering unit to filter the specified content in the message according to the message processing unit received from the service server and parsed out from the filtering request process, and send the filtering result to the service server through the message processing unit. 3. The content filtering system according to claim 2, wherein the filtering device also includes: Virus database, used to record virus characteristics; A virus scanning unit, configured to perform virus scanning on the specified content in the message according to the virus characteristics in the virus database. 4. The content filtering system according to claim 2, wherein the filtering device also includes: A subscription and user rule management unit, configured to manage user subscriptions to virus scanning, content identification and identification, and content filtering services, and manage filtering rules for user-defined content; The main control unit performs corresponding filtering processing according to the services subscribed by the user in the subscription and user rule management unit. 5. The content filtering system according to claim 2, wherein the system further comprises a remote storage module for storing specified content in the message; The filtering device acquires the specified content from the remote storage module according to the uniform resource location in the message. 6. The content filtering system according to claim 2, wherein the filtering request includes the service server identification that initiates the filtering request, the identification number of the filtering request, the content source identification requesting filtering, the filtering function requested, Whether the content is categorized, and the filtered results that are required to be returned. 7. The content filtering system according to any one of claims 1 to 6, wherein the filtering device also includes an information recording unit, and the main control unit will respond to the specified content in the message The filtering result of filtering processing is recorded in this information recording unit. 8. A content filtering method, characterized in that, comprising the following steps: The service server that provides services for the user sends a filtering request message to the filtering device, and uses the content to be sent to the user as the specified content in the message to request the filtering device to filter the content; The filtering device performs corresponding filtering processing on the specified content in the message according to the received filtering request message, and returns the filtering result to the service server; The service server sends the filtered content to the user according to the filtering result returned by the filtering device. 9. The content filtering method according to claim 8, wherein the filtering process comprises the following sub-steps: According to the identification and identification result of the specified content in the message by the content identification and identification unit, match applicable filtering rules, and filter the specified content in the message according to the matched filtering rules. 10. The content filtering method according to claim 8, wherein the user subscribes to the filtering device to filter and process the content sent to the user by the service server; The filtering device performs corresponding filtering processing according to the service subscribed by the user. 11. The content filtering method according to claim 10, wherein the services subscribed by the user include virus scanning, content classification, content filtering, and content classification and filtering. 12. The content filtering method according to claim 11, wherein the user defines rules for filtering content, and the filtering device filters the message according to public content and/or user-defined content filtering rules The specified content in is filtered. 13. The content filtering method according to any one of claims 8 to 12, wherein the filtering device obtains the specified content from an attachment carried in the message; or The filtering device acquires the specified content from the remote device according to the uniform resource location of the message.

Images