HK40021507B - Reporting method and apparatus for live broadcast - Google Patents

Description

Reporting method and device for live broadcast

Technical Field

The present invention relates to the field of computer technology, and in particular to a reporting method and device for live broadcasting.

Background Art

With the development of computer technology, live video broadcasting has attracted more and more attention. Live video broadcasting starts with the host client providing a video data stream, which is forwarded in real time by the server and then viewed on the viewer client.

Due to the uncertainty of the video data stream provided by the live broadcast client, some illegal content often appears during live broadcasts. In related technologies, when reporting illegal content during live broadcasts, the reporting operation interface is often unclear. As a result, by the time the reporting operation interface is found, the relevant illegal live broadcast video has already been reviewed or deleted, which is not conducive to the supervision of live broadcasts.

Summary of the Invention

In order to solve the problems of the prior art, the embodiments of the present invention provide a method and device for reporting live broadcasts. The technical solution is as follows:

In one aspect, a method for reporting live broadcasting is provided, the method comprising:

Receive the gesture trajectory input during the live video playback and obtain the target gesture;

When the target gesture matches the preset reporting gesture, obtaining a video stream identifier of the live video;

Generate a reporting instruction according to the video stream identifier;

The reporting instruction is sent to a reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, records the audio data and video image data of the target live video stream, and performs reporting processing based on the audio data and video image data.

In another aspect, a reporting method for live broadcast is provided, the method comprising:

Receive a report instruction, the report instruction carrying a video stream identifier of the live video being reported; the report instruction is generated when a target gesture received by the reporting client during the live video playback matches a preset report gesture;

In response to the reporting instruction, determining a target live video stream that matches the video stream identifier;

Recording the audio data and video image data of the target live video stream;

Report processing is performed based on the audio data and video image data.

In another aspect, a reporting device for live broadcasting is provided, the device comprising:

The first receiving module is used to receive the gesture trajectory input during the live video playback process and obtain the target gesture;

A first acquisition module is configured to acquire a video stream identifier of the live video when the target gesture matches a preset reporting gesture;

A generating module, configured to generate a reporting instruction according to the video stream identifier;

A sending module is used to send the reporting instruction to a reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, record the audio data and video image data of the target live video stream, and perform reporting processing based on the recorded audio data and video image data.

Optionally, the generating module includes:

A third acquisition module is used to obtain the violation level corresponding to the preset reporting gesture that matches the target gesture;

A generating submodule is used to generate the reporting instruction according to the video stream identifier and the violation level.

Optionally, the device further includes a setting module, which is used to set a preset reporting gesture; the setting module includes:

A fourth acquisition module, configured to acquire an input preset reporting gesture in response to a preset reporting gesture setting request;

Display module, used to display violation level options;

The fifth acquisition module is used to determine the violation level corresponding to the preset reporting gesture in response to the selection signal of the violation level option.

In another aspect, a reporting device for live broadcasting is provided, the device comprising:

The second receiving module is configured to receive a reporting instruction, wherein the reporting instruction carries a video stream identifier of the live video being reported; the reporting instruction is generated when a target gesture received by the reporting client during the live video playback matches a preset reporting gesture;

A first determining module is configured to respond to the reporting instruction and determine a target live video stream that matches the video stream identifier;

A recording module, configured to record the audio data and video image data of the target live video stream;

The reporting processing module is used to perform reporting processing based on the recorded audio data and video image data.

Optionally, the report processing module includes:

A feature extraction module is used to extract features from the recorded audio data and video image data to obtain audio features and video image features;

a second determining module, configured to determine the label information of the audio data according to the audio features, and determine the label information of the video image data according to the video image features;

A third determining module is configured to determine the tag information of the target live video stream based on the tag information of the audio data and the tag information of the video image data;

A fourth determination module is used to determine a reporting processing strategy based on the tag information of the target live video stream;

The processing submodule is used to process the report according to the report processing strategy.

Optionally, the label information includes a label type, and the label type includes a violation label and a non-violation label. When the label type is a violation label, the label information also includes a violation level.

The third determining module includes:

A fifth determining module is configured to determine that the tag type of the target live video stream is a violation tag when there is a violation tag in the tag type of the audio data and the tag type of the video image data;

A sixth determining module, configured to use the highest violation level in the tag information corresponding to the violation tag as the violation level of the target live video stream;

The seventh determination module determines that the tag type of the target live video stream is a non-violating tag when there is no violating tag in the tag type of the audio data and the tag type of the video image data.

Optionally, the reporting instruction includes the violation level of the reported live video stream;

The fourth determining module includes:

an eighth determination module, configured to, when the label type of the target live video stream is a violation label, determine a penalty level for the anchor client corresponding to the video stream identifier based on the violation level of the target live video stream, and determine a reward level for the reporting client based on the violation level in the reporting instruction and the violation level of the target live video stream;

The ninth determination module is used to determine the penalty level for the reporting client based on the violation level in the reporting instruction when the label type of the target live video stream is a non-violation label.

Optionally, the eighth determination module is specifically used to: when the violation level in the reporting instruction matches the violation level of the target live video stream, determine the reward level for the reporting client based on the violation level of the reporting instruction; when the violation level in the reporting instruction and the violation level of the target live video stream do not match, determine the reward level for the reporting client based on the violation level of the target live video stream.

On the other hand, a reporting system for live broadcast is provided, the system comprising a reporting client and a reporting server, wherein:

The reporting client is configured to receive a gesture trajectory input during live video playback and obtain a target gesture; when the target gesture matches a preset reporting gesture, obtain a video stream identifier of the live video; generate a reporting instruction based on the video stream identifier; and send the reporting instruction to a reporting server;

The reporting server is used to receive the reporting instruction; respond to the reporting instruction, determine the target live video stream that matches the video stream identifier; record the audio data and video image data of the target live video stream; and perform reporting processing based on the recorded audio data and video image data.

On the other hand, a terminal is provided, including a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the above-mentioned client-side reporting method for live broadcast.

On the other hand, a server is provided, including a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the above-mentioned server-side reporting method for live broadcast.

On the other hand, a computer-readable storage medium is provided, in which at least one instruction, at least one program, code set or instruction set is stored. The at least one instruction, the at least one program, the code set or instruction set is loaded and executed by a processor to implement the reporting method for live broadcast on the reporting client side or the reporting server side provided in the above-mentioned method embodiment.

The embodiment of the present invention obtains the target gesture by receiving the gesture trajectory during the live video playback process, and obtains the video stream identifier of the live video when the target gesture matches the preset reporting gesture, generates a reporting instruction according to the video stream identifier, and sends the reporting instruction to the reporting server, so that the reporting server can immediately record the audio data and video image data of the live video stream when receiving the reporting instruction, and perform reporting processing based on the recorded audio data and video image data, realizing the function of completing reporting based on convenient interactive gestures, avoiding the problem of illegal live videos being passed or deleted due to finding unclear reporting operation entrances, and is conducive to strengthening the supervision of live video broadcasts.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

FIG1 is a schematic diagram of an implementation environment provided by an embodiment of the present invention;

FIG2 is a flow chart of a reporting method for live broadcasting provided by an embodiment of the present invention;

3a, 3b and 3c are schematic diagrams of gesture trajectories input during live video playback received by a reporting client according to an embodiment of the present invention;

FIG4 is a flow chart of another reporting method for live broadcasting provided by an embodiment of the present invention;

5 is a flow chart of a method for reporting based on recorded audio data and video image data provided by an embodiment of the present invention;

Figures 6a, 6b, and 6c are schematic diagrams illustrating rewards for reporting clients when a report is true, according to an embodiment of the present invention; Figures 6d, 6e, and 6f are schematic diagrams illustrating penalties for reporting clients when a report is false, according to an embodiment of the present invention;

FIG7 is a schematic structural diagram of a reporting device for live broadcasting provided by an embodiment of the present invention;

FIG8 is a schematic structural diagram of another reporting device for live broadcasting provided by an embodiment of the present invention;

9 is a block diagram of the hardware structure of a terminal provided in an embodiment of the present invention;

FIG10 is a block diagram of the hardware structure of a server provided in an embodiment of the present invention.

DETAILED DESCRIPTION

The following will clearly and completely describe the technical solutions in the embodiments of the present invention in conjunction with the accompanying drawings. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without making any creative efforts shall fall within the scope of protection of the present invention.

It should be noted that the terms "first", "second", etc. in the description and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. It should be understood that the numbers used in this way are interchangeable where appropriate so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions. For example, a process, method, system, product or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

Please refer to Figure 1, which is a schematic diagram of an implementation environment provided by an embodiment of the present invention. The implementation environment may include an anchor terminal 110, a live broadcast server 120, an audience terminal 130 and a reporting server 140.

The host terminal 110 may run a host client, and the viewer terminal 130 may run a viewer client. Multiple viewer clients may correspond to the host client. In the embodiments of this specification, when a viewer client reports a live video broadcast by the host client, the viewer client initiating the report may also be referred to as a reporting client. The host terminal 110 and viewer terminal 130 may include, but are not limited to, smartphones, desktop computers, tablet computers, laptops, digital assistants, smart wearable devices, and the like.

The live broadcast server 120 can provide background live broadcast services for the host client and the viewer client. It can include a standalone server, a distributed server, or a server cluster consisting of multiple servers. The live broadcast server 120 and the host terminal 110 can be connected via a wired network or a wireless network. The live broadcast server 120 and the viewer terminal 130 can be connected via a wired gateway or a wireless network.

The reporting server 140 can provide a backend reporting service for the viewer client and can include a standalone server, a distributed server, or a server cluster consisting of multiple servers. The reporting server 140 can be connected to the anchor terminal 110 via a wired network or a wireless network, and the reporting server 140 can be connected to the viewer terminal 130 via a wired gateway or a wireless network.

Please refer to Figure 2, which shows a flow chart of a reporting method for live broadcast provided by an embodiment of the present invention. The method can be applied to the audience terminal in Figure 1, and more specifically, can be applied to the reporting client that initiates the report in the audience terminal. It should be noted that this specification provides method operation steps as described in the embodiments or flow charts, but more or fewer operation steps may be included based on conventional or non-creative labor. The order of steps listed in the embodiments is only one way of executing the steps among many steps, and does not represent the only execution order. When the system or product is executed in practice, it can be executed in sequence or in parallel according to the method shown in the embodiments or the accompanying drawings (for example, a parallel processor or a multi-threaded processing environment). Specifically, as shown in Figure 2, the method may include:

S201, receiving a gesture trajectory input during live video playback to obtain a target gesture.

Specifically, during live video streaming, users can use the viewer client to play the live video provided by the host client. During the live video playback process, if the user feels that the live video content contains illegal content, they can enter a gesture trajectory by sliding their finger on the live video playback interface. The viewer client can monitor the user's touch signals through a monitor and analyze the gesture trajectory formed by sliding the finger on the live video playback interface to obtain the target gesture. Illegal content can include, but is not limited to, pornographic video images, banned words, etc.

S203: When the target gesture matches a preset reporting gesture, obtain a video stream identifier of the live video.

In the embodiments of this specification, the preset reporting gesture is a pre-set reporting gesture. The preset reporting gesture can be a default gesture or a gesture set by the user based on personal preferences and habits. To facilitate users to quickly report, the preset reporting gesture is generally a simple graphic, number, mathematical symbol, or letter.

In a specific embodiment, if the preset reporting gesture is the system default gesture, each time the user opens the live video application, the default gesture will pop up and the violation level corresponding to the default gesture will be prompted to prompt the user to report the corresponding violation level through the default gesture. Different violation levels correspond to different preset reporting gestures. In order to facilitate users to report quickly, the preset reporting gestures corresponding to different violation levels can be distinguished by the number of identical elements included. For example, the violation levels from low to high may include warning, level 1 warning, and ban, and the corresponding preset reporting gestures may be "X", "XX", and "XXX".

In another specific embodiment, the method may further include a step of setting a preset report gesture, so that the user can set the preset report gesture according to personal preferences and habits. Specifically, when the user first uses the live video application, the viewer client may prompt the user to set the preset report gesture and display a drawing interface for the preset report gesture. When the user enters the gesture trajectory in the drawing interface and clicks submit, the viewer client may respond to the preset report gesture setting request and obtain the input preset report gesture; the viewer client may display a violation level option so that the user selects the violation level corresponding to the current preset gesture; the viewer client may determine the violation level corresponding to the preset report gesture in response to a selection signal for the violation level option. The violation level included in the violation level option may include multiple levels. For example, the violation levels from low to high may include warning, level 1 warning, and ban.

Taking the violation levels from low to high as warning, level one warning, and ban, and the preset reporting gestures corresponding to the violation levels from low to high as "X", "XX", and "XXX" as an example, as shown in Figure 3a, the target gesture received by the client is "X", which matches the preset reporting gesture "X"; as shown in Figure 3b, the target gesture received by the client is "XX", which matches the preset reporting gesture "XX"; as shown in Figure 3c, the target gesture received by the client is "XXX", which matches the preset reporting gesture "XXX".

In the embodiments of this specification, when the target gesture matches a preset report gesture, the viewer client can obtain the video stream identifier of the live video. The video stream identifier uniquely identifies the live video stream and has a one-to-one correspondence with the host client providing the live video. This means that the host client and the live video stream can be uniquely identified through the video stream identifier.

S205: Generate a reporting instruction according to the video stream identifier.

In the embodiment of this specification, when the preset reporting gesture corresponds to a corresponding violation level, the violation level corresponding to the preset reporting gesture matching the target gesture can be obtained, and a corresponding reporting instruction can be generated according to the violation level and the video stream identifier.

S207, sending the reporting instruction to the reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, records the audio data and video image data of the target live video stream, and performs reporting processing based on the recorded audio data and video image data.

It can be seen from the above technical solutions of the embodiment of the present invention that in the embodiment of the present invention, users only need to slide and input corresponding gestures on the playback interface of the live video to report the live video, making the reporting of the live video faster and more convenient, and there is no need to search for the reporting operation entrance, thereby avoiding the problem of illegal live videos being passed or deleted due to searching for unclear reporting operation entrances, which is conducive to strengthening the supervision of live video broadcasts.

Please refer to FIG4 , which is a flow chart of another method for reporting live broadcasts provided by an embodiment of the present invention. This method can be applied to the reporting server in FIG1 . As shown in FIG4 , the method may include:

S401, receiving a reporting instruction, wherein the reporting instruction carries a video stream identifier of a live video being reported.

Among them, the reporting instruction is generated when the target gesture received by the reporting client during the live video playback matches the preset reporting gesture. For the preset reporting gesture, please refer to the relevant description in the method embodiment shown in Figure 2 above, which will not be repeated here.

S403: In response to the reporting instruction, determine a target live video stream that matches the video stream identifier.

Specifically, after receiving the reporting instruction, the reporting server may extract the video stream identifier carried in the reporting instruction and determine the target live video stream that matches the video stream identifier.

In a specific embodiment, the reporting instruction can also carry the violation level of the reported live video stream. When the reporting server simultaneously receives reporting instructions for different live videos from multiple different reporting terminals, the reporting server can extract the violation level in the reporting instruction and sort the reporting instructions from high to low according to the violation level. In this way, the target reporting instruction can be determined according to the violation level, and then priority can be given to responding to reporting instructions with high violation levels, so as to promptly process the most unhealthy live videos.

S405: Record the audio data and video image data of the target live video stream.

In the embodiment of the present specification, after responding to the reporting instruction, the reporting server immediately records the audio data and video image data of the target live video stream, thereby being able to retain the content of the reported live video in a timely manner.

In a specific implementation, audio data and video image data within a preset time period can be recorded. The preset time period is a preset duration starting from the receiving timestamp of the reporting instruction. The preset time period can be set according to actual needs, for example, it can be set to 20 seconds, 50 seconds, etc.

S407: Perform reporting processing based on the recorded audio data and video image data.

In the embodiment of this specification, the reporting server may use the method shown in FIG5 to implement reporting processing based on the recorded audio data and video image data. As shown in FIG5 , the method may include:

S501 , performing feature extraction on the recorded audio data and video image data respectively to obtain audio features and video image features.

In the embodiments of this specification, feature extraction of audio data includes identifying the audio frequency, amplitude, and timbre of the audio data, converting it into corresponding text content, and obtaining keywords in the text content. The audio features are the keywords of the text content corresponding to the audio data.

Feature extraction from the video image data includes determining the number of skin regions in the video image data, determining the ratio of pixels in the skin regions to all pixels in the image, and determining the ratio of the maximum skin region to the total skin region. Accordingly, the video image features include the number of skin regions, the ratio of pixels in the skin regions to all pixels in the image, and the ratio of the maximum skin region to the total skin region.

S503: Determine tag information of the audio data according to the audio feature, and determine tag information of the video image data according to the video image feature.

In practical applications, audio features and video image features can be input into an audio label determination model and a video label determination model, respectively. The audio label determination model determines the label information corresponding to the audio features, and the video label determination model determines the label information corresponding to the video image features. The audio label determination model is a machine learning model trained based on sample audio and corresponding labels, and the video label determination model is a machine learning model trained based on sample video images and corresponding labels. The above-mentioned machine learning models may include, but are not limited to, linear classifiers (such as LR), support vector machines (SVM), naive Bayes (NB), and the like.

In a specific implementation, the audio samples include positive and negative audio samples. Positive audio samples are determined to contain no illegal content, while negative audio samples are determined to contain illegal content. Positive audio samples are labeled with a non-illegal label, while negative audio samples are labeled with an illegal label. Sample video images include positive and negative video images. Positive video images are determined to contain no illegal content, while negative video images are determined to contain illegal content. Positive video images are labeled with a non-illegal label, while negative video images are labeled with an illegal label.

In a specific embodiment, when training a machine learning model, the violation level of negative audio samples and the violation level of negative video samples can also be annotated. In this way, the machine learning model trained using negative audio samples annotated with the violation level can output the corresponding violation level, and the machine learning model trained using negative video samples annotated with the violation level can output the corresponding violation level. Regarding the violation level, please refer to the relevant description of the method embodiment shown in Figure 2 above, and will not be repeated here.

S505: Determine the tag information of the target live video stream according to the tag information of the audio data and the tag information of the video image data.

In the embodiment of this specification, the label information may include a label type, which includes a violation label and a non-violation label. When the label type is a violation label, the corresponding label information may further include a violation level.

In the case where there is a violation tag in the tag type of the audio data and the tag type of the video image data, the tag type of the target live video stream is determined to be a violation tag, that is, as long as one of the tag types of the audio data and the tag type of the video image data is a violation tag, the tag type of the target live video stream can be considered to be a violation tag. When one of the tag types is a violation tag, the violation level in the tag information corresponding to the violation tag can be obtained, and the violation level can be determined as the violation level of the target live video stream; when the tag type of the audio data is a violation tag, and the tag type of the video image data is a violation tag, the violation level in the tag information of the audio data and the violation level in the tag information of the video image data are obtained respectively, and the highest violation level between the violation level in the tag information of the audio data and the violation level in the tag information of the video image data is used as the violation level of the target live video stream.

For example, when the label information of the audio data is: violation label, warning, and the label information of the video image data is: non-violation label, the label information of the target live video stream is determined to be: violation label, warning; when the label information of the audio data is: non-violation label, and the label information of the video image data is: violation label, banned, the label information of the target live video stream is determined to be: violation label, banned; when the label information of the audio data is: violation label, warning, and the label information of the video image data is: violation label, banned, since the violation level of banned is higher than warning, the label information of the target live video stream can be determined to be: violation label, banned.

When there is no violation tag in the tag type of the audio data and the tag type of the video image data, the tag type of the target live video stream is determined to be a non-violation tag. That is, when the tag type of the audio data is a non-violation tag and the tag type of the video image data is a non-violation tag, the tag information of the target live video stream can be determined to be: non-violation tag.

S507: Determine a reporting processing strategy based on the tag information of the target live video stream.

In order to encourage users to report illegal content and strengthen the crackdown on illegal live broadcasters, in the embodiments of this specification, the reporting processing strategy includes a reporting processing strategy corresponding to true reports and a reporting processing strategy corresponding to false reports. Among them, a true report means that the tag information of the target live video stream determined by the reporting server is consistent with the reporting instructions; an false report means that the tag information of the target live video stream determined by the reporting server does not match the reporting instructions. Among them, the reporting processing strategy for true reports includes a reward strategy for the reporting client and a penalty strategy for the anchor client; the reporting processing strategy for false reports includes a penalty strategy for the reporting client.

In actual applications, the reporting instruction includes the violation level of the reported live video stream. When the label type of the target live video stream is a violation label, the report can be determined to be true. The penalty level of the anchor client corresponding to the video stream identifier can be determined based on the violation level of the target live video stream, and the reward level for the reporting client can be determined based on the violation level in the reporting instruction and the violation level of the target live video stream.

In a specific implementation, the reporting server may store the correspondence between violation levels and penalty levels. Depending on the penalty object (including the reporting client and the anchor client), the correspondence may include the correspondence between the violation level and the penalty level of the anchor client, as well as the correspondence between the violation level and the penalty level of the reporting client.

In a specific embodiment, when the object of punishment is the anchor client, the violation levels from low to high may include warning, level one warning and ban, and the corresponding punishment levels may include warning punishment, level one warning punishment and ban punishment. Among them, the warning punishment and level one warning punishment can reflect the different severity of the punishment through the different ban durations. For example, the warning punishment can be set to ban for 10 minutes, and the level one warning punishment can be set to ban for half an hour; the ban punishment can be a permanent ban.

In a specific implementation, when the target of the penalty is a reporting client, the violation levels, from low to high, can include warning, level 1 warning, and ban, and the corresponding penalty levels can include level 1 penalty, level 2 penalty, and level 3 penalty. The penalty methods for each level can be the same or different, and the severity of the penalty can be reflected by the different penalty contents. For example, level 1 penalty, level 2 penalty, and level 3 penalty all result in a ban on the reporting client. The level 1 penalty can be set to a 5-minute ban, the level 2 penalty to a 30-minute ban, and the level 3 penalty to a 24-hour ban.

The reporting server may also store a correspondence between violation levels and reward levels. In a specific embodiment, the violation levels may include warnings, level 1 warnings, and bans, and the corresponding reward levels may include level 1 rewards, level 2 rewards, and level 3 rewards. The reward methods for each reward level may be the same or different, and the different levels of rewards between the same reward methods may be reflected by the different reward contents. For example, the level 1 reward, level 2 reward, and level 3 reward are all virtual resources such as virtual gold coins, points, etc. awarded to the reporting client. For example, the level 1 reward may be set to 50 virtual gold coins, the level 2 reward to 250 virtual gold coins, and the level 3 reward to 500 virtual gold coins.

In an embodiment of the present specification, when determining the reward level for the reporting client based on the violation level in the reporting instruction and the violation level of the target live video stream, when the violation level in the reporting instruction and the violation level of the target live video stream match, the reward level for the reporting client can be determined based on the violation level of the reporting instruction; when the violation level in the reporting instruction and the violation level of the target live video stream do not match, the reward level for the reporting client can be determined based on the violation level of the target live video stream, and the lower violation level between the violation level in the reporting instruction and the violation level of the target live video stream can be determined, and the reward level for the reporting client can be determined based on the lower violation level.

In the embodiment of the present specification, when the tag type of the target live video stream is a non-violation tag, it can be determined that the report is untrue, and the penalty level for the reporting client can be determined based on the violation level in the reporting instruction.

S509: Perform report processing according to the report processing strategy.

Specifically, the reporting server performs corresponding reporting processing according to the determined reporting processing strategy. For example, when the report is true, the reporting client is rewarded with virtual gold coins corresponding to the reward level, as shown in Figures 6a, 6b, and 6c. The reporting client may also be prompted with the reward, such as by displaying the reward information on the display interface of the reporting client. The reported live stream client may be punished according to the penalty level, by converting the live stream image of the live stream client to a preset screen, and displaying the penalty information on the display interface of the live stream client. When the report is false, the reporting client is punished according to the penalty level, as shown in Figures 6d, 6e, and 6f. The reporting client may also be prompted with the penalty information, such as by displaying the penalty information on the display interface of the reporting client.

It can be seen from the above technical solutions of the embodiment of the present invention that the embodiment of the present invention realizes the reporting function of live video through convenient interactive gestures. The reporting server can immediately record the reported live video stream when receiving the reporting instruction, and quickly retain the audio data and video image data for corresponding reporting processing, effectively avoiding the problem of related illegal live videos being passed or deleted, which makes reporting convenient and is conducive to improving the efficiency of reporting processing.

In addition, the embodiment of the present invention can reduce the server's load pressure by recording the audio data and video image data of the live video stream in a preset time period, avoiding the problem of high server load pressure caused by recording the complete live content, thereby reducing the monitoring cost of the live video.

An embodiment of the present invention further provides another reporting method for live broadcasting, the method comprising:

The reporting client receives the gesture trajectory input during the live video playback and obtains the target gesture; when the target gesture matches the preset reporting gesture, obtains the video stream identifier of the live video; generates a reporting instruction based on the video stream identifier; and sends the reporting instruction to the reporting server;

The reporting server receives the reporting instruction; responds to the reporting instruction, determines the target live video stream that matches the video stream identifier; records the audio data and video image data of the target live video stream; and performs reporting processing based on the recorded audio data and video image data.

Corresponding to the reporting methods for live broadcast on the reporting client side provided in the above-mentioned embodiments, an embodiment of the present invention also provides a reporting device for live broadcast. Since the reporting device for live broadcast provided in the embodiment of the present invention corresponds to the reporting methods for live broadcast on the reporting client side provided in the above-mentioned embodiments, the implementation methods of the aforementioned reporting methods for live broadcast on the reporting client side are also applicable to the reporting device for live broadcast provided in this embodiment, and will not be described in detail in this embodiment.

Please refer to Figure 7, which shows a schematic diagram of the structure of a reporting device for live broadcasting provided by an embodiment of the present invention. The device has the function of implementing the reporting method for live broadcasting on the client side in the above-mentioned method embodiment. The function can be implemented by hardware or by hardware executing corresponding software. As shown in Figure 7, the device may include:

The first receiving module 710 is configured to receive a gesture trajectory input during live video playback and obtain a target gesture;

A first acquisition module 720 is configured to acquire a video stream identifier of the live video when the target gesture matches a preset reporting gesture;

A generating module 730, configured to generate a reporting instruction according to the video stream identifier;

The sending module 740 is used to send the reporting instruction to the reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, record the audio data and video image data of the target live video stream, and perform reporting processing based on the recorded audio data and video image data.

In a specific embodiment, the generation module 730 may include:

A third acquisition module is used to obtain the violation level corresponding to the preset reporting gesture that matches the target gesture;

A generating submodule is used to generate the reporting instruction according to the video stream identifier and the violation level.

In another specific embodiment, the device may further include a setting module, wherein the setting module is used to set a preset reporting gesture; the setting module may include:

A fourth acquisition module, configured to acquire an input preset reporting gesture in response to a preset reporting gesture setting request;

Display module, used to display violation level options;

The fifth acquisition module is used to determine the violation level corresponding to the preset reporting gesture in response to the selection signal of the violation level option.

Please refer to Figure 8, which shows a schematic diagram of the structure of another reporting device for live broadcasting provided by an embodiment of the present invention. The device has the function of implementing the reporting method for live broadcasting on the reporting server side in the above method embodiment. The function can be implemented by hardware or by hardware executing corresponding software. As shown in Figure 8, the device may include:

The second receiving module 810 is configured to receive a reporting instruction, wherein the reporting instruction carries the video stream identifier of the live video being reported; the reporting instruction is generated when a target gesture received by the reporting client during the live video playback matches a preset reporting gesture;

A first determining module 820 is configured to respond to the reporting instruction and determine a target live video stream that matches the video stream identifier;

The recording module 830 is used to record the audio data and video image data of the target live video stream;

The reporting processing module 840 is used to perform reporting processing based on the recorded audio data and video image data.

In a specific embodiment, the report processing module 840 may include:

A feature extraction module is used to extract features from the recorded audio data and video image data to obtain audio features and video image features;

a second determining module, configured to determine the label information of the audio data according to the audio features, and determine the label information of the video image data according to the video image features;

A third determining module is configured to determine the tag information of the target live video stream based on the tag information of the audio data and the tag information of the video image data;

A fourth determination module is used to determine a reporting processing strategy based on the tag information of the target live video stream;

The processing submodule is used to process the report according to the report processing strategy.

Specifically, the label information includes a label type, which includes a violation label and a non-violation label. When the label type is a violation label, the label information also includes a violation level. The third determination module may include:

A fifth determining module is configured to determine that the tag type of the target live video stream is a violation tag when there is a violation tag in the tag type of the audio data and the tag type of the video image data;

A sixth determining module, configured to use the highest violation level in the tag information corresponding to the violation tag as the violation level of the target live video stream;

The seventh determination module determines that the tag type of the target live video stream is a non-violating tag when there is no violating tag in the tag type of the audio data and the tag type of the video image data.

In a specific embodiment, the reporting instruction includes the violation level of the reported live video stream; accordingly, the fourth determining module may include:

an eighth determination module, configured to, when the label type of the target live video stream is a violation label, determine a penalty level for the anchor client corresponding to the video stream identifier based on the violation level of the target live video stream, and determine a reward level for the reporting client based on the violation level in the reporting instruction and the violation level of the target live video stream;

The ninth determination module is used to determine the penalty level for the reporting client based on the violation level in the reporting instruction when the label type of the target live video stream is a non-violation label.

Optionally, the eighth determination module is specifically used to: when the violation level in the reporting instruction matches the violation level of the target live video stream, determine the reward level for the reporting client based on the violation level of the reporting instruction; when the violation level in the reporting instruction matches the violation level of the target live video stream, determine the reward level for the reporting client based on the violation level of the target live video stream.

The embodiment of the present invention further provides a reporting system for live broadcasting, which may include a reporting client and a reporting server, wherein:

The reporting client is configured to receive a gesture trajectory input during live video playback and obtain a target gesture; when the target gesture matches a preset reporting gesture, obtain a video stream identifier of the live video; generate a reporting instruction based on the video stream identifier; and send the reporting instruction to a reporting server;

The reporting server is used to receive the reporting instruction; respond to the reporting instruction, determine the target live video stream that matches the video stream identifier; record the audio data and video image data of the target live video stream; and perform reporting processing based on the recorded audio data and video image data.

It should be noted that the apparatus provided in the above embodiments, when implementing its functions, is only illustrated by the division of the above functional modules. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. In addition, the apparatus and method embodiments provided in the above embodiments are based on the same concept. The specific implementation process is detailed in the method embodiment and will not be repeated here.

An embodiment of the present invention provides a terminal comprising a processor and a memory, wherein the memory stores at least one instruction, at least one program, code set, or instruction set. The at least one instruction, at least one program, code set, or instruction set is loaded and executed by the processor to implement the reporting method for live broadcasting provided by the reporting client side as described in the above method embodiment. Figure 9 is a hardware block diagram of a terminal running a reporting method for live broadcasting provided by an embodiment of the present invention. Specifically:

The terminal may include components such as an RF (Radio Frequency) circuit 910, a memory 920 including one or more computer-readable storage media, an input unit 930, a display unit 940, a sensor 950, an audio circuit 960, a WiFi (wireless fidelity) module 970, a processor 980 including one or more processing cores, and a power supply 990. It will be understood by those skilled in the art that the terminal structure shown in FIG9 does not limit the terminal and may include more or fewer components than shown, or combine certain components, or arrange the components differently. Among them:

The RF circuit 910 can be used to receive and send signals during information transmission or calls. Specifically, after receiving downlink information from the base station, it is handed over to one or more processors 980 for processing. In addition, uplink data is sent to the base station. Generally, the RF circuit 910 includes but is not limited to an antenna, at least one amplifier, a tuner, one or more oscillators, a subscriber identity module (SIM) card, a transceiver, a coupler, an LNA (low noise amplifier), a duplexer, etc. In addition, the RF circuit 910 can also communicate with the network and other terminals via wireless communication. Such wireless communication can use any communication standard or protocol, including but not limited to GSM (Global System of Mobile Communication), GPRS (General Packet Radio Service), CDMA (Code Division Multiple Access), WCDMA (Wideband Code Division Multiple Access), LTE (Long Term Evolution), email, SMS (Short Messaging Service), etc.

The memory 920 can be used to store software programs and modules. The processor 980 executes various functional applications and data processing by running the software programs and modules stored in the memory 920. The memory 920 may mainly include a program storage area and a data storage area. The program storage area may store an operating system, application programs required for functions, etc.; the data storage area may store data created based on the use of the terminal, etc. In addition, the memory 920 may include high-speed random access memory and non-volatile memory, such as at least one disk storage device, flash memory device, or other volatile solid-state storage device. Accordingly, the memory 920 may also include a memory controller to provide access to the memory 920 by the processor 980 and the input unit 930.

The input unit 930 can be used to receive input digital or character information and generate keyboard, mouse, joystick, optical, or trackball signal input related to user settings and function control. Specifically, the input unit 930 may include a touch-sensitive surface 931 and other input devices 932. The touch-sensitive surface 931, also known as a touch display or touchpad, can detect user touch operations on or near it (for example, operations performed by a user using a finger, stylus, or any other suitable object or accessory on or near the touch-sensitive surface 931) and drive corresponding connected devices according to a pre-set program. Optionally, the touch-sensitive surface 931 may include a touch detection device and a touch controller. The touch detection device detects the user's touch position and detects signals generated by the touch operation, transmitting the signals to the touch controller. The touch controller receives the touch information from the touch detection device, converts it into touch point coordinates, and then sends it to the processor 980. It can also receive and execute commands from the processor 980. In addition, the touch-sensitive surface 931 can be implemented using various types, including resistive, capacitive, infrared, and surface acoustic wave. In addition to the touch-sensitive surface 931, the input unit 930 may further include other input devices 932. Specifically, the other input devices 932 may include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power keys, etc.), a trackball, a mouse, and a joystick.

The display unit 940 can be used to display information input by the user or information provided to the user, as well as various graphical user interfaces of the terminal. These graphical user interfaces can be composed of graphics, text, icons, videos, and any combination thereof. The display unit 940 may include a display panel 941. Optionally, the display panel 941 can be configured in the form of an LCD (Liquid Crystal Display), an OLED (Organic Light-Emitting Diode), or the like. Furthermore, the touch-sensitive surface 931 can cover the display panel 941. When the touch-sensitive surface 931 detects a touch operation on or near it, it transmits the information to the processor 980 to determine the type of touch event. The processor 980 then provides a corresponding visual output on the display panel 941 based on the type of touch event. Among them, the touch-sensitive surface 931 and the display panel 941 can be two independent components to implement input and output functions. However, in some embodiments, the touch-sensitive surface 931 and the display panel 941 can also be integrated to implement input and output functions.

The terminal may also include at least one sensor 950, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor, wherein the ambient light sensor may adjust the brightness of the display panel 941 according to the brightness of the ambient light, and the proximity sensor may turn off the display panel 941 and/or the backlight when the terminal is moved to the ear. As a type of motion sensor, the gravity acceleration sensor can detect the magnitude of acceleration in all directions (generally three axes), and can detect the magnitude and direction of gravity when stationary. It can be used for applications that identify the terminal posture (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc.; as for other sensors that the terminal can also be configured with, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be described in detail here.

Audio circuit 960, speaker 961, and microphone 962 provide an audio interface between the user and the terminal. Audio circuit 960 can convert received audio data into electrical signals and transmit them to speaker 961, which then converts them into sound signals for output. Microphone 962, on the other hand, converts collected sound signals into electrical signals, which are then received by audio circuit 960 and converted into audio data. The audio data is then processed by output processor 980 and transmitted via RF circuit 910 to, for example, another terminal. Alternatively, the audio data can be output to memory 920 for further processing. Audio circuit 960 may also include an earphone jack to allow communication between an external headset and the terminal.

WiFi is a short-range wireless transmission technology. The terminal, through WiFi module 970, can help users send and receive emails, browse web pages, and access streaming media, providing users with wireless broadband Internet access. Although FIG9 shows WiFi module 970, it is understood that it is not a required component of the terminal and can be omitted as needed without changing the essence of the invention.

The processor 980 is the control center of the terminal. It connects all components of the terminal using various interfaces and circuits. By running or executing software programs and/or modules stored in memory 920 and accessing data stored in memory 920, it performs various terminal functions and processes data, thereby providing overall terminal monitoring. Optionally, the processor 980 may include one or more processing cores. Preferably, the processor 980 may integrate an application processor and a modem processor. The application processor primarily handles the operating system, user interface, and application programs, while the modem processor primarily handles wireless communications. It is understood that the modem processor may not be integrated into the processor 980.

The terminal also includes a power supply 990 (e.g., a battery) for supplying power to various components. Preferably, the power supply can be logically connected to the processor 980 via a power management system, thereby enabling the power management system to manage charging, discharging, and power consumption. The power supply 990 can also include any of one or more DC or AC power supplies, a recharging system, a power failure detection circuit, a power converter or inverter, a power status indicator, and other components.

Although not shown, the terminal may also include a camera, a Bluetooth module, etc., which will not be described in detail here. Specifically in this embodiment, the terminal also includes a memory and one or more programs, wherein one or more programs are stored in the memory and configured to be executed by one or more processors. The one or more programs include instructions for executing the method for reporting the client side provided in the above method embodiment.

Those skilled in the art will appreciate that the structure shown in FIG9 is merely illustrative and does not limit the structure of the electronic device. For example, the terminal may include more or fewer components than shown in FIG9 , or have a configuration different from that shown in FIG9 .

An embodiment of the present invention also provides a computer-readable storage medium, which can be set in a terminal to store at least one instruction, at least one program, code set or instruction set related to a reporting method for live broadcast on the reporting client side. The at least one instruction, the at least one program, the code set or instruction set is loaded and executed by the processor to implement the reporting client side method provided by the above method embodiment.

An embodiment of the present invention provides a server, which includes a processor and a memory, wherein the memory stores at least one instruction, at least one program, a code set or an instruction set, and the at least one instruction, the at least one program, the code set or the instruction set is loaded and executed by the processor to implement the reporting method for live broadcast on the reporting server side provided in the above-mentioned method embodiment.

FIG10 is a block diagram of the hardware structure of a server running a method for reporting live broadcasts provided by an embodiment of the present invention. As shown in FIG10 , the server may vary significantly due to different configurations or performances, and may include one or more central processing units (CPUs) 1010 (processor 1010 may include, but is not limited to, a processing device such as a microprocessor MCU or a programmable logic device FPGA), a memory 1030 for storing data, and one or more storage media 1020 (e.g., one or more mass storage devices) for storing application programs 1023 or data 1022. The memory 1030 and storage medium 1020 may be either short-term storage or persistent storage. The program stored in the storage medium 1020 may include one or more modules, each of which may include a series of instruction operations on the server. Furthermore, the CPU 1010 may be configured to communicate with the storage medium 1020 to execute a series of instruction operations in the storage medium 1020 on the server 1000. The server 1000 may also include one or more power supplies 1060, one or more wired or wireless network interfaces 1050, one or more input and output interfaces 1040, and/or one or more operating systems 1021, such as Windows Server™, Mac OS X™, Unix™, Linux™, FreeBSD™, etc.

The input/output interface 1040 can be used to receive or send data via a network. Specific examples of the aforementioned network may include a wireless network provided by the server's communications provider. In one embodiment, the input/output interface 1040 includes a network adapter (NIC), which can be connected to other network devices via a base station to enable communication with the Internet. In another embodiment, the input/output interface 1040 can be a radio frequency (RF) module for wireless communication with the Internet.

Those skilled in the art will appreciate that the structure shown in FIG10 is merely illustrative and does not limit the structure of the electronic device. For example, the server may include more or fewer components than shown in FIG10 , or may have a configuration different from that shown in FIG10 .

An embodiment of the present invention also provides a computer-readable storage medium, which can be set in a server to store at least one instruction, at least one program, code set or instruction set related to a reporting method for live broadcast on the reporting server side. The at least one instruction, the at least one program, the code set or instruction set is loaded and executed by the processor to implement the reporting server side method provided by the above method embodiment.

Optionally, in this embodiment, the above-mentioned storage medium may include but is not limited to: a USB flash drive, a read-only memory (ROM), a random access memory (RAM), a mobile hard disk, a magnetic disk or an optical disk, and other media that can store program codes.

It should be noted that the order in which the embodiments of the present invention are described above is for illustrative purposes only and does not represent the superiority or inferiority of the embodiments. The above description is of specific embodiments of this specification. Other embodiments are within the scope of the appended claims. In some cases, the actions or steps described in the claims can be performed in an order different from that in the embodiments and still achieve the desired results. In addition, the processes depicted in the accompanying drawings do not necessarily require the specific order or sequential order shown to achieve the desired results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.

The various embodiments in this specification are described in a progressive manner. Similar parts between the various embodiments can be referred to in conjunction with each other. Each embodiment focuses on the differences from other embodiments. In particular, the device embodiments are generally similar to the method embodiments, so the description is relatively simple. For relevant parts, refer to the description of the method embodiments.

Those skilled in the art will understand that all or part of the steps to implement the above embodiments may be accomplished by hardware, or by a program to instruct the relevant hardware, and the program may be stored in a computer-readable storage medium, which may be a read-only memory, a disk, or an optical disk, etc.

The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention should be included in the scope of protection of the present invention.

Claims (10)

1. A method for reporting live streams, characterized in that the method includes: Receive the gesture trajectory input during live video playback to obtain the target gesture; When the target gesture matches a preset reporting gesture, the video stream identifier of the live video is obtained; A report instruction is generated based on the video stream identifier; The reporting instruction is sent to the reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, records the audio data and video image data of the target live video stream, and processes the report based on the recorded audio data and video image data. 2. The reporting method for live streaming according to claim 1, characterized in that generating a reporting instruction based on the video stream identifier includes: Obtain the violation level corresponding to the preset reporting gesture that matches the target gesture; The reporting instruction is generated based on the video stream identifier and the violation level. 3. The reporting method for live streaming according to claim 2, characterized in that the method further includes a preset reporting gesture setting step, wherein the preset reporting gesture setting includes: In response to a request to set a preset reporting gesture, obtain the input preset reporting gesture; Display violation level options; In response to the selection signal of the violation level option, the violation level corresponding to the preset reporting gesture is determined. 4. A method for reporting live streams, characterized in that the method includes: The system receives a report instruction, which carries the video stream identifier of the live video being reported. The report instruction is generated when the target gesture received by the reporting client during the live video playback matches a preset report gesture. In response to the reporting instruction, a target live video stream matching the video stream identifier is identified; Record the audio data and video image data of the target live video stream; Reports will be processed based on the recorded audio and video image data. 5. The reporting method for live streaming according to claim 4, characterized in that the reporting processing based on the recorded audio data and video image data includes: Feature extraction is performed on the recorded audio data and video image data respectively to obtain audio features and video image features; The label information of the audio data is determined based on the audio features, and the label information of the video image data is determined based on the video image features; The tag information of the target live video stream is determined based on the tag information of the audio data and the tag information of the video image data; The report handling strategy is determined based on the tag information of the target live video stream; Reports will be processed according to the aforementioned report handling strategy. 6. The reporting method for live streaming according to claim 5, wherein the tag information includes tag types, the tag types include violation tags and non-violation tags, and when the tag type is a violation tag, the tag information also includes a violation level; The step of determining the tag information of the target live video stream based on the tag information of the audio data and the tag information of the video image data includes: If there are illegal tags in the tag types of the audio data and the tag types of the video image data, the tag type of the target live video stream is determined to be an illegal tag; The highest violation level among the tag information corresponding to the violation tag is taken as the violation level of the target live video stream; If there are no illegal tags in the tag types of the audio data and the video image data, the tag type of the target live video stream is determined to be a non-illegal tag. 7. The reporting method for live streaming according to claim 6, wherein the reporting instruction includes the violation level of the reported live video stream; The step of determining the report handling strategy based on the tag information of the target live video stream includes: If the tag type of the target live video stream is a violation tag, the penalty level for the broadcaster client corresponding to the video stream identifier is determined based on the violation level of the target live video stream, and the reward level for the reporting client is determined based on the violation level in the reporting instruction and the violation level of the target live video stream. If the target live video stream has a non-violation tag type, the penalty level for the reporting client is determined based on the violation level in the reporting instruction. 8. The reporting method for live streaming according to claim 7, characterized in that, determining the reward level for the reporting client based on the violation level in the reporting instruction and the violation level of the target live streaming video stream includes: When the violation level in the reporting instruction matches the violation level of the target live video stream, the reward level for the reporting client is determined based on the violation level of the reporting instruction; When the violation level in the reporting instruction does not match the violation level of the target live video stream, the reward level for the reporting client is determined based on the violation level of the target live video stream. 9. A reporting device for live streaming, characterized in that the device comprises: The first receiving module is used to receive the gesture trajectory input during the live video playback and obtain the target gesture; The first acquisition module is used to acquire the video stream identifier of the live video when the target gesture matches the preset reporting gesture; The generation module is used to generate a reporting instruction based on the video stream identifier; The sending module is used to send the reporting instruction to the reporting server, so that the reporting server responds to the reporting instruction to determine the target live video stream that matches the video stream identifier, records the audio data and video image data of the target live video stream, and performs reporting processing based on the recorded audio data and video image data. 10. A reporting device for live streaming, characterized in that the device comprises: The second receiving module is used to receive a reporting instruction, which carries the video stream identifier of the reported live video; the reporting instruction is generated when the target gesture received by the reporting client during the live video playback matches a preset reporting gesture; The first determining module is used to respond to the reporting instruction and determine the target live video stream that matches the video stream identifier; The recording module is used to record the audio data and video image data of the target live video stream; The report processing module is used to process reports based on the recorded audio and video image data.