TWI879896B - Method for establishing network private group - Google Patents

Abstract

A method of establishing a network private group includes the steps: generating a playing signal with user device information according to a user device message of the first end and a playing signal; in the multi-person connection state of the network video stream, the first end broadcasts the play signal of the user device message; determining whether a user device at the first end exists according to the play signal of the user device message at the first end by the second end; and if the second end determines that the user device at the first end exists, the second end adds the first end to a private group list.

Description

How to create a private online group

This case involves a method for establishing an online group, in particular a method for establishing an online private group.

With the development of online video streaming, live video or video conferencing has become quite popular. When developing new related products and adding functions to these mature systems, it is often necessary to negotiate cooperation with these different existing systems. Only when the other party has an open SDK or cloud API can there be an opportunity to integrate new operating processes. The entry threshold is quite high. Moreover, the cooperation conditions of these existing systems or the development interfaces for third parties are often changing, resulting in difficulties in subsequent maintenance.

Therefore, it is clear that the current online video streaming still has deficiencies in terms of the above issues and needs to be improved urgently.

The present invention discloses a method for establishing a network private group, comprising the following steps: establishing a multi-person connection of a network video stream between a first end and at least a second end; generating a playback signal with a user device message according to a user device message and a playback signal of the first end; in the state of the multi-person connection of the network video stream, broadcasting the playback signal with the user device message by the first end; judging by the second end whether a user device of the first end exists according to the playback signal with the user device message of the first end; and if the second end judges that the user device of the first end exists, the second end adds the first end to a private group list.

The present invention also discloses a method for establishing a private group under network video streaming, which is used in conjunction with a network video streaming unit communicating between at least a first end and at least a second end, wherein the method for establishing a private group under network video streaming comprises the following steps: establishing a multi-person connection of network video streaming between the first end and the second end through the network video streaming; generating a playback signal including the user device message according to a user device message and a playback signal of the first end; When the user is connected to the first end, the first end broadcasts the playback signal with the user device message through the network video streaming unit; the second end receives the playback signal with the user device message from the first end through the network video streaming unit; the second end determines whether a user device of the first end exists according to the playback signal with the user device message from the first end; and if the second end determines that the user device of the first end exists, the second end adds the first end to a private group list.

Therefore, according to the technical content of this case, a method for establishing a network private group and a method for establishing a private group under network video streaming are provided. In the state of multi-person connection of network video streaming, a broadcast signal with user device information is broadcast by the first end, and the second end determines whether a user device of the first end exists according to the received broadcast signal, and then decides whether to add the first end to the private group list of the second end. In this way, in the state of multi-person connection of the existing network video streaming, a private group list for subsequent external information exchange can be generated, thereby adding more interactive functions between the first end and the second end.

S11-S15: Steps

The following detailed description, when read in conjunction with the accompanying drawings, will facilitate a better understanding of the present disclosure. It should be noted that, based on the practical needs of the description, the features in the drawings are not necessarily drawn to scale. In fact, for the purpose of clarity of discussion, the size of each feature may be arbitrarily increased or decreased.

Figure 1 shows a flow chart of a method for establishing a private group according to an embodiment of the present invention: and

Figure 2 is a schematic diagram of a method for establishing a private group according to some embodiments of the present invention.

The following will use diagrams and detailed descriptions to clearly explain the spirit of this case. After understanding the implementation examples of this case, any person with ordinary knowledge in the relevant technical field can make changes and modifications based on the technology taught by this case, which does not deviate from the spirit and scope of this case.

The terms used in this article are only for describing specific embodiments and are not intended to be limiting of this case. Singular forms such as "one", "this", "this", "this" and "the" as used in this article also include plural forms.

The terms "first", "second", etc. used in this article do not specifically refer to order or sequence, nor are they used to limit this case. They are only used to distinguish components or operations described by the same technical terms.

As used herein, "coupling" or "connection" may refer to direct or indirect physical contact between two or more components or devices, or to the mutual operation or movement of two or more components or devices, or to direct or indirect electrical (electrical or electrical signals) connections.

The terms "include", "including", "have", "contain", etc. used in this article are open terms, which means including but not limited to.

The term "and/or" used in this article includes any or all combinations of the items mentioned.

The directional terms used in this article, such as up, down, left, right, front or back, etc., are only used to refer to the directions of the attached drawings. Therefore, the directional terms used are used for explanation and not for limiting this case.

The terms used in this article generally have the ordinary meanings of each term used in this field, in the context of this case, and in the specific context, unless otherwise specified. Certain terms used to describe this case will be discussed below or elsewhere in this specification to provide additional guidance to those skilled in the art in describing this case.

The method and system for establishing a private network group in this embodiment can be applied to a video streaming (e.g., video conferencing or live streaming) method and system. Of course, the method and system for establishing a private network group can also cover a video streaming (e.g., video conferencing or live streaming) method and system, or the method and system for establishing a private network group can itself be a part of a video streaming (e.g., video conferencing or live streaming) method and system.

In the method of establishing a network private group in this embodiment, information from the first end can be transmitted to the second end through a network stream. In this embodiment, the first end can be a near end, and the second end can be a far end, wherein the near end can refer to a near end local end or a near end cloud end, and the far end can refer to a far end local end or a far end cloud end, and there is no limitation here.

As shown in FIG1 , a method for establishing a network private group according to an embodiment of the present invention includes the following steps. Step S11: Establish a multi-person connection of a network video stream between a first end and at least one second end. Step S12: Generate a play signal with a user device message based on a user device message and a play signal of the first end. Step S513: In the state of the multi-person connection of the network video stream, the first end broadcasts the play signal with the user device message. Step S14: The second end determines whether a user device of the first end exists based on the play signal with the user device message of the first end. Step S15: If the second end determines that the user device of the first end exists, the second end adds the first end to a private group list.

As described above, the method for establishing a network private group in this embodiment, in the state of multi-person connection of network video streaming, is to broadcast a broadcast signal with user device information by the first end, and the second end determines whether a user device of the first end exists according to the received broadcast signal, and then decides whether to add the first end to the private group list of the second end. In this way, in the state of multi-person connection of the existing network video streaming, a private group list for subsequent external information exchange can be generated, thereby adding more interactive functions between the first end and the second end.

For a detailed example, please refer to FIG. 1 and FIG. 2 at the same time. In step S11 of the present embodiment, a multi-person connection of a network video stream is established between a first end and at least one second end. The multi-person connection of the network video stream can be a multi-person connection of a network video conference or a multi-person connection of a network video live broadcast. For example, in a multi-person connection of a network video stream, the first end can send information to the second end in a one-way design (for example, live streaming). It can also be a two-way design (for example, video conferencing) in which the first end sends information to the second end and the second end sends information to the first end. The number of the first end and the second end can be one or more. If it is an example of live streaming, the first end can be one for example, and the second end can be multiple for example.

In this embodiment, after the multi-person connection of the network video streaming is established, the first end and the second end can establish a communication group between the first end and the second end according to different actual functional settings, such as a communication group for a video conference or a group between a live stream host and viewers. It is particularly noted that the group when the multi-person connection is established is different from the private group to be discussed later.

In step S12 of the present embodiment, the playback information may include image information and/or sound information, wherein the image information may be video information or picture information, and of course, may also be other multimedia playback information. In addition, the playback information may be generated by a playback source, and the playback source may be an audio and video source, such as a camera and/or a microphone. In addition, the user device information may be a personal identification code and/or device information. The personal identification code may be the user's ID or the user's IP address. Device information, such as the device version or the media access control address (Mac address), may have different settings depending on the actual communication protocol.

In this embodiment, step S12 may further include: step S121: processing the user device message to obtain a processed user device message; and step S122: hiding the processed user device message in the playback signal to generate the playback signal with the user device message.

In step S121 of the present embodiment, processing the user device message may refer to sorting the message to find a major information (major data) and a redundant information (temporal redundancy), and further removing the redundant information so that the processed user device message includes the major information. In addition, the processed user device message may include an error control code (Error Control Code) of the user device message in addition to the major information. In the present embodiment, the method of finding the redundant information may include, but is not limited to, for example one: the description or estimation of the interpixel correlation may be used; for example, DCT, DWT, DPCM. For example two: the characteristics of physiological vision (psychovisual) may be used, such as various quantization methods (quantization), the characteristics that the human eye is insensitive to high-frequency information, etc. For example three: binary coding technology (coding), etc.

In step S122 of the present embodiment, the processed user device information is hidden and embedded in the playback signal to generate the playback signal embedded with the user device information. The hidden embedding method can be implemented by a steganography embedding method, so that the processed user device information can be hidden (invisible) on the playback signal. In addition, the steganography embedding method can be, for example, divided into a spatial domain embedding method or a frequency domain embedding method. The spatial domain method technology includes, for example, neural network technology, statistical technology, spread spectrum technology, cryptography technology, vector quantization (VQ), and fractal coding. Frequency domain embedding methods include discrete cosine transform (DCT), discrete wavelet transform (DWT), discrete Fourier transform (DFT), etc. In addition, the aforementioned hiding may refer to information that is not easily perceived or visible to the human vision system.

In this embodiment, step S12 may be initiated by a trigger signal. The trigger signal may be determined by a trigger button of the user or generated based on analysis of a specific event. For example, a specific event may be triggered when a specific audio frequency is detected in the playback signal, or a specific event may be triggered when a specific image is detected in the playback signal.

In step S13 of this embodiment, in the state of multi-user connection of the network video stream, the first end broadcasts the playback signal with the user device message. In this embodiment, the first end can compress the playback signal with the user device message and convert it into the format of the network stream packet, and then broadcast the playback signal with the user device message to those users in the state of multi-user connection of the network video stream, such as several users of the second end.

In this embodiment, step S14 may further include: step S141 (not shown in the figure): the second end restores the user device message of the first end from the playback signal of the first end that carries the user device message; and step S142 (not shown in the figure): the second end determines whether the user device of the first end exists by judging the user device message of the first end.

In this embodiment, the restoration of step S141 can be to find out the processed user device information hidden in the broadcast signal through a reverse hidden secret clipping method, and then restore the user device information through a reverse processing method. Among them, the hidden secret embedding method mentioned in step S122 corresponds to the reverse hidden secret embedding method mentioned in step S141. For example, the hidden secret embedding method is to achieve hidden information through a specific hidden secret technology, and the reverse hidden secret embedding method is to achieve finding the hidden information through a specific reverse hidden secret technology. In addition, in this embodiment, the reverse processing method of step S141 corresponds to the processing method of step S121. For example, the processing method of step S121 can be to process the original message into a non-original message (main information or compressed information), while the reverse processing method of step S141 is to restore it to the user device message. In some embodiments, the reverse processing method is used in conjunction with an error control code to enhance the integrity of the restoration.

In this embodiment, step S141 may include: step S1411: a playback module at the second end plays the playback signal of the user device message at the first end to generate a corresponding image or sound; step S1412: the second end captures the image or sound of the playback signal of the user device message at the first end played by the playback module; step S1413: according to the captured image or sound from the playback module, the second end restores the captured playback signal of the user device message at the first end to obtain the user device message at the first end. The playback module may refer to a speaker or a screen.

In this embodiment, according to the above description, step S122 can be understood as an encryption process, and the restoration of step S141 can be understood as a decryption process.

In step S142 (not shown): the second end determines whether the user device of the first end exists by judging the user device message of the first end. For example, if the first end and the second end have corresponding encryption (step S122) and decryption (step S141), the second end can decrypt the user device message from the first end, so it is determined that the user device of the first end exists. Similarly, if the second end does not have the decryption corresponding to the first end (step S141), the second end cannot decrypt the user device message, so it is determined that the user device of the first end does not exist. In other words, only the first end and the second end under the same corresponding system encryption and decryption architecture can carry out the subsequent private group.

In step S15 of this embodiment: if the second end determines that the user device of the first end exists, the second end adds the first end to a private group list, wherein the first end and the second end in the private group list have the same structure with corresponding encryption (step S122) and decryption (step S141). This private group list can be displayed on the display or not, and this private group list can be used for more interactive functions between the first end and the second end in the subsequent list, such as establishing a private group chat room, or executing interactive control between the first end and the second end.

In the present implementation example, step S15 further includes: step S151 (not shown in the figure): if the second end determines that the user device of the first end exists, the second end and the first end perform a handshake; step S152 (not shown in the figure): if the handshake between the second end and the first end is completed, a message prompting the existence of the user device is generated at the second end; and step S153 (not shown in the figure): after a connection confirmation is performed between the second end and the first end (for example, the second end sends a connection notification to the first end, and the first end returns a connection approval notification to the second end), the second end adds the first end to a private group list.

In this embodiment, the method for establishing a private group can be coordinated with a network video streaming unit communicating between a first end and a second end, wherein the network video streaming unit can be a video conferencing unit or a live streaming unit, which can be implemented through software or hardware devices, and the network video streaming unit can be a third-party software and hardware device, and a third-party video conferencing software is used as an example. Among them, the aforementioned steps S11 and S13 can be executed by the network video streaming unit (using the third-party video conferencing software as an example). Among them, step S11 can be executed by the network video streaming unit of the first end or the network video streaming unit of the second end, and step S13 can be executed by the network video streaming unit of the first end. In addition, steps S12/S14/S15 can be executed by software and hardware designed by us, wherein at the first end, our device can be connected between the playback source and the network video streaming unit at the first end, and at the second end, our device can be connected between the playback module and the network video streaming unit at the second end.

Another embodiment of the present invention discloses a method for establishing a private group under network video streaming, which is used in conjunction with a network video streaming unit communicating between at least a first end and at least a second end, wherein the method for establishing a private group under network video streaming includes the following steps: establishing a multi-person connection of network video streaming between the first end and the second end through the network video streaming; generating a playback signal including the user device message according to a user device message and a playback signal of the first end; and transmitting the playback signal to the user device in the network video streaming. In a multi-person connection state, the first end broadcasts the playback signal with the user device message through the network video streaming unit; the second end receives the playback signal with the user device message from the first end through the network video streaming unit; the second end determines whether a user device of the first end exists according to the playback signal with the user device message from the first end; and if the second end determines that the user device of the first end exists, the second end adds the first end to a private group list. This embodiment has been described in detail in the above-mentioned Figures 1 and 2 and the corresponding paragraphs, and will not be repeated here.

S11-S15: Steps

Claims (11)

A method for establishing a network private group includes: establishing a multi-person connection of a network video stream between a first end and at least a second end; generating a playback signal with the user device message according to a user device message and a playback signal of the first end, wherein the step of generating the playback signal with the user device message according to the user device message of the first end and the playback signal includes: processing the user device message to obtain a processed user device message; and transmitting the processed user device message to the second end. The information is embedded in the playback signal to generate the playback signal embedded with the user device message; in the multi-person connection state of the network video streaming, the first end broadcasts the playback signal embedded with the user device message; the at least one second end determines whether a user device of the first end exists according to the playback signal embedded with the user device message of the first end; and if the at least one second end determines that the user device of the first end exists, the at least one second end adds the first end to a private group list. A method for establishing a private network group as described in claim 1, wherein the playback information includes image information and/or sound information. A method for establishing a private network group as described in claim 1, wherein the multi-person connection of the network video stream is a multi-person connection of an online video conference or a multi-person connection of an online video live broadcast. A method for establishing a network private group as described in claim 1, wherein the user device information is a personal identification code and/or device information. The method for establishing a network private group as described in claim 1, wherein the step of generating the playback signal including the user device message based on the user device message of the first end and the playback signal is initiated by a trigger signal. The method for establishing a network private group as described in claim 1, wherein the processed user device message is clipped into the playback signal to generate the playback signal clipped with the user device message, and the playback signal is clipped into the playback signal in a hidden clipping manner. The method for establishing a network private group as described in claim 1, wherein the step of judging whether the user device of the first end exists by the at least one second end according to the playback signal of the first end with the user device message includes: restoring the user device message of the first end from the playback signal of the first end with the user device message; and judging whether the user device of the first end exists by the at least one second end based on the user device message of the first end. The method for establishing a network private group as described in claim 7, wherein the step of restoring the user device message of the first end from the playback signal of the first end with the user device message includes: playing the playback signal of the first end with the user device message by a playback module of the at least one second end; capturing the playback signal of the first end with the user device message played by the playback module; and restoring the captured playback signal of the first end with the user device message by the at least one second end to obtain the user device message of the first end. The method for establishing a network private group as described in claim 1, wherein if the at least one second end determines that the user device of the first end exists, the step of adding the first end to the private group list by the at least one second end further includes: if the at least one second end determines that the user device of the first end exists, the at least one second end and the first end perform a handshake; if the handshake between the at least one second end and the first end is completed, a message prompting the user device exists is generated at the at least one second end; and after a connection confirmation is performed between the at least one second end and the first end, the at least one second end adds the first end to the private group list. A method for establishing a private group under network video streaming is used in conjunction with a network video streaming unit communicating between at least a first end and at least a second end, wherein the method for establishing a private group under network video streaming comprises: establishing a multi-person connection of network video streaming between the first end and the at least one second end through the network video streaming; generating a playback signal with the user device message according to a user device message and a playback signal of the first end, wherein the step of generating the playback signal with the user device message according to the user device message of the first end and the playback signal comprises: processing the user device message to obtain a processed user device message; and transmitting the processed user device message to the user device; The user device message after the video is embedded in the playback signal to generate the playback signal with the embedded user device message; in the multi-person connection state of the network video streaming, the first end broadcasts the playback signal with the embedded user device message through the network video streaming unit; the at least one second end receives the playback signal with the embedded user device message of the first end through the network video streaming unit; the at least one second end determines whether a user device of the first end exists according to the playback signal with the embedded user device message of the first end; and if the at least one second end determines that the user device of the first end exists, the at least one second end adds the first end to a private group list. A method for establishing a private group under network video streaming as described in claim 10, wherein the network video streaming unit is a video conferencing unit or a video live broadcast unit.

Images