TWI897305B - Method for establishing connection of conference assistance system and camera - Google Patents

Abstract

A method for establishing a connection of a conference assistance system includes steps as follows. A first client device executes the video conferencing software to conduct a video conference; the first client device receives the audio and video information of a second client device through the video conference, so that the first client device obtains the connection information through the audio and video information; the first client device uses the connection information to establish a connection channel of the conference assistance system with the second client device.

Description

Connection establishment method and camera for conference assistance system

The present invention relates to an electronic device and an operating method, and more particularly to a connection establishment method and a camera for a conference assistance system.

Video conferencing systems, such as third-party video software, can be used with any commercially available webcam for conference communication. However, webcams are limited to the same functions as the third-party video software, lacking additional conferencing support features.

To address the aforementioned lack of meeting assistance features, relevant fields have been diligently searching for solutions, but no suitable method has been developed. Therefore, establishing additional connections for meeting assistance systems is a key current research and development topic, and a goal that is urgently needed for improvement in relevant fields.

The present invention proposes a connection establishment method and camera for a conference assistance system to improve the problems of the prior art.

In some embodiments of the present invention, the present invention provides a method for establishing a connection for a conference assistance system, comprising the following steps: executing video conferencing software on a first client device to conduct a video conference; utilizing the first client device to receive audio and video information from a second client device via the video conference, so that the first client device obtains connection information via the audio and video information; and utilizing the connection information to establish a connection channel for the conference assistance system with the second client device via the first client device.

In some embodiments of the present invention, the camera provided herein includes a processing element, a connection element, and a camera element. The camera element is electrically connected to the processing element, and the connection element is electrically connected to the processing element. The processing element provides a connection code, and the connection element allows a first computer device to connect, so that the first computer device registers its external connection data and the connection code with a server as connection information. The camera element captures an image, allowing the first computer device to provide audio and video information to a second computer device via a video conferencing channel. The audio and video information includes the image and the connection code. The second computer device analyzes the image information to obtain the connection code and uses the connection code to query the server for connection information. The second computer device uses the connection information to establish a connection channel with the first computer device for the conference assistance system.

In summary, the technical solution of this invention offers significant advantages and benefits over existing technologies. By utilizing the connection establishment method and camera of the conference assistance system of this invention, users in a video conference will automatically establish a connection channel to the conference assistance system, enabling additional conference assistance functions and improving the user experience.

The following will describe the above description in detail with an implementation method and provide a further explanation of the technical solution of the present invention.

To make the description of the present invention more detailed and complete, reference is made to the accompanying drawings and various embodiments described below, in which the same numbers represent the same or similar elements. On the other hand, well-known elements and steps are not described in the embodiments to avoid unnecessary limitations on the present invention.

FIG1 is a block diagram of a connection establishment system 100 for a conference assistance system according to some embodiments of the present invention. As shown in FIG1 , the connection establishment system 100 for a conference assistance system may include a first client device 110 and a second client device 120. The first client device 110 may include a first computer device 111 and a camera 115, while the second client device 120 may include a second computer device 121 and a camera 125. Architecturally, the first computer device 111 is electrically connected to the camera 115, and the second computer device 121 is electrically connected to the camera 125.

In practice, for example, the first computer device 111 and the second computer device 121 may be personal computers, laptops, tablet computers, smart phones, or other computer circuits, and the cameras 115 and 125 may be webcams, video cameras, or other photographic devices.

During use, the first client device 110 executes the video conferencing software 112 to conduct a video conference, and the second client device 120 executes the video conferencing software 122 to conduct the same video conference. The video conferencing software 112 of the first client device 110 and the video conferencing software 122 of the second client device 120 establish a video conferencing channel 130. For example, the video conferencing software 112 and 122 can be the same third-party video conferencing software (such as Teams, etc.), and the third-party video conferencing software can be locally installed software or web-based software. The first client device 110 receives audio and video information from the second client device 120 via a video conference. The first client device 110 uses the audio and video information to obtain connection information. The first client device 110 uses the connection information to establish a conference assistance system connection channel 140 with the second client device 120. Thus, when users are participating in a video conference using the video conferencing software 112, a conference assistance system connection channel 140 is automatically established between them, enabling additional conference assistance functions and improving the user experience.

The aforementioned conference assistance system can be a software function implemented between the first client device 110 and the second client device 120. For example, the conference assistance system can also include a function that verifies that shared data and audio are visible to both parties through the exchange of desktop information and audio between the first client device 110 and the second client device 120 (i.e., "Can you see my shared screen? Can you hear my voice?"). The conference assistance system can also include interactive PTZ control, where PTZ stands for Pan, Tilt, and Zoom. The conference assistance system can also include automatic data synchronization, sharing (e.g., automatic assignment submission), and/or customization features.

To provide a more detailed description of the operation method of the connection establishment system 100 for the conference assistance system, please refer to Figures 1 and 2. Figure 2 is a flow chart of a connection establishment method 200 for the conference assistance system according to some embodiments of the present invention. It should be understood that the steps mentioned in the embodiment of Figure 2, except for those specifically described in their order, can be adjusted in order according to actual needs, and can even be executed simultaneously or partially simultaneously.

In step S200, a connection code (e.g., MPbG_) is generated by the camera 115 of the first client device 110. Similarly, in step S210, another connection code (e.g., _PnG7) is generated by the camera 125 of the second client device 120.

In step S201, the first client device 110 registers its external connection data (e.g., the IP address of the first client device 110, etc.) and connection code with the server 290 as connection information (e.g., the external connection data of the first client device 110 and its correspondence with the connection code). Similarly, in step S211, the second client device 120 registers its external connection data (e.g., the IP address of the second client device 120, etc.) and connection code with the server 290 as connection information (e.g., the external connection data of the second client device 120 and its correspondence with the connection code).

In step S202 , the first client device 110 executes the video conferencing software 112 to conduct a video conference with the second client device 120 , and the second client device 120 executes the video conferencing software 122 to conduct a video conference with the first client device 110 . After a video conference is established between a first client device 110 and a second client device 120, the first client device 110 integrates its connection key into the audio and video information. The first client device 110 provides the audio and video information to the second client device 120 via the video conference (e.g., channel 130 of the video conference), allowing the second client device 120 to obtain the audio and video information of the first client device 110. Similarly, the second client device 120 integrates its connection key into the audio and video information. The second client device 120 provides the audio and video information to the first client device 110 via the video conference (e.g., channel 130 of the video conference), allowing the first client device 110 to obtain the audio and video information of the second client device 120.

Regarding the mechanism for integrating a connection code into audio and video information, in some embodiments of the present invention, a camera 115 of a first client device 110 captures an image, and the first client device 110 embeds a connection code within the image, so that the audio and video information provided by the first client device 110 includes the image with the connection code embedded therein. Similarly, a camera 125 of a second client device 120 captures an image, and the second client device 120 embeds a connection code within the image, so that the audio and video information provided by the second client device 120 includes the image with the connection code embedded therein. For example, the aforementioned method of embedding the connection code can be implemented through alpha blending.

Alternatively or additionally, in some embodiments of the present invention, the first client device 110 generates ultrasonic information based on a connection code, so that the audio and video information provided by the first client device 110 includes ultrasonic information. Similarly, the second client device 120 generates ultrasonic information based on a connection code, so that the audio and video information provided by the second client device 120 includes ultrasonic information. The use of ultrasound in embodiments of the present invention can avoid affecting the auditory experience of the users of the first client device 110 and the second client device 120.

In step S203, the first client device 110 analyzes the video and audio information of the second client device 120 to obtain the connection key of the second client device 120. Similarly, in step S213, the second client device 120 analyzes the video and audio information of the first client device 110 to obtain the connection key of the first client device 110. For example, the analysis performed by the first client device 110 and the second client device 120 can include image analysis, ultrasound analysis, etc.

In step S204, the first client device 110 uses the connection code of the second client device 120 to query the server 290 for connection information. Similarly, in step S214, the second client device 120 uses the connection code of the first client device 110 to query the server 290 for connection information of the first client device 110.

In step S205 , the first client device 110 establishes a connection channel 140 of the conference assistance system with the second client device 120 using the connection information of the second client device 120 ; alternatively, the second client device 120 establishes a connection channel 140 of the conference assistance system with the first client device 110 using the connection information of the first client device 110 .

Regarding the specific process of steps S210 and S211, in some embodiments of the present invention, please refer to Figures 1-3. In step S301, the camera 125 of the second client device 120 generates a connection code. In step S302, the second client device 120 registers its external connection data and the connection code with the server 290 as connection information. In step S303, the second client device 120 tests whether the registration is successful. For example, the second client device 120 sends the connection code generated by the camera 125 to the server 290 to determine whether the server 290 returns corresponding connection information. If the registration is successful, in step S304, the server 290 waits for the first client device 110 to query and retrieve the connection information of the second client device 120.

Next, regarding the specific process of steps S202-205, in some embodiments of the present invention, please refer to Figures 1, 2, and 4. In step S401, the first client device 110 and the second client device 120 respectively execute video conferencing software 112 and 122 to establish a video conference (i.e., video conference channel 130). In step S402, the first client device 110 analyzes the image information of the second client device 120 to obtain the connection code of the second client device 120. In step S403, the first client device 110 uses the connection code of the second client device 120 to query the server 290, expecting to receive the connection information of the second client device 120. If the first client device 110 obtains the connection information of the second client device 120, in step S404, the first client device 110 uses the connection information of the second client device 120 to establish a connection channel 140 of the conference assistance system with the second client device 120. In step S405, the software functions of the conference assistance system begin to execute in the connection channel 140 of the conference assistance system.

Alternatively or further, regarding the specific process of steps S203-205, in some embodiments of the present invention, please refer to Figures 1, 2, and 5. In step S501, the first client device 110 analyzes the audio and video information of the second client device 120 to obtain the connection code of the second client device 120, and then queries the server 290 for the connection information of the second client device 120. In step S502, the first client device 110 uses the connection information of the second client device 120 to request the second client device 120 to establish a connection channel 140 to the conference assistance system. For example, the first client device 110 generates connection requests based on the connection information of the second client device 120 and periodically sends the connection requests to the second client device 120. The connection requests from the first client device 110 request the second client device 120 to establish the connection channel 140 to the conference assistance system. In step S503, the first client device 110 determines whether the connection channel 140 to the conference assistance system has been established. After the second client device 120 accepts the request from the first client device 110, in step S504, the conference assistance system connection channel 140 is established between the first client device 110 and the second client device 120. The first client device 110 and the second client device 120 can perform additional software functions beyond the video conferencing channel 130 via the conference assistance system connection channel 140.

Conversely, for example, if the first client device 110 determines that it has not received a response from the second client device 120 accepting the request of the first client device 110 within the predetermined time, in step S503, the first client device 110 determines that the connection channel 140 of the conference assistance system has not been established. In practice, the predetermined time may be slightly less than the cycle of sending the connection request.

When the first client device 110 determines that the connection channel 140 of the conference assistance system has not been established, in step S504 , the first client device 110 detects whether the second client device 120 requests to establish the connection channel 140 of the conference assistance system.

After the first client device 110 detects that the second client device 120 requests to establish the connection channel 140 of the conference assistance system, in order to prevent the first client device 110 and the second client device 120 from simultaneously requesting each other to establish the connection channel 140 of the conference assistance system, in step S505, the first client device 110 enters a pause mode to pause the request to establish the connection channel 140 of the conference assistance system from the second client device 120 and accepts the second client device 120's request. After the connection channel 140 of the conference assistance system is established in step S503, the connection channel 140 of the conference assistance system is established between the first client device 110 and the second client device 120 in step S504. The first client device 110 and the second client device 120 can perform additional software functions other than the video conference channel 130 via the connection channel 140 of the conference assistance system.

Similarly, regarding the specific process of steps S213, S214, and 205, in some embodiments of the present invention, please refer to Figures 1, 2, and 6. In step S601, the second client device 120 analyzes the audio and video information of the first client device 110 to obtain the connection code of the first client device 110, and then queries the server 290 for the connection information of the first client device 110. In step S602, the second client device 120 uses the connection information of the first client device 110 to request the first client device 110 to establish a connection channel 140 to the conference assistance system. For example, the second client device 120 generates connection requests based on the connection information of the first client device 110 and periodically sends these connection requests to the first client device 110. The connection requests from the second client device 120 request the first client device 110 to establish the connection channel 140 to the conference assistance system. In step S603, the second client device 120 determines whether the connection channel 140 to the conference assistance system has been established. After the first client device 110 accepts the request from the second client device 120, in step S604, the conference assistance system connection channel 140 is established between the second client device 120 and the first client device 110. The second client device 120 and the first client device 110 can perform additional software functions beyond the video conferencing channel 130 via the conference assistance system connection channel 140.

Conversely, for example, if the second client device 120 determines that it has not received a response from the first client device 110 accepting the second client device 120's request within a predetermined time, the second client device 120 determines in step S603 that the connection channel 140 of the conference assistance system has not been established. In practice, the predetermined time may be slightly less than the period for sending the connection request.

When the second client device 120 determines that the connection channel 140 of the conference assistance system has not been established, in step S604, the second client device 120 detects whether the first client device 110 requests to establish the connection channel 140 of the conference assistance system.

After the second client device 120 detects that the first client device 110 has requested to establish the connection channel 140 of the conference assistance system, in order to prevent the second client device 120 and the first client device 110 from simultaneously requesting each other to establish the connection channel 140 of the conference assistance system, in step S605, the second client device 120 enters a pause mode to pause the request to establish the connection channel 140 of the conference assistance system from the first client device 110 and accepts the request from the first client device 110. After the connection channel 140 of the conference assistance system is established in step S603, the connection channel 140 of the conference assistance system is established between the second client device 120 and the first client device 110 in step S604. The second client device 120 and the first client device 110 can perform additional software functions other than the video conference channel 130 via the connection channel 140 of the conference assistance system.

In some embodiments of the present invention, if the first client device 110 successfully establishes a connection with the second client device 120 on the timeline, then in step S603, the second client device 120 determines that the connection channel 140 of the conference assistance system has been established. Therefore, after this point in time, the second client device 120 skips steps S604 and S605.

In some embodiments of the present invention, the duration of the pause request in the pause mode of the first client device 110 in step S505 (e.g., approximately 5 seconds) is different from the duration of the pause request in the pause mode of the second client device 120 in step S605 (e.g., approximately 3 seconds), thereby preventing the first client device 110 and the second client device 120 from issuing simultaneous requests again.

FIG7 is a block diagram of a connection establishment system 700 for a conference assistance system according to some embodiments of the present invention. As shown in FIG7 , camera 115 includes a processing element 712, a connection element 711, and a camera element 713. Architecturally, camera element 713 is electrically connected to processing element 712, and connection element 711 is electrically connected to processing element 712. For example, processing element 712 can be a processing circuit, connection element 711 can be a USB port or other connector, and camera element 713 can be an optical camera device.

During use, the processing element 712 of the camera 115 provides a connection code, and the connection element 711 allows the first computer device 111 to connect. The first computer device 111 then registers its external connection data (e.g., the IP address of the first computer device 111, etc.) and the connection code provided by the camera 115 with the server 290 as connection information (e.g., the external connection data of the first computer device 111 and its correspondence with the connection code). The camera element 713 captures the image, allowing the first computer device 111 to provide audio and video information to the second computer device 121 via the video conferencing channel 130. The audio and video information includes the image and the connection code. The second computer device 121 analyzes the image information to obtain a connection code and uses the connection code to query the connection information of the first computer device 111 from the server 290. The second computer device 121 uses the connection information of the first computer device 111 to establish a connection channel 140 of the conference assistance system with the first computer device 111.

Similarly, camera 125 includes a processing element 722, a connection element 721, and an imaging element 723. Architecturally, imaging element 723 is electrically connected to processing element 722, and connection element 721 is electrically connected to processing element 722. For example, processing element 722 can be a processing circuit, connection element 721 can be a USB port or other connector, and imaging element 723 can be an optical imaging device.

During use, the processing element 722 of the camera 125 provides a connection code, and the connection element 721 allows the second computer device 121 to connect. The second computer device 121 then registers its external connection data (e.g., the IP address of the second computer device 121, etc.) and the connection code provided by the camera 125 with the server 290 as connection information (e.g., the external connection data of the second computer device 121 and its correspondence with the connection code). The camera element 723 captures the image, allowing the second computer device 121 to provide audio and video information to the first computer device 111 via the video conferencing channel 130. The audio and video information includes the image and the connection code. The first computer device 111 analyzes the image information to obtain a connection code and uses the connection code to query the connection information of the second computer device 121 from the server 290. The first computer device 111 uses the connection information of the second computer device 121 to establish a connection channel 140 of the conference assistance system with the second computer device 121.

In the application scenario, the connection channel 140 of the conference assistance system between the first client device 110 and the second client device 120 may belong to a two-way conversation mode, which is a basic connection mode in which any two parties directly establish a connection.

If the connection establishment system 700 of the conference assistance system includes more client devices (e.g., a third client device, a fourth client device, etc.), the connection channel 140 of the conference assistance system between any two of the three or more client devices constitutes a multi-party conversation mode. This is an expanded application mode based on the two-party conversation mode and can be applied to parallel group meetings.

If there is one first client device 110 and multiple second client devices 120, establishing a conference assistance system connection channel 140 from the first client device 110 to multiple second client devices 120 is a central point model. The central point model can be applied to school teaching methods, for example, where the teacher's first client device 110 serves as the central point, and the students' second client devices 120 each establish a conference assistance system connection channel 140 with the central point, while the students' second client devices 120 do not connect to each other.

In summary, the technical solution of the present invention offers significant advantages and benefits compared to existing technologies. By utilizing the conference assistance system connection establishment method 200 and cameras 115 and 125 of the present invention, users in a video conference will automatically establish a conference assistance system connection channel 140 between them, enabling additional conference assistance functions and improving the user experience.

Although the present invention has been disclosed in the form of embodiments as described above, it is not intended to limit the present invention. Anyone skilled in the art may make various changes and modifications without departing from the spirit and scope of the present invention. Therefore, the scope of protection of the present invention shall be determined by the scope of the attached patent application.

To facilitate understanding of the above and other objects, features, advantages, and embodiments of the present invention, the accompanying symbols are described as follows: 100: Connection establishment system for conference assistance system 110: First client device 111: First computer device 112: Video conferencing software 115: Camera 120: Second client device 121: Second computer device 122: Video conferencing software 125: Camera 130: Video conferencing channel 140: Connection channel for conference assistance system 200: Connection establishment method for conference assistance system 290: Server S200-S205, S210, S211, S213, S214: Steps S301-S304: Steps S401-S405: Steps S501-S506: Steps S601-S606: Steps 700: Conference Support System Connection Establishment System 711, 721: Connection Components 712, 722: Processing Components 713, 723: Imaging Components

To facilitate understanding of the above and other objects, features, advantages, and embodiments of the present invention, the accompanying figures are described as follows: Figure 1 is a block diagram of a method for establishing a connection in a conference assistance system according to some embodiments of the present invention; Figures 2-6 are flow charts of a method for establishing a connection in a conference assistance system according to some embodiments of the present invention; and Figure 7 is a block diagram of a method for establishing a connection in a conference assistance system according to some embodiments of the present invention.

200: Conference Assistance System Connection Establishment Method

110: First client device

120: Second client device

290: Server

S200~S205, S210, S211, S213, S214: Steps

Claims (8)

A method for establishing a connection in a conference assistance system comprises the following steps: (A) executing video conferencing software on a first client device to conduct a video conference; (B) using the first client device to receive audio and video information from a second client device via the video conference, so that the first client device obtains connection information via the audio and video information; and (C) establishing a connection channel of the conference assistance system with the second client device using the connection information, through the first client device. The connection establishment method of the conference assistance system further includes: generating a connection code via a camera of the second client device; and registering the second client device's external connection data and the connection code with a server as the connection information. After the second client device registers the connection information with the server, step (A) includes: executing the video conferencing software on the second client device to conduct the video conference with the first client device; and integrating the connection code with the video information via the second client device to provide the video information via the video conference. The connection establishment method for a conference assistance system as described in claim 1, wherein the step of integrating the connection code into the video information using the second client device comprises: capturing a video frame using a camera of the second client device; and embedding the connection code into the video frame using the second client device, wherein the video information includes the video frame in which the connection code is embedded. The connection establishment method for a conference assistance system as described in claim 1, wherein the step of integrating the connection code into the video and audio information using the second client device comprises: Genertating ultrasound information based on the connection code using the second client device, wherein the video and audio information includes the ultrasound information. The connection establishment method for a conference assistance system as described in claim 1, wherein step (B) comprises: Analyzing the audio and video information by the first client device to obtain the connection key; and Querying the connection information from the server using the connection key by the first client device. The method for establishing a connection in a conference assistance system as described in claim 1, wherein step (C) comprises: Requesting, via the first client device, to the second client device using the connection information, to establish the connection channel in the conference assistance system. The connection establishment method of the conference assistance system as described in claim 5, wherein after the second client device accepts the request of the first client device, the connection channel of the conference assistance system between the first client device and the second client device is established. The method for establishing a connection to a conference assistance system as described in claim 5, wherein step (C) further comprises: When the first client device determines that the connection channel to the conference assistance system has not been established, detecting, by the first client device, whether the second client device has requested to establish the connection channel to the conference assistance system; and After the first client device detects that the second client device has requested to establish the connection channel to the conference assistance system, pausing, by the first client device, the request to establish the connection channel to the conference assistance system from the second client device and accepting the request from the second client device, thereby completing the establishment of the connection channel to the conference assistance system between the first client device and the second client device. A camera comprises: a processing element providing a connection code; a connection element electrically connected to the processing element, the connection element being connected to a first computer device, enabling the first computer device to register its external connection data and the connection code with a server as connection information; and a camera element electrically connected to the processing element, the camera element capturing an image. After the first computer device registers the connection information with the server, the first computer device executes video conferencing software to conduct a video conference with a second computer device. The first computer device integrates the connection code into video and audio information, and then provides the video and audio information through the video conference, enabling the first computer device to The computer device provides the video and audio information to the second computer device via the video conference channel. The video and audio information includes the image and the connection code. The second computer device analyzes the video and audio information to obtain the connection code and uses the connection code to query the server for the connection information. The second computer device uses the connection information to establish a connection channel with the first computer device to the conference assistance system.