CN103096017B - Computer operating power control method and system - Google Patents

Abstract

A method for controlling computer control rights, comprising: detecting whether a directional microphone receives a voice signal, and triggering the camera corresponding to the directional microphone to start when the voice signal is detected, and the participant using the directional microphone becomes the master The controller of the computer; receives the gestures of the controller captured by the camera, uses image recognition software to analyze the gestures to obtain corresponding control instructions, and controls the main computer according to the control instructions; when another When the directional microphone receives the voice signal of the participant, the above-mentioned camera that is shooting is turned off, and the camera corresponding to the other directional microphone is started; the gesture of the participant in front of the camera lens corresponding to the other directional microphone is captured action. The invention also provides a computer control right control system. The invention can realize the switch and control of the control right of the main control computer in the teleconference mode.

Description

Method and system for controlling computer control rights

technical field

The present invention relates to a method and system for controlling the control right of a computer, in particular to a method and system for controlling the control right of a main control computer in a teleconference mode.

Background technique

In the remote conference mode, a main control computer is connected with other remote computers through the network. The control person can control the sharing of documents, the display of files and other actions during the meeting, while the rest of the participants other than the control person cannot operate on the documents shared and displayed during the meeting. Therefore, when the other participants other than the control person need to operate the shared documents and displayed files during the meeting, if they need to turn the page of the shared document, the other participants other than the control person operation is not possible. This way only the control person has the control right of the master computer, which reduces the interaction between the participants in the remote conference process, so it is necessary to find a way to allow the rest of the participants other than the controller to control the master computer method to enhance the interaction between the participants during the teleconference.

Contents of the invention

In view of the above, it is necessary to provide a method for controlling the control right of a computer to realize the switching and control of the control right of the master computer.

In view of the above, it is also necessary to provide a computer control right control system to realize switching and control of the control right of the master computer.

The computer control method includes the following steps: voice detection step: after the remote conference is established, detect whether the directional microphone receives a voice signal; control power switching step 1: when the voice signal is detected, The camera corresponding to the directional microphone starts to capture the image of the participant using the directional microphone, so that the participant becomes the controller of the main computer; the image recognition step: receiving the gesture of the controller captured by the camera , and use the image recognition software to analyze the gestures to obtain the corresponding control instructions, and control the main control computer according to the control instructions; Judgment steps: During the teleconference, when it is detected that there is another directional microphone receiving the When the voice signal of the person is heard, judge whether the other directional microphone is in the same meeting room as the above-mentioned camera that is taking pictures. If it is in the same meeting room, return to control right switching step 1. Control right switching step 2; control right switching step 2: turn off the above-mentioned camera that is shooting through the network, and start the camera corresponding to the other directional microphone, so that the participant using the other directional microphone becomes the master The person with the control right of the computer returns to the image recognition step; repeats the above image recognition step to control right switching step 2 until the teleconference ends.

The computer control right control system includes: a voice detection module, used to detect whether the directional microphone receives a voice signal after the remote conference mode is established; a switching module, used to detect the voice signal, Make the camera corresponding to the directional microphone start to capture the image of the participant using the directional microphone, so that the participant becomes the controller of the master computer; the image recognition module is used to receive the image of the controller captured by the camera Gesture actions, and use image recognition software to analyze the gesture actions to obtain corresponding control instructions, and control the main control computer according to the control instructions; the judging module is used for when a remote conference is in progress, when another directivity is detected When the microphone receives the participant's voice signal, it is judged whether the other directional microphone is in the same meeting room as the above-mentioned video camera being photographed; When the rubber machine is not in the same meeting room, turn off the above-mentioned video camera through the network, and start the camera corresponding to the other directional microphone, so that the participants using the other directional microphone become the control of the master computer rights holder.

Compared with the prior art, the computer control right control method and system described above can realize switching of the control right of the main control computer in the teleconference mode in which one main control computer is connected to other remote computers through the network, Let the rest of the participants in the meeting room where the master computer is located and the participants in the meeting room where the remote computer is located have the opportunity to control the master computer, thereby enhancing the interaction between the participants during the remote conference.

Description of drawings

Fig. 1 is a structure diagram of a preferred embodiment of the computer control right control system of the present invention.

Fig. 2 is a functional block diagram of a preferred embodiment of the computer control right control system of the present invention.

Fig. 3 is a flow chart of a preferred embodiment of the computer control right control method of the present invention.

Fig. 4 is an example diagram of the conference room where the remote computer in the teleconference mode of the preferred embodiment is located.

Description of main component symbols

master computer 1 computer control system 10 first display device 11 first camera 12 first directional microphone 13 The internet 2 remote computer 3 second display device 31 second camera 32 second directional microphone 33 voice detection module 100 positioning module 101 Image Recognition Module 102 switch module 103 judgment module 104

The following specific embodiments will further illustrate the present invention in conjunction with the above-mentioned drawings.

detailed description

As shown in FIG. 1 , it is a structure diagram of a preferred embodiment of the computer control right control system of the present invention.

The computer control right control system 10 runs in the main control computer 1 . The main control computer 1 includes a first display device 11 , and the main control computer 1 is also connected to one or more first cameras 12 and a plurality of first directional microphones 13 . The first display device 11 can be a display connected externally to the main control computer 1, or it can be a display screen of the main control computer 1. In this preferred embodiment, the first display device 11 is the display screen of the main control computer 1 as an example. Make an introduction. The first directional microphone 13 is used to trigger the opening of the corresponding first camera 12, and the first camera 12 is used to capture the image of the corresponding participant using the first directional microphone 13, the participant is It is the operator of the master computer 1, and the controller can operate the master computer 1 through keyboard, mouse or gesture actions. The main control computer 1 is configured with image recognition software, and the image recognition software is used to perform gesture recognition in cooperation with the gestures of the control person captured by the first camera 12 .

The main control computer 1 is connected to a plurality of remote computers 3 through a network 2 (only one is shown in the figure). The network 2 may be an intranet (Intranet) or an Ethernet (Ethernet), or the Internet (Internet) or other types of communication networks.

The remote computer 3 includes a computer control system 10 and a second display device 31 , and the remote computer 3 is also connected to one or more second cameras 32 and a plurality of second directional microphones 33 . The second display device 31 can be either a display connected to the remote computer 3 or a display screen of the remote computer 3. In this preferred embodiment, the second display device 31 is the display screen of the remote computer 3 as an example. Make an introduction. The second directional microphone 33 is used to trigger the opening of the corresponding second camera 32 , and the second camera 32 is used to capture images of the corresponding participants using the second directional microphone 33 . When the participant using the second directional microphone 33 obtains the control right of the main control computer 1 , the participant can operate the main control computer 1 through keyboard, mouse or gesture actions. The remote computer 3 is also configured with image recognition software, which is used to recognize the gestures of the participants captured by the second camera 32 .

It should be noted that, in the teleconference mode, both the first display device 11 and the second display device 31 share the screen content of the first display device 11 . In the following description, the conference room where the master computer 1 is located is called the master conference room, and the conference room where the remote computer 3 is located is called a remote conference room, and there may be multiple remote conference rooms.

In the present invention, there are two types of cameras (including the first camera 12 and the second camera 32 ): fixed cameras and mobile cameras.

When the camera is a fixed camera, there are multiple fixed cameras in the main control conference room and the remote conference room in the teleconference mode, and each fixed camera corresponds to a directional microphone, as shown in Figure 4 . Among them, a directional microphone is used as an element for obtaining the control right of the host computer 1 . When a directional microphone receives the voice signal from the current participant, the fixed camera corresponding to the directional microphone is turned on, and the fixed camera starts to capture the image of the current participant using the directional microphone and transmits the image to On the display devices in each conference room, the participant is the controller of the main control computer 1 at this time. The fixed camera cooperates with the image recognition software to analyze the captured gestures of the controller to obtain the control of the main control computer 1. control instructions.

When the camera is a mobile camera, the main control conference room and the remote conference room in the teleconference mode respectively have a mobile camera, and the mobile camera corresponds to multiple directional microphones in the conference room. The positional relationship between each directional microphone and the mobile camera is preset in the computer control system 10, so that when a certain directional microphone receives a voice signal, the mobile camera can be controlled according to the control system 10 of the computer. The control goes to where that directional microphone is located.

As shown in FIG. 2 , it is a block diagram of the functions of a preferred embodiment of the computer control right control system of the present invention.

The computer control right control system 10 includes a voice detection module 100 , a positioning module 101 , an image recognition module 102 , a switching module 103 and a judging module 104 . The functions of each module will be introduced in detail in conjunction with the flow chart in Figure 3 .

As shown in FIG. 3 , it is a flow chart of a preferred embodiment of the computer control right control method of the present invention.

Step S10 , after the teleconference mode is established, the voice detection module 100 detects whether the directional microphone receives voice signals at all times. When the directional microphone receives the voice signal of the participant, it indicates that the voice detection module 100 has detected the voice signal.

Step S11, when the voice detection module 100 detects that the directional microphone receives the voice signal, it triggers the switching module 103 or the positioning module 101 according to the camera type to start the camera corresponding to the directional microphone. The participant with the directional microphone obtains the control right of the main control computer 1 and becomes the control right holder, and the camera captures images and gestures of the control right person.

When the camera is a mobile camera, the voice detection module 100 triggers the positioning module 101, and the positioning module 101 controls the mobile camera to turn to The location of the directional microphone.

When the camera is a fixed camera, the voice detection module 100 triggers the switch module 103, and the switch module 103 turns off the camera that was shooting before, and starts the camera corresponding to the directional microphone. When the teleconference mode is just established and the control right of the main control computer 1 has not been obtained by the participants, there is no video camera in each meeting room. At this time, the switching module 103 only starts the pointing Camera corresponding to sex microphone.

Step S12, the image recognition module 102 receives the images and gestures of the control person captured by the camera, transmits the images to the display devices in each conference room, and uses image recognition software to analyze the gestures to obtain corresponding control Instructions to control the main control computer 1 according to the control instructions.

The control instructions include: switching documents, changing pages, opening documents, closing documents, and the like. Or the controller can also use the mouse, keyboard, remote control, etc. to mark the document and other actions. The document can be a PPT document, a Word document, a slideshow, and the like.

When the control person is in the main control meeting room, after the first camera 12 captures the image of the control right person, the image recognition module 102 transmits the image to the first display device 11 of the main control meeting room and the remote meeting room on the second display device 31 of the camera 12, and receive the gestures of the control person captured by the first camera 12, use the image recognition software in the main control computer 1 to analyze the gestures, and obtain the control corresponding to the gestures Instructions to control the main control computer 1 according to the control instructions.

When the control person is in the remote meeting room, after the second camera 32 captures the image of the control person, the image recognition module 102 transmits the image to the first display device 11 of the main control meeting room and the remote meeting room. On the second display device 31, and receive the gestures of the control person captured by the second camera 32, use the image recognition software in the remote computer 3 to analyze the gestures, and obtain the control instructions corresponding to the gestures , to control the main control computer 1 according to the control instruction.

Step S13, during the teleconference, when the voice detection module 100 detects that another directional microphone receives the participant's voice signal, the judging module 104 judges whether the other directional microphone is compatible with the above-mentioned camera that is taking pictures. in the same conference room. When the other directional microphone is in the same meeting room as the above-mentioned video camera, the process returns to step S11. When the other directional microphone is not in the same meeting room as the above-mentioned video camera, step S14 is executed.

In step S14, the switching module 103 turns off the above-mentioned video camera in another conference room through the network 2, and starts the video camera corresponding to the other directional microphone, and returns to step S12.

In this step S14, if the activated camera is a mobile camera, the positioning module 101 also needs to control the mobile camera to turn to the other the position of the directional microphone. At this time, the participant corresponding to the other directional microphone is the controller of the main control computer 1 .

Step S15, repeatedly execute the above steps S12 to S14 until the teleconference ends.

Through the above distribution of the control right of the main control computer 1 and the appropriate gestures of the participants, the remote video conference can be carried out smoothly and conveniently.

As shown in FIG. 4 , it is an example diagram of the conference room where the remote computer in the teleconference mode of the preferred embodiment is located.

The second display device 31 shares the same screen as the first display device 11 of the main control computer 1, and the ongoing "PPT document display content" in the conference process is displayed on the second display device 31, while the main control computer 1 The avatar of the controller D appears on the lower right of the second display device 31 . The control person D has the control right of the master computer 1 . The remote conference room where the remote computer 3 is located includes three fixed cameras, each of which corresponds to a second directional microphone 33 , and there is a participant in front of each second directional microphone 33 .

When the control person D is in the process of reporting, a participant B in the teleconference room asks a question, and when the second directional microphone 33 used by the participant B detects the voice signal of the participant B, the switching The module 103 turns off the camera of the control person D through the network 2, and starts the camera corresponding to the directional microphone used by the participant B, and the participant B obtains the control right of the main control computer 1. If the camera in the teleconference room is a mobile camera, the positioning module 101 also needs to turn the activated mobile camera to the position where the directional microphone used by the participant B is located. The camera captures the image of participant B and transmits it to the display device in the main control conference room and each remote conference room, and captures the gesture of participant B and transmits it to the image of the remote computer 3 in the remote conference room The recognition software performs image recognition, and the image recognition software analyzes the gestures to obtain control instructions for operating documents on the main control computer 1 , and the image recognition module 102 controls the main control computer 1 according to the control instructions.

It should be noted that, in the process from S10 to S14 above, it is realized when the control right of the main control computer 1 is released. When the control right of the main control computer 1 is not released, in steps S11 and S13, the control right of the main control computer 1 will not be directly switched to other participants, but a switching request signal will be sent to the main control computer 1 . When the person with the control right of the main control computer 1 agrees with the switching request signal, the action of switching the control right will be performed.

The above embodiments are only used to illustrate the technical solutions of the present invention without limitation. Although the present invention has been described in detail with reference to preferred embodiments, those of ordinary skill in the art should understand that the technical solutions of the present invention can be modified or equivalently replaced. Without departing from the spirit and scope of the technical solution of the present invention.

Claims (8)

1. A method for controlling computer control rights, applied in a teleconference mode, characterized in that the method comprises the following steps: Voice detection step: after the remote conference is established, detect whether the directional microphone receives a voice signal; Control switching step 1: When the voice signal is detected, the camera corresponding to the directional microphone starts to capture the image of the participant using the directional microphone, so that the participant becomes the control person of the master computer; Image recognition step: receiving the gestures of the control person captured by the camera, and using image recognition software to analyze the gestures to obtain corresponding control instructions, and controlling the main control computer according to the control instructions; Judgment step 1: During the teleconference, when it is detected that another directional microphone receives the voice signal of the participant, send a switching request signal to the main control computer, and when the control person agrees to the When switching the request signal, trigger the judgment step 2; Judgment step 2: Judging whether the other directional microphone is in the same meeting room as the above-mentioned video camera, if it is in the same meeting room, return to the control right switching step 1, and when not in the same meeting room, execute the control right Switching step 2; Control right switching step 2: Turn off the above-mentioned camera that is shooting through the network, and start the camera corresponding to the other directional microphone, so that the participant using the other directional microphone becomes the control person of the master computer, And return to the image recognition step; Repeat the above image recognition step to control right switching step 2 until the teleconference ends. 2. The computer control method as claimed in claim 1, wherein the camera includes two types: a fixed camera and a mobile camera, and when the camera is a fixed camera, each fixed camera corresponds to a pointing camera. When the camera is a mobile camera, one mobile camera corresponds to multiple directional microphones. 3. The method for controlling computer control right as claimed in claim 2, characterized in that, in step one of switching control right, when the camera is a mobile camera, according to each directional microphone preset and the mobile camera Positional relationship, controlling the mobile camera to turn to the position where the directional microphone is located; When the camera is a fixed camera, turn off the camera that was shooting before, and start the camera corresponding to the directional microphone. 4. The computer control method as claimed in claim 2, characterized in that, in the control right switching step 2, when the camera corresponding to the other directional microphone started is a mobile camera, according to the preset The positional relationship between the other directional microphone and the mobile camera controls the mobile camera to turn to the position where the other directional microphone is located. 5. A computer control system, characterized in that the system comprises: The voice detection module is used to detect whether the directional microphone receives a voice signal after the remote conference mode is established; The switching module is used to make the camera corresponding to the directional microphone start to capture the image of the participant using the directional microphone when the voice signal is detected, so that the participant becomes the controller of the master computer; The image recognition module is used to receive the gestures of the control person captured by the camera, and use image recognition software to analyze the gestures to obtain corresponding control instructions, and control the main control computer according to the control instructions; The judging module is used to send a switching request signal to the main control computer when another directional microphone is detected to receive the voice signal of the participant during the teleconference, and when the control person agrees to the When the above-mentioned switch request signal is triggered, a further judgment operation is triggered, and the further judgment operation includes judging whether the other directional microphone is in the same meeting room as the above-mentioned video camera being photographed; The switching module is also used to turn off the above-mentioned video camera through the network when the other directional microphone is not in the same meeting room as the above-mentioned video camera, and start the other directional microphone corresponding to the other directional microphone. camera, so that the participant using the additional directional microphone becomes the controller of the host computer. 6. The computer control system according to claim 5, wherein the cameras include two types: fixed cameras and mobile cameras, and when the cameras are fixed cameras, each fixed camera corresponds to a pointing camera. When the camera is a mobile camera, one mobile camera corresponds to multiple directional microphones. 7. The computer control right control system according to claim 6, further comprising a positioning module: When the activated camera is a mobile camera, the mobile camera is controlled to turn to the position where the directional microphone is located according to the preset positional relationship between each directional microphone and the mobile camera. 8. The computer control right control system according to claim 6, wherein the switching module is also used for: When the other directional microphone is in the same conference room as the above-mentioned video camera, and the above-mentioned video camera is a fixed camera, close the previously video camera, and start the other directional microphone corresponding camera.