JP2012160793A - Video conference system and apparatus for video conference, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video conference system etc. which is capable of speedily contributing to decision making during a video conference and in particular, automatically acquiring related data most suitable for the content of a comment such as a question from a reviewer, thereby enabling more speedy progress of the video conference.SOLUTION: The video conference system is provided with: presenter-side and reviewer-side apparatuses for a video conference 1 and 2 which are respectively provided at bases A and B and interconnected via a network 4; and a storage unit 3 for storing material data. The presenter-side apparatus 1 is provided with speech recognition means 184 which converts speech information transmitted from the reviewer-side apparatus 2, to characters. When a keyword Q included in the converted characters is spoken by a presenter, the presenter-side apparatus 1 acquires material data associated with the keyword from the storage unit 3 and transmits the material data to a predetermined transmission destination.

Description

  The present invention relates to a video conference system, a video conference device, and a program used for a video conference between remote locations.

  For example, in a teleconference between remote locations held in a company, etc., a material to be presented by the presenter (presenter) at the teleconference is prepared, and that material is sent to the reviewer (questioner) who is the remote destination. The information is distributed to the video conference device and displayed on the screen of the display device (display device) in the video conference device, and the presenter explains the material, and the question (utterance) from the reviewer is the presenter. It is often sent to the side video conferencing device and the presenter proceeds in the form of answering the question.

  In that case, considering the scenario of the contents to be announced by the presenter in advance, considering the questions from the reviewers to some extent, it is common to prepare related materials (supplemental materials and reference materials) separately. .

  2. Description of the Related Art Conventionally, for example, a technique in which a presenter performs an operation of switching display images in response to a questioner's instruction in a question-and-answer session using an image (see, for example, Patent Document 1).

  In addition, if there are any questions such as questions from participants of the video conference regarding the presenter's announcements so that the presenter can save time and effort to find the materials during the conference, the video conference can proceed quickly. A technique has also been proposed in which related materials are automatically extracted from a database in response to the request and displayed on a display device (see, for example, Patent Document 2).

JP 2002-351435 A JP-A-5-347666

  By the way, in the above-mentioned video conference system in the prior art, the presenter prepares the scenario of the contents to be announced in advance and prepares the related materials after assuming some questions from the reviewer. When materials are presented at video conferences, unexpected questions often occur. In that case, the presenter may not be able to give a clear answer to the questioner immediately. In such a case, there is a problem that the decision making is delayed because the conclusion of the purpose of the presentation cannot be made due to a lack of judgment materials and it is carried over until the next video conference.

  In order to avoid such problems as much as possible, if the presenter prepares a material with a wide range of contents, it will be an excessive burden on the presenter. It may be necessary, and it is difficult to prepare a wide range of materials in advance.

  Further, in the technique of the above-mentioned prior art document 1, the presenter simply switches the display of the material according to the instruction of the questioner during the question-and-answer session in the video conference. Annoying and hinders smooth explanation.

  Furthermore, in the technique of the prior document 2, when there is a comment such as a question from a reviewer with respect to the presenter's announcement content, related materials are taken out from the comment content. Relevant materials with high accuracy that match the content of the question are not always retrieved.

  The present invention has been made in view of the above circumstances, and can contribute to speeding up the video conference decision-making, and in particular, automatically obtains the most relevant related materials for the contents of comments such as questions from reviewers. Therefore, it is an object of the present invention to provide a video conference system and a video conference apparatus capable of proceeding with a video conference more quickly, and to provide a program for causing a computer of the video conference apparatus to execute an operation.

The above problem is solved by the following means.
(1) Presenter-side and reviewer-side videoconferencing devices that are provided at each of a plurality of bases and connected to each other via a network, and are provided inside or on any of the videoconferencing devices. A video conference system comprising: a storage device storing material data in association with a keyword, wherein each video conference device includes a photographing unit for photographing a video conference, and a video conference participant Between the sound collecting means for collecting the utterances, the sound output means for outputting the sound information collected by the sound collecting means of the other video conference device, and the other video conference device. Communication means for transferring data including video information photographed by the means and audio information collected by the sound collection means; and stored in the storage device Display device capable of displaying video data transmitted by the communication means, and the presenter-side video conference device further transmits from the reviewer-side video conference device by the communication means. Voice recognition means for converting the voice information that has been converted into characters, determination means for determining whether a keyword included in the characters converted by the voice recognition means has been uttered by a presenter, and the conversion by the determination means. If it is determined that the keyword included in the characters is uttered by the presenter, acquisition means for acquiring the material data corresponding to the keyword from the storage device, and the material data acquired by the acquisition means are displayed on the display means. Control means for displaying and transmitting to a predetermined destination via the communication means; TV conference system, characterized in that with.
(2) The determining means determines whether or not there are a plurality of material data corresponding to the keyword, and the control means determines a thumbnail of each material data when it is determined that there are a plurality of the material data. The material data selected by the presenter from the displayed thumbnails of the plurality of material data is displayed on the display device and transmitted to a predetermined transmission destination. Video conference system.
(3) The determination means determines whether or not confidential information is included in the document data, determines a security level of the presenter, and is determined by the determination means that confidential information is included in the document data. In this case, the control unit displays the document data on the display unit and transmits the document data to a predetermined destination only when the presenter has authority over a predetermined level. Video conference system.
(4) When confidential information is included in a part of the document data, the control means displays the document data on the display means with the confidential information portion hidden, and sends it to a predetermined transmission destination. 4. The video conference system according to item 3 above.
(5) The video conference system according to any one of items 1 to 4, wherein the predetermined transmission destination to which the document data is transmitted is a reviewer side video conference device and / or a terminal device of a conference participant.
(6) The video conference system according to (5), wherein the control unit transmits the material data only to the reviewer side video conference device when confidential information is included in the material data.
(7) A presenter-side video conference device connected to a reviewer-side video conference device via a network, the video information captured by the imaging means with the reviewer-side video conference device And communication means for exchanging data including voice information collected by the sound collecting means, and stored in a storage device built in the apparatus or provided on the network and associated with keywords and storing material data Display means capable of displaying the document data and video information transmitted from the reviewer-side video conference device by the communication means, and transmitted from the reviewer-side video conference device by the communication means. Speech recognition means for converting speech information into characters, and keywords included in the characters converted by the speech recognition means are presented. Determining means for determining whether or not the keyword has been spoken, and when the determining means determines that the keyword included in the converted character has been spoken by the presenter, the storage device stores the material data corresponding to the keyword And a control unit that displays the material data acquired by the acquisition unit on the display unit and transmits the data to a predetermined destination via the communication unit. Video conferencing equipment.
(8) The determination means determines whether or not there are a plurality of material data corresponding to the keyword, and if the control means determines that there are a plurality of the material data, the thumbnail of each material data 8 is displayed on the display unit, and the material data selected by the presenter from the thumbnails of the plurality of displayed material data is displayed on the display unit and transmitted to a predetermined transmission destination. Video conferencing equipment.
(9) The determination means determines whether or not confidential information is included in the document data, determines a security level of the presenter, and is determined by the determination means that confidential information is included in the document data. In this case, the control means displays the material data on the display means and transmits the data to a predetermined destination only when the presenter has authority over a predetermined level. Video conferencing equipment.
(10) When confidential information is included in a part of the document data, the control unit displays the document data on the display unit with the confidential information part hidden, and a predetermined transmission destination 10. The apparatus for video conference according to 9 above, which is transmitted to.
(11) The video conference device according to any one of items 7 to 10 above, wherein the predetermined transmission destination to which the material data is transmitted is a reviewer side video conference device and / or a terminal device of a conference participant.
(12) The video conferencing apparatus according to item 11 above, wherein when the material data includes confidential information, the control unit transmits the material data only to the reviewer side video conference apparatus.
(13) A program for causing a computer of a presenter-side video conference device connected to a reviewer-side video conference device via a network to execute the program with the reviewer-side video conference device, A communication step for transmitting and receiving data including video information photographed by the photographing means and voice information collected by the sound collecting means; and a material data incorporated in the apparatus or provided on the network and associated with the keyword. A display step for displaying the material data stored in the storage device stored therein and video information transmitted from the reviewer-side video conference device in the communication step on a display means; and a reviewer in the communication step. A voice recognition system that converts voice information sent from the video conference device to text A determination step for determining whether a keyword included in the character converted in the speech recognition step is spoken by a presenter; and in the determination step, a keyword included in the converted character is spoken by a presenter. If it is determined, the acquisition step of acquiring the material data corresponding to the keyword from the storage device, the material data acquired in the acquisition step is displayed on the display means, and predetermined via the communication means A program for causing the computer to execute a control step of transmitting to a transmission destination of the computer.

  According to the invention described in the preceding paragraph (1), when a presenter presents a document at a video conference, if a remote reviewer makes an unexpected question, the content of the comment is converted into text. Is done. When a keyword included in the converted character is uttered by a presenter, material data corresponding to the keyword uttered by the presenter is acquired from a storage device in which the material data is stored in association with the keyword. The information is displayed on the display unit of the conference apparatus and transmitted to a preset destination via the communication unit.

  In other words, when the presenter repeats the keyword included in the content of the reviewer's statement, the related material data corresponding to the reviewer's question is automatically acquired from the storage device and transmitted to the transmission destination such as the connection destination. Can respond to reviewer's questions on an ad hoc basis, and can proceed quickly and make decisions.

  In particular, when a presenter reiterates a keyword included in a reviewer's remarks, it is possible to transmit relevant material data with high accuracy that can sufficiently persuade the reviewer to a connection destination, etc., and a video conference can proceed more quickly. .

  According to the invention described in the above item (2), when there are a plurality of material data corresponding to the keyword, those thumbnail images are displayed, so that the presenter looks at the thumbnail image and selects from among the plurality of material data. It becomes possible to select the relevant material most suitable for the question contents and promptly display it on the reviewer side.

  According to the invention described in the preceding paragraph (3), when confidential information is included in the document data, the document data is displayed on the display means only when the presenter has authority over a predetermined level. Since transmission can be made to a preset destination, inadvertent leakage of confidential information by an unauthorized presenter can be prevented.

  According to the invention described in the preceding item (4), when the confidential information having a high confidentiality level is included in a part of the document data, the control means does not include the confidential information portion having a high confidentiality level. Since it is displayed, highly confidential information can be effectively protected.

  According to the invention described in the preceding paragraph (5), since the document data can be transmitted to the reviewer side video conferencing apparatus and / or the destination of each participant of the conference, each person on the reviewer side transmits the transmitted material. The data can be displayed on the reviewer side video conference device, or can be viewed by each terminal device.

  According to the invention described in item (6) above, when confidential information is included in the document data, the document data is transmitted only to the reviewer-side video conference device, so there is a risk of leakage of confidential information. Can be reduced.

  According to the invention described in the preceding item (7), when the presenter repeats the keyword included in the reviewer's statement, the related material data corresponding to the reviewer's question is automatically acquired from the storage device, and the connection destination or the like. Since it is sent to the destination, it is possible to respond to the reviewer's questions on an as-needed basis, and the conference can be promptly advanced and decision-making can be performed. In particular, when a presenter reiterates a keyword included in a reviewer's remarks, it is possible to transmit relevant material data with high accuracy that can sufficiently persuade the reviewer to a connection destination, etc., and a video conference can proceed more quickly. .

  According to the invention described in the preceding item (8), when there are a plurality of material data corresponding to the keyword, those thumbnail images are displayed, so that the presenter looks at the thumbnail image and selects from among the plurality of material data. It is possible to select and display related materials that are most suitable for the question contents.

  According to the invention described in item (9) above, inadvertent leakage of confidential information by an unauthorized presenter can be prevented.

  According to the invention described in item (10), highly confidential information can be effectively protected.

  According to the invention described in the above item (11), each person on the reviewer side can display the transmitted document data on the reviewer-side video conference device, or can view the data on his / her terminal device.

  According to the invention described in item (12), the risk of leakage of confidential information can be reduced.

  According to the invention described in item (13) above, when a presenter repeats a keyword included in a comment from a reviewer, processing for acquiring material data corresponding to the keyword from a storage device and transmitting it to a transmission destination such as a connection destination Can be executed by the computer of the video conference apparatus.

It is a schematic block diagram which shows the video conference system provided with the apparatus for video conferences concerning one Embodiment of this invention. It is a schematic block diagram which shows the apparatus for video conferences in a video conference system. It is a block diagram which shows the electric constitution of the apparatus for video conferences. It is a block diagram which shows the structure of a control part. It is explanatory drawing of the state by which document data are displayed on the display apparatus of the apparatus for video conferences. It is explanatory drawing which shows an example of the keyword displayed on the display apparatus. It is explanatory drawing in the case of displaying document data on the terminal device of each video conference participant. It is a flowchart which shows the basic operation | movement of the apparatus for video conferences. It is a flowchart which shows a process in case confidential information is contained in document data.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 is a schematic configuration diagram showing a video conference system including a video conference device according to an embodiment of the present invention.

  In FIG. 1, this video conference system is arranged at a plurality of remote sites, for example, a presenter-side video conference device 1 arranged at one site A of two sites A and B, and at the other site B. A reviewer-side video conference device 2 and an information server 3 as a storage device that stores various material data prepared by the presenter in association with keywords as a database, the presenter-side video conference device 1, the reviewer-side video conference device 2 and the information server 3 are connected via a network 4. Note that the storage device holding the document data may be incorporated in either the presenter-side video conference device 1 or the reviewer-side video conference device 2.

  FIG. 2 is a schematic configuration diagram of the video conference device 1 (2) in the video conference system.

  In FIG. 2, this video conference device 1 (2) is connected to a device main body 11 and a display device such as an LCD which is connected to the device main body 11 (21) and displays the state of the video conference of the connection destination. A speaker 13 (23) as an audio output means for outputting an audio signal obtained by collecting speeches of 12 (22) (a display device) and connected participants (presenters, reviewers, etc.) Then, a photographing device, for example, a video camera 14 (24) for photographing the participant's state and transmitting it to the connection destination, and a microphone (referred to as a microphone) for collecting and transmitting the participant's remarks to the connection destination 15 (25).

  FIG. 3 is a block diagram showing an electrical configuration of the video conference apparatuses 1 and 2. In the figure, the same or corresponding parts as those in FIG.

  In FIG. 3, a presenter-side video conference device 1 is arranged at the presenter-side site A, and a review-side video conference device 2 is arranged at the reviewer-side site B. Connected through.

  The apparatus main body 11 in the presenter-side video conference apparatus 1 includes a control unit 18 and a communication unit 19.

  As shown in FIG. 4, the control unit 18 includes a CPU 181, a ROM 182, a RAM 183, a voice recognition unit 184, a keyword detection unit 185, an authentication unit 186, a diagnosis unit 187, a data acquisition unit 188, a storage unit 189, and the like. .

  The CPU 181 performs overall control of the entire video conference device 1 such as the communication unit 19, the display device 12, the speaker 13, the video camera 14, and the microphone 15. For example, the video information from the review-side video conference device 2 that is the connection destination received by the receiving unit 16 and the material data acquired from the information server 3 are combined and the combined video signal is displayed on the display device 12. To display on the display device 12 or when there are a plurality of material data, a thumbnail of each material data is displayed, the material data selected from the thumbnails is displayed, or the material data is displayed on the reviewer side. When data is transmitted to a preset destination such as the video conference device 2 or the conference participant's terminal device, or when the material data contains confidential information, one of the material data to be transmitted according to the authority of the presenter The receiving unit 16 receives the audio information transmitted from the connection destination and sends it to the speaker 13.

  The ROM 182 is a memory in which an operation program for operating the CPU 181 is stored, and the RAM 183 is a memory that provides a work area when the CPU 181 operates in accordance with the operation program.

  The voice recognition unit 184 recognizes voice information from the connection destination received by the receiving unit 16 and converts it into characters, or recognizes presenter's voice information collected by the microphone 15.

  The keyword detection unit 185 detects a keyword included in the character string when the voice information from the connection destination is converted by the voice recognition unit 184. The keyword is detected by acquiring a list of keywords associated with the material data stored in the information server 3 from the information server 3 and detecting whether the keyword is included in the character string. Just do it. The detected keyword is displayed on the display device 12.

  The authentication unit 186 detects the authority of the presenter. User information and authority information including voice information for each user is stored in advance in the storage unit 189, and when the user repeats a keyword, the voice of the presenter is recognized by the voice recognition unit 184 and stored in the storage unit 189. The presenter is identified by comparing the voice information for each user, and the authority is further identified.

  The determination unit 187 determines whether at least one keyword detected by the keyword detection unit 186 has been uttered by a presenter, or whether there are a plurality of material data acquired by the data acquisition unit 188 To determine whether or not confidential information is included in the document data, and other determinations. Whether or not confidential information is included in the document data is determined by adding information indicating that the confidential information is included in the document data when the document data is stored in the information server 3. The additional information may be referred to.

  When the determination unit 187 determines that at least one keyword detected by the keyword detection unit 186 has been uttered by the presenter, the data acquisition unit 188 passes the communication unit 19 through the communication unit 19. Material data such as supplementary material and reference material corresponding to the keyword is acquired from the information server 3.

  As shown in FIG. 5, the document data V acquired by the data acquisition unit 188 is displayed on the presenter-side display device 12 and the reviewer-side display device 22, respectively, and further on the presenter-side display device 12. The reviewer-side video V2 is displayed, and the reviewer-side display device 22 displays the presenter-side video V1.

  The storage unit 189 stores user information including voice information of each user and authority information indicating the authority of the user, material data associated with a keyword acquired from the information server 3, and the like.

  The voice recognition unit 184, the keyword detection unit 185, the authentication unit 186, the determination unit 187, and the data acquisition unit 188 described above are configured as a part of the function of the CPU 181.

  On the other hand, the communication unit 19 includes a receiving unit 16 and a transmitting unit 17. The receiving unit 16 receives video information, audio information, document data, and the like from the reviewer-side video conference device 2 and the information server 3 that are connection destinations. The transmitter 17 transmits video information obtained by the video camera 14, audio information collected by the microphone 15, material data acquired from the information server 3, etc. to the reviewer-side video conference device 2, In addition, a request for acquiring material data or the like is transmitted to the information server 3.

  The device main body 21 in the reviewer-side video conference device 2 includes a control unit 28 and a communication unit 29 that exchanges data with the presenter-side video conference device 1 and the information server 3 that are connection destinations. The communication unit 29 includes a reception unit 26 and a transmission unit 27. In addition, since the specific structure of each part is the same as the structure of each part of the presenter side video conference apparatus 1, description is abbreviate | omitted.

  Next, the flow of a video conference using the video conference system having the above configuration will be described.

  First, the following cases are generally considered as a method of proceeding a video conference.

  First, the presenter presents the main theme to be discussed at the video conference based on the presentation materials, and then the reviewer asks questions about the presentation.

  At this time, a comment made by the reviewer is transmitted as audio information from the reviewer-side video conference device 2 to the presenter-side video conference device 1 and converted into characters by the voice recognition unit 184 of the presenter-side video conference device 1. At the same time, the keyword included in the converted character string, that is, the keyword Q registered in association with the material data stored in the information server 3 is detected by the keyword detection unit 185. The detected keyword Q is displayed on the screen of the display device 12 of the presenter-side video conference device 1 as shown in FIG.

  In the screen of FIG. 6, for example, “number of code lines”, “number of bugs”, and “development cost” are displayed as the keyword Q.

  When the presenter looks at the keyword Q and explains the utterance (question) of the reviewer using the material data, the presenter utters and repeats at least one keyword Q corresponding to the material data. The speech content is voice-recognized by the voice recognition unit 184, and the judgment unit 187 determines whether or not the uttered keyword Q is included in the character string. When it is determined that the spoken keyword Q is included in the character string, in other words, the spoken keyword Q is at least one of the keywords Q displayed on the screen of the display device 12. If it is determined that they match, the data acquisition unit 188 requests the information server 3 storing the material data to acquire the material data associated with the keyword Q.

  The information server 3 transmits the requested material data to the requesting pre-center side video conference device 1.

  The presenter-side video conference device 1 that has acquired the document data displays the document data on the screen of the display device 12 and transmits it to the reviewer-side video conference device 2. The document data may be transmitted to the reviewer-side video conference device 2 by the information processing server 3 based on the control of the presenter-side video conference device 1.

  The presenter can accurately answer the reviewer's question by using the information of the material data. In particular, when the presenter reiterates the keyword Q, the presenter recognizes the relevant material data. Since the reviewer is configured to acquire the data, the reviewer can obtain the material data corresponding to the content of the question accurately, and can fully understand the presenter's explanation.

  By the way, it is also conceivable that a plurality of material data associated with the keyword Q exist in the database of the information server 3. In that case, for example, a cover page of a plurality of material data acquired from the information server 3 is displayed as a thumbnail on the display device 12 of the pre-center side video conference device 1. When the presenter selects a thumbnail of the document data to be acquired by an operation unit (not shown) such as a touch panel, the selected document data is displayed on the screen of the display device 12 and the document data is displayed on the reviewer side video conference. Is transmitted directly to the device 2 or via the information server 3.

  Further, when necessary material data is displayed on the screens of the display devices 12 and 22, there may be a case where confidential information is included in the material data. In that case, if the acquisition of the material data from the information server 3 and the display on the screens of the display devices 12 and 22 are restricted according to the authority of the presenter, the confidential information is inadvertently leaked. Is prevented.

  Specifically, when the presenter repeats the keyword Q, the presenter specifies the presenter by voice authentication based on the utterance data, and the degree of authority the presenter has in the storage unit 189 Know from the information.

  For example, when the document data includes numerical information such as a budget or sales amount as confidential information, the document data may not be displayed unless it is a presenter of a position higher than the general manager. Furthermore, not only all of the material data is not displayed, but only a part of the material data, for example, only a portion including confidential information may be hidden. As a method for hiding only the portion containing confidential information, there are two types: first material data from which data in the portion containing confidential information is removed and normal second material data that is not removed. May be stored in the information server 3 and the information server 3 may be requested to acquire the first material data or the second material data according to the authority of the presenter.

  Recently, as shown in FIG. 7, participants in a video conference bring their own personal computers (notebook computers) 112, for example, as shown in FIG. 7, and materials distributed by presenters on the screens of the personal computers 112 are displayed. There are many cases where people attend meetings while browsing. In such a case, each personal computer 112 is often connected to an in-house intranet.

  In a video conference under such an environment, the document data is distributed not only on the screens of the display devices 12 and 22 of the video conference devices 1 and 2 but also to each personal computer 112, and the reviewer has his personal computer 112. The information of the material data may be browsed on the screen. It may be sent by e-mail. However, it is desirable from the viewpoint of preventing leakage of confidential information that the document data including the confidential information is transmitted only to the reviewer-side video conference device 2 and is not distributed to the personal computer 112 of each participant. . .

  FIG. 8 is a flowchart showing the basic operation of the video conference apparatus 1. This operation is executed by the CPU 181 operating according to an operation program recorded on a recording medium such as the ROM 182.

  In FIG. 8, in step S <b> 1, it is determined whether there is a reviewer's utterance (question) at the connection destination in response to the presenter's presentation during the video conference. If there is no reviewer's utterance (NO in step S <b> 1). If the reviewer has made a comment (YES in step S1), the process proceeds to step S2.

  In step S2, the utterance content is converted into characters by voice recognition, and the keyword Q is detected from the converted character string. In step S3, the detected keyword Q is displayed on the screen of the display device 12, and the process proceeds to step S4. .

  In step S4, it is determined whether or not the presenter has replayed at least one of the displayed keywords Q. If the presenter does not repeat the keyword Q (NO in step S4), the process waits for a repeat. If the presenter repeats the keyword Q (YES in step S4), in step S5, material data corresponding to the keyword Q is acquired from the information server 3, and the process proceeds to step S6.

  In step S6, it is determined whether or not there are a plurality of read material data. If there are not a plurality of material data (NO in step S6), the process proceeds to step S7. If there are a plurality of document data (YES in step S6), a plurality of document data is displayed as thumbnails in step S8, and after the document data selected by the presenter from the thumbnail display is acquired from the information server 3 in step S9, Proceed to S7.

  In step S7, the document data is displayed on the screen of the display device 12, and is distributed to the reviewer-side video conference device 2 and / or the personal computer 112 of each conference participant, which is the connection destination, and then the process ends.

  FIG. 9 is a flowchart showing processing when confidential information is included in the material data. Since steps S1 to S9 are the same as those in the flowchart of FIG. 8, the same step numbers are assigned.

  In FIG. 9, in step S <b> 1, during the video conference, it is determined whether or not there is a reviewer's statement (question) at the connection destination with respect to the presenter's presentation. If the reviewer has made a comment (YES in step S1), the process proceeds to step S2.

  In step S2, the utterance content is converted into characters by voice recognition, and the keyword Q is detected from the converted character string. In step S3, the detected keyword Q is displayed on the screen of the display device 12, and the process proceeds to step S4. .

  In step S4, it is determined whether or not the presenter has replayed at least one of the displayed keywords Q. If the presenter does not repeat the keyword Q (NO in step S4), the process waits for a repeat. If the presenter repeats the keyword Q (YES in step S4), in step S5, material data corresponding to the keyword Q is acquired from the information server 3, and the process proceeds to step S6.

  In step S6, it is determined whether or not there are a plurality of read material data. If there are not a plurality of material data (NO in step S6), the process proceeds to step S10. If there are a plurality of document data (YES in step S6), a plurality of document data is displayed as thumbnails in step S8, and after the document data selected by the presenter from the thumbnail display is acquired from the information server 3 in step S9, Proceed to S10.

  In step S10, it is determined whether or not confidential information is included in the acquired material data. If confidential information is not included (NO in step S10), the process proceeds to step S7.

  If confidential information is included (YES in step S10), it is determined in step S11 whether or not the presenter has the authority to display the confidential information (for example, whether the position is higher than the general manager). If there is (YES in step S11), the process proceeds to step S7. If there is no authority (NO in step S11), the process proceeds to step S12.

  In step S7, the document data is displayed on the screen of the display device 12, and is distributed to the reviewer-side video conference device 2 and / or the personal computer 112 of each conference participant, which is the connection destination, and then the process ends.

  On the other hand, in step S12, the document data is not displayed and distributed, or the confidential information portion is hidden and the document data is displayed on the screen of the display device 12, and the reviewer side video conference device 2 that is the connection destination is displayed. And / or after delivering to each meeting participant's personal computer 112, a process is complete | finished.

1, 2 Videoconferencing device 3 Information server 4 Network 12, 22 Display device 13, 23 Speaker 14, 24 Video camera 15, 26 Microphone 18, 28 Control unit 19, 29 Communication unit 181 CPU
184 Voice recognition unit 185 Keyword detection unit 186 Authentication unit 187 Judgment unit 188 Data acquisition unit A, B Base Q Keyword

Claims (13)

Provided at each of a plurality of bases, and presenter-side and reviewer-side videoconferencing devices connected to each other via a network, inside any one of the videoconferencing devices or on the network, and a keyword A video conferencing system comprising: a storage device that stores associated data;
Each of the video conference devices is
Shooting means for shooting the state during the video conference,
A sound collection means for collecting the speech of a video conference participant;
Audio output means for outputting audio information collected by the sound collection means of the other video conference device;
A communication unit that exchanges data including video information captured by the imaging unit and audio information collected by the sound collecting unit with the other video conference device;
Display means capable of displaying the document data stored in the storage device and the video information transmitted by the communication means;
With
The presenter-side video conference device further includes:
Voice recognition means for converting voice information transmitted from the reviewer-side video conference device into characters by the communication means;
Determination means for determining whether a keyword included in the character converted by the voice recognition means is spoken by a presenter;
When the determination unit determines that a keyword included in the converted character is spoken by a presenter, an acquisition unit acquires material data corresponding to the keyword from the storage device;
Control means for displaying the material data acquired by the acquisition means on the display means and transmitting the data to a predetermined destination via the communication means;
A video conference system characterized by comprising: The determination means determines whether or not there are a plurality of material data corresponding to the keyword,
When it is determined that there are a plurality of the document data, the control unit displays a thumbnail of each document data on the display unit and is selected by a presenter from the displayed thumbnails of the plurality of document data. The video conference system according to claim 1, wherein the received material data is displayed on the display means and transmitted to a predetermined transmission destination. The determination means determines whether or not confidential information is included in the material data, determines the security level of the presenter,
If it is determined by the determination means that the document data contains confidential information, the control means only sends the document data to the display means if the presenter has authority over a predetermined level. The video conference system according to claim 1, wherein the video conference system displays and transmits the video to a predetermined transmission destination.   When confidential information is included in a part of the document data, the control unit displays the document data on the display unit without displaying the confidential information part and transmits the document data to a predetermined transmission destination. Item 4. The video conference system according to Item 3.   5. The video conference system according to claim 1, wherein the predetermined transmission destination to which the material data is transmitted is a reviewer-side video conference device and / or a terminal device of a conference participant.   6. The video conference system according to claim 5, wherein, when the material data includes confidential information, the control means transmits the material data only to the reviewer side video conference device. A presenter-side video conference device connected to a reviewer-side video conference device via a network,
A communication unit that exchanges data including video information captured by the imaging unit and audio information collected by the sound collection unit with the reviewer-side video conference device;
The material data stored in the storage device that is built in the device itself or provided on the network and stores the material data in association with the keyword, and transmitted from the reviewer-side video conference device by the communication means. Display means capable of displaying the received video information;
Voice recognition means for converting voice information transmitted from the reviewer-side video conference device into characters by the communication means;
Determination means for determining whether a keyword included in the character converted by the voice recognition means is spoken by a presenter;
When the determination unit determines that a keyword included in the converted character is spoken by a presenter, an acquisition unit acquires material data corresponding to the keyword from the storage device;
Control means for displaying the material data acquired by the acquisition means on the display means and transmitting the data to a predetermined destination via the communication means;
An apparatus for video conference, comprising: The determination means determines whether or not there are a plurality of material data corresponding to the keyword,
When it is determined that there are a plurality of the document data, the control unit displays a thumbnail of each document data on the display unit and is selected by a presenter from the displayed thumbnails of the plurality of document data. The video conference apparatus according to claim 7, wherein the received material data is displayed on the display means and transmitted to a predetermined transmission destination. The determination means determines whether or not confidential information is included in the material data, determines the security level of the presenter,
When it is determined by the determining means that the document data contains confidential information, the control means only displays the document data on the display means when the presenter has authority over a predetermined level. The video conference apparatus according to claim 7 or 8, wherein the video conference apparatus displays and transmits the video to a predetermined transmission destination.   In a case where confidential information is included in a part of the document data, the control unit displays the document data on the display unit without displaying the confidential information part and transmits the data to a predetermined transmission destination. The video conference apparatus according to claim 9.   The video conference apparatus according to any one of claims 7 to 10, wherein the predetermined transmission destination to which the material data is transmitted is a reviewer-side video conference apparatus and / or a terminal device of a conference participant.   The video conferencing apparatus according to claim 11, wherein when the material data includes confidential information, the control unit transmits the material data only to the reviewer-side video conference apparatus. A program for causing a computer of a presenter-side video conference device connected to a reviewer-side video conference device via a network,
A communication step for exchanging data including video information photographed by the photographing means and audio information collected by the sound collecting means with the reviewer-side video conference device;
The material data stored in the storage device built in the device itself or provided on the network and associated with the keyword and stored in the data device, and transmitted from the reviewer side video conference device in the communication step A display step for displaying the received video information on the display means;
A voice recognition step of converting voice information transmitted from the reviewer-side video conference device into characters in the communication step;
A determination step of determining whether a keyword included in the character converted in the voice recognition step is spoken by a presenter;
In the determination step, when it is determined that a keyword included in the converted character is spoken by a presenter, an acquisition step of acquiring material data corresponding to the keyword from the storage device;
A control step of displaying the document data acquired in the acquisition step on the display unit and transmitting the data to a predetermined destination via the communication unit;
For causing the computer to execute.

Images