JP2018085623A - Communication device, method, and program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a mechanism for making a user of a communication device aware of the establishment of a dialogue state between communication devices. A communication device having a receiving unit that receives a dialogue request from another communication device, and a user of the communication device responding to the dialogue request after receiving the dialogue request by the receiving unit. A control unit that starts output control of video and audio received from the other communication device is provided, and the control unit controls notification by a calling sound after the output control is started. Communication device. [Selection diagram] Fig. 5

Description

  The present invention relates to a communication device, a method, and a program.

  In recent years, with the development of network and multimedia transmission technology, it has become easy to introduce telework between remote satellite offices or between a local satellite office and a head office. For this reason, an increasing number of companies are promoting the introduction of telework as part of management reform.

  At the office, communication during work is regarded as important, so an attempt has been made to get a feeling as if members in offices apart from each other are working together in the same space. For example, in a telework system, office overhead images can be distributed to each other, and members can interact like a TV phone. Patent Document 1 discloses a method for gradually increasing a ringtone of a telephone for calling with respect to a conversation between members.

Japanese Patent Application Laid-Open No. 11-68890

  In communication in the same space, members talk directly to the other party without listening to the phone. From the viewpoint of imitating communication in the same space, it is desirable that the conversation state of each member's terminal is created without a response operation to the incoming call by the talked side even when realizing a telework conversation. However, if a dialog state is created without a response operation, it may happen that the member requested to interact is not aware of the dialog state.

  Accordingly, the present invention has been made in view of the above problems, and an object of the present invention is a new and improved technique capable of notifying a user of a communication apparatus of establishment of a conversation state between the communication apparatuses. It is to provide an improved communication apparatus, method, and program.

  In order to solve the above-described problem, according to an aspect of the present invention, a communication device, a reception unit that receives a dialogue request from another communication device, and after the reception of the dialogue request by the reception unit, A control unit that starts output control of video and audio received from the other communication device regardless of whether or not the user of the communication device responds to the dialogue request, and the control unit includes the output control. A communication device is provided for controlling notification by means of a call sound after the start of.

  The control unit may control notification by the calling sound according to an instruction from the other communication device.

  The communication device further includes a dialog determination unit that determines whether or not a user of the communication device has started a dialog, and the control unit is configured to start the dialog by the user of the communication device by the dialog determination unit. Until the determination is made, the notification by the calling sound may be repeatedly controlled.

  The control unit may start the output control without performing notification by the sound of the dialogue request after the reception of the dialogue request by the reception unit.

  The communication device includes a first sound output unit, a second sound output unit, and a dialogue determination unit that determines whether or not a user of the communication device has started a dialogue, and the control unit includes: In the output control, after the voice received from the other communication device is output to the first sound output unit, and the dialogue determination unit determines that the user of the communication device has started the dialogue, You may make the said 2nd sound output part output the audio | voice received from another communication apparatus.

  The second sound output unit may be provided in the handset.

  The control unit starts transmission control of the input image and input sound to the communication device together with the start of output control of video and audio received from the other communication device. Also good.

  The control unit controls the output of the overhead video including the user of the other communication device before receiving the dialogue request, and stops the control of the output of the overhead video based on the reception of the dialogue request. May be.

  The control unit controls the output of the environmental sound on the other communication device side before receiving the dialogue request, and stops the control of the output of the environmental sound based on the reception of the dialogue request. Also good.

  In order to solve the above-described problem, according to another aspect of the present invention, there is provided a method executed by a communication device, comprising: receiving a dialog request from another communication device; and receiving the dialog request. Later, regardless of the presence or absence of a response to the dialogue request by the user of the communication device, start output control of video and audio received from the other communication device, and after the start of the output control, Controlling audible notification. In order to solve the above-described problem, according to another aspect of the present invention, a computer is a communication device, a reception unit that receives a dialogue request from another communication device, and the dialogue request by the reception unit. A control unit that starts output control of video and audio received from the other communication device regardless of whether or not there is a response to the dialogue request by a user of the communication device after reception, and the control unit Is provided with a program for functioning as a communication device for controlling notification by a calling sound after the output control is started.

  In order to solve the above problem, according to another aspect of the present invention, there is provided a communication device that receives a dialogue request from another communication device, and receives the dialogue request by the receiving unit. And a control unit that starts output control of a voice received from the other communication device regardless of whether or not there is a response to the dialogue request by a user of the communication device, and the control unit includes the output A communication device is provided that controls notification by means of a call sound after the start of control.

  As described above, according to the present invention, it is possible to make a user of a communication device aware of establishment of a conversation state between the communication devices.

It is explanatory drawing which shows the structure of the remote communication system by embodiment of this invention. It is explanatory drawing which shows the structure of a communication apparatus. It is explanatory drawing which shows the specific example of a bird's-eye view image | video. It is explanatory drawing which shows the example of an image | video of the member who requested | required the dialog. It is explanatory drawing which shows the example of an image | video of the member who requested | required the dialog. It is explanatory drawing which shows the example of an image | video of the member who requested | required the dialog. It is explanatory drawing which shows the structure of the remote communication system by the 1st Embodiment of this invention. It is explanatory drawing which shows the operation example of the communication apparatus with which the dialogue state was established with the communication apparatus. It is a flowchart which shows the operation | movement of the 1st Embodiment of this invention. It is explanatory drawing which shows the structure of the remote communication system by the 2nd Embodiment of this invention. It is explanatory drawing which shows the example of determination of the dialogue by a sound volume. It is explanatory drawing which shows the call by 2nd Embodiment. It is a flowchart which shows the operation | movement of the 2nd Embodiment of this invention. It is the block diagram which showed the hardware constitutions of the communication apparatus.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings. In addition, in this specification and drawing, about the component which has the substantially same function structure, duplication description is abbreviate | omitted by attaching | subjecting the same code | symbol.

  In the present specification and drawings, a plurality of components having substantially the same functional configuration may be distinguished by adding different alphabets after the same reference numeral. For example, a plurality of configurations having substantially the same functional configuration or logical significance are distinguished as communication devices 20A and 20B as necessary. However, when it is not necessary to particularly distinguish each of a plurality of constituent elements having substantially the same functional configuration, only the same reference numeral is given to each of the plurality of constituent elements. For example, when it is not necessary to distinguish between the communication devices 20A and 20B, each client is simply referred to as the communication device 20.

<0. Overview of remote communication system>
Embodiments described herein relate generally to a remote communication system that realizes communication between remote bases. The outline of the remote communication system will be described below with reference to FIGS.

  FIG. 1 is an explanatory diagram showing a configuration of a remote communication system according to an embodiment of the present invention. As shown in FIG. 1, the remote communication system according to the embodiment of the present invention includes an imaging device 10A, a communication device 20A, and a work terminal 30A provided at the site A, an imaging device 10B provided at the site B, and a communication device. 20B and a work terminal 30B. Base A and base B are connected by a network 12.

  The imaging device 10 has a function of capturing a bird's-eye view video of a base and a function of collecting environmental sound of the base. The imaging device 10 </ b> A provided at the site A transmits the bird's-eye view video and the environmental sound of the site A to the site B via the network 12. Similarly, the imaging device 10 </ b> B provided at the site B transmits the overhead view video and the environmental sound of the site B to the site A via the network 12. The imaging device 10 does not need to have both a function to capture an image and a function to collect sound, and the function to collect sound may be separated from the imaging device 10 so that it can be installed in the center of the office.

  The work terminal 30 is a terminal used by each member (user) for work. The work terminal 30 may be a PC (Personal Computer), for example.

  The communication device 20 is a device for supporting communication between members of the base A and members of the base B. For example, the communication device 20A provided at the site A displays a bird's-eye view image of the site B transmitted from the imaging device 10B at the site B and outputs an environmental sound of the site B. Similarly, the communication device 20B provided at the site B displays a bird's-eye view image of the site A transmitted from the imaging device 10A at the site A and outputs the environmental sound of the site A. In this way, by constantly exchanging the bird's-eye view video and environmental sound of each base, each member can feel the atmosphere and situation of different bases as if the different bases exist in the same space. It is.

  Further, the communication device 20 has a function of supporting a dialogue between a plurality of members. For example, when a member included in the overhead video of another base displayed on the communication device 20 is selected, the communication device 20 can interact with the selected member using the communication device 20. Establish a dialogue state in which the video and audio of both members are exchanged.

  Here, with reference to FIG. 2, the structure of the communication apparatus 20 is demonstrated more concretely. FIG. 2 is an explanatory diagram showing the configuration of the communication device 20. As illustrated in FIG. 2, the communication device 20 includes an operation display unit 220, a sound output unit 224, a video input unit 228, and an audio input / output unit 232.

  The operation display unit 220 includes a function as an operation unit that detects an operation by a member and a video output unit that displays a video. For example, the operation display unit 220 of the communication device 20A located at the site A displays the overhead image of the site B transmitted from the imaging device 10B at the site B, as shown in FIG.

  2 illustrates an example in which the functions of the operation unit and the video output unit are integrally mounted on the operation display unit 220, the functions of the operation unit and the video output unit may be configured separately. The function as the operation unit may be realized by a touch panel, may be configured by a physical button, or may be realized by a non-contact sensor using infrared rays, ultrasonic waves, or the like.

  The sound output unit 224 (first sound output unit) has a function of outputting sound and can be configured by a speaker. For example, the sound output unit 224 of the communication device 20A located at the site A outputs the environmental sound of the site B transmitted from the imaging device 10B at the site B.

  The video input unit 228 has a function of imaging members who use the communication device 20. For example, the video input unit 228 of the communication device 20A located at the site A acquires a video of a member who uses the communication device 20A by imaging. When the conversation state between the communication device 20A and the communication device 20B at the base B is established, the video acquired by the video input unit 228 of the communication device 20A is transmitted to the communication device 20B at the base B via the network 12. . Similarly, when the conversation state between the communication device 20A and the communication device 20B at the base B is established, the video acquired by the video input unit 228 of the communication device 20B is transmitted to the communication device 20A at the base A via the network 12. Sent.

  The voice input / output unit 232 has a voice input function and an output function (second sound output unit), and is used in a dialogue between members. The voice input / output unit 232 is configured by a handset as shown in FIG. The handset does not have to be a gripping type, and may be configured to be hands-free with a directional microphone and a directional speaker. Although it is possible to realize a conversation between members in a hands-free manner using a sound output unit 224 and a microphone (not shown) provided in the communication device 20, a voice input / output unit 232 composed of a handset is provided. By using it, the sound that leaks to the surroundings becomes small, and it becomes difficult to disturb the surroundings. The voice input / output unit 232 and the main body of the communication device 20 may be connected wirelessly or may be connected by wire, or the voice input / output unit 232 may be provided in the main body of the communication device 20. Good.

  For example, the voice input / output unit 232 of the communication device 20A located at the site A outputs the voice of the conversation partner member transmitted from the communication device 20B used by the conversation partner member, and the member of the communication device 20A uses the communication device 20A. Pick up sound. The voice obtained by collecting the voice input / output unit 232 of the communication device 20A is transmitted via the network 12 to the communication device 20B used by the conversation partner member. Similarly, the voice input / output unit 232 of the communication device 20B located at the base B outputs the voice of the conversation partner member transmitted from the communication device 20A used by the conversation partner member, and uses the communication device 20B. The sound of is picked up. The voice obtained by the voice input / output unit 232 of the communication apparatus 20B is transmitted to the communication apparatus 20A used by the conversation partner member via the network 12.

  Note that a management server that collects overhead video and environmental sound from each imaging device 10 and centrally manages the distribution of overhead video and environmental sound to each communication device 20 may be provided between the base A and the base B. Good. The management server receives an overhead video and environmental sound transmission request from the communication device 20 to the imaging device 10, a dialogue request from the communication device 20 to another communication device 20, and performs processing according to these requests. May be.

(background)
In order to realize a dialogue between members located at different bases, in general, one member performs a call operation for calling the other member, and a communication device used by the other member emits a ring tone. The other member performs a response operation according to the ring tone. However, there is a concern that when a ring tone is generated at each dialogue, the concentration of surrounding members is cut by the ring tone, which hinders the action.

  In this regard, based on the calling operation by one member, the dialog state between the communication devices used by both members can be changed without the output of a ringtone by the communication device used by the other member and the response operation of the other member. In the established method, since no ring tone is generated, the concentration of surrounding members is not hindered.

  However, in a method of establishing a dialog state without the other member's response operation, it may happen that the other member is unaware that a dialog has been requested and that the dialog state has been established.

  FIG. 4 is an explanatory diagram illustrating an example of a video image of a member who is requested to interact. The member who requested the dialogue may notice the dialogue request and turn to the video input unit 228 as shown in FIG. 4A, but concentrates on the work as shown in FIG. 4B and does not notice the dialogue request. In addition, as shown in FIG. 4C, the user may not be aware of the dialogue request while interacting with another member.

  The present inventor has come up with an embodiment of the present invention by focusing on the above circumstances. According to each embodiment of the present invention, it is possible to make a user of a communication device aware of establishment of a dialog state between the communication devices. Hereinafter, each embodiment of the present invention will be described in detail.

<1. First Embodiment>
(Constitution)
FIG. 5 is an explanatory diagram showing the configuration of the remote communication system according to the first embodiment of the present invention.

/// Imaging device //
As illustrated in FIG. 5, the imaging device 10 includes an overhead video input unit 120, an environmental sound input unit 130, and a communication unit 140. The bird's-eye view video input unit 120 acquires a bird's-eye view video of a site where the imaging device 10 is provided by imaging. The environmental sound input unit 130 acquires the environmental sound of the site where the imaging device 10 is provided by collecting sound. The communication unit 140 transmits the overhead view video acquired by the overhead view video input unit 120 and the environmental sound acquired by the environmental sound input unit 130 to a base different from the base where the imaging device 10 is provided.

//Communication device//
As illustrated in FIG. 5, the communication device 20 includes a video output unit 221, an operation unit 222, a sound output unit 224, a video input unit 228, a voice input / output unit 232, a communication unit 240, a control unit 250, and a notification sound generation unit. 260. The video output unit 221 and the operation unit 222 correspond to the operation display unit 220 described with reference to FIG. Since the configurations of the sound output unit 224, the video input unit 228, and the audio input / output unit 232 are as described with reference to FIG. 2, detailed description thereof is omitted here.

  The communication unit 240 communicates video and audio via the network 12. For example, the communication unit 240 has a function as a receiving unit that receives an overhead view video and environmental sound of another site from the imaging device 10 provided at another site. Moreover, the communication part 240 receives the image | video and audio | voice of the other party from the communication apparatus 20 provided in the other base in the dialog state. Further, in the conversation state, the communication unit 240 receives the member video using the communication device 20 acquired by the video input unit 228 and the voice of the member using the communication device 20 acquired by the audio input / output unit 232. It functions as a transmission unit that transmits to the communication device 20 used by the conversation partner. Further, the communication unit 240 can receive a dialogue request from the communication device 20 at another base and can transmit a dialogue request to the communication device 20 at another base.

  The control unit 250 controls the overall operation of the communication device 20. For example, the control unit 250 causes the video output unit 221 to display a bird's-eye view video of another base received by the communication unit 240 and causes the sound output unit 224 to output the environmental sound of the other base received by the communication unit 240. . Further, the control unit 250 displays the video received from the other communication device 20 on the video output unit 221 in the conversation state with the other communication device 20, and the voice received from the other communication device 20 is the voice. The data is output to the input / output unit 232. In addition, the control unit 250 communicates the video acquired by the video input unit 228 and the audio acquired by the audio input / output unit 232 to the other communication device 20 in a dialog state with the other communication device 20. 240. In this specification, a state in which a member's video and audio can be transmitted and received between the communication devices 20 in this way is called a dialog state.

  The control unit 250 according to the present embodiment establishes the above-described dialog state with the other communication device 20 based on the dialog request from the other communication device 20 without the output of the ringtone and the response operation by the member. For this reason, the member using the communication device 20 may not be aware of the establishment of the conversation state. Therefore, the control unit 250 causes the notification sound generation unit 260 to generate a notification sound for a call in response to a call request (instruction) from another communication device 20 in the conversation state. The notification sound generated by the notification sound generation unit 260 is output from the sound output unit 224. The output of the notification sound will be described more specifically with reference to FIG.

  FIG. 6 is an explanatory diagram illustrating an operation example of the communication apparatus 20B in which a conversation state with the communication apparatus 20A is established. As shown in FIG. 6, a video V1 of a member who uses the communication device 20A is displayed on the video output unit 221 of the communication device 20B. The voice input / output unit 232 of the communication device 20B outputs a call voice X1 “Mr. XX” from a member who uses the communication device 20A. However, the member M1 who uses the communication device 20B concentrates on the work using the work terminal 30, and is not aware of the establishment of a dialog state between the communication device 20A and the communication device 20B.

  At this time, when a member who uses the communication device 20A performs a predetermined calling operation, the control unit 250 of the communication device 20B causes the notification sound generation unit 260 to generate a notification sound, and the sound output unit 224, for example, as illustrated in FIG. In this way, the notification sound X2 “CONCON” is output. Since the output volume of the sound output unit 224 is larger than the output volume of the voice input / output unit 232, the member M 1 does not recognize the call voice X 1 from the voice input / output unit 232. The notification sound X2 output from 224 is easily noticed. If the member M1 notices the dialogue state between the communication devices 20 by the notification sound X2, the member M1 can face the video input unit 228, hold the voice input / output unit 232, and start the dialogue.

  The call operation may be an operation of tapping a member included in the overhead view video. The call operation can be repeated many times before the conversation state is ended. The control unit 250 may cause the notification sound generation unit 260 to generate a notification sound with a gradually increasing volume according to the number of times the call operation is repeated.

(Operation)
The configuration of the first embodiment of the present invention has been described above. Subsequently, with reference to FIG. 7, the operation of the first exemplary embodiment of the present invention is organized.

  FIG. 7 is a flowchart showing the operation of the first exemplary embodiment of the present invention. As shown in FIG. 7, the communication device 20A and the communication device 20B output an overhead view video and environmental sound of the other site (S101). Then, when a member who uses the communication device 20A selects a conversation partner from the overhead image of the base B (S102), a conversation request is transmitted to the communication device 20B used by the selected conversation partner (S103). The device 20B receives the dialogue request (S104). Here, the management server sets a clickable map in the overhead view video of the site B, specifies the member corresponding to the position tapped by the member using the communication device 20A, and the communication device used by the specified member A dialogue request may be sent to 20B.

  Thereafter, the communication device 20A and the communication device 20B stop the overhead image output from the video output unit 221 (S105). Then, the communication device 20A and the communication device 20B start transmission / reception of the member video, and start outputting the member video received from the other (S106). Note that the output of the bird's-eye view video may not be completely stopped. For example, the communication device 20 may output a screen including both the bird's-eye view video and the member's video. At this time, the member's image may be displayed larger than the overhead view image.

  Further, the communication device 20A and the communication device 20B stop the output of the environmental sound by the sound output unit 224 (S107). Then, the communication device 20A and the communication device 20B start transmission / reception of the member's voice, and start outputting the member's voice received from the other (S108). Thereby, a dialogue state is established between the communication device 20A and the communication device 20B.

  When a member using the communication device 20A performs a calling operation on the operation unit 222 in the dialog state (S109), the notification sound generation unit 260 of the communication device 20B generates a preset notification sound (S110). The output unit 224 outputs the notification sound (S111). The member using the communication device 20A can repeat the calling operation until the member using the communication device 20B notices the dialogue state by the notification sound. After the member using the communication device 20B notices the dialogue state, The dialogue starts.

  Thereafter, when an operation for ending the dialog is performed on the operation unit 222 of the communication device 20A (S113), a dialog end notification is transmitted to the communication device 20B, and the communication end notification is received by the communication device 20B (S114). . The operation for ending the dialogue may be a selection of a predetermined button or a predetermined gesture.

  Then, the communication device 20A and the communication device 20B stop transmission / reception and output of the member's video and audio (S115), and restart output of the overhead video and environmental sound (S116, S117). As a result, the states of the communication device 20A and the communication device 20B are equal to the states of the communication device 20A and the communication device 20B in S101.

(effect)
As described above, according to the first embodiment of the present invention, the dialog state between the communication devices 20 is established without the output of the ringtone and the response operation by the conversation partner. For this reason, it is possible to establish a conversation state without hindering the concentration of surrounding members by the ring tone. Furthermore, after the dialog state is established, it is possible to call a dialog partner who does not notice the dialog state using a notification sound. For this reason, it is possible for the conversation partner to notice the conversation state by the notification sound and to start the conversation smoothly.

<2. Second Embodiment>
The first embodiment of the present invention has been described above. Subsequently, a second embodiment of the present invention will be described. The second embodiment of the present invention relates to a proposal for realizing a voice call of a member in a dialog state.

(Constitution)
FIG. 8 is an explanatory diagram showing a configuration of a remote communication system according to the second embodiment of the present invention. As shown in FIG. 8, the remote communication system according to the second embodiment includes an imaging device 10A and a communication device 22A provided at the site A, and an imaging device 10B and a communication device 22B provided at the site B. Since the configuration of the imaging apparatus 10 is as described in the first embodiment, a detailed description thereof is omitted here.

  As shown in FIG. 8, the communication device 22 includes a video output unit 221, an operation unit 222, a sound output unit 224, a video input unit 228, a voice input / output unit 232, a communication unit 240, a control unit 252 and a dialogue determination unit 270. Is provided. Since the configurations of the video output unit 221, the operation unit 222, the sound output unit 224, the video input unit 228, the audio input / output unit 232, and the communication unit 240 are as described in the first embodiment, a detailed description here. Is omitted.

  The dialog determination unit 270 of the communication device 22 on the dialog request receiving side determines whether a member using the communication device 22 notices the dialog state and starts the dialog. For example, when the volume of the sound collected by the voice input / output unit 232 exceeds a threshold, the dialogue determination unit 270 determines that the member using the communication device 22 has noticed the dialogue state and started the dialogue. Also good. The member who notices the conversation state is considered to start speaking using the voice input / output unit 232, and when the voice starts using the voice input / output unit 232, the voice collected by the voice input / output unit 232 This is because the volume of the sound is considered to increase. For example, in the example illustrated in FIG. 9, the conversation determination unit 270 recognizes that the member using the communication device 22 is in the conversation state at a time t1 when the volume of the sound collected by the voice input / output unit 232 exceeds a threshold value. It may be determined that the dialogue has started.

  The dialogue determination unit 270 can also determine the start of the dialogue based on the video of the member who uses the communication device 22. For example, the conversation determination unit 270 determines that the member using the communication device 22 notices the conversation state and starts the conversation when the member faces the front in the member image acquired by the image input unit 228. May be.

  The control unit 252 controls the overall operation of the communication device 22. For example, the control unit 252 causes the video output unit 221 to display a bird's-eye view video of another base received by the communication unit 240 and causes the sound output unit 224 to output the environmental sound of the other base received by the communication unit 240. . In addition, the control unit 252 displays the video received from the other communication device 22 on the video output unit 221 in the conversation state with the other communication device 22, and the audio received from the other communication device 22 is audio. The data is output to the input / output unit 232. Further, the control unit 252 communicates the video acquired by the video input unit 228 and the audio acquired by the audio input / output unit 232 to the other communication device 22 in a dialog state with the other communication device 22. 240.

  When the communication device 22 is the dialog request accepting side, the control unit 252 according to the present embodiment outputs the voice of the member using the other communication device 22 received from the other communication device 22 to the sound output unit 224. Let Then, when the conversation determination unit 270 determines that the member using the communication device 22 has started the conversation, the control unit 252 determines the voice output destination of the member using the other communication device 22 as the voice input / output unit. Switch to 232. Hereinafter, a more specific description will be given with reference to FIG.

  FIG. 10 is an explanatory diagram showing a call according to the second embodiment. As shown in FIG. 10, the video V2 of the member who uses the communication device 22A is displayed on the video output unit 221 of the communication device 22B which is the side that accepts the dialogue request. However, the member M1 who uses the communication device 22B concentrates on the work using the work terminal 30, and is not aware of the establishment of a dialog state between the communication device 22A and the communication device 22B.

  At this time, when the member using the communication device 22A speaks to the member M1 through the voice input / output unit 232 of the communication device 22A, as shown in FIG. 10, the voice X3 of the member using the communication device 22A is the sound of the communication device 22A. Output from the output unit 224. When the member M1 notices the conversation state between the communication devices 22 using the voice X3 and faces the video input unit 228 or speaks using the voice input / output unit 232, the voice of the member using the other communication device 22 is heard. Is switched to the voice input / output unit 232. Therefore, the member M1 can perform a conversation using the voice input / output unit 232.

(Operation)
The configuration of the second embodiment of the present invention has been described above. Next, with reference to FIG. 11, the operation of the second exemplary embodiment of the present invention is organized.

  FIG. 11 is a flowchart showing the operation of the second exemplary embodiment of the present invention. The processing of S101 to S107 shown in FIG. 11 is substantially the same as the processing of S101 to S107 described with reference to FIG.

  When the communication device 22A and the communication device 22B stop outputting the environmental sound from the sound output unit 224 (S107), the sound collected by the sound input / output unit 232 of the communication device 22A is transmitted to the communication device 22B (S208). The sound output unit 224 of the communication device 22B outputs the sound (S209). On the other hand, the voice collected by the voice input / output unit 232 of the communication device 22B is transmitted to the communication device 22A (S210), and the voice input / output unit 232 of the communication device 22A outputs the voice (S211).

  After that, when it is determined by the dialogue determination unit 270 of the communication device 22B that the member using the communication device 22B has started the dialogue (S212), the control unit 252 determines the output destination of the voice received from the communication device 22A. The sound output unit 224 is switched to the sound input / output unit 232 (S213). Thereafter, a dialogue is performed via the voice input / output unit 232 of the communication device 22A and the voice input / output unit 232 of the communication device 22B (S214).

  Thereafter, the processing of S113 to S117 described with reference to FIG. 7 is performed, and the states of the communication device 22A and the communication device 22B become equal to the states of the communication device 22A and the communication device 22B in S101.

(effect)
As described above, according to the second embodiment of the present invention, after the conversation state is established, a conversation partner who does not notice the conversation state can be called by the voice of the member who requested the conversation. That is, it is possible to make a call with the voice of the member who requested the dialogue, instead of a call with an inorganic notification sound. For this reason, the conversation partner can recognize the conversation requesting member before viewing the video of the conversation requesting member.

  Further, since the voice output destination of the dialogue requesting member is automatically switched to the voice input / output unit 232 based on the judgment by the dialogue judgment unit 270, the dialogue partner does not need to operate a response button or the like, and operability is improved. good.

<3. Modification>
The embodiments of the present invention have been described above. Hereinafter, some modifications of the embodiment of the present invention will be described. In addition, each modification demonstrated below may be applied to embodiment of this invention independently, and may be applied to embodiment of this invention in combination. Each modification may be applied instead of the configuration described in the embodiment of the present invention, or may be additionally applied to the configuration described in the embodiment of the present invention.

(First modification)
In the first embodiment, an example in which a notification sound is output based on a call operation performed by a member who has requested the conversation has been described. However, the trigger for outputting the notification sound is not limited to the call operation. For example, the communication device 20 on the incoming side may include the dialogue determination unit 270 described in the second embodiment, and intermittently output a notification sound until the start of the dialogue is determined.

(Second modification)
In the embodiment of the present invention, since the dialogue state is established regardless of whether there is a response from the other party, the ring tone is not essential, but the communication device 20 on the dialogue request receiving side receives the dialogue request. You may output the ringtone of a short time (for example, within 2 second) or a small volume (for example, a volume smaller than a notification sound). According to such a configuration, when receiving a dialogue request, a member on the dialogue request receiving side can notice the dialogue state, and it is possible to suppress adverse influences on the surroundings if the incoming tone is short or low in volume.

(Third Modification)
A communication device in which the functions of both the first embodiment and the second embodiment described above are combined can also be realized. The communication apparatus can output both a call by notification sound and a call by voice before the start of the dialogue. Or the said communication apparatus may validate either the function of 1st Embodiment or the function of 2nd Embodiment by the user's liking of the said communication apparatus, the condition of a dialogue other party, or a base.

(Fourth modification)
In the second embodiment, the dialog determining unit 270 of the communication device 22 on the dialog request receiving side has described the example of determining the start of the dialog from the video or audio of the member receiving the dialog request. The determination 270 may be performed by other methods. For example, the dialogue determination unit 270 may determine the start of the dialogue based on the volume of the voice of the member received from the communication requesting communication device 22. Specifically, when the sound volume of the member's voice falls below a threshold value for a certain period of time, it is considered that the call has ended, so it may be determined that the member receiving the dialogue request has started dialogue. Here, the certain period of time is a time lag that occurs from when the member on the dialog request receiving side notices the call to when the conversation starts. Further, the control unit 252 may switch the voice output destination of the dialogue request source member to the voice input / output unit 232 when a predetermined time has elapsed since the establishment of the dialogue state.

<4. Hardware configuration>
The embodiments of the present invention have been described above. Information processing such as video processing and audio processing described above is realized by cooperation of software and hardware of the communication device 20 described below.

  FIG. 12 is a block diagram illustrating a hardware configuration of the communication device 20. The communication device 20 includes a CPU (Central Processing Unit) 201, a ROM (Read Only Memory) 202, a RAM (Random Access Memory) 203, and a host bus 204. The communication device 20 includes a bridge 205, an external bus 206, an interface 207, an input device 208, a display device 209, an audio output device 210, a storage device (HDD) 211, a drive 212, and a network interface. 215.

  The CPU 201 functions as an arithmetic processing device and a control device, and controls the overall operation in the communication device 20 according to various programs. Further, the CPU 201 may be a microprocessor. The ROM 202 stores programs used by the CPU 201, calculation parameters, and the like. The RAM 203 temporarily stores programs used in the execution of the CPU 201, parameters that change as appropriate during the execution, and the like. These are connected to each other by a host bus 204 including a CPU bus. Functions of the control unit 250 (252), the notification sound generation unit 260, the dialogue determination unit 270, and the like can be realized by cooperation of the CPU 201, the ROM 202, the RAM 203, and the software.

  The host bus 204 is connected to an external bus 206 such as a PCI (Peripheral Component Interconnect / Interface) bus via a bridge 205. Note that the host bus 204, the bridge 205, and the external bus 206 are not necessarily configured separately, and these functions may be mounted on one bus.

  The input device 208 generates input signals based on input by members, such as a mouse, keyboard, touch panel, buttons, microphones, sensors, switches, and levers, and inputs that are input by the members and outputs them to the CPU 201. It consists of a control circuit. A member who uses the communication device 20 can input various data and instruct a processing operation to the communication device 20 by operating the input device 208. The input device 208 corresponds to the operation unit 222, for example.

  The display device 209 includes, for example, a display device such as a CRT (Cathode Ray Tube) display device, a liquid crystal display (LCD) device, a projector device, an OLED (Organic Light Emitting Diode) device, and a lamp. The display device 209 corresponds to the video output unit 221, for example. The audio output device 210 includes an audio output device such as a speaker and headphones. The audio output device 210 corresponds to, for example, the sound output unit 224 and the audio input / output unit 232.

  The storage apparatus 211 is a data storage apparatus configured as an example of a storage unit of the communication apparatus 20 according to the present embodiment. The storage device 211 may include a storage medium, a recording device that records data on the storage medium, a reading device that reads data from the storage medium, a deletion device that deletes data recorded on the storage medium, and the like. The storage device 211 is configured by, for example, a hard disk drive (HDD), a solid storage drive (SSD), or a memory having an equivalent function. The storage device 211 drives a storage and stores programs executed by the CPU 201 and various data.

  The drive 212 is a storage medium reader / writer, and is built in or externally attached to the communication device 20. The drive 212 reads information recorded on a removable storage medium 24 such as a mounted magnetic disk, optical disk, magneto-optical disk, or semiconductor memory, and outputs the information to the RAM 203 or the storage device 211. The drive 212 can also write information to the removable storage medium 24.

  The network interface 215 is a communication interface configured by a communication device for connecting to the network 12, for example. The network interface 215 may be a wireless LAN (Local Area Network) compatible communication device or a wire communication device that performs wired communication.

<5. Conclusion>
As described above, according to the embodiment of the present invention, it is possible to establish a conversation state without hindering the concentration of surrounding members by a ring tone. Furthermore, after the dialogue state is established, a call can be made to the conversation partner who is not aware of the dialogue state by a notification sound or voice. For this reason, it is possible for the conversation partner to notice the conversation state by the notification sound or voice and to start the conversation smoothly.

  Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention pertains can come up with various changes or modifications within the scope of the technical idea described in the claims. Of course, it is understood that these also belong to the technical scope of the present invention.

  For example, the embodiment of the present invention can be applied not only to a telework system between offices but also to various forms of telework such as homes and offices of members who work from home, and homes of members who work from home. .

  In the above embodiment, an example in which the communication device 20 and the work terminal 30 are configured separately has been described. However, the function of the communication device 20 is implemented in another information processing device such as the work terminal 30. Also good.

  In the above-described embodiment, an example in which both the bird's-eye view video and the environmental sound are shared between the bases has been described. However, the bird's-eye view video is not shared between the bases, and the environmental sound may be shared. Similarly, in the conversation state, the member's video may not be communicated but the member's voice may be communicated.

  Further, each step in the processing of the remote communication system of the present specification does not necessarily have to be processed in time series in the order described as a flowchart. For example, each step in the processing of the remote communication system may be processed in an order different from the order described as the flowchart, or may be processed in parallel.

  In addition, it is possible to create a computer program for causing hardware such as the CPU 201, the ROM 202, and the RAM 203 built in the communication device 20 to perform the same functions as the components of the communication device 20 described above. A storage medium storing the computer program is also provided.

DESCRIPTION OF SYMBOLS 10 Imaging device 12 Network 20, 22 Communication device 30 Work terminal 120 Overhead video input unit 130 Environmental sound input unit 140 Communication unit 220 Operation display unit 221 Video output unit 222 Operation unit 224 Sound output unit 228 Video input unit 232 Audio input / output Unit 240 communication unit 250, 252 control unit 260 notification sound generation unit 270 dialogue determination unit

Claims (12)

A communication device,
A receiving unit for receiving a dialogue request from another communication device;
A control unit that starts output control of video and audio received from the other communication device after the reception of the dialogue request by the receiving unit, regardless of whether or not the user of the communication device has responded to the dialogue request When,
With
The said control part is a communication apparatus which controls the notification by a calling sound after the said output control is started.   The communication device according to claim 1, wherein the control unit controls notification by the calling sound according to an instruction from the other communication device. The communication device
A dialog determining unit that determines whether the user of the communication device has started a dialog;
The communication device according to claim 1, wherein the control unit repeatedly controls notification by the calling sound until the dialog determination unit determines that a user of the communication device has started the dialog.   The communication according to any one of claims 1 to 3, wherein the control unit starts the output control without performing notification by the sound of the dialogue request after receiving the dialogue request by the receiving unit. apparatus. The communication device
A first sound output unit;
A second sound output unit;
A dialog determination unit that determines whether a user of the communication device has started a dialog;
With
In the output control, the control unit causes the first sound output unit to output a sound received from the other communication device, and determines that the user of the communication device has started the dialog by the dialog determination unit. 3. The communication device according to claim 1, further comprising: outputting a sound received from the other communication device to the second sound output unit.   The communication device according to claim 5, wherein the second sound output unit is provided in a handset.   The control unit starts transmission control of the input image and input sound to the communication device together with the start of output control of video and audio received from the other communication device, The communication apparatus as described in any one of Claims 1-6.   The control unit controls the output of the overhead view video including the user of the other communication device before receiving the dialogue request, and stops the control of the output of the overhead view video based on the reception of the dialogue request. The communication apparatus according to any one of claims 1 to 7.   The control unit controls the output of the environmental sound on the side of the other communication device before the reception of the dialog request, and stops the control of the output of the environmental sound based on the reception of the dialog request. The communication apparatus as described in any one of Claims 1-8. A method performed by a communication device, comprising:
Receiving a dialog request from another communication device;
After receiving the dialogue request, regardless of the presence or absence of a response to the dialogue request by a user of the communication device, starting output control of video and audio received from the other communication device;
Controlling notification by a call sound after the start of the output control;
Including a method. Computer
A communication device,
A receiving unit for receiving a dialogue request from another communication device;
A control unit that starts output control of video and audio received from the other communication device after the reception of the dialogue request by the receiving unit, regardless of whether or not the user of the communication device has responded to the dialogue request When,
With
The said control part is a program for functioning as a communication apparatus which controls the notification by the sound of a call after the said output control is started. A communication device,
A receiving unit for receiving a dialogue request from another communication device;
A control unit for starting output control of a voice received from the other communication device, regardless of whether or not there is a response to the dialogue request by a user of the communication device after receiving the dialogue request by the receiving unit;
With
The said control part is a communication apparatus which controls the notification by a calling sound after the said output control is started.

Images