JP7685071B2 - COMMUNICATION SYSTEM, INFORMATION PROCESSING APPARATUS, INFORMATION PROCESSING METHOD, PROGRAM, AND RECORDING MEDIUM - Google Patents

Description

The present invention relates to a communication system, an information processing device, an information processing method, a program, and a recording medium, for example, a communication system, an information processing device, an information processing method, a program, and a recording medium for providing video from a mobile body to the outside.

There is a communication system that communicates between an onboard device installed in a vehicle and an external terminal located outside the vehicle. For example, Patent Document 1 discloses a system in which a voice call is made between the driver of the vehicle and the operator of the external terminal, and while the voice call is being made, video data showing an image in front of the vehicle is transmitted from the onboard device to the external terminal, and the image is displayed on the external terminal (for example, Patent Document 1).

JP 2016-213791 A

In the above-mentioned communication system, exterior video captured outside the vehicle and interior video captured inside the vehicle are switched as appropriate and transmitted from the in-vehicle unit to an external terminal. Such video switching is performed by the driver operating the in-vehicle unit. However, the driver of the vehicle can only operate the operation section of the in-vehicle unit when the vehicle is stopped, and cannot operate it while driving. Therefore, there was a problem in that the video could not be switched while the vehicle was moving.

The present invention has been made in consideration of the above-mentioned points, and one of its objectives is to provide a communication system that transmits video from an in-vehicle unit to an external terminal, and that is capable of switching between transmitting external video and internal video while the vehicle is traveling.

The invention described in claim 1 is a communication system for audio-video communication in which audio and video in a vehicle acquired by a first device moving with the vehicle are sequentially transmitted to a second device, and the system has a video transmission unit that transmits to the second device either an in-camera video, which is video captured inside the vehicle, or an out-camera video, which is video captured outside the vehicle, and the video transmission unit switches the video to be transmitted to either the in-camera video or the out-camera video based on a switching request in response to an operation of the second device while the vehicle is traveling.

The invention described in claim 7 is an information processing device that performs audio-video communication by receiving video captured in a vehicle and audio from vehicle occupants from a first device traveling with the vehicle and sequentially transmitting the video to a second device, the information processing device having an image acquisition unit that acquires in-camera video, which is video captured inside the vehicle, and out-camera video, which is video captured outside the vehicle, and an image transmission unit that transmits either the in-camera video or the out-camera video to the second device, the image transmission unit switching the video to be transmitted to either the in-camera video or the out-camera video based on a switching request in response to an operation of the second device while the vehicle is traveling.

1 is an overall configuration diagram of a communication system according to a first embodiment; 1 is a diagram showing a configuration of a front seat portion of a vehicle according to a first embodiment; 1 is a diagram showing a configuration of a terminal device 20 according to a first embodiment and a display mode when an outer camera image is displayed. 2 is a diagram showing a configuration of a terminal device 20 according to a first embodiment and a display mode when an in-camera image is displayed; FIG. 1 is a block diagram of an in-vehicle device according to a first embodiment; FIG. 2 is a block diagram of a server according to the first embodiment. FIG. 11 is a diagram illustrating an example of setting information stored in a user DB. FIG. 11 is a diagram illustrating another example of setting information stored in a user DB. FIG. 2 is a block diagram of a terminal device according to the first embodiment. 4 is a flowchart showing an audio/video transmission processing routine executed by the in-vehicle device. 13 is a flowchart showing an audio/video transmission processing routine executed by the server.

A preferred embodiment of the present invention will be described in detail below. In the following description of the embodiment and in the accompanying drawings, the same reference numerals are used to refer to substantially the same or equivalent parts.

1 is an overall configuration diagram of a communication system 100 according to the present embodiment. As shown in FIG. 1, the communication system 100 is configured by connecting an in-vehicle device 10, a terminal device 20, and a server 30 mounted on a vehicle M as a moving body via a network NW.

In this embodiment, the in-vehicle device 10 and the server 30 are connected via a network NW, and the terminal device 20 and the server 30 are connected via the network NW. In other words, the in-vehicle device 10 and the terminal device 20 are configured to be able to transmit and receive information via the server 30.

The network NW is a network that communicates via a mobile communication network via a connection to a base station such as LTE (Long Term Evolution), 4G (4th Generation) or 5G (5th Generation: fifth generation mobile communication system).

2 is a diagram showing the front seat portion of a vehicle M in which an in-vehicle device 10 according to the first embodiment is mounted. The in-vehicle device 10 is connected to an exterior camera 11, an interior camera 12, a GPS receiver 13, a microphone 14, a touch panel display 15, and a speaker 16, which are installed in the vehicle M, and includes a control unit that controls these. The in-vehicle device 10 is disposed, for example, in the center of a dashboard DB in the front seat of the vehicle M.

The exterior camera 11 as the first imaging unit is an imaging device that captures images of the external situation of the vehicle M. In this embodiment, the exterior camera 11 is a wide-angle camera that captures an image of a wide area in front of the vehicle M through the windshield FG. In this embodiment, the exterior camera 11 is disposed on the dashboard DB.

The interior camera 12 as the first imaging unit is an imaging device that captures images of the interior of the vehicle M. In this embodiment, the interior camera 12 is a camera that captures images of the driver of the vehicle M. In this embodiment, the interior camera 12 is provided on the upper end of the windshield FG or on the ceiling near the upper end.

In addition, the above-mentioned exterior vehicle camera 11 and interior vehicle camera 12 may be a multi-directional camera capable of capturing images of the exterior of vehicle M and images of the interior of vehicle M with a single camera as the first imaging unit.

The GPS receiver 13 is a receiver that receives signals (GPS signals) from GPS (Global Positioning System) satellites. In this embodiment, the GPS receiver 13 is arranged on the dashboard DB.

The microphone 14 as the first sound collection unit is a voice input device that receives sounds inside the vehicle, such as voices emitted by the driver or passengers of the vehicle M (hereinafter collectively referred to as passengers), and converts them into electrical signals. In this embodiment, the microphone 14 is arranged on the dashboard DB.

The touch panel display 15 as the first display unit is a display device that combines a display that displays a screen based on the control of the in-vehicle device 10 and a touch panel that accepts input operations from the occupants of the vehicle M. In this embodiment, the touch panel display 15 is disposed in the center of the dashboard DB.

The touch panel display 15 displays, for example, a navigation image in which the current position of the vehicle M (hereinafter also referred to as the current position) and the planned travel route (hereinafter also referred to as the travel route) are superimposed on a map.

The speaker 16 as the first sound output unit is an audio output device that outputs sound based on an electrical signal transmitted from the outside. In this embodiment, the speaker 16 is provided on each of the two A-pillars AP.

In this embodiment, an occupant of vehicle M can make voice calls with an operator of terminal device 20 (hereinafter also referred to as user) via a microphone 14 and a speaker 16 connected to the in-vehicle device 10.

The positions of the in-vehicle device 10, exterior camera 11, interior camera 12, GPS receiver 13, microphone 14, touch panel display 15 and speaker 16 in the front seat portion of the vehicle M described above are merely examples, and they may be arranged in other positions.

For example, the exterior vehicle camera 11 may be installed anywhere as long as it is capable of capturing images of the situation in front of the vehicle M, and may be installed at the top edge of the windshield FG or on the ceiling near the top edge.

In this embodiment, the in-vehicle device 10 sequentially transmits video information of the "out-camera video", which is an external video of the vehicle M captured by the exterior camera 11, and the "in-camera video", which is an internal video of the vehicle M captured by the interior camera 12, to the server 30.

In addition, the server 30, which receives the video information transmitted from the in-vehicle device 10, transmits (i.e., transfers) one of the received "out-camera video" and "in-camera video" to the terminal device 20. At that time, information about which video is currently being transmitted to the terminal device 20 is notified from the server 30 to the in-vehicle device 10, and is displayed on the touch panel display 15 of the in-vehicle device 10. This allows the passengers of the vehicle M to know which of the in-camera video and the out-camera video is being displayed on the terminal device 20.

Figure 3 is a diagram showing the configuration of the terminal device 20 and the display mode of the image displayed on the terminal device 20. Here, an example is shown in which the out-camera image is displayed.

The terminal device 20 is a communication device including a frame F and a microphone 21, a speaker 22, and a touch panel display 23 housed in the frame F. In this embodiment, the terminal device 20 is a smartphone capable of communicating with others via communication.

The microphone 21 as the second sound collection unit is a voice input device that receives voice uttered by the user of the terminal device 20 and converts it into an electrical signal. The microphone 21 is provided on one end side of the terminal device 20.

The speaker 22, which serves as the sound output unit or the second sound output unit, is an audio output device that outputs sound based on an electrical signal transmitted from the outside. The speaker 22 is provided on the other end side of the terminal device 20.

The first sound information indicating the sound collected by the microphone 14 as the first sound collection unit of the above-mentioned in-vehicle device 10 is output as sound from the speaker 22 as the sound output unit by the control unit of the terminal device 20. In other words, the control unit of the terminal device 20 is a sound output control unit that controls the speaker 22 to output the sound collected in the vehicle M as the moving body sound.

The second sound information indicating the sound collected by the microphone 21 as the second sound collection unit is output as sound from the speaker 16 as the first sound output unit by the control unit of the above-mentioned in-vehicle device 10.

The touch panel display 23 as the display unit or the second display unit is a display device that combines a display that displays a screen based on the control of the terminal device 20 and a touch panel that accepts input operations from the user of the terminal device 20. The touch panel display 23 is provided in the center of the terminal device 20.

In this embodiment, the operator of the terminal device 20 is configured to be able to make voice calls with the driver of the vehicle M in which the in-vehicle device 10 is installed via the microphone 21 and speaker 22 described above.

In this embodiment, the terminal device 20 sequentially receives the video information transmitted from the in-vehicle device 10 via the server 30. Specifically, the terminal device 20 sequentially receives the video information of the in-camera video or the out-camera video captured in the vehicle M from the in-vehicle device 10 via the server 30.

As described above, in this embodiment, the communication system 100 is configured to enable a driver of the vehicle M equipped with the on-board device 10 and an operator of the terminal device 20 to communicate with each other by voice. Also, in this embodiment, the communication system 100 is configured to enable real-time display of an image of the outside or inside of the vehicle M captured by the exterior camera 11 on the touch panel display 23 of the terminal device 20.

In other words, the communication system 100 is configured to enable the in-vehicle device 10 to perform live streaming to the terminal device 20.

In this embodiment, a communication form in which audio communication is established between the in-vehicle device 10 and the terminal device 20 while transmitting video of the outside or inside of the vehicle M from the in-vehicle device 10 to the terminal device 20 in real time is referred to as audio-visual communication here. In this embodiment, the in-vehicle device 10 and the terminal device 20 perform audio-visual communication via the server 30. This audio-visual communication allows a user using the terminal device 20 to experience a virtual passenger (hereinafter referred to as "VP") who is virtually riding in the vehicle M.

The image received by the terminal device 20 is displayed on the touch panel display 23. For example, as shown in FIG. 3, the first display area A1 displays an out-camera image, which is an image captured outside the vehicle M. The second display area A2 displays a switch button SB for switching whether the image displayed in the first display area A1 is the out-camera image or the in-camera image. For example, when the out-camera image is displayed and the user wants to switch the image to the in-camera image, the user operates (tap) the switch button SB. In response to the operation of the switch button SB, the terminal device 20 transmits a switch request, which is a signal requesting the image to be switched, to the server 30. In the following description, whether the image is the out-camera image or the in-camera image is also simply referred to as the "type of image".

Figure 4 is a diagram showing the configuration of the terminal device 20 and the display mode when the in-camera image is displayed. The in-camera image, which is an image captured inside the vehicle M, is displayed in the first display area A1, and the switching button SB is displayed in the second display area A2.

Next, the configuration of each of the in-vehicle device 10, server 30 and terminal device 20 that constitute the communication system 100 will be explained with reference to Figures 5 to 7.

Figure 5 is a block diagram showing the configuration of the in-vehicle device 10. The control unit 17 is a processing device including a CPU (Central Processing Unit) and RAM (Random Access Memory).

The memory unit 18 is a storage device that stores and manages data necessary for processing by the control unit 17. The memory unit 18 is composed of storage devices such as a hard disk, a flash memory, and an SSD (Solid State Drive). The memory unit 18 stores map data.

The communication unit 19 is a communication device that transmits and receives data to and from external devices according to instructions from the control unit 17. The communication unit 19 includes, for example, a NIC (Network Interface Card) for connecting to the network NW. The communication unit 19 functions as a transmission unit that transmits, for example, audio acquired in the vehicle M, in-vehicle images of the vehicle M, outside-vehicle images, and current location information of the vehicle M to the server 30.

Figure 6 is a block diagram showing the configuration of the server 30. The control unit 31 is a processing device including a CPU and RAM.

The communication unit 32 is a communication device that transmits and receives data with external devices according to instructions from the control unit 31. The communication unit 32 includes, for example, a NIC for connecting to the network NW.

The communication unit 32 functions as a receiving unit that receives, for example, images of the outside and inside of the vehicle M, audio acquired inside the vehicle M, and information on the current location of the vehicle M from the in-vehicle device 10. The communication unit 32 also functions as a transmitting unit that transmits, for example, images of the outside and inside of the vehicle M, and audio acquired inside the vehicle M to the terminal device 20.

The memory unit 33 is a storage device that stores and manages data necessary for processing by the control unit 31. The memory unit 33 is composed of storage devices such as a hard disk, a flash memory, an SSD, etc.

The memory unit 33 has a user database 331 (hereinafter referred to as user DB 331) that stores information on users (hereinafter referred to as registered users) who are registered as users of the terminal device for audiovisual communication, and setting information regarding whether or not video switching is permitted for each registered user.

7 is a diagram showing an example of setting information stored in user DB 331. User DB 331 stores, for each registered user, an initial setting as to whether the image displayed in audiovisual communication is the in-camera image or the out-camera image, and setting information as to whether the image can be switched (i.e., whether switching is permitted or not).

Figure 8 is a diagram showing another example of setting information stored in user DB 331. User DB 331 stores setting information for each registered user as to whether the image to be displayed is to be able to display only the in-camera image, to be able to display only the out-camera image, or to be able to display both. If it is set to be able to display both, image switching is permitted. On the other hand, if it is set to be able to display only the in-camera image or only the out-camera image, image switching is not permitted.

The setting as to whether or not video switching is permitted is set in advance before audio-video communication begins by the user of the in-vehicle device (e.g., the driver of vehicle M) who performs audio-video communication using the in-vehicle device 10. For example, the driver of vehicle M operates the touch panel 23 of the in-vehicle device 10 to input a setting as to whether or not video switching is permitted for a specific user on the terminal device side (or whether the in-camera video or the out-camera video is to be displayed). The in-vehicle device 10 transmits the input setting information to the server 30. The server 30 receives the setting information and stores it in the user DB 331 (i.e., updates the setting information in the user DB 331).

Next, we will explain the functional blocks of the control unit 31. Each functional block is formed, for example, by the control unit 31 reading and executing a program stored in the memory unit 33.

The video information acquisition unit 34 is a functional block that acquires video information sequentially transmitted from the in-vehicle device 10 via the communication unit 32. Specifically, the video information acquisition unit 34 acquires the in-vehicle video (in-camera video) and the outside-vehicle video (out-camera video) of the vehicle M transmitted from the in-vehicle device 10 as video information.

The vehicle information acquisition unit 35 is a functional block that sequentially acquires current location information sequentially transmitted from the in-vehicle device 10, i.e., the current location information of the vehicle M.

The video transmission unit 36 transmits (transfers) one of the in-vehicle video and the outside-vehicle video acquired by the video information acquisition unit 34 to the terminal device 20 via the communication unit 32.

In addition, when the video transmission/reception unit 36 receives a switching request from the terminal device 20 via the communication unit 32, it switches the type of video to be transmitted to the terminal device 20 (i.e., in-vehicle video or outside-vehicle video).

The control unit 31 notifies the in-vehicle device 10 of information specifying whether the video being transmitted to the terminal device 20 by the video transmission unit 36 is an in-camera video or an out-camera video. In other words, the control unit 31 functions as a notification control unit that causes the in-vehicle device 10 to notify the type of video being transmitted to the terminal device 20.

When the video transmission/reception unit 36 switches the type of video in response to a switching request from the terminal device 20, the control unit 31 notifies the in-vehicle device 10 via the communication unit 32 that the type of video displayed on the terminal device 20 has switched. As described above, the touch panel display 15 of the in-vehicle device 10 displays information about whether the video currently being displayed on the terminal device 20 is the in-camera video or the out-camera video, and the display of this information is also updated based on the notification from the server 30.

The switching possibility determination unit 37 is a functional block that determines whether or not to permit the video transmission unit 36 to switch the type of video transmitted to the terminal device 20 in response to a distance change request from the terminal device 20. For example, when audio-video communication is established between the in-vehicle device 10 and the terminal device 20, the switching possibility determination unit 37 determines whether or not to permit video switching by reading setting information from the user DB 331.

The control unit 31 of the server 30 displays the switching button SB on the touch panel display 23 of the terminal device 20 only when the switching possibility determination unit 37 has determined that video switching is permitted. The video transmission unit 36 receives a switching request transmitted from the terminal device 20 in response to the operation of the switching button SB via the communication unit 32, and switches the video to be transmitted. On the other hand, when the switching possibility determination unit 37 has determined that video switching is not permitted, the switching button SB is not displayed on the touch panel display 23 of the terminal device 20.

Figure 9 is a block diagram showing the configuration of the terminal device 20. The control unit 24 is a processing device including a CPU and RAM.

The communication unit 25 is a communication device that transmits and receives data with external devices in accordance with instructions from the control unit 24. The communication unit 25 includes, for example, a NIC for connecting to the network NW.

The communication unit 25 functions as a receiving unit that receives, for example, an image of the outside of the vehicle M or an image of the inside of the vehicle M from the server 30. The communication unit 25 also functions as a transmitting unit that transmits information corresponding to an operation input using the touch panel display 23 to the server 30.

As described above, if the user of terminal device 20 is a registered user who is permitted to switch between the in-camera image and the out-camera image, a reception display (e.g., a switch button SB shown in Figures 3 and 4) that accepts an operation for a request to switch the image is displayed on the touch panel display 23 of terminal device 20 along with the in-camera image or the out-camera image. In response to the user's operation of the reception display, a switch request is transmitted to server 30 via communication unit 25.

Next, an example of the specific operation of each of the in-vehicle device 10, the terminal device 20, and the server 30 in this embodiment will be explained using a flowchart.

Figure 10 is a flowchart showing the audio/video transmission processing routine REX1 executed by the control unit 17 of the in-vehicle device 10.

The control unit 17 determines whether an audio/video communication connection between the in-car device 10 and the terminal device 20 has been established and whether audio/video communication has started (STEP 101). If the control unit 17 determines that audio/video communication has not started (STEP 101: NO), it ends the audio/video transmission processing routine REX1.

On the other hand, when it is determined that audio-visual communication has started (STEP 101: YES), the control unit 17 sequentially transmits to the server 30 the image of the exterior of the vehicle M captured by the exterior camera 11, the image of the interior of the vehicle M captured by the interior camera 12, and the audio input via the microphone 14 (STEP 102).

The control unit 17 determines whether the audiovisual communication has ended (STEP 103). If it determines that the audiovisual communication has not ended (STEP 103: NO), the control unit 17 returns to STEP 102 and repeats the transmission of video and audio. On the other hand, if it determines that the audiovisual communication has ended (STEP 103: YES), the control unit 17 stops the transmission of video and audio (STEP 104) and ends the process.

The control unit 17 of the in-vehicle device 10 continues to transmit video and audio to the server 30 by the above-mentioned audio/video transmission processing routine REX1 as long as audio/video communication between the in-vehicle device 10 and the terminal device 20 continues.

Figure 11 is a flowchart showing the audio/video transmission processing routine REX2 executed by the control unit 31 of the server 30.

The control unit 31 determines whether an audio/video communication connection between the in-car device 10 and the terminal device 20 has been established and whether audio/video communication has started (STEP 201). If the control unit 31 determines that audio/video communication has not started (STEP 201: NO), it ends the audio/video transmission processing routine REX2.

On the other hand, when it is determined that audiovisual communication has started (STEP 201: YES), the switching feasibility determination unit 37 of the control unit 31 reads from the user DB 331 the setting information of the registered user on the terminal device side for the started audiovisual communication, and determines whether or not to permit video switching in response to a switching request from the terminal device 20. Based on the determination result of the switching feasibility determination unit 37, the control unit 31 sets whether or not video switching in the audiovisual communication is permitted (STEP 202).

The video information acquisition unit 34 of the control unit 31 starts sequentially receiving the video and audio transmitted from the in-vehicle device 10 (STEP 202).

The control unit 31 transfers the video and audio received in STEP 202 to the terminal device 20 (STEP 203).

The control unit 31 determines whether or not a video switching request has been received from the terminal device 20 via the communication unit 32 (STEP 204). If it determines that a switching request has not been received (STEP 204: NO), the control unit 31 returns to STEP 202 and continues to receive the video and audio transmitted from the in-vehicle device 10.

On the other hand, if it is determined that a switching request has been received (STEP 204: YES), the video transmission unit 36 of the control unit 31 switches the type of video (in-camera video and out-camera video) to be transmitted to the terminal device 20 (STEP 205).

The control unit 31 determines whether the audiovisual communication has ended (STEP 206). If it determines that the audiovisual communication has not ended (STEP 206: NO), the control unit 31 returns to STEP 202 and continues receiving and transferring video and audio.

On the other hand, if it is determined that the audio-visual communication has ended (STEP 206: YES), the control unit 31 stops receiving and transferring video and audio (STEP 207) and terminates the processing.

As described above, in the communication system 100 of this embodiment, the server 30 switches the video to be transmitted to the terminal device 20 between the in-camera video and the out-camera video in response to a switching request from the terminal device 20. With this configuration, in audio-video communication in which audio and video are transmitted from the in-vehicle device 10 to the terminal device 20, it is possible to switch between transmitting the in-vehicle video and the out-vehicle video while the vehicle is traveling.

In addition, in the communication system 100 of this embodiment, whether or not to switch images in response to a switching request from the terminal device 20 is set for each registered user, and a switching request from the terminal device 20 and switching of images in response thereto are possible only when switching is set to be possible. With this configuration, the type of image that can be transmitted to the terminal device 20 is preset depending on who is the other party in the audio-visual communication, making it possible to protect the privacy of the passengers of the vehicle M as necessary.

Note that the present invention is not limited to the above embodiment. For example, in the above embodiment, the possibility of switching the video is set in advance before the audio-video communication, the setting information is stored in the user DB 331, and when the audio-video communication starts, the setting information is read from the user DB 331 to determine whether or not to switch the video in response to the switching request. However, the possibility of switching the video in response to the switching request from the terminal device 20 may be configured to be changeable during the execution of the audio-video communication. For example, if some change in the situation occurs on the in-vehicle device side after the audio-video communication starts in a state where video switching is possible, the passenger of the vehicle M operates the touch panel display 15 of the in-vehicle device 10 to input a request to disable switching. The in-vehicle device 10 transmits a request corresponding to the input to the server 30, and the server 30 disables video switching from the middle of the audio-video communication based on the request. With this configuration, for example, if a passenger joins the vehicle M while it is traveling and the passenger does not want their face to be shown, it becomes possible to flexibly change whether or not to switch images, such as by preventing the in-camera image from being displayed.

In the above embodiment, an example has been described in which the in-vehicle device 10 transmits both the in-camera video and the out-camera video to the server 30, and the server 30 transfers one of the videos to the terminal device 20. However, at the stage when the in-vehicle device 10 transmits video to the server 30, it may be configured to transmit only one of the in-camera video and the out-camera video to the server 30. In this case, a switching request from the terminal device 20 is transmitted to the in-vehicle device 10 via the server 30, and the in-vehicle device 10 switches the video to be transmitted. In this case, the user database is provided in the memory unit 18 of the in-vehicle device 10, and the setting as to whether or not to switch the video is performed in the in-vehicle device 10.

In the above embodiment, a case has been described in which a switching button is displayed on the touch panel display 23 of the terminal device 20 as a switching request acceptance image only when the user is permitted to switch images based on the setting information stored in the user DB 331. However, in contrast to this, even if switching images is not permitted, the switching button itself may be displayed on the touch panel display 23 of the terminal device 20, and the server 30 may reject the switching request when it is received.

In the above embodiment, as shown in FIG. 2, one vehicle exterior camera 11 and one vehicle interior camera 12 are provided, and one of the outside camera image and the inside camera image is transmitted to the terminal device 20. However, a plurality of outside and inside vehicles may be provided. For example, n outside vehicles cameras and m inside vehicles cameras (m and n are integers of 2 or more) may be provided, and one or more of the first to nth outside camera images and the first to mth inside camera images may be transmitted to the terminal device 20 in response to a switching request from the terminal device 20.

REFERENCE SIGNS LIST 100 Communication system 10 Vehicle-mounted device 11 Vehicle exterior camera 12 Vehicle interior camera 13 GPS receiver 14 Microphone 15 Touch panel display 16 Speaker 17 Control unit 18 Memory unit 19 Communication unit 20 Terminal device 21 Microphone 22 Speaker 23 Touch panel display 24 Control unit 25 Communication unit 30 Server 31 Control unit 32 Communication unit 33 Memory unit 331 User DB
34 Video information acquisition unit 35 Vehicle information acquisition unit 36 Video transmission unit 37 Switching possibility determination unit

Claims (9)

A communication system for audio-visual communication in which audio and video in a vehicle, which are acquired by a first device moving together with the vehicle, are successively transmitted to a second device,
a video transmission unit that transmits to the second device during the audio-video communication one of an in-camera video that is a video of the inside of the vehicle and an out-camera video that is a video of the outside of the vehicle,
the video transmission unit performs video switching to switch the video to be transmitted between the in-camera video or the out-camera video based on a switching request in response to an operation of the second device during the audio-video communication;
The communication system further includes a judgment unit that judges during the audio-video communication whether or not to allow the video transmission unit to switch the video in response to operation of the second device, and the video transmission unit performs the video switching only if permitted by the judgment unit. The communication system according to claim 1, characterized in that the determination unit determines whether to permit the video switching based on who the user of the second device is. The communication system according to claim 2, characterized in that the determination unit determines whether to permit the video switching based on whether or not a specific operation has been performed by the user of the first device. The communication system according to claim 2 or 3, characterized in that when the determination unit determines that the video switching is permitted, the second device displays an operation acceptance display that accepts the video switching operation. The communication system according to any one of claims 1 to 4, characterized in that it includes a notification control unit that causes the first device to notify information specifying whether the video being transmitted by the video transmission unit is the in-camera video or the out-camera video. An information processing device that performs audio-video communication by receiving an image captured in a vehicle and audio from a passenger of the vehicle from a first device that moves with the vehicle and sequentially transmitting the received video to a second device,
an image acquisition unit that acquires an in-camera image that is an image captured inside the vehicle and an out-camera image that is an image captured outside the vehicle;
a video transmission unit that transmits one of the in-camera video and the out-camera video to the second device during audio-video communication;
having
the video transmission unit performs video switching to switch the video to be transmitted between the in-camera video or the out-camera video based on a switching request in response to an operation of the second device during the audio-video communication;
The information processing device further includes a judgment unit that judges during the audio-video communication whether or not to allow the video transmission unit to switch the video in response to operation of the second device, and the video transmission unit performs the video switching only when permitted by the judgment unit. 1. An information processing method executed in an information processing device that performs audio-video communication by receiving an image captured in a vehicle and audio from a passenger of the vehicle from a first device traveling with the vehicle and sequentially transmitting the received video to a second device,
an image information acquisition step of acquiring an in-camera image, which is an image captured inside the vehicle, and an out-camera image, which is an image captured outside the vehicle, in the vehicle;
a video transmission step of transmitting one of the in-camera video and the out-camera video to the second device during audio-video communication;
a video switching step of switching a video to be transmitted to either the in-camera video or the out-camera video based on a switching request in response to an operation of the second device during the audio-video communication;
a determination step of determining, during the audio/video communication, whether or not the video switching in response to an operation of the second device is permitted in the video switching step;
having
An information processing method, comprising the steps of: performing the video switching in the video switching step only if the video switching is permitted in the determining step; an information processing device that performs audio-video communication by receiving an image captured in a vehicle and an audio from a passenger of the vehicle from a first device moving together with the vehicle and sequentially transmitting the received image and audio to a second device;
an image information acquisition step of acquiring an in-camera image, which is an image captured inside the vehicle, and an out-camera image, which is an image captured outside the vehicle, in the vehicle;
a video transmission step of transmitting one of the in-camera video and the out-camera video to the second device during audio-video communication;
a video switching step of switching a video to be transmitted to either the in-camera video or the out-camera video based on a switching request in response to an operation of the second device during the audio-video communication;
a determination step of determining, during the audio/video communication, whether or not the video switching in response to an operation of the second device is permitted in the video switching step;
having
a program for causing a process of switching the video in the video switching step to be executed only if the video switching is permitted in the determining step; an information processing device that performs audio-video communication by receiving an image captured in a vehicle and an audio from a passenger of the vehicle from a first device moving together with the vehicle and sequentially transmitting the received image and audio to a second device;
an image information acquisition step of acquiring an in-camera image, which is an image captured inside the vehicle, and an out-camera image, which is an image captured outside the vehicle, in the vehicle;
a video transmission step of transmitting one of the in-camera video and the out-camera video to the second device during audio-video communication;
a video switching step of switching a video to be transmitted to either the in-camera video or the out-camera video based on a switching request in response to an operation of the second device during the audio-video communication;
a determination step of determining, during the audio/video communication, whether or not the video switching in response to an operation of the second device is permitted in the video switching step;
having
A computer-readable recording medium storing a program for executing a process of performing the video switching in the video switching step only if the video switching is permitted in the determination step.

Images