CN104184982B - Audio/video communication method, system, terminal device and voice and video telephone service centre - Google Patents
Audio/video communication method, system, terminal device and voice and video telephone service centre Download PDFInfo
- Publication number
- CN104184982B CN104184982B CN201310204221.6A CN201310204221A CN104184982B CN 104184982 B CN104184982 B CN 104184982B CN 201310204221 A CN201310204221 A CN 201310204221A CN 104184982 B CN104184982 B CN 104184982B
- Authority
- CN
- China
- Prior art keywords
- audio
- terminal device
- video
- service center
- call service
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Landscapes
- Telephonic Communication Services (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
本发明适用于通信技术领域,提供了一种音视频通信方法、系统、终端设备及音视频通话服务中心,所述方法包括:第一终端设备发送加入请求至音视频通话服务中心,请求加入至音视频通话服务中心的家庭通信终端列表中,家庭通信终端列表中包括第二终端设备;在与对端音视频通信系统建立音视频通话后,第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放;第一终端设备选择所述家庭通信终端列表中的第二终端设备,以便于第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。本发明,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频。
The present invention is applicable to the technical field of communication, and provides an audio and video communication method, system, terminal equipment and audio and video call service center, the method includes: the first terminal equipment sends a join request to the audio and video call service center, and requests to join in In the home communication terminal list of the audio and video call service center, the second terminal device is included in the home communication terminal list; after establishing an audio and video call with the peer audio and video communication system, the first terminal device completes the collection, encoding and audio recording of audio data. Data receiving, decoding, and playing; the first terminal device selects the second terminal device in the home communication terminal list, so that the second terminal device completes video data collection, encoding and video data reception, decoding, and playing. In the present invention, since the second terminal device is a terminal device with a high-quality or wide-angle camera, the terminal devices in family B can conveniently watch the videos of multiple family members in family A.
Description
技术领域technical field
本发明属于通信技术领域,尤其涉及一种音视频通信方法、系统、终端设备及音视频通话服务中心。The invention belongs to the technical field of communication, and in particular relates to an audio and video communication method, system, terminal equipment and an audio and video call service center.
背景技术Background technique
视频通话自产生以来,主要应用在公司企业的视频会议。随着电子技术,信息技术,人们生活水平的提高,视频/音频通话取代传统的语音通话的需求越来越强,通信网络技术的发展,带宽成本越来越低,光纤到家(Fiber To The Home,FTTH)的普及,个人、家庭消费市场的视频通话也将随之普及。Since the video call was produced, it has been mainly used in corporate video conferencing. With the improvement of electronic technology, information technology and people's living standards, the demand for video/audio calls to replace traditional voice calls is getting stronger and stronger. With the development of communication network technology, bandwidth costs are getting lower and lower, and Fiber To The Home (Fiber To The Home) , FTTH) popularization, video calls in the personal and family consumer markets will also be popularized.
现在家庭的智能终端设备很多,有智能机顶盒,多个便携式设备(PortableDevice,PAD),多部智能手机等,任意两台设备之间都能实现视频通话,但是目前,在音视频通话时,终端设备往往只限制在固定的某个终端设备上,这样会导致如下几个问题,大大影响了用户的体验和易用性。Now there are many smart terminal devices in the family, including smart set-top boxes, multiple portable devices (Portable Devices, PADs), multiple smart phones, etc., and video calls can be realized between any two devices, but at present, during audio and video calls, the terminal The device is often limited to a fixed terminal device, which will lead to the following problems, greatly affecting the user experience and ease of use.
1、移动终端视频采集装置分辨率低,终端间音频和视频输入强耦合,无组合能力,易用性差。1. The resolution of the mobile terminal video capture device is low, the audio and video inputs between terminals are strongly coupled, there is no combination capability, and the usability is poor.
PAD或者智能手机等移动通信终端,其前置摄像头拍摄的视频分辨率较低,一般是视频图形阵列(Video Graphics Array,VGA)以下,视频质量较差,那么用PAD或者智能手机打视频电话,对方看不太清楚视频,而要得到质量更高、更清晰的视频,就必须使用后置摄像头,这样自己又看不到对方视频了。采用机顶盒高清摄像头作为视频输入,移动终端语音输入作为音频输入相组合,即可形成高质量的家庭视频通信输入系统。但是目前终端设备间音频和视频输入强耦合,且无组合能力,易用性太差。For mobile communication terminals such as PAD or smart phone, the resolution of the video captured by the front camera is low, generally below the Video Graphics Array (VGA), and the video quality is poor. The other party can't see the video clearly, but to get a higher quality and clearer video, you must use the rear camera, so that you can't see the other party's video. A high-quality home video communication input system can be formed by using the high-definition camera of the set-top box as the video input and the voice input of the mobile terminal as the audio input. However, at present, the audio and video inputs between terminal devices are strongly coupled, and there is no combination capability, and the usability is too poor.
2、作为家庭视频通信视频采集,移动终端视频采集装置图像采集范围过小。2. As a home video communication video collection, the image collection range of the mobile terminal video collection device is too small.
PAD或者智能手机摄像头角度本身就小,且移动终端在通话时手持设备的方便性使得摄像头角度更小,使得在通话时对方不能同时看到家里其他成员的视频。The camera angle of PAD or smart phone itself is small, and the convenience of holding the device when the mobile terminal is talking makes the camera angle even smaller, so that the other party cannot see the video of other members of the family at the same time during the call.
3、主动加入已进行的视频通话的方式,易用性差。3. The way of actively joining the video call that has already been carried out is poor in usability.
用PAD或者智能手机视频通话时,家中其他房间的成员想参与视频通话,该成员只能跑出来拿着该终端设备进行通话,或者让其挂断,该成员身边的终端呼叫对方进行通话,非常不方便。When using a PAD or smart phone to make a video call, if a member in another room of the home wants to participate in the video call, the member can only run out and hold the terminal device to make a call, or ask him to hang up, and the terminal next to the member calls the other party to make a call. inconvenient.
4、邀请成员加入已进行的视频通话的方式,易用性差。4. The method of inviting members to join the video call that has been carried out is not easy to use.
用PAD或者智能手机视频通话时,想要家中其他房间的成员参与音视频通话,只能叫该成员出来拿着该终端设备进行通话,或者让对方挂断,重新呼叫该成员身边的终端设备进行通话,非常不方便。When using a PAD or smart phone to make a video call, if you want members in other rooms in the house to participate in the audio and video call, you can only ask the member to come out and hold the terminal device for the call, or ask the other party to hang up and call the terminal device next to the member to start the call again. Calling is very inconvenient.
上述问题的解决,都要求家庭视频通话时可以按需选择合适终端设备来分别完成音视频通话中的音频采集/视频采集,音频接收播放/视频接收播放。To solve the above problems, it is required that suitable terminal equipment can be selected according to needs to complete audio collection/video collection, audio receiving and playing/video receiving and playing in audio and video calls during home video calls.
现有技术提供的视频通话的技术方案如图1所示,家庭之间进行音视频通话时,A方家庭有甩屏功能,B方也一样可以有,图中忽略。对于A方,手机A通过公网服务器与B方建立信令通道后,A方手机A采集音视频并且编码后通过公网服务器发送给B方手机B。如果手机A和大屏幕终端机顶盒在家庭网内,此时手机A通过公网服务器接收B方手机B的音频和视频数据并渲染出来,手机A可以把接收到B方手机B的视频数据发送给大屏终端(比如机顶盒电视)去解码并渲染。The technical solution of the video call provided by the prior art is shown in Fig. 1. When an audio and video call is made between families, the family of party A has the function of flipping the screen, and the family of party B can also have it, which is ignored in the figure. For party A, after mobile phone A establishes a signaling channel with party B through the public network server, mobile phone A of party A collects audio and video and sends them to mobile phone B of party B through the public network server after encoding. If mobile phone A and the large-screen terminal set-top box are in the home network, mobile phone A receives and renders the audio and video data of party B's mobile phone B through the public network server, and mobile phone A can send the video data received from party B's mobile phone B to Large-screen terminals (such as set-top box TVs) decode and render.
现有的视频通话的技术方案的缺点是:The disadvantages of the existing technical solutions for video calls are:
1、视频通话时,需要的音视频采集发送都固定在一个设备上,使得采集视频数据不能选择家庭内高质量或者广角度的摄像头来完成视频采集。1. During a video call, the required audio and video collection and transmission are all fixed on one device, making it impossible to choose a high-quality or wide-angle camera in the home to complete video collection for video data collection.
2、视频通话时,用户不能实现或者不便于实现看对方家内其他成员视频。2. During a video call, the user cannot or is inconvenient to watch the videos of other members in the other party's home.
3、视频通话时,在本次通话时其他成员不能实现参与通话,也不能实现要求对方家内其他成员一起参与通话。3. During a video call, other members cannot participate in the call during this call, nor can they ask other members of the other party's family to participate in the call together.
发明内容Contents of the invention
本发明实施例提供了一种音视频通信方法、系统、终端设备及音视频通话服务中心,旨在解决现有技术音视频通话时,音视频数据的采集都固定在第一终端设备上,使得不能选择家庭内高质量或者广角度的摄像头来完成视频采集,在家庭音视频通信系统之间进行视频通话时,用户不能实现或者不便于实现看对端家内其他成员视频的问题。Embodiments of the present invention provide an audio-video communication method, system, terminal equipment, and audio-video call service center, aiming to solve the problem that audio-video data collection is fixed on the first terminal equipment during audio-video calls in the prior art, so that It is not possible to choose a high-quality or wide-angle camera in the home to complete video collection. When making a video call between home audio and video communication systems, the user cannot or is not convenient to watch the video of other members in the opposite end of the home.
第一方面,提供一种音视频通信方法,包括:In the first aspect, an audio and video communication method is provided, including:
第一终端设备发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表中,所述家庭通信终端列表中包括第二终端设备;The first terminal device sends a join request to the audio and video call service center, requesting to be added to the family communication terminal list of the audio and video call service center, and the second terminal device is included in the family communication terminal list;
在与对端音视频通信系统建立音视频通话后,所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放;After establishing an audio and video call with the peer audio and video communication system, the first terminal device completes the collection and encoding of audio data and the reception, decoding, and playback of audio data;
所述第一终端设备选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。The first terminal device selects the second terminal device in the home communication terminal list, so that the second terminal device completes collection and encoding of video data and reception, decoding and playing of video data.
在第一方面的第一种可能的实现方式中,所述第一终端设备完成音频数据的采集、编码包括:In a first possible implementation manner of the first aspect, the first terminal device completing the collection and encoding of audio data includes:
所述第一终端设备采集音频数据,并在所述音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心;The first terminal device collects audio data, adds a time stamp to the audio data, encodes it, and sends it to the audio and video call service center;
所述第二终端设备完成视频数据的采集、编码包括:The second terminal device completing the collection and encoding of video data includes:
所述第二终端设备采集视频数据,并在所述视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心。The second terminal device collects video data, adds a time stamp to the video data, encodes it, and sends it to the audio and video call service center.
结合第一方面的第一种可能的实现方式,在第二种可能的实现方式中,在所述第一终端设备采集音频数据,并在所述音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心或者所述第二终端设备采集视频数据,并在所述视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心之前,还包括:With reference to the first possible implementation of the first aspect, in the second possible implementation, audio data is collected at the first terminal device, and a time stamp is added to the audio data, encoded and then sent Collecting video data at the audio and video call service center or the second terminal device, adding a time stamp to the video data, encoding and sending to the audio and video call service center, further includes:
所述第一终端设备与所述音视频通话服务中心、所述第二终端设备之间进行周期性的时钟同步。Periodic clock synchronization is performed between the first terminal device, the audio and video call service center, and the second terminal device.
在第一方面的第三种可能的实现方式中,在所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放的过程中,还包括:In a third possible implementation manner of the first aspect, when the first terminal device finishes collecting and encoding audio data and receiving, decoding, and playing audio data, it further includes:
所述第一终端设备完成视频数据的采集、编码,并发送编码后的视频数据至所述音视频通话服务中心。The first terminal device completes the collection and encoding of video data, and sends the encoded video data to the audio and video call service center.
结合第一方面的第三种可能的实现方式,在第四种可能的实现方式中,在所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放的过程中,还包括:With reference to the third possible implementation manner of the first aspect, in a fourth possible implementation manner, when the first terminal device finishes collecting and encoding audio data and receiving, decoding, and playing audio data, Also includes:
所述第一终端通知所述音视频通话服务中心,由所述第一终端设备接收所述音视频通话服务中心发送的视频数据,并对所述视频数据进行解码、播放。The first terminal notifies the audio and video call service center that the first terminal device receives the video data sent by the audio and video call service center, and decodes and plays the video data.
结合第一方面或第一方面的第一种可能的实现方式或第一方面的第二种可能的实现方式或第一方面的第三种可能的实现方式或第一方面的第四种可能的实现方式,在第五种可能的实现方式中,在所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放或者所述第一终端设备选择所述家庭通信终端列表中的第二终端设备,由所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放的过程中,还包括:In combination with the first aspect or the first possible implementation of the first aspect or the second possible implementation of the first aspect or the third possible implementation of the first aspect or the fourth possible implementation of the first aspect Implementation manner, in the fifth possible implementation manner, the first terminal device completes the collection and encoding of audio data and the reception, decoding, and playback of audio data, or the first terminal device selects the home communication terminal list In the second terminal device, the second terminal device completes the process of video data collection, encoding and video data reception, decoding, and playing, and also includes:
所述第一终端设备发送多方通话邀请指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述多方通话邀请指令通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中;The first terminal device sends a multi-party call invitation instruction to the audio-video call service center, so that the audio-video call service center notifies a third terminal device to participate in the first terminal device and the audio-video call service center according to the multi-party call invitation instruction. During a call between peer audio and video communication systems;
或发送请求加入通话指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述请求加入通话指令使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。Or send a request to join the call instruction to the audio and video call service center, so that the audio and video call service center can make the first terminal device join the third terminal device to communicate with the opposite end audio and video according to the request to join the call instruction In a call between systems.
结合第一方面的第五种可能的实现方式,在第六种可能的实现方式中,所述第一终端设备和第三终端设备是具有音频通话功能的移动终端,所述第二终端设备是具有高质量或者广角度摄像头的终端设备。With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner, the first terminal device and the third terminal device are mobile terminals with an audio call function, and the second terminal device is a End devices with high-quality or wide-angle cameras.
第二方面,提供一种音视频通信方法,包括:In the second aspect, an audio and video communication method is provided, including:
音视频通话服务中心接收第一终端设备和第二终端设备发送的加入请求,将所述第一终端设备和所述第二终端设备加入至家庭通信终端列表中;The audio and video call service center receives the joining requests sent by the first terminal device and the second terminal device, and adds the first terminal device and the second terminal device to the family communication terminal list;
所述音视频通话服务中心在所述第一终端设备与对端音视频通信系统之间建立通信通道;The audio and video call service center establishes a communication channel between the first terminal device and the peer audio and video communication system;
所述音视频通话服务中心接收所述第一终端设备发送的第一音频数据,并转发所述第一音频数据至对端音视频通信系统;The audio and video call service center receives the first audio data sent by the first terminal device, and forwards the first audio data to the peer audio and video communication system;
所述音视频通话服务中心接收对端音视频通信系统发送的第二音频数据并转发所述第二音频至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二音频数据;The audio and video call service center receives the second audio data sent by the peer audio and video communication system and forwards the second audio to the first terminal device, so that the first terminal device can decode and play the second audio data. audio data;
所述音视频通话服务中心接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统;The audio and video call service center receives the first video data sent by the first terminal device from the second terminal device selected in the home communication terminal list, and forwards the first video data to the peer audio and video communication system;
所述音视频通话服务中心接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据。The audio and video call service center receives the second video data sent by the peer audio and video communication system and forwards the second video to the second terminal device, so that the second terminal device can decode and play the second video data. video data.
在第二方面的第一种可能的实现方式中,所述第一音频数据是第一终端设备在采集的音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的,所述第一视频数据是第二终端设备在采集的视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的。In a first possible implementation manner of the second aspect, the first audio data is sent to the audio and video call service center after the first terminal device adds a time stamp to the collected audio data, encodes it, The first video data is sent to the audio and video call service center after the second terminal device adds a time stamp to the collected video data and encodes it.
结合第二方面的第一种可能的实现方式,在第二种可能的实现方式中,在所述音视频通话服务中心接收所述第一终端设备发送的第一音频数据或者在所述接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据之前,还包括:With reference to the first possible implementation manner of the second aspect, in a second possible implementation manner, the audio and video call service center receives the first audio data sent by the first terminal device or receives the first audio data sent by the first terminal device at the receiving second Before the first video data sent by a terminal device from the second terminal device selected in the home communication terminal list, it also includes:
所述音视频通话服务中心与所述第一终端设备、所述第二终端设备之间进行周期性的时钟同步。Periodic clock synchronization is performed between the audio and video call service center and the first terminal device and the second terminal device.
在第二方面的第三种可能的实现方式中,在所述音视频通话服务中心接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据的过程中,还包括:In a third possible implementation manner of the second aspect, when the audio and video call service center receives the first video data sent by the first terminal device from the second terminal device selected in the home communication terminal list, Also includes:
所述音视频通话服务中心接收所述第一终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。The audio and video call service center receives the first video data sent by the first terminal device, and forwards the first video data to the peer audio and video communication system.
在第二方面的第四种可能的实现方式中,在所述音视频通话服务中心接收对端音视频通信系统的终端设备发送的第二视频数据并转发所述第二视频数据至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据之后,还包括:In a fourth possible implementation manner of the second aspect, the audio and video call service center receives the second video data sent by the terminal device of the peer audio and video communication system and forwards the second video data to the first The second terminal device, so that after the second terminal device decodes and plays the second video data, it further includes:
所述音视频通话服务中心接收对端音视频通信系统发送的第二视频数据并转发所述第二视频数据至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二视频数据。The audio and video call service center receives the second video data sent by the peer audio and video communication system and forwards the second video data to the first terminal device, so that the first terminal device can decode and play the second video data. Two video data.
结合第二方面或第二方面的第一种可能的实现方式或第二方面的第二种可能的实现方式或第二方面的第三种可能的实现方式或第二方面的第四种可能的实现方式,在第五种可能的实现方式中,在所述音视频通话服务中心接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据的过程中,还包括:In combination with the second aspect or the first possible implementation of the second aspect or the second possible implementation of the second aspect or the third possible implementation of the second aspect or the fourth possible implementation of the second aspect Implementation manner, in a fifth possible implementation manner, the audio and video call service center receives the second video data sent by the peer audio and video communication system and forwards the second video to the second terminal device, so that In the process of decoding and playing the second video data by the second terminal device, it also includes:
所述音视频通话服务中心根据所述第一终端设备发送的多方通话邀请指令,通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中;或The audio and video call service center notifies the third terminal device to participate in the call between the first terminal device and the peer audio and video communication system according to the multi-party call invitation instruction sent by the first terminal device; or
所述音视频通话服务中心根据所述第一终端设备发送的请求加入通话指令,使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。The audio and video call service center enables the first terminal device to join the call between the third terminal device and the peer audio and video communication system according to the request to join the call instruction sent by the first terminal device.
第三方面,提供一种终端设备,包括:In a third aspect, a terminal device is provided, including:
加入请求发送单元,用于发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表中,所述家庭通信终端列表中包括第二终端设备;A join request sending unit, configured to send a join request to the audio and video call service center, requesting to be added to the home communication terminal list of the audio and video call service center, and the home communication terminal list includes the second terminal device;
音频数据处理单元,用于在与对端音视频通信系统建立音视频通话后,完成音频数据的采集、编码和音频数据的接收、解码、播放;The audio data processing unit is used to complete audio data collection, encoding, and audio data reception, decoding, and playback after establishing an audio and video call with the peer audio and video communication system;
视频设备获取单元,用于选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。The video device acquisition unit is configured to select a second terminal device in the home communication terminal list, so that the second terminal device completes video data collection, encoding, and video data reception, decoding, and playback.
在第三方面的第一种可能的实现方式中,所述音频数据处理单元采集音频数据,并在所述音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心;In a first possible implementation of the third aspect, the audio data processing unit collects audio data, adds a time stamp to the audio data, encodes it, and sends it to the audio and video call service center;
所述视频设备获取单元选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备采集视频数据,并在所述视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心。The video device acquisition unit selects the second terminal device in the home communication terminal list, so that the second terminal device collects video data, adds a time stamp to the video data, encodes it, and sends it to the The audio and video call service center.
结合第一方面的第一种可能的实现方式,在第二种可能的实现方式中,所述终端设备还包括:With reference to the first possible implementation manner of the first aspect, in a second possible implementation manner, the terminal device further includes:
时钟同步单元,用于与所述音视频通话服务中心、所述第二终端设备之间进行周期性的时钟同步。A clock synchronization unit, configured to perform periodic clock synchronization with the audio and video call service center and the second terminal device.
在第三方面的第三种可能的实现方式中,所述终端设备还包括:In a third possible implementation manner of the third aspect, the terminal device further includes:
第一视频数据处理单元,用于完成视频数据的采集、编码,并发送编码后的视频数据至所述音视频通话服务中心。The first video data processing unit is used to complete the collection and encoding of video data, and send the encoded video data to the audio and video call service center.
结合第三方面的第三种可能的实现方式,在第四种可能的实现方式中,所述终端设备还包括:With reference to the third possible implementation manner of the third aspect, in a fourth possible implementation manner, the terminal device further includes:
第二视频数据处理单元,用于接收所述音视频通话服务中心发送的视频数据,并对所述视频数据进行解码、播放。The second video data processing unit is configured to receive the video data sent by the audio and video call service center, and decode and play the video data.
结合第三方面或第三方面的第一种可能的实现方式或第三方面的第二种可能的实现方式或第三方面的第三种可能的实现方式或第三方面的第四种可能的实现方式,在第五种可能的实现方式中,所述终端设备还包括:In combination with the third aspect or the first possible implementation of the third aspect or the second possible implementation of the third aspect or the third possible implementation of the third aspect or the fourth possible implementation of the third aspect Implementation manner, in a fifth possible implementation manner, the terminal device further includes:
多方通话邀请指令/请求加入通话指令发送单元,用于发送多方通话邀请指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述多方通话邀请指令通知第三终端设备参与至所述终端设备与对端音视频通信系统之间的通话中;或A multi-party call invitation instruction/request to join call instruction sending unit, configured to send a multi-party call invitation instruction to the audio and video call service center, so that the audio and video call service center can notify a third terminal device to participate according to the multi-party call invitation instruction to the call between the terminal device and the peer audio and video communication system; or
发送请求加入通话指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述请求加入通话指令使所述终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。Sending a request to join the call instruction to the audio and video call service center, so that the audio and video call service center can join the terminal device between the third terminal device and the peer audio and video communication system according to the request to join the call instruction in the call.
结合第三方面的第五种可能的实现方式,在第六种可能的实现方式中,所述终端设备和第三终端设备是具有音频通话功能的移动终端,所述第二终端设备具有高质量或者广角度摄像头。With reference to the fifth possible implementation of the third aspect, in a sixth possible implementation, the terminal device and the third terminal device are mobile terminals with an audio call function, and the second terminal device has a high-quality Or a wide-angle camera.
第四方面,提供一种音视频通话服务中心,所述音视频通话服务中心包括:In a fourth aspect, an audio and video call service center is provided, and the audio and video call service center includes:
加入请求接收单元,用于接收第一终端设备和第二终端设备发送的加入请求,将所述第一终端设备和所述第二终端设备加入至家庭通信终端列表中;A join request receiving unit, configured to receive join requests sent by the first terminal device and the second terminal device, and add the first terminal device and the second terminal device to the family communication terminal list;
通信通道建立单元,用于在所述第一终端设备与对端音视频通信系统之间建立通信通道;A communication channel establishment unit, configured to establish a communication channel between the first terminal device and the peer audio and video communication system;
第一音频数据处理单元,用于接收所述第一终端设备发送的第一音频数据,并转发所述第一音频数据至对端音视频通信系统;A first audio data processing unit, configured to receive the first audio data sent by the first terminal device, and forward the first audio data to the peer audio and video communication system;
第二音频数据处理单元,用于接收对端音视频通信系统发送的第二音频数据并转发所述第二音频至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二音频数据;The second audio data processing unit is configured to receive the second audio data sent by the peer audio and video communication system and forward the second audio to the first terminal device, so that the first terminal device can decode and play the second audio data;
第一视频数据处理单元,用于接收第二终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统;The first video data processing unit is configured to receive the first video data sent by the second terminal device, and forward the first video data to the peer audio and video communication system;
第二视频数据处理单元,用于接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据。The second video data processing unit is configured to receive the second video data sent by the peer audio and video communication system and forward the second video to the second terminal device, so that the second terminal device can decode and play the Second video data.
在第四方面的第一种可能的实现方式中,所述第一音频数据是第一终端设备在采集的音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的,所述第一视频数据是第二终端设备在采集的视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的。In a first possible implementation manner of the fourth aspect, the first audio data is sent to the audio and video call service center after the first terminal device adds a time stamp to the collected audio data, encodes it, The first video data is sent to the audio and video call service center after the second terminal device adds a time stamp to the collected video data and encodes it.
结合第一方面的第一种可能的实现方式,在第二种可能的实现方式中,所述音视频通话服务中心还包括:With reference to the first possible implementation of the first aspect, in a second possible implementation, the audio and video call service center further includes:
时钟同步单元,用于与所述第一终端设备、所述第二终端设备之间进行周期性的时钟同步。A clock synchronization unit, configured to perform periodic clock synchronization with the first terminal device and the second terminal device.
在第四方面的第三种可能的实现方式中,所述第一视频数据处理单元,还用于接收所述第一终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。In a third possible implementation manner of the fourth aspect, the first video data processing unit is further configured to receive the first video data sent by the first terminal device, and forward the first video data to the Terminal audio and video communication system.
在第四方面的第四种可能的实现方式中,所述第二视频数据处理单元,还用于接收对端音视频通信系统发送的第二视频数据并转发所述第二视频数据至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二视频数据。In a fourth possible implementation manner of the fourth aspect, the second video data processing unit is further configured to receive the second video data sent by the peer end audio and video communication system and forward the second video data to the The first terminal device, so that the first terminal device decodes and plays the second video data.
结合第四方面或第四方面的第一种可能的实现方式或第四方面的第二种可能的实现方式或第四方面的第三种可能的实现方式或第四方面的第四种可能的实现方式,在第五种可能的实现方式中,所述音视频通话服务中心还包括:In combination with the fourth aspect or the first possible implementation of the fourth aspect or the second possible implementation of the fourth aspect or the third possible implementation of the fourth aspect or the fourth possible implementation of the fourth aspect Implementation manner, in a fifth possible implementation manner, the audio and video call service center further includes:
多方通话控制单元,用于根据所述第一终端设备发送的多方通话邀请指令,通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中;或A multi-party call control unit, configured to notify a third terminal device to participate in the call between the first terminal device and the peer audio and video communication system according to the multi-party call invitation instruction sent by the first terminal device; or
根据所述第一终端设备发送的请求加入通话指令,使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。According to the request to join call instruction sent by the first terminal device, the first terminal device is added to the call between the third terminal device and the peer audio-video communication system.
第五方面、提供一种音视频通信系统,所述系统包括如上任一项所述的音视频通话服务中心和与所述音视频通话服务中心分别连接的如上任一项所述的终端设备、具有高质量或者广角度摄像头的终端设备。In the fifth aspect, an audio and video communication system is provided, the system includes the audio and video call service center as described in any one of the above and the terminal devices as described in any of the above respectively connected to the audio and video call service center, End devices with high-quality or wide-angle cameras.
在本发明实施例中,第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频,家庭A内的终端设备可以方便的看到家庭B内多个家庭成员的视频。In the embodiment of the present invention, the first terminal device may select the second terminal device, and the second terminal device replaces the first terminal device to complete video data collection, encoding, and video data reception, decoding, and playback. The terminal device is a terminal device with a high-quality or wide-angle camera. Therefore, when family A makes an audio and video call with the terminal device in family B, the terminal device in family B can easily see the multiple family members in family A. Members' videos, terminal devices in family A can easily view the videos of multiple family members in family B.
附图说明Description of drawings
图1是现有技术提供的家庭音视频通信系统的拓扑结构示意图;Fig. 1 is a schematic diagram of the topology of a home audio-video communication system provided by the prior art;
图2是本发明实施例一提供的音视频通信方法的实现流程图;FIG. 2 is a flow chart of the implementation of the audio and video communication method provided by Embodiment 1 of the present invention;
图3是本发明实施例二提供的音视频通信方法的实现流程图;FIG. 3 is a flowchart for realizing the audio and video communication method provided by Embodiment 2 of the present invention;
图4是本发明实施例三提供的音视频通信方法的实现流程图;FIG. 4 is a flow chart of the implementation of the audio and video communication method provided by Embodiment 3 of the present invention;
图5是本发明实施例四提供的音视频通信方法的实现流程图;FIG. 5 is a flowchart for realizing the audio and video communication method provided by Embodiment 4 of the present invention;
图6是本发明实施例五提供的终端设备的具体结构框图;FIG. 6 is a specific structural block diagram of a terminal device provided in Embodiment 5 of the present invention;
图7是本发明实施例六提供的音视频通话服务中心的具体结构框图;FIG. 7 is a specific structural block diagram of an audio and video call service center provided in Embodiment 6 of the present invention;
图8是本发明实施例七提供的音视频通信系统的具体结构框图;FIG. 8 is a specific structural block diagram of the audio and video communication system provided by Embodiment 7 of the present invention;
图9是本发明实施例八提供的音视频通信系统的具体结构框图。Fig. 9 is a specific structural block diagram of the audio and video communication system provided by the eighth embodiment of the present invention.
具体实施方式Detailed ways
为了使本发明的目的、技术方案及优点更加清楚明白,以下结合附图及实施例,对本发明进行进一步详细说明。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.
在本发明实施例中,第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频,家庭A内的终端设备可以方便的看到家庭B内多个家庭成员的视频。In the embodiment of the present invention, the first terminal device may select the second terminal device, and the second terminal device replaces the first terminal device to complete video data collection, encoding, and video data reception, decoding, and playback. The terminal device is a terminal device with a high-quality or wide-angle camera. Therefore, when family A makes an audio and video call with the terminal device in family B, the terminal device in family B can easily see the multiple family members in family A. Members' videos, terminal devices in family A can easily view the videos of multiple family members in family B.
以下结合具体实施例对本发明的实现进行详细描述:The realization of the present invention is described in detail below in conjunction with specific embodiment:
实施例一Embodiment one
图2示出了本发明实施例一提供的音视频通信方法的实现流程,以第一终端设备侧为例来进行说明,详述如下:FIG. 2 shows the implementation process of the audio and video communication method provided by Embodiment 1 of the present invention. The first terminal device side is used as an example for illustration, and the details are as follows:
步骤S201、第一终端设备发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表中,所述家庭通信终端列表中包括第二终端设备。Step S201, the first terminal device sends a joining request to the audio-video call service center, requesting to be added to the home communication terminal list of the audio-video call service center, and the second terminal device is included in the home communication terminal list.
在本发明实施例中,第一终端设备是具有音频通话功能的移动终端,第二终端设备是具有高质量或者广角度摄像头的终端设备。在第一终端和第二终端自动搜索到音视频通话服务中心后,第一终端和第二终端设备均发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表。In the embodiment of the present invention, the first terminal device is a mobile terminal with an audio call function, and the second terminal device is a terminal device with a high-quality or wide-angle camera. After the first terminal and the second terminal automatically search for the audio and video call service center, both the first terminal and the second terminal device send a joining request to the audio and video call service center, requesting to join the family communication of the audio and video call service center Terminal list.
步骤S202、在与对端音视频通信系统建立音视频通话后,所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放。Step S202, after establishing an audio and video call with the peer audio and video communication system, the first terminal device completes the collection and encoding of audio data, and the reception, decoding, and playback of audio data.
在本发明实施例中,第一终端设备通过音视频通话服务中心与对端音视频通信系统建立音视频通话后,可以与对端音视频通信系统中的终端设备进行音视频通话。其中,第一终端设备负责完成音频数据的采集、编码和音频数据的接收、解码、播放。In the embodiment of the present invention, after the first terminal device establishes an audio and video call with the peer audio and video communication system through the audio and video call service center, it can conduct an audio and video call with a terminal device in the peer audio and video communication system. Wherein, the first terminal device is responsible for collecting and encoding audio data and receiving, decoding, and playing audio data.
具体的,第一终端设备完成音频数据的采集、编码的过程为:第一终端设备采集音频数据,并在所述音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心。Specifically, the process for the first terminal device to complete the collection and encoding of audio data is as follows: the first terminal device collects audio data, adds a time stamp to the audio data, encodes it and sends it to the audio and video call service center .
另外,在第一终端设备采集音频数据之前,还需要执行:第一终端设备与所述音视频通话服务中心、所述第二终端设备之间进行周期性的时钟同步的步骤,这样才能保证音视频数据的同步。In addition, before the first terminal device collects audio data, it is also necessary to perform the step of periodically synchronizing clocks between the first terminal device, the audio and video call service center, and the second terminal device, so as to ensure audio data Synchronization of video data.
此外,作为本发明的一个优选实施例,在第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放中,第一终端设备可以拉回第二终端设备采集的视频或者第二终端设备接收的视频中的一路或者两路,由第一终端设备完成视频数据的采集、编码,并发送编码后的视频数据至音视频通话服务中心,也可以通知音视频通话服务中心,由第一终端设备接收音视频通话服务中心发送的视频数据,并对所述视频数据进行解码、播放。In addition, as a preferred embodiment of the present invention, when the first terminal device completes the collection and encoding of audio data and the reception, decoding, and playback of audio data, the first terminal device can pull back the video or the first video collected by the second terminal device. One or two of the videos received by the second terminal device, the first terminal device completes the collection and encoding of the video data, and sends the encoded video data to the audio and video call service center, and may also notify the audio and video call service center. The first terminal device receives the video data sent by the audio and video call service center, and decodes and plays the video data.
步骤S203、所述第一终端设备选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。Step S203, the first terminal device selects a second terminal device in the home communication terminal list, so that the second terminal device completes video data collection, encoding, and video data reception, decoding, and playback.
在本发明实施例中,第一终端设备从音视频通话服务中心的家庭通信终端列表中选择第二终端设备作为视频数据的采集、编码和视频数据的接收、解码、播放设备。In the embodiment of the present invention, the first terminal device selects the second terminal device from the home communication terminal list of the audio and video call service center as the video data collection, coding and video data reception, decoding, and playing device.
具体的,第二终端设备完成视频数据的采集、编码包括:第二终端设备采集视频数据,并在所述视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心。Specifically, the second terminal device completes the collection and encoding of video data, including: the second terminal device collects video data, adds a time stamp to the video data, encodes it, and sends it to the audio and video call service center.
同样的,在第二终端设备完成视频数据的采集、编码之前,还需要执行:第一终端设备与所述音视频通话服务中心、所述第二终端设备之间进行周期性的时钟同步的步骤,这样才能保证音视频数据的同步。Similarly, before the second terminal device completes the acquisition and encoding of video data, it is also necessary to perform: a step of periodic clock synchronization between the first terminal device, the audio and video call service center, and the second terminal device , so as to ensure the synchronization of audio and video data.
本实施例,由于第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频,家庭A内的终端设备可以方便的看到家庭B内多个家庭成员的视频。In this embodiment, since the first terminal device can select the second terminal device, the second terminal device replaces the first terminal device to complete video data collection, encoding, and video data reception, decoding, and playback. Since the second terminal device It is a terminal device with a high-quality or wide-angle camera. Therefore, when family A makes an audio and video call with a terminal device in family B, the terminal device in family B can easily see the photos of multiple family members in family A. For video, terminal devices in family A can easily view videos of multiple family members in family B.
实施例二Embodiment two
图3示出了本发明实施例二提供的音视频通信方法的实现流程,以第一终端设备侧为例来进行说明,详述如下:FIG. 3 shows the implementation process of the audio and video communication method provided by Embodiment 2 of the present invention. The first terminal device side is used as an example for illustration, and the details are as follows:
步骤S301、第一终端设备发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表中,所述家庭通信终端列表中包括第二终端设备。Step S301, the first terminal device sends a joining request to the audio-video call service center, requesting to be added to the home communication terminal list of the audio-video call service center, and the second terminal device is included in the home communication terminal list.
步骤S302、在与对端音视频通信系统建立音视频通话后,所述第一终端设备完成音频数据的采集、编码和音频数据的接收、解码、播放。Step S302, after establishing an audio and video call with the peer audio and video communication system, the first terminal device completes audio data collection, encoding, and audio data reception, decoding, and playback.
步骤S303、所述第一终端设备选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。Step S303, the first terminal device selects a second terminal device in the home communication terminal list, so that the second terminal device completes video data collection, encoding, and video data reception, decoding, and playback.
在本发明实施例中,在步骤S302或者步骤S303执行的过程中,还包括步骤S304或者步骤S305。In the embodiment of the present invention, during the execution of step S302 or step S303, step S304 or step S305 is further included.
其中,在步骤S304中,第一终端设备发送多方通话邀请指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述多方通话邀请指令通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中。Wherein, in step S304, the first terminal device sends a multi-party call invitation instruction to the audio-video call service center, so that the audio-video call service center notifies the third terminal device to participate in the audio-video call service center according to the multi-party call invitation instruction. A call between the first terminal device and the peer audio and video communication system is in progress.
在步骤S305中,第一终端设备发送请求加入通话指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述请求加入通话指令使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。In step S305, the first terminal device sends a request to join the call to the audio and video call service center, so that the audio and video call service center can make the first terminal device join the third party according to the request to join the call. During a call between the terminal device and the peer audio and video communication system.
需要说明的是,第三终端设备是与第一终端设备相同的具有音视频通话功能的移动终端。It should be noted that the third terminal device is the same mobile terminal as the first terminal device and has audio and video call functions.
本实施例,在本次通话时,第一终端设备的使用成员可以邀请第三终端设备的使用成员参与到与对端音视频通信系统之间的通话中,另外,第三终端设备的使用成员也可以主动请求参与到与对端音视频通信系统之间的通话中,使得家庭音视频通话中多成员可以参与通话,可以让家内多个成员在各自的终端设备上同时和对方家庭进行音视频通话,方便了用户家庭间多成员同时的沟通。In this embodiment, during this call, the user member of the first terminal device may invite the user member of the third terminal device to participate in the call with the peer audio and video communication system. In addition, the user member of the third terminal device It can also actively request to participate in the call with the peer audio and video communication system, so that multiple members in the family audio and video call can participate in the call, allowing multiple members of the family to conduct audio and video with the other family on their respective terminal devices at the same time Calling facilitates simultaneous communication among multiple members of the user's family.
实施例三Embodiment three
图4示出了本发明实施例三提供的音视频通信方法的实现流程,以音视频通话服务中心侧为例来进行说明,详述如下:FIG. 4 shows the implementation process of the audio and video communication method provided by Embodiment 3 of the present invention, and the audio and video call service center side is used as an example to illustrate, and the details are as follows:
步骤S401、音视频通话服务中心接收第一终端设备和第二终端设备发送的加入请求,将所述第一终端设备和所述第二终端设备加入至家庭通信终端列表中。Step S401, the audio and video call service center receives the joining requests sent by the first terminal device and the second terminal device, and adds the first terminal device and the second terminal device to the list of home communication terminals.
步骤S402、所述音视频通话服务中心在所述第一终端设备与对端音视频通信系统之间建立通信通道。Step S402, the audio and video call service center establishes a communication channel between the first terminal device and the peer audio and video communication system.
步骤S403、所述音视频通话服务中心接收所述第一终端设备发送的第一音频数据,并转发所述第一音频数据至对端音视频通信系统。Step S403, the audio and video call service center receives the first audio data sent by the first terminal device, and forwards the first audio data to the peer audio and video communication system.
具体的,第一音频数据是第一终端设备在采集的音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的。Specifically, the first audio data is sent to the audio and video call service center after the first terminal device adds a time stamp to the collected audio data and encodes it.
另外,在音视频通话服务中心接收所述第一终端设备发送的第一音频数据之前,还需要执行:音视频通话服务中心与所述第一终端设备、所述第二终端设备之间进行周期性的时钟同步的步骤,这样才能保证音视频数据的同步。In addition, before the audio and video call service center receives the first audio data sent by the first terminal device, it is also necessary to perform: a period between the audio and video call service center and the first terminal device and the second terminal device A permanent clock synchronization step, so as to ensure the synchronization of audio and video data.
步骤S404、所述音视频通话服务中心接收对端音视频通信系统发送的第二音频数据并转发所述第二音频至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二音频数据。Step S404, the audio-video call service center receives the second audio data sent by the peer-end audio-video communication system and forwards the second audio data to the first terminal device, so that the first terminal device can decode and play the second audio data the second audio data.
步骤S405、所述音视频通话服务中心接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。Step S405, the audio and video call service center receives the first video data sent by the first terminal device from the second terminal device selected in the home communication terminal list, and forwards the first video data to the peer audio and video communication system .
具体的,所述第一视频数据是第二终端设备在采集的视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的。Specifically, the first video data is sent to the audio and video call service center after the second terminal device adds a time stamp to the collected video data and encodes it.
同样的,在音视频通话服务中心接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据之前,还需要执行:音视频通话服务中心与所述第一终端设备、所述第二终端设备之间进行周期性的时钟同步的步骤,这样才能保证音视频数据的同步。Similarly, before the audio and video call service center receives the first video data sent by the first terminal device from the second terminal device selected in the home communication terminal list, it is also necessary to perform: the audio and video call service center communicates with the first terminal The step of performing periodic clock synchronization between the device and the second terminal device, so as to ensure the synchronization of audio and video data.
优选的,在执行步骤S405的过程中,音视频通话服务中心可以接收第一终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。Preferably, in the process of executing step S405, the audio and video call service center may receive the first video data sent by the first terminal device, and forward the first video data to the peer audio and video communication system.
步骤S406、所述音视频通话服务中心接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据。Step S406, the audio-video call service center receives the second video data sent by the peer-end audio-video communication system and forwards the second video to the second terminal device, so that the second terminal device can decode and play the second video data the second video data.
优选的,在执行步骤S406的过程中,音视频通话服务中心可以接收对端音视频通信系统发送的第二视频数据并转发所述第二视频数据至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二视频数据。Preferably, in the process of executing step S406, the audio-video call service center may receive the second video data sent by the peer-end audio-video communication system and forward the second video data to the first terminal device, so as to facilitate the The first terminal device decodes and plays the second video data.
本实施例,由于第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频,家庭A内的终端设备可以方便的看到家庭B内多个家庭成员的视频。In this embodiment, since the first terminal device can select the second terminal device, the second terminal device replaces the first terminal device to complete video data collection, encoding, and video data reception, decoding, and playback. Since the second terminal device It is a terminal device with a high-quality or wide-angle camera. Therefore, when family A makes an audio and video call with a terminal device in family B, the terminal device in family B can easily see the photos of multiple family members in family A. For video, terminal devices in family A can easily view videos of multiple family members in family B.
实施例四Embodiment four
图5示出了本发明实施例四提供的音视频通信方法的实现流程,以音视频通话服务中心侧为例来进行说明,详述如下:FIG. 5 shows the implementation process of the audio-video communication method provided by Embodiment 4 of the present invention. The audio-video call service center side is used as an example for illustration, and the details are as follows:
步骤S501、音视频通话服务中心接收第一终端设备和第二终端设备发送的加入请求,将所述第一终端设备和所述第二终端设备加入至家庭通信终端列表中。Step S501, the audio and video call service center receives the joining requests sent by the first terminal device and the second terminal device, and adds the first terminal device and the second terminal device into the list of home communication terminals.
步骤S502、所述音视频通话服务中心在所述第一终端设备与对端音视频通信系统之间建立通信通道。Step S502, the audio and video call service center establishes a communication channel between the first terminal device and the peer audio and video communication system.
步骤S503、所述音视频通话服务中心接收所述第一终端设备发送的第一音频数据,并转发所述第一音频数据至对端音视频通信系统。Step S503, the audio and video call service center receives the first audio data sent by the first terminal device, and forwards the first audio data to the peer audio and video communication system.
步骤S504、所述音视频通话服务中心接收对端音视频通信系统发送的第二音频数据并转发所述第二音频至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二音频数据。Step S504, the audio-video call service center receives the second audio data sent by the peer-end audio-video communication system and forwards the second audio data to the first terminal device, so that the first terminal device can decode and play the second audio data the second audio data.
步骤S505、所述音视频通话服务中心接收第一终端设备从家庭通信终端列表中所选择的第二终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。Step S505, the audio and video call service center receives the first video data sent by the first terminal device from the second terminal device selected in the home communication terminal list, and forwards the first video data to the peer audio and video communication system .
步骤S506、所述音视频通话服务中心接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据。Step S506, the audio-video call service center receives the second video data sent by the peer-end audio-video communication system and forwards the second video to the second terminal device, so that the second terminal device can decode and play the second video data the second video data.
在本发明实施例中,在步骤S506执行的过程中,还包括步骤S507或者步骤S508。In the embodiment of the present invention, step S507 or step S508 is further included in the process of step S506.
其中,在步骤S507中,音视频通话服务中心根据所述第一终端设备发送的多方通话邀请指令,通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中。Wherein, in step S507, the audio-video call service center notifies the third terminal device to participate in the call between the first terminal device and the peer audio-video communication system according to the multi-party call invitation instruction sent by the first terminal device middle.
在步骤S508中,音视频通话服务中心根据所述第一终端设备发送的请求加入通话指令,使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。In step S508, the audio-video call service center enables the first terminal device to join the call between the third terminal device and the opposite end audio-video communication system according to the request to join the call instruction sent by the first terminal device.
需要说明的是,第三终端设备是与第一终端设备相同的具有音视频通话功能的移动终端。It should be noted that the third terminal device is the same mobile terminal as the first terminal device and has audio and video call functions.
本实施例,在本次通话时,第一终端设备的使用成员可以邀请第三终端设备的使用成员参与到与对端音视频通信系统之间的通话中,另外,第三终端设备的使用成员也可以主动请求参与到与对端音视频通信系统之间的通话中,使得家庭音视频通话中多成员可以参与通话,可以让家内多个成员在各自的终端设备上同时和对端家庭进行音视频通话,方便了用户家庭间多成员同时的沟通。In this embodiment, during this call, the user member of the first terminal device may invite the user member of the third terminal device to participate in the call with the peer audio and video communication system. In addition, the user member of the third terminal device It can also actively request to participate in the call with the peer audio and video communication system, so that multiple members in the family audio and video call can participate in the call, allowing multiple members of the family to simultaneously conduct audio with the peer family on their respective terminal devices Video calls facilitate simultaneous communication among multiple members of the user's family.
实施例五Embodiment five
图6示出了本发明实施例五提供的终端设备的具体结构框图,为了便于说明,仅示出了与本发明实施例相关的部分。在本实施例中,该终端设备6包括:加入请求发送单元61、音频数据处理单元62和视频设备获取单元63。FIG. 6 shows a specific structural block diagram of a terminal device provided by Embodiment 5 of the present invention. For ease of description, only parts related to the embodiment of the present invention are shown. In this embodiment, the terminal device 6 includes: a joining request sending unit 61 , an audio data processing unit 62 and a video device acquiring unit 63 .
其中,加入请求发送单元61,用于发送加入请求至音视频通话服务中心,请求加入至所述音视频通话服务中心的家庭通信终端列表中,所述家庭通信终端列表中包括第二终端设备;Wherein, the joining request sending unit 61 is configured to send a joining request to the audio and video call service center, requesting to be added to the home communication terminal list of the audio and video call service center, and the home communication terminal list includes the second terminal device;
音频数据处理单元62,用于在与对端音视频通信系统建立音视频通话后,完成音频数据的采集、编码和音频数据的接收、解码、播放;The audio data processing unit 62 is used to complete the collection, encoding, and reception, decoding, and playback of audio data after establishing an audio and video call with the opposite end audio and video communication system;
视频设备获取单元63,用于选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放。A video device acquisition unit 63 is configured to select a second terminal device in the home communication terminal list, so that the second terminal device completes video data collection, encoding, and video data reception, decoding, and playback.
具体的,所述音频数据处理单元62采集音频数据,并在所述音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心;Specifically, the audio data processing unit 62 collects audio data, adds a time stamp to the audio data, encodes it, and sends it to the audio and video call service center;
所述视频设备获取单元63选择所述家庭通信终端列表中的第二终端设备,以便于所述第二终端设备采集视频数据,并在所述视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心。The video device acquisition unit 63 selects the second terminal device in the home communication terminal list, so that the second terminal device collects video data, adds a time stamp to the video data, encodes it, and sends it to The audio and video call service center.
进一步地,所述终端设备6还包括:Further, the terminal device 6 also includes:
时钟同步单元64,用于与所述音视频通话服务中心、所述第二终端设备之间进行周期性的时钟同步。The clock synchronization unit 64 is configured to perform periodic clock synchronization with the audio and video call service center and the second terminal device.
进一步地,所述终端设备6还包括:Further, the terminal device 6 also includes:
第一视频数据处理单元65,用于完成视频数据的采集、编码,并发送编码后的视频数据至所述音视频通话服务中心。The first video data processing unit 65 is configured to complete the collection and encoding of video data, and send the encoded video data to the audio and video call service center.
进一步地,所述终端设备还包括:Further, the terminal device also includes:
第二视频数据处理单元66,用于接收所述音视频通话服务中心发送的视频数据,并对所述视频数据进行解码、播放。The second video data processing unit 66 is configured to receive the video data sent by the audio and video call service center, and decode and play the video data.
进一步地,所述终端设备6还包括:Further, the terminal device 6 also includes:
多方通话邀请指令/请求加入通话指令发送单元67,用于发送多方通话邀请指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述多方通话邀请指令通知第三终端设备参与至所述终端设备与对端音视频通信系统之间的通话中;或发送请求加入通话指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述请求加入通话指令使所述终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。A multi-party call invitation instruction/request to join a call instruction sending unit 67, configured to send a multi-party call invitation instruction to the audio and video call service center, so that the audio and video call service center notifies a third terminal device according to the multi-party call invitation instruction Participate in the call between the terminal device and the peer audio and video communication system; or send a request to join the call instruction to the audio and video call service center, so that the audio and video call service center joins the call instruction according to the request The terminal device is made to join the call between the third terminal device and the peer audio and video communication system.
进一步地,所述终端设备和第三终端设备是具有音频通话功能的移动终端,所述第二终端设备具有高质量或者广角度摄像头。Further, the terminal device and the third terminal device are mobile terminals with an audio call function, and the second terminal device has a high-quality or wide-angle camera.
实施例六Embodiment six
图7示出了本发明实施例六提供的音视频通话服务中心的具体结构框图,为了便于说明,仅示出了与本发明实施例相关的部分。在本实施例中,该音视频通话服务中心7包括:加入请求接收单元71、通信通道建立单元72、第一音频数据处理单元73、第二音频数据处理单元74、第一视频数据处理单元75和第二视频数据处理单元76。FIG. 7 shows a specific structural block diagram of the audio and video call service center provided by Embodiment 6 of the present invention. For convenience of description, only the parts related to the embodiment of the present invention are shown. In this embodiment, the audio and video call service center 7 includes: a joining request receiving unit 71, a communication channel establishing unit 72, a first audio data processing unit 73, a second audio data processing unit 74, and a first video data processing unit 75 and the second video data processing unit 76 .
加入请求接收单元71,用于接收第一终端设备和第二终端设备发送的加入请求,将所述第一终端设备和所述第二终端设备加入至家庭通信终端列表中;A join request receiving unit 71, configured to receive join requests sent by the first terminal device and the second terminal device, and add the first terminal device and the second terminal device to the family communication terminal list;
通信通道建立单元72,用于在所述第一终端设备与对端音视频通信系统之间建立通信通道;A communication channel establishing unit 72, configured to establish a communication channel between the first terminal device and the peer audio and video communication system;
第一音频数据处理单元73,用于接收所述第一终端设备发送的第一音频数据,并转发所述第一音频数据至对端音视频通信系统;The first audio data processing unit 73 is configured to receive the first audio data sent by the first terminal device, and forward the first audio data to the peer audio and video communication system;
第二音频数据处理单元74,用于接收对端音视频通信系统发送的第二音频数据并转发所述第二音频至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二音频数据;The second audio data processing unit 74 is configured to receive the second audio data sent by the peer audio and video communication system and forward the second audio to the first terminal device, so that the first terminal device can decode and play the the second audio data;
第一视频数据处理单元75,用于接收第二终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统;The first video data processing unit 75 is configured to receive the first video data sent by the second terminal device, and forward the first video data to the peer audio and video communication system;
第二视频数据处理单元76,用于接收对端音视频通信系统发送的第二视频数据并转发所述第二视频至所述第二终端设备,以便于所述第二终端设备解码、播放所述第二视频数据。The second video data processing unit 76 is configured to receive the second video data sent by the peer audio and video communication system and forward the second video to the second terminal device, so that the second terminal device can decode and play the second video data the second video data.
具体的,所述第一音频数据是第一终端设备在采集的音频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的,所述第一视频数据是第二终端设备在采集的视频数据中加上时间戳,进行编码后发送至所述音视频通话服务中心的。Specifically, the first audio data is sent to the audio and video call service center after the first terminal device adds a time stamp to the collected audio data, and the first video data is sent to the audio and video call service center by the second terminal device Add a time stamp to the collected video data, encode it and send it to the audio and video call service center.
进一步地,所述音视频通话服务中心7还包括:Further, the audio and video call service center 7 also includes:
时钟同步单元77,用于与所述第一终端设备、所述第二终端设备之间进行周期性的时钟同步。A clock synchronization unit 77, configured to perform periodic clock synchronization with the first terminal device and the second terminal device.
进一步地,所述第一视频数据处理单元75,还用于接收所述第一终端设备发送的第一视频数据,并转发所述第一视频数据至对端音视频通信系统。Further, the first video data processing unit 75 is further configured to receive the first video data sent by the first terminal device, and forward the first video data to the peer audio and video communication system.
进一步地,所述第二视频数据处理单元76,还用于接收对端音视频通信系统发送的第二视频数据并转发所述第二视频数据至所述第一终端设备,以便于所述第一终端设备解码、播放所述第二视频数据。Further, the second video data processing unit 76 is also configured to receive the second video data sent by the peer audio and video communication system and forward the second video data to the first terminal device, so that the second A terminal device decodes and plays the second video data.
进一步地,所述音视频通话服务中心7还包括:Further, the audio and video call service center 7 also includes:
多方通话控制单元78,用于根据所述第一终端设备发送的多方通话邀请指令,通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中;或根据所述第一终端设备发送的请求加入通话指令,使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。The multi-party call control unit 78 is configured to notify the third terminal device to participate in the call between the first terminal device and the peer audio and video communication system according to the multi-party call invitation instruction sent by the first terminal device; or The request to join the call instruction sent by the first terminal device causes the first terminal device to join the call between the third terminal device and the peer audio-video communication system.
实施例七Embodiment seven
图8示出了本发明实施例七提供的音视频通信系统的具体结构框图,为了便于说明,仅示出了与本发明实施例相关的部分。在本实施例中,以其中一端音视频通信系统为例来进行说明,该音视频通信系统8包括公网服务器21,所述系统还包括:与所述公网服务器21连接的音视频通话服务中心22和分别与所述音视频通话服务中心22连接的至少两个终端设备,在本实施例中,所述终端设备包括多个第一终端设备和多个第二终端设备,其中,第一终端设备是具有音视频通话功能的移动终端,第二终端设备是具有高质量或者广角度摄像头的终端设备,比如机顶盒电视或者平板电脑PAD等大屏终端设备。在本实施例中,以音视频通信系统中包括一个第一终端设备23和一个第二终端设备24为例来进行说明。FIG. 8 shows a specific structural block diagram of an audio-video communication system provided by Embodiment 7 of the present invention. For ease of description, only parts related to the embodiment of the present invention are shown. In this embodiment, an audio and video communication system at one end is taken as an example for illustration. The audio and video communication system 8 includes a public network server 21, and the system also includes: an audio and video call service connected to the public network server 21 Center 22 and at least two terminal devices respectively connected to the audio and video call service center 22. In this embodiment, the terminal devices include a plurality of first terminal devices and a plurality of second terminal devices, wherein the first The terminal device is a mobile terminal with an audio and video call function, and the second terminal device is a terminal device with a high-quality or wide-angle camera, such as a large-screen terminal device such as a set-top box TV or a tablet computer PAD. In this embodiment, an audio-video communication system including one first terminal device 23 and one second terminal device 24 is taken as an example for illustration.
具体的,所述音视频通话服务中心22的结构如图7所示,第一终端设备23的结构如图6所示,在此不再赘述。Specifically, the structure of the audio and video call service center 22 is shown in FIG. 7 , and the structure of the first terminal device 23 is shown in FIG. 6 , which will not be repeated here.
以下举例详细的说明音视频通信系统中各个实体单元之间的交互过程,其中将该音视频通信系统称为家庭A,与该音视频通信系统进行音视频通话的对端音视频通信系统称为家庭B:The following examples illustrate in detail the interaction process between the various physical units in the audio and video communication system, where the audio and video communication system is called family A, and the peer audio and video communication system that conducts audio and video calls with the audio and video communication system is called Family B:
1、家庭A内第一终端设备和第二终端设备均参与音视频通话。1. Both the first terminal device and the second terminal device in family A participate in audio and video calls.
第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码,解决了现有技术家庭A内的终端设备与家庭B内的终端设备进行音视频通话时,音视频数据的采集都固定在家庭A内第一终端设备上的问题,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频。The first terminal device can select the second terminal device, and the second terminal device replaces the first terminal device to complete the collection and encoding of video data. During audio and video calls, the collection of audio and video data is fixed on the first terminal device in family A. Since the second terminal device is a terminal device with a high-quality or wide-angle camera, the connection between family A and family B When the terminal devices in family B make audio and video calls, the terminal devices in family B can conveniently watch the videos of multiple family members in family A.
2、第一终端设备和第二终端设备自动搜索到家庭A内的音视频通话服务中心,并加入到所述音视频通话服务中心的家庭通信终端列表中。2. The first terminal device and the second terminal device automatically search for the audio and video call service center in family A, and add them to the family communication terminal list of the audio and video call service center.
3、第一终端设备通过家庭A内的音视频通话服务中心和家庭B内的终端设备进行通话,第一终端设备通过家庭A内的音视频通话服务中心与家庭B之间建立通信信道。3. The first terminal device communicates with the terminal device in home B through the audio and video call service center in home A, and the first terminal device establishes a communication channel with home B through the audio and video call service center in home A.
4、第一终端设备通过家庭A内的音视频通话服务中心获取家庭A内的其它终端设备的信息列表。4. The first terminal device obtains the information list of other terminal devices in the family A through the audio and video call service center in the family A.
5、第一终端设备、第二终端设备与家庭A内的音视频通话服务中心之间进行周期性的时钟同步。5. Periodic clock synchronization is performed between the first terminal device, the second terminal device and the audio and video call service center in family A.
6、第一终端设备选择视频通话的设备,在本实施例中,该设备为第二终端设备,通过该第二终端设备完成视频数据的采集、编码、发送以及视频数据的接收、解码、播放,由第一终端设备进行音频数据的采集、编码、发送以及音频数据的接收、解码、播放。当然,第一终端设备也可以同时进行音频数据或者视频数据或者两者解码渲染或播放。6. The first terminal device selects the device for video calls. In this embodiment, the device is the second terminal device, and the second terminal device completes the collection, encoding, and transmission of video data, as well as the reception, decoding, and playback of video data , the first terminal device collects, encodes, and sends audio data, and receives, decodes, and plays audio data. Certainly, the first terminal device may also decode, render or play audio data or video data or both at the same time.
7、音视频通话服务中心接收到第一终端设备的设备选择命令时,转发视频数据给相应设备,并转发回复结果,自身做好选择结果记录,以此控制相应的音视频数据转发。7. When the audio and video call service center receives the device selection command of the first terminal device, it forwards the video data to the corresponding device, forwards the reply result, and records the selection result by itself, so as to control the forwarding of the corresponding audio and video data.
在本实施例中,由于第一终端设备可以选择第二终端设备,由第二终端设备代替所述第一终端设备完成视频数据的采集、编码和视频数据的接收、解码、播放,由于第二终端设备是具有高质量或者广角度的摄像头的终端设备,因此,在家庭A与家庭B内的终端设备进行音视频通话时,家庭B内的终端设备可以方便的看到家庭A内多个家庭成员的视频,家庭A内的终端设备可以方便的看到家庭B内多个家庭成员的视频。In this embodiment, since the first terminal device can select the second terminal device, the second terminal device replaces the first terminal device to complete video data acquisition, encoding, video data reception, decoding, and playback, because the second terminal device The terminal device is a terminal device with a high-quality or wide-angle camera. Therefore, when family A makes an audio and video call with the terminal device in family B, the terminal device in family B can easily see the multiple family members in family A. Members' videos, terminal devices in family A can easily view the videos of multiple family members in family B.
实施例八Embodiment eight
图9示出了本发明实施例八提供的音视频通信系统的具体结构框图,为了便于说明,仅示出了与本发明实施例相关的部分。在本实施例中,以其中一端音视频通信系统为例来进行说明,该音视频通信系统包括公网服务器31,所述系统还包括:与所述公网服务器31连接的音视频通话服务中心32和分别与所述音视频通话服务中心32连接的至少两个终端设备,在本实施例中,所述终端设备包括多个第一终端设备和多个第二终端设备,其中,第一终端设备是具有音视频通话功能的移动终端,第二终端设备是具有高质量或者广角度摄像头的终端设备,比如机顶盒电视或者平板电脑PAD等大屏终端设备。在本实施例中,以音视频通信系统中包括一个第一终端设备43和一个第二终端设备44为例来进行说明。FIG. 9 shows a specific structural block diagram of an audio-video communication system provided by Embodiment 8 of the present invention. For ease of description, only parts related to the embodiment of the present invention are shown. In this embodiment, an audio and video communication system at one end is used as an example for illustration. The audio and video communication system includes a public network server 31, and the system also includes: an audio and video call service center connected to the public network server 31 32 and at least two terminal devices respectively connected to the audio and video call service center 32. In this embodiment, the terminal devices include a plurality of first terminal devices and a plurality of second terminal devices, wherein the first terminal The device is a mobile terminal with an audio and video call function, and the second terminal device is a terminal device with a high-quality or wide-angle camera, such as a set-top box TV or a tablet computer PAD and other large-screen terminal devices. In this embodiment, an audio-video communication system including a first terminal device 43 and a second terminal device 44 is taken as an example for illustration.
具体的,所述音视频通话服务中心32的包括图7中所示的加入请求接收单元71、通信通道建立单元72、第一音频数据处理单元73、第二音频数据处理单元74、第一视频数据处理单元75、第二视频数据处理单元76,还包括时钟同步单元77和多方通话控制单元78。Specifically, the audio and video call service center 32 includes a joining request receiving unit 71, a communication channel establishing unit 72, a first audio data processing unit 73, a second audio data processing unit 74, a first video The data processing unit 75 and the second video data processing unit 76 also include a clock synchronization unit 77 and a multi-party call control unit 78 .
其中,多方通话控制单元,用于根据所述第一终端设备发送的多方通话邀请指令,通知第三终端设备参与至所述第一终端设备与对端音视频通信系统之间的通话中;或根据所述第一终端设备发送的请求加入通话指令,使所述第一终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。Wherein, the multi-party call control unit is configured to notify the third terminal device to participate in the call between the first terminal device and the peer audio and video communication system according to the multi-party call invitation instruction sent by the first terminal device; or According to the request to join call instruction sent by the first terminal device, the first terminal device is added to the call between the third terminal device and the peer audio-video communication system.
具体的,所述第一终端设备43除包括如图6所示的加入请求发送单元61、音频数据处理单元62和视频设备获取单元63,还包括时钟同步单元64、第一视频数据处理单元65、第二视频数据处理单元66和多方通话邀请指令/请求加入通话指令发送单元67。Specifically, the first terminal device 43 includes a join request sending unit 61, an audio data processing unit 62, and a video device acquiring unit 63 as shown in FIG. 6 , and also includes a clock synchronization unit 64, a first video data processing unit 65 , a second video data processing unit 66 and a multi-party call invitation instruction/request to join a call instruction sending unit 67.
其中,多方通话邀请指令/请求加入通话指令发送单元67,用于发送多方通话邀请指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述多方通话邀请指令通知第三终端设备参与至所述终端设备与对端音视频通信系统之间的通话中;或发送请求加入通话指令至所述音视频通话服务中心,以使所述音视频通话服务中心根据所述请求加入通话指令使所述终端设备加入至第三终端设备与对端音视频通信系统之间的通话中。Wherein, the multi-party call invitation instruction/request to join the call instruction sending unit 67 is used to send the multi-party call invitation instruction to the audio and video call service center, so that the audio and video call service center notifies the third party according to the multi-party call invitation instruction. The terminal device participates in the call between the terminal device and the peer audio and video communication system; or sends a request to join the call to the audio and video call service center, so that the audio and video call service center joins according to the request The call instruction enables the terminal device to join the call between the third terminal device and the peer audio and video communication system.
以下举例详细的说明音视频通信系统中各个实体单元之间的交互过程,其中将该音视频通信系统称为家庭A,与该音视频通信系统进行音视频通话的对端音视频通信系统称为家庭B:The following examples illustrate in detail the interaction process between the various physical units in the audio and video communication system, where the audio and video communication system is called family A, and the peer audio and video communication system that conducts audio and video calls with the audio and video communication system is called Family B:
1、家庭A内的第一终端设备43和第一终端设备44一起与家庭B内的终端设备进行通话。1. The first terminal device 43 and the first terminal device 44 in the family A make a call with the terminal device in the family B together.
第一终端设备43和第一终端设备44其中一设备(如第一终端设备43)先通话,第一终端设备43可以邀请和接受家庭网络内其他成员第一终端设备44一起参与视频通话。One of the first terminal device 43 and the first terminal device 44 (such as the first terminal device 43 ) talks first, and the first terminal device 43 can invite and accept the first terminal device 44 of other members in the home network to participate in the video call together.
2、家庭A内的第一终端设备43和第一终端设备44等其它家庭智能终端设备自动搜索到家庭A内的音视频通话服务中心,并加入到其家庭通信终端列表。2. The first terminal device 43 and the first terminal device 44 in the family A and other smart home terminal devices automatically search for the audio and video call service center in the family A, and add them to the family communication terminal list.
3、家庭A内第一终端设备43通过家庭A内的音视频通话服务中心和家庭B之间进行通话,第一终端设备43通过家庭A内的音视频通话服务中心与家庭B内之间建立通信通道。3. The first terminal device 43 in family A makes a call with family B through the audio and video call service center in family A, and the first terminal device 43 establishes a call with family B through the audio and video call service center in family A. communication channel.
4、第一终端设备43选择视频通话各个数据处理设备为自己并且与音视频通话服务中心进行时钟同步,最后进行视频通话。4. The first terminal device 43 selects each data processing device for the video call as itself and performs clock synchronization with the audio and video call service center, and finally makes the video call.
5、第一终端设备43在通话过程中,想邀请第一终端设备44参与通话。5. During the call, the first terminal device 43 wants to invite the first terminal device 44 to participate in the call.
第一终端设备43通过家庭A内的音视频通话服务中心发出“邀请”命令给第一终端设备44,第一终端设备44可以拒绝或接受。当第一终端设备44拒绝时经家庭A内的音视频通话服务中心回复拒绝信息给第一终端设备43;当第一终端设备44接受时,第一终端设备44经家庭A内的音视频通话服务中心回复接受信息给第一终端设备43,而后第一终端设备43发送命令给家庭A内的音视频服务中心,让其通知第一终端设备44进行通话输入,并接收第一终端设备44通话输入的数据并转发,同时将家庭B内的家庭音视频数据发送给第一终端设备43及第一终端设备44。此时第一终端设备44充当第一终端设备43角色,第一终端设备43能看到家庭B内的家庭音视频和第一终端设备44的音视频。此过程中第一终端设备43可以向第一终端设备44请求成为通话输入操作者;第一终端设备44也可以邀请第一终端设备43重新成为通话输入者。The first terminal device 43 sends an "invitation" command to the first terminal device 44 through the audio-video call service center in the family A, and the first terminal device 44 can reject or accept it. When the first terminal device 44 refuses, the audio and video call service center in the family A replies the rejection information to the first terminal device 43; The service center replies an acceptance message to the first terminal device 43, and then the first terminal device 43 sends an order to the audio-video service center in family A, asking it to notify the first terminal device 44 to make a call input and receive the first terminal device 44 call The input data is forwarded, and at the same time, the home audio and video data in the home B is sent to the first terminal device 43 and the first terminal device 44 . At this time, the first terminal device 44 acts as the first terminal device 43 , and the first terminal device 43 can watch the home audio and video in the family B and the audio and video of the first terminal device 44 . During this process, the first terminal device 43 may request the first terminal device 44 to become a call input operator; the first terminal device 44 may also invite the first terminal device 43 to become a call input operator again.
6、第一终端设备43通话过程中,第一终端设备44向第一终端设备43请求参与通话:6. During the call of the first terminal device 43, the first terminal device 44 requests the first terminal device 43 to participate in the call:
第一终端设备44通过音视频通话服务中心向第一终端设备43发出“通话请求”命令,第一终端设备43可以拒绝或接受。当第一终端设备43拒绝时,经家庭A内的音视频通话服务中心回复拒绝信息给第一终端设备44;当第一终端设备43接受时,第一终端设备43经家庭A内的音视频通话服务中心回复接受信息给第一终端设备44,而后第一终端设备43发送命令给家庭A内的音视频通话服务中心,让其通知第一终端设备44进行通话输入,同时接收第一终端设备44通话输入的数据并转发,同时将家庭B内的音视频数据发送给第一终端设备43及第一终端设备44。此时第一终端设备44充当第一终端设备43角色,第一终端设备43能看到家庭B内的家庭音视频和第一终端设备44的音视频。此过程中第一终端设备43可以向第一终端设备44请求成为通话输入操作者;第一终端设备44也可以邀请第一终端设备43重新成为通话输入者。The first terminal device 44 sends a "call request" command to the first terminal device 43 through the audio and video call service center, and the first terminal device 43 can reject or accept it. When the first terminal device 43 refuses, the audio and video call service center in family A will reply the rejection message to the first terminal device 44; The call service center replies an acceptance message to the first terminal device 44, and then the first terminal device 43 sends an order to the audio and video call service center in family A, asking it to notify the first terminal device 44 to make a call input, and at the same time receive the first terminal device 44 call the input data and forward it, and send the audio and video data in the family B to the first terminal device 43 and the first terminal device 44 at the same time. At this time, the first terminal device 44 acts as the first terminal device 43 , and the first terminal device 43 can watch the home audio and video in the family B and the audio and video of the first terminal device 44 . During this process, the first terminal device 43 may request the first terminal device 44 to become a call input operator; the first terminal device 44 may also invite the first terminal device 43 to become a call input operator again.
在本实施例中,视频通话时,在本次通话时,其中一个第一终端设备的使用成员可以邀请其他第一终端设备的使用成员参与到与对端家庭的音视频通话中,另外,其他第一终端设备的使用成员也可以主动请求参与到与对端家庭的音视频通话中,使得家庭音视频通话中多成员可以参与通话,可以让家内多个成员在各自的终端设备上同时和对端家庭进行音视频通话,方便了用户家庭间多成员同时的沟通。In this embodiment, during a video call, during this call, one user of the first terminal device may invite other users of the first terminal device to participate in the audio and video call with the opposite family. In addition, other The user member of the first terminal device can also actively request to participate in the audio and video call with the peer family, so that multiple members in the family audio and video call can participate in the call, allowing multiple members in the family to communicate with the peer on their respective terminal devices at the same time The audio and video calls can be made in the terminal family, which facilitates the simultaneous communication of multiple members in the user's family.
值得注意的是,上述系统实施例中,所包括的各个单元只是按照功能逻辑进行划分的,但并不局限于上述的划分,只要能够实现相应的功能即可;另外,各功能单元的具体名称也只是为了便于相互区分,并不用于限制本发明的保护范围。It is worth noting that in the above system embodiments, the units included are only divided according to functional logic, but are not limited to the above division, as long as the corresponding functions can be realized; in addition, the specific names of each functional unit It is only for the convenience of distinguishing each other, and is not used to limit the protection scope of the present invention.
另外,本领域普通技术人员可以理解实现上述各实施例方法中的全部或部分步骤是可以通过程序来指令相关的硬件来完成,相应的程序可以存储于一计算机可读取存储介质中,所述的存储介质,如ROM/RAM、磁盘或光盘等。In addition, those of ordinary skill in the art can understand that all or part of the steps in the methods of the above-mentioned embodiments can be completed by instructing related hardware through programs, and the corresponding programs can be stored in a computer-readable storage medium. Storage media, such as ROM/RAM, magnetic disk or optical disk, etc.
以上所述仅为本发明的较佳实施例而已,并不用以限制本发明,凡在本发明的精神和原则之内所作的任何修改、等同替换和改进等,均应包含在本发明的保护范围之内。The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the present invention. Any modifications, equivalent replacements and improvements made within the spirit and principles of the present invention should be included in the protection of the present invention. within range.
Claims (24)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310204221.6A CN104184982B (en) | 2013-05-28 | 2013-05-28 | Audio/video communication method, system, terminal device and voice and video telephone service centre |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201310204221.6A CN104184982B (en) | 2013-05-28 | 2013-05-28 | Audio/video communication method, system, terminal device and voice and video telephone service centre |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN104184982A CN104184982A (en) | 2014-12-03 |
| CN104184982B true CN104184982B (en) | 2018-04-10 |
Family
ID=51965684
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201310204221.6A Active CN104184982B (en) | 2013-05-28 | 2013-05-28 | Audio/video communication method, system, terminal device and voice and video telephone service centre |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN104184982B (en) |
Families Citing this family (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104918132A (en) * | 2015-06-05 | 2015-09-16 | Tcl集团股份有限公司 | Method and system for smart television audio and video communication |
| CN106331568B (en) * | 2015-07-03 | 2019-11-15 | 华平智慧信息技术(深圳)有限公司 | A kind of instant communication method, system and mobile terminal |
| CN106341641A (en) * | 2015-07-10 | 2017-01-18 | 小米科技有限责任公司 | Video communication method and device |
| CN105657324A (en) * | 2015-12-31 | 2016-06-08 | 宇龙计算机通信科技(深圳)有限公司 | Method and device for processing video images, and terminals |
| CN106210148A (en) * | 2016-09-13 | 2016-12-07 | 乐视控股(北京)有限公司 | Real time phone call processing method and processing device |
| CN107071138B (en) * | 2016-12-15 | 2020-03-10 | 北京佰人科技有限责任公司 | Video call method and device |
| CN108632560A (en) * | 2018-05-14 | 2018-10-09 | 聚好看科技股份有限公司 | Video call method, device and terminal equipment |
| CN112351235B (en) * | 2019-08-06 | 2022-06-07 | 荣耀终端有限公司 | Video call method |
| CN113556613A (en) * | 2020-04-23 | 2021-10-26 | 深圳市万普拉斯科技有限公司 | Mobile terminal audio and video delivery method, device, computer equipment and storage medium |
| CN113473237B (en) * | 2020-04-29 | 2022-05-27 | 海信集团有限公司 | Video call method, device and equipment |
| CN115550518B (en) * | 2022-09-30 | 2025-03-14 | 西安交通大学 | A reversible information hiding method and system based on adaptive pixel block division |
| CN116886849A (en) * | 2023-09-06 | 2023-10-13 | 中移(杭州)信息技术有限公司 | Two-way audio and video call method, device, electronic equipment and storage medium |
| CN118890883B (en) * | 2024-09-30 | 2024-12-06 | 广州边在晓峰网络科技有限公司 | Network equipment maintenance device with dust removal function |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004165949A (en) * | 2002-11-13 | 2004-06-10 | Canon Inc | Video phone system |
| CN101677388A (en) * | 2008-09-17 | 2010-03-24 | 中国移动通信集团公司 | Visual communication system, terminal gateway, video gateway, and visual communication method |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP1443765B1 (en) * | 2003-01-30 | 2008-10-15 | Broadcom Corporation | Media channel setup in a media exchange network |
| CN101472132A (en) * | 2007-12-27 | 2009-07-01 | 深圳创维-Rgb电子有限公司 | Television set with visual telephone function |
| CN101222607A (en) * | 2008-02-02 | 2008-07-16 | 张原天 | Network television or/and video telephone system |
| GB2463110B (en) * | 2008-09-05 | 2013-01-16 | Skype | Communication system and method |
| US20110047581A1 (en) * | 2009-08-19 | 2011-02-24 | Ram Caspi | Apparatus and method for a home communication center |
| CN202918417U (en) * | 2012-11-28 | 2013-05-01 | 青岛海信宽带多媒体技术有限公司 | Video conversation system based on Android set top box |
-
2013
- 2013-05-28 CN CN201310204221.6A patent/CN104184982B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004165949A (en) * | 2002-11-13 | 2004-06-10 | Canon Inc | Video phone system |
| CN101677388A (en) * | 2008-09-17 | 2010-03-24 | 中国移动通信集团公司 | Visual communication system, terminal gateway, video gateway, and visual communication method |
Also Published As
| Publication number | Publication date |
|---|---|
| CN104184982A (en) | 2014-12-03 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN104184982B (en) | Audio/video communication method, system, terminal device and voice and video telephone service centre | |
| US9024997B2 (en) | Virtual presence via mobile | |
| JP6182902B2 (en) | Transmission terminal, transmission system and program | |
| CN101917586B (en) | Joining method and equipment for conference | |
| CN109586929B (en) | Conference content transmission method and device, electronic equipment and storage medium | |
| CN108933914B (en) | Method and system for carrying out video conference by using mobile terminal | |
| JP2016511949A (en) | Server-mediated audio-video communication with reduced latency | |
| CN203352696U (en) | Multimedia digit conference system | |
| JP6074915B2 (en) | Transmission management system, transmission system, transmission management method, and program for transmission management system | |
| TWI451746B (en) | Video conference system and video conference method thereof | |
| US20140168345A1 (en) | Integrating audio and video conferencing capabilities | |
| WO2014154065A2 (en) | Data transmission method, media acquisition device, video conference terminal and storage medium | |
| CN105611219A (en) | Method and device for processing video conference | |
| US20160205347A1 (en) | Video conferencing system and multi-way video conference switching method | |
| WO2015003532A1 (en) | Multimedia conferencing establishment method, device and system | |
| JP6458464B2 (en) | Control system, control device, communication system, relay device selection method, and program | |
| JP2017050603A (en) | Management system, control device, management method, and program | |
| KR20210013923A (en) | Video Call Mediating Apparatus, Method and Computer Readable Recording Medium Thereof | |
| CN104735390A (en) | Layout method and device for videos and audios in immersive conference | |
| WO2017113695A1 (en) | Video communication method for smart television, terminal equipment and smart television | |
| CN116545786A (en) | A conference transfer method and device | |
| CN103098440B (en) | Network system, communication means and communication terminal | |
| AU2013261274B2 (en) | Relay device selection device, transmission system, and program for relay device selection device | |
| WO2016206471A1 (en) | Multimedia service processing method, system and device | |
| EP2827584A1 (en) | Method, device, and system for implementing multi-party conference call by using set top box |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |