CN109413357B

CN109413357B - Audio and video call method and device, equipment and storage medium thereof

Info

Publication number: CN109413357B
Application number: CN201710696521.9A
Authority: CN
Inventors: 兰鹏
Original assignee: Tencent Technology Shenzhen Co Ltd
Current assignee: Tencent Technology Shenzhen Co Ltd
Priority date: 2017-08-15
Filing date: 2017-08-15
Publication date: 2021-08-10
Anticipated expiration: 2037-08-15
Also published as: CN109413357A

Abstract

The embodiment of the invention provides an audio and video communication method, an audio and video communication device, audio and video communication equipment and a storage medium, wherein the method comprises the following steps: receiving an audio and video call instruction, and sending an audio and video call request to a first terminal in response to the audio and video call instruction; determining a first moment for receiving a first audio and video data packet, wherein the first audio and video data packet is sent by the first terminal for receiving the audio and video call request; determining a second moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an audio and video unit of the notification message in response to the audio and video call request; and determining the later occurring time among the first time and the second time, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit if the later occurring time is within a preset waiting time period.

Description

Audio and video call method and device, equipment and storage medium thereof

Technical Field

The invention relates to the technical field of internet communication, in particular to an audio and video communication method and device, equipment and a storage medium thereof.

Background

With the development and popularization of mobile networks, more and more people begin to use mobile terminals to perform network audio and video calls. In a single audio/video call, a calling party generally initiates an audio/video request to a called party, and the called party clicks an answering button on an operation interface of a mobile terminal to complete answering operation.

In the prior art, after clicking an answer button, a called party sends a message a to a calling party, where the message a is used to inform the calling party that the called party has answered the call, and then the calling party and the called party establish a connection b of audio and video data, and receive and send an audio and video data stream c. The calling party usually considers that the audio/video data connection b is established after receiving the message a, and the display is connected on the interface of the calling party, and starts the call timing. However, at this time, the audio/video data connection b is not yet established, the audio and video data stream c is not received, or the local audio device is not yet completely started successfully. The user of the calling party intuitively feels that although the call timing is started on the interface, the voice of the other party is not heard, and a time difference exists.

Disclosure of Invention

In view of this, embodiments of the present invention are intended to provide an audio and video call method, an apparatus, a device, and a storage medium.

The technical scheme of the embodiment of the invention is realized as follows:

in a first aspect, an embodiment of the present invention provides an audio and video call method, where the method includes:

receiving an audio and video call instruction, and sending an audio and video call request to a first terminal in response to the audio and video call instruction;

determining a first moment for receiving a first audio and video data packet, wherein the first audio and video data packet is sent by the first terminal for receiving the audio and video call request;

determining a second moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an audio and video unit of the notification message in response to the audio and video call request;

and determining the later occurring time among the first time and the second time, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit if the later occurring time is within a preset waiting time period.

In a second aspect, an embodiment of the present invention provides an audio and video call method, where the method includes:

receiving an audio and video call request sent by a second terminal;

determining a third moment for receiving a first audio and video data packet, wherein the first audio and video data packet is sent by the second terminal after receiving an audio and video call response, and the audio and video call response is sent by the second terminal after responding to the audio and video call request;

determining a fourth moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an audio and video unit of the notification message in response to the audio and video call request;

and determining the later occurring time of the third time and the fourth time, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit if the later occurring time is within a preset waiting time period.

In a third aspect, an embodiment of the present invention provides an audio/video call apparatus, where the apparatus includes:

the first receiving module is used for receiving an audio and video call instruction and responding to the audio and video call instruction to send an audio and video call request to the first terminal;

the first determining module is used for determining a first moment for receiving a first audio and video data packet, wherein the first audio and video data packet is sent by the first terminal for receiving the audio and video call request;

the second determining module is used for determining a second moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an audio and video unit of the second determining module in response to the audio and video call request;

and the first timing module is used for determining the later occurring time between the first time and the second time, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit if the later occurring time is within a preset waiting time period.

In a fourth aspect, an embodiment of the present invention provides an audio and video apparatus, where the apparatus includes:

the second receiving module is used for receiving an audio and video call request sent by a second terminal;

a third determining module, configured to determine a third time for receiving a first audio/video data packet, where the first audio/video data packet is sent by the second terminal in response to the audio/video call request, and the audio/video call response is sent by the second terminal in response to the audio/video call request;

a fourth determining module, configured to determine a fourth time when a notification message indicating that the start is successful is received, where the notification message is sent by an audio/video unit of the fourth determining module in response to the audio/video call request;

and the second timing module is used for determining the later occurring time among the third time and the fourth time, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit if the later occurring time is within a preset waiting time period.

In a fifth aspect, an embodiment of the present invention provides an audio/video call device, where the device includes:

a memory, a communication bus, and a processor, wherein:

the memory is used for storing an audio and video call program;

the communication bus is used for realizing connection communication between the processor and the memory;

the processor is used for executing the audio and video call program stored in the memory so as to realize the following steps:

determining a first moment for receiving an audio and video data packet, wherein the audio and video data packet is sent by the first terminal for receiving the audio and video call request;

In a sixth aspect, an embodiment of the present invention provides an audio/video call device, where the device includes:

a memory, a communication bus, and a processor, wherein:

the memory is used for storing an audio and video call program;

receiving an audio and video call request sent by a second terminal;

In a seventh aspect, an embodiment of the present invention provides a computer-readable storage medium, where an audio/video call program is stored on the computer-readable storage medium, and when the audio/video call program is executed by a processor, the steps of the audio/video call method are implemented.

The embodiment of the invention provides an audio and video call method, an audio and video call device, audio and video call equipment and a storage medium, wherein firstly, an audio and video call instruction is received, and an audio and video call request is sent to a first terminal in response to the audio and video call instruction; determining a first moment for receiving an audio and video data packet, wherein the audio and video data packet is sent by the first terminal for receiving the audio and video call request, and determining a second moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an own audio and video unit for responding to the audio and video call request; and finally, determining the later occurring time among the first time and the second time, and if the later occurring time is within a preset waiting time period, starting a timer to start timing at the later occurring time and simultaneously outputting the audio and video data packet by using the audio and video unit, thus ensuring that when the first data packet sent from the first terminal is received and the two events of successful start of the audio and video unit are completely completed, starting the timer to start timing and outputting the audio and video data packet, so that the audio and video call can be normally carried out when a call interface starts timing, and further improving the user experience.

Drawings

Fig. 1 is a schematic diagram of an implementation environment of an audio/video call method according to an embodiment of the present invention;

fig. 2 is a schematic diagram of an implementation flow of an audio/video call method according to an embodiment of the present invention;

fig. 3 is a schematic diagram of an implementation flow of another audio/video call method according to an embodiment of the present invention;

fig. 4 is an interface schematic diagram of a first terminal receiving an audio/video call request according to an embodiment of the present invention;

fig. 5 is a schematic interface diagram after a first terminal receives an audio/video call answering instruction according to an embodiment of the present invention;

fig. 6 is a schematic view of a scenario where the first terminal starts timing according to an embodiment of the present invention;

fig. 7 is a schematic diagram illustrating an implementation flow of a conventional audio/video call method according to an embodiment of the present invention;

fig. 8 is a schematic diagram of an implementation flow of another audio/video call method according to an embodiment of the present invention;

fig. 9 is a schematic structural diagram of an audio/video call device according to an embodiment of the present invention;

fig. 10 is a schematic structural diagram of the audio/video call device according to the embodiment of the present invention.

Detailed Description

In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the following describes specific technical solutions of the present invention in further detail with reference to the accompanying drawings in the embodiments of the present invention. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.

Fig. 1 is a schematic diagram of an implementation environment of an audio/video call method according to an embodiment of the present invention, and as shown in fig. 1, the implementation environment includes an intelligent terminal 101, an intelligent terminal 102, and a server 103, where the

intelligent terminals

101 and 102, the intelligent terminal 101 and the server 103, and the intelligent terminal 102 and the server 103 are connected through a network and perform information interaction.

The intelligent terminal 101 is installed with an instant communication program, which refers to instant communication programs similar to QQ and wechat of tengchin science and technology (shenzhen) limited in china, michat of beijing millet science and technology limited in china, and YY voice of guangzhou hua multi-network science and technology limited in china. The intelligent terminal can be a smart phone, a tablet computer, an e-book reader, an MP3 player (Moving Picture Experts Group Audio Layer iii, motion video compression standard Audio Layer 3), an MP4 player (Moving Picture Experts Group Audio Layer iv, motion video compression standard Audio Layer 4), a laptop portable computer, a desktop computer, and the like.

The server 103 may be a server, a server cluster composed of several servers, or a cloud computing service center. The server 103 is configured to transmit the audio/video digital signal, and the server 103 is further configured to receive an error message reported by the intelligent terminal 101 and/or the intelligent terminal 102, so as to close the audio/video call method function provided by the embodiment of the present invention to an intelligent terminal of the same model as the intelligent terminal 101 and/or the intelligent terminal 102.

With reference to the schematic diagram shown in fig. 1, the following describes embodiments of an audio/video call method and an audio/video call apparatus.

An embodiment of the present invention provides an audio and video call method, and fig. 2 is a schematic diagram illustrating an implementation flow of the audio and video call method provided in the embodiment of the present invention, and as shown in fig. 2, the method includes:

step S201, the second terminal receives an audio and video call instruction and responds to the audio and video call instruction to send an audio and video call request to the first terminal.

In an embodiment, the audio/video call instruction received by the second terminal may be an operation instruction generated when the user clicks a "voice call" button or a "video call" button on an executed instant messaging program, or may be an instruction generated when the user sends a gesture or voice preset to initiate an audio/video call.

After receiving the audio and video call instruction, the second terminal acquires the identification information of the called party carried in the audio and video call instruction, determines the identification information of the first terminal corresponding to the called party according to the identification information of the called party, and sends an audio and video call request to the first terminal, wherein the audio and video call request carries the identification information of the calling party. At this time, the second terminal enters the state of the calling ring back tone, and a prompt message of 'waiting for the other party to answer' is displayed on an interface of the second terminal.

Step S202, the second terminal determines a first moment for receiving the first audio/video data packet.

In an embodiment, the first audio/video data packet is sent by the first terminal for receiving the audio/video call request.

After receiving the audio and video call request, the first terminal sends an audio and video call response to the second terminal if receiving an instruction of answering the audio and video call, wherein the audio and video call response is used for representing that the first terminal receives the audio and video call request, the first terminal initializes and starts an audio and video unit of the first terminal, collects an audio and video data packet sent by a user A of the first terminal after the first terminal finishes the starting, and sends the collected audio and video data packet to the second terminal.

The audio and video unit may include: the device comprises an audio input unit, an audio output unit, a video input unit and a video output unit. The audio input unit can be a microphone of the terminal, and can also be a microphone on an earphone connected with the terminal; the audio output unit can be a receiver and a microphone carried by the terminal, or a receiver on an earphone which is connected with the terminal; the video input unit can be a camera carried by the terminal, and can also be a camera which is connected with the terminal; the video output unit is typically a display screen of the terminal.

Step S203, the second terminal determines a second time for receiving the notification message indicating that the starting is successful.

In an embodiment, the notification message is sent by an audio/video unit of the notification message in response to the audio/video call request.

When the second terminal receives the audio and video call instruction or sends the audio and video call request to the first terminal, the second terminal starts to initialize the audio and video unit of the second terminal, or starts to initialize and start the audio and video unit of the second terminal.

If the second terminal only performs an initialization process on the audio/video unit when receiving the audio/video call instruction or when the second terminal sends the audio/video call request to the first terminal, the second terminal starts the audio/video unit after receiving a response of receiving the audio/video call request sent by the first terminal.

In the embodiments of the present invention and other embodiments, initializing an audio/video unit of the device includes:

acquiring configuration parameters of the audio and video unit, wherein the configuration parameters at least comprise a coding format, a bit rate and a sampling rate of the audio and video unit;

acquiring identification information and configuration permission of the audio and video unit;

and sending the configuration parameters to the audio and video unit according to the identification information of the audio and video unit.

The method for starting the self audio and video unit comprises the following steps:

and sending a starting instruction to the audio and video unit of the user, wherein the starting instruction is used for informing the audio and video unit of starting to collect audio and video data packets.

After the audio and video unit is started successfully, a notification message of successful start is sent out. And the second terminal determines the time when the notification message of successful starting is received as a second time.

Step S204, the second terminal determines a later time from the first time and the second time.

Here, for example, the first time is 15:17:20:50 on 29/7/2017, and the second time is 15:17:21:10 on 29/7/2017, and the second time is a time occurring later than the first time and the second time.

And step S205, if the later time is within a preset waiting time period, starting a timer at the later time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit.

In other embodiments, before step S205, the method further comprises: the second terminal determines a fifth moment when the audio and video call connection between the second terminal and the first terminal is successfully established; and determining a preset waiting time period according to the fifth moment and a preset waiting time.

For example, the fifth time when the audio-video call connection between the first terminal and the second terminal is successfully established is 15:17:19:40 in 7/29/2017, and the preset waiting time is 2 seconds, the preset waiting time period is from the fifth time to the fifth time plus the preset waiting time period, that is, the preset waiting time period is from 15:17:19:40 in 29/7/2017 to 15:17:21:40 in 29/7/2017.

It should be noted that the preset waiting time is generally preset by a developer of the audio/video call method, and is generally invisible to the user and cannot be changed by the user.

If the first time is 29/7/month (2017) 15:17:20:50 and the second time is 29/7/month (2017) 15:17:21:10, the later time between the first time and the second time is 29/7/month (2017) 15:17:21:10 (the second time), and the time is between 29/7/month (2017) 15:17:21:10 and the 29/7/month (2017) 15:17:19:40 and the 29/7 month (2017) 15:17:21:40, the timer is started at the second time to start the audio-video call timing, and the received audio-video data packet is output by using the audio-video unit of the timer. Therefore, when the audio and video call timing is started, the self audio and video unit is started successfully and receives the audio and video data packet of the first terminal, and when the timing is started, a user can carry out normal audio and video call without time difference, so that the actual state of the audio and video call can be effectively and correctly sensed through the time on the terminal interface.

In other embodiments, if at least one of the first time and the second time is not within the preset waiting time period, starting a timer at the sixth time to start timing and simultaneously outputting the audio/video data packet by using the audio/video unit. And the sixth moment is obtained by adding the preset waiting time to the fifth moment. That is, if the first audio/video data packet sent by the first terminal is not received and/or the notification message that the starting of the audio/video unit of the first terminal is successful is not received within the preset time period, timing is started at the sixth moment to avoid normal audio/video conversation.

In the embodiment of the invention, firstly, an audio and video call instruction is received, and an audio and video call request is sent to a first terminal in response to the audio and video call instruction; determining a first moment for receiving an audio and video data packet, wherein the audio and video data packet is sent by the first terminal for receiving the audio and video call request, and determining a second moment for receiving a notification message for indicating successful starting, wherein the notification message is sent by an own audio and video unit for responding to the audio and video call request; and finally, determining the later occurring time among the first time and the second time, and if the later occurring time is within a preset waiting time period, starting a timer to start timing at the later occurring time and simultaneously outputting the audio and video data packet by using the audio and video unit, thus ensuring that when the first data packet sent from the first terminal is received and the two events of successful start of the audio and video unit are completely completed, starting the timer to start timing and outputting the audio and video data packet, so that the audio and video call can be normally carried out when a call interface starts timing, and further improving the user experience.

Based on the foregoing embodiment, an embodiment of the present invention further provides an audio/video call method, and fig. 3 is a schematic diagram illustrating an implementation flow of another audio/video call method provided in the embodiment of the present invention, as shown in fig. 3, the method includes the following steps:

step S301, the second terminal receives an audio and video call instruction and responds to the audio and video call instruction to send an audio and video call request to the first terminal.

Step S302, when the second terminal sends an audio and video call request to the first terminal or receives an audio and video call instruction, the second terminal initializes the audio and video unit thereof.

In this embodiment, initializing its own audio/video unit includes: acquiring configuration parameters of the audio and video unit, wherein the configuration parameters at least comprise a coding format, a bit rate and a sampling rate of the audio and video unit; acquiring identification information and configuration permission of the audio and video unit; and sending the configuration parameters to the audio and video unit according to the identification information of the audio and video unit.

In this embodiment, after the initialization of the audio/video unit is completed, an unavailable identifier is added to the audio/video unit, and at this time, other services cannot occupy the audio/video unit, so that the problem that the audio/video unit is occupied by other services after the first terminal sends a request for receiving an audio/video call, which causes a failure in the audio/video call, can be avoided.

In some technologies, when a second terminal requests to perform an audio/video call with a first terminal, the second terminal starts initializing and starts an audio/video unit thereof after receiving a response to answer the audio/video call sent by the first terminal. In the embodiment, the second terminal starts initializing the audio/video unit when receiving an audio/video call instruction sent by a user or sending an audio/video call request to the first terminal, so that the step of starting the audio/video unit is only needed to be executed after receiving a response of answering the audio/video call sent by the first terminal.

And step S303, the second terminal receives the audio and video call response and responds to the audio and video call response to start an own audio and video unit.

Here, the audio/video call response is triggered by the first terminal answering the audio/video call.

In this embodiment, starting the audio/video unit itself includes: and sending a starting instruction to the audio and video unit, wherein the starting instruction is used for informing the audio and video unit to start collecting audio and video data packets, and starting a pre-processing module and a post-processing module of the audio, and the pre-processing module and the post-processing module are used for carrying out operations such as noise cancellation, echo cancellation and the like on the received audio data packets.

And step S304, the second terminal determines a second moment when the notification message that the self audio/video unit is successfully started is received.

Here, after the audio/video unit of the terminal is successfully started, a notification message of successful start is sent to the second terminal, and the second terminal records the time when the notification message is received and determines the time as the second time.

Step S305, the second terminal determines whether the audio/video call connection between itself and the first terminal is successfully established.

In this embodiment, when the second terminal receives the data packet representing the audio/video call connection, it indicates that the audio/video call connection between the first terminal and the second terminal is successfully established.

If the audio and video call connection between the first terminal and the second terminal is successfully established, the method goes to step S306; if the audio/video call connection between the first terminal and the second terminal is failed to be established, the process goes to step S314.

And step S306, the second terminal determines a fifth moment when the audio and video call connection between the second terminal and the second terminal is successfully established.

And step S307, the second terminal determines a waiting time period according to the fifth time and a preset waiting time.

Here, the waiting time period is from the fifth timing to the fifth timing plus a preset waiting time period.

Step S308, the second terminal determines a first moment for receiving the first audio/video data packet.

Here, the first audio/video data packet is sent by the first terminal for receiving the audio/video call request, that is, the first audio/video data packet is a first data packet sent by the first terminal after answering the audio/video call, and the voice carried in the first data packet is often a greeting such as "feed", "hello", and the like.

Step S309, the second terminal determines a later time occurring between the first time and the second time.

Step S310, the second terminal determines whether the subsequent time is within a preset waiting time period.

Judging whether the later time is in a preset waiting time period, namely judging whether a notification message that the starting of the audio and video unit is successful is received in the preset waiting time period and a first audio and video data packet is received; if the later time is within the preset waiting time period, it indicates that the notification message that the starting of the audio/video unit is successful is received within the preset waiting time period and the first audio/video data packet is also received, and then the step S311 is performed; if the later time is not within the preset waiting time period, it indicates that the message of successful start or at least one of the first audio/video data packets is not received within the preset waiting time period, and then the process goes to step S312.

And step S311, starting a timer at the later time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit.

And step S312, starting a timer at the sixth moment to start timing and simultaneously outputting the audio and video data packet by utilizing the audio and video unit.

Here, the sixth time is obtained by adding the waiting time period to the fifth time.

Step 313, the second terminal judges whether an instruction for ending the audio/video call is received.

Here, the instruction for ending the audio/video call may be an instruction generated by the second terminal receiving a touch operation for turning off the audio/video call, which is sent by the user on a touch screen of the second terminal; the instruction for ending the audio and video call can also be an instruction for ending the audio and video call sent by the first terminal.

Step S314, ending the video call.

In other embodiments of the present invention, step S302 ', step S303 ', and step S304 ' may be performed without performing step S302 and step S303:

step S302', the second terminal determines the own ring mode when sending an audio and video call request to the first terminal or receiving an audio and video call instruction;

and step S303', if the own ring mode is mute or vibration, the second terminal initializes and starts the own audio/video unit.

And step S304', the second terminal receives the audio and video call response sent by the first terminal.

In the embodiments of steps S302 'to S304', if the ring mode of the second terminal is mute or vibrate, the second terminal does not need to play a ring in the process of making an audio/video call, and the second terminal can initialize and start its audio/video unit when sending an audio/video call request or receiving an audio/video call instruction to the first terminal and before receiving an audio/video call response sent by the first terminal, so that when receiving a response of the first terminal to answer the audio/video call, the audio/video unit of the second terminal is always started successfully, and the audio/video data packet sent by the first terminal can be received at any time, thereby increasing the connection speed.

In this embodiment, first, the second terminal receives an audio/video call instruction, sends an audio/video call request to the first terminal in response to the audio/video call instruction, initializes its own audio/video unit when sending the audio/video call request to the first terminal or receiving the audio/video call instruction, and starts its own audio/video unit in response to the audio/video call response after the second terminal receives the audio/video call response from the first terminal; then the second terminal determines a second moment when the notification message that the audio and video unit of the second terminal is successfully started is received, and determines a fifth moment when the audio and video call connection is successfully established on the premise that the audio and video call connection between the second terminal and the first terminal is successfully established; determining a waiting time period according to the fifth moment and a preset waiting time; the second terminal determines a first moment for receiving a first audio/video data packet; the second terminal determines the later time from the first time and the second time; if the later time is within the preset waiting time period, starting a timer to start timing at the later time and simultaneously utilizing the audio and video unit to output the audio and video data packet, and if the later time is not within the preset waiting time period, starting the timer to start timing at a sixth time and simultaneously utilizing the audio and video unit to output the audio and video data packet. Compared with the prior art, the method has the advantages that the step of initializing the audio and video unit is advanced, the occupancy rate of system resources after the communication is communicated can be reduced, and the communication speed can be increased; and when the first data packet sent from the first terminal is received and the audio and video unit of the first data packet is successfully started, the timer is started again to start timing and output the audio and video data packet, so that the audio and video call can be normally carried out when the call interface starts timing, and the user experience is further improved.

Based on the foregoing embodiment, an embodiment of the present invention further provides an audio/video call method, where the method includes the following steps:

step 1, a first terminal receives an audio and video call request sent by a second terminal, and initializes an audio and video unit of the first terminal when receiving the audio and video call request sent by the second terminal.

In this embodiment, after receiving the audio/video call request, the first terminal enters a ring state, and displays a 401 "answer" button and a 402 "hang-up" button on the interface shown in fig. 4, and if the first terminal receives an instruction of answering the audio/video call sent by a user in a touch area of the "answer" button, the first terminal sends a response of accepting the audio/video call request to the second terminal; if the first terminal receives an instruction of refusing to answer the audio and video call sent by a user in a touch area of the 'hang-up' button, a response of refusing the audio and video call request is sent to the second terminal; if the first terminal does not receive any operation of the user within a certain time period, an unmanned response is sent to the second terminal.

And step 2, if the first terminal receives an audio and video call answering instruction, responding to the audio and video call answering instruction and sending an audio and video call answering response to the second terminal.

Here, fig. 5 is an interface schematic diagram after the first terminal receives the audio/video call answering instruction according to the embodiment of the present invention, and if the first terminal receives the audio/video call answering instruction, as shown in fig. 5, a prompt message that connection is being performed is displayed 501 on the interface of the first terminal.

In other embodiments of the present invention, if the first terminal receives the audio/video call rejection instruction, the first terminal responds to the audio/video call rejection instruction, sends an audio/video call rejection response to the second terminal, and ends the audio/video call. And if the first terminal does not receive the operation of the user, sending an unmanned answering response to the second terminal, and ending the audio and video call.

And step 3, the first terminal starts the audio and video unit thereof.

And 4, the first terminal determines the fourth moment of receiving the notification message that the self audio and video unit is successfully started.

And 5, the first terminal judges whether the audio and video call connection between the first terminal and the second terminal is established successfully.

If the audio and video call connection between the second terminal and the second terminal is successfully established, entering step 6; and if the audio and video call connection between the second terminal and the second terminal is failed to be established, the step 13 is carried out.

And 6, the first terminal determines a fifth moment when the audio and video call connection is successfully established.

And 7, the first terminal determines a preset waiting time period according to the fifth moment and a preset waiting time.

And 8, the first terminal determines a third moment for receiving the first audio/video data packet.

Here, the first audio/video data packet is sent by the second terminal receiving an audio/video call response, and the audio/video call response is sent by the second terminal itself in response to the audio/video call request.

And 9, the first terminal determines the later occurring time in the third time and the fourth time.

And step 10, if the later time is within a preset waiting time period, starting a timer at the later time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit.

And step 11, if the later time is not in the preset waiting time period, starting a timer at the sixth time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit.

Here, the sixth time is a time obtained by adding the waiting time period to the fifth time.

Fig. 6 is a schematic view of a scenario in which the first terminal starts timing according to an embodiment of the present invention, and as shown in fig. 6, when a notification message that the start is successful is received and a first audio/video data packet is received within a preset waiting time period, timing is started, and a timing duration of an audio/video call is displayed on an interface 601 of the first terminal.

And step 12, the first terminal judges whether an instruction for finishing the audio and video call is received.

Here, if the first terminal receives an instruction to end the audio/video call, the process goes to step 13; and if the first terminal does not receive the instruction of finishing the audio and video call, continuing the audio and video call with the second terminal.

And step 13, the first terminal finishes the audio and video call with the second terminal.

In other embodiments of the present invention, after step 13, the method further comprises: judging whether the state of the audio/video unit is started or not; if the state of the audio/video unit is starting, the audio/video unit is closed; and if the state of the audio and video unit is not starting, ending the process.

In other embodiments of the present invention, steps 1 ', 2' and 3 'may be performed instead of steps 1, 2 and 3':

step 1', a first terminal receives an audio and video call request sent by a second terminal, and determines a self ring mode when receiving the audio and video call request sent by the second terminal;

step 2', if the own ring mode is mute or vibration, the first terminal initializes and starts the own audio and video unit;

and 3', if the first terminal receives an audio and video call answering instruction, responding to the audio and video call answering instruction and sending an audio and video call answering response to the second terminal.

It should be noted that, for the explanation of the same steps or concepts in the present embodiment as in the other embodiments, reference may be made to the description in the other embodiments.

In the embodiment, the audio and video unit is initialized when the audio and video call request is received, the step of initializing the audio and video unit is advanced, the occupancy rate of system resources after call communication can be reduced, and the communication speed can be increased; and when the first data packet sent from the first terminal is received and the audio and video unit of the first data packet is successfully started, the timer is started again to start timing and output the audio and video data packet, so that the audio and video call can be normally carried out when the call interface starts timing, and the user experience is further improved.

In order to better understand the embodiment of the invention, the existing audio and video call method is explained first, so that the technical effect of the audio and video call method provided by the embodiment of the invention can be more clearly understood.

A normal session typically goes through three steps of accepting (initiating) a call, connecting, and starting a timer. Fig. 7 is a schematic diagram illustrating an implementation flow of a conventional audio/video call method according to an embodiment of the present invention, and as shown in fig. 7, the method includes the following steps:

step S701, the user initiates an audio and video call or receives an audio and video call request of the other side.

Step S702, judging whether the opposite side receives the audio and video call request or whether an operation instruction of the user for answering the audio and video call is received.

Here, if in step S701, the audio/video call is initiated by the user, if the opposite side accepts the audio/video call request (that is, the opposite side answers the audio/video call), step S703 is entered; if the opposite side is working or inconvenient to answer the audio/video call, the audio/video call request is rejected (that is, the opposite side presses the off key to reject the audio/video call) or the opposite side does not answer the audio/video call (that is, the opposite side does not answer after ringing for a period of time), then the procedure goes to step S708.

If in step S701, the user is a called party and receives an audio/video call request from the other party (i.e., a calling party), then if an operation instruction for the user to answer the audio/video call is received, the process goes to step S703; if no operation instruction for the user to listen to the high-pitched video call is received, the process proceeds to step S708.

And step S703, initializing and starting the audio and video equipment of the user.

Step S704, determining whether the audio/video call connection is established successfully.

Here, if the audio/video call connection is successfully established, the process goes to step S705; if the quality of the network channel of any one of the two parties is not good or the network connection is disconnected during the process of establishing the audio/video call connection, the audio/video call connection is failed to be established, and then the process goes to step S708.

Step S705, a first timer is started to start timing, and the timing is stopped after waiting for a preset time.

Here, after the audio/video call connection is successfully established, both sides will wait for a certain time, for example, 2s, and will start the audio/video call after 2s, and time the audio/video call.

And step S706, carrying out audio and video call with the other party, and starting a timer to start timing the audio and video call.

Step S707 determines whether a notification message to hang up the video call is received or whether an operation instruction to hang up the video call sent by the user of the user is received.

Here, if a notification message that the opposite party hangs up the video call is received or an operation instruction for hanging up the video call is received from the user of the user, the process proceeds to step S708; and if the notification message that the opposite side hangs up the video call is not received or the operation instruction of hanging up the video call sent by the user of the opposite side is not received, continuing the audio and video call.

And step S708, ending the audio and video call.

Here, if step S708 is executed because the opposite party rejects the audio/video call request or the opposite party does not answer the audio/video call while step S702 is executed, then the audio/video call is only ended at this time; if yes, executing step S704, executing step S708 because the audio-video call connection is not established successfully; or in step S707, since either of the two parties hangs up the audio/video call and executes step S708, the audio/video device is in the start state, and therefore the audio/video device needs to be turned off and the audio/video call is ended.

In the existing audio and video call method, after the audio and video call connection is successfully established, a certain time length needs to be forcibly waited, and in the waiting process, the audio and video equipment of the user possibly starts up, and an audio and video data packet is sent from the opposite party, but the user still is in a connection state on an interface, and the user can mistakenly think that the user is not connected with the opposite party, and the user misses the call content started by the opposite party.

Based on this, an embodiment of the present invention provides an audio and video call method, and fig. 8 is a schematic diagram illustrating an implementation flow of another audio and video call method provided in an embodiment of the present invention, as shown in fig. 8, the method includes the following steps:

step S801, the user initiates an audio and video call or receives an audio and video call request of the other side.

Step S802, initializing the audio and video equipment of the user.

And step S803, judging whether the opposite side receives the audio and video call request or whether an operation instruction of the user for answering the audio and video call is received.

Here, if in step S801, the audio/video call is initiated by itself, if the opposite side accepts the audio/video call request (that is, the opposite side answers the audio/video call), then step S804 is entered; if the opposite side is working or inconvenient to answer the audio/video call, the audio/video call request is rejected (that is, the opposite side presses the off key to reject the audio/video call) or the opposite side does not answer the audio/video call (that is, the opposite side does not answer after ringing for a period of time), then the procedure goes to step S810.

If in step S801, the user is a called party and receives an audio/video call request from the other party (i.e. a calling party), then if an operation instruction for the user to answer the audio/video call is received, the process goes to step S804; if no operation instruction for the user to listen to the high-pitched video call is received, the process proceeds to step S810.

And step S804, starting the audio and video equipment of the user.

Step S805, determining whether the audio/video call connection is successfully established.

Here, if the audio/video call connection is successfully established, the process proceeds to step S806; if the quality of the network channel of any one of the two parties is poor or the network connection is disconnected in the process of establishing the audio/video call connection, the audio/video call connection is failed to be established, and then the process goes to step S810.

Step S806, starting a first timer to start timing, and determining whether the audio data packet is received and a notification message that the audio/video device is successfully started is received within a preset time period.

Here, if within the preset duration, an audio/video data packet is received and a notification message that the audio/video device is successfully started is received, it indicates that the audio/video device of the user can already collect the audio/video data packet and that audio/video data arrives, and then an audio/video call can be started and call timing is performed, and then step S808 is performed. If the audio/video data packet and the notification message that the starting of the audio/video device is successful are not received within the preset time length, the step S807 is entered.

In step S807, the timing duration is waited for to reach the preset duration.

And step S808, carrying out audio and video call with the other party, and starting a timer to start timing the audio and video call.

Step S809, determining whether a notification message that the opposite party hangs up the video call is received or whether an operation instruction for hanging up the video call sent by the user of the user is received.

Here, if a notification message that the opposite side hangs up the video call is received or an operation instruction for hanging up the video call is received from the user of the user, the process proceeds to step S810; and if the notification message that the opposite side hangs up the video call is not received or the operation instruction of hanging up the video call sent by the user of the opposite side is not received, continuing the audio and video call.

And step S810, ending the audio and video call.

Here, if step S810 is executed because the opposite party rejects the audio/video call request or the opposite party does not answer the audio/video call while step S803 is executed, then the audio/video call is only ended at this time; if yes, executing step S805, executing step S810 because the audio-video call connection is not established successfully; or in the step S809, since either one of the two parties hangs up the audio/video call and performs the step S810, at this time, the audio/video device is in the start state, so that the audio/video device needs to be turned off and the audio/video call is ended.

It should be noted that the audio and video communication method provided by the embodiment of the present invention is applicable to iPhone4 and above models, and some Android (Android) models. Because the init step and the start step of the Android part model separation audio equipment have the silence problem, the audio and video call method provided by the embodiment of the invention can be configured through the background cloud, and the method is not applied to the models.

However, because the number of Android models is large, the configuration information of audio devices and ROMs of different models is different, the cloud server cannot acquire the information of audio and video devices and ROMs of all models, the cloud server cannot determine whether a certain model can apply the audio and video call method provided by the embodiment of the invention, when an application for starting the function of the audio and video call method provided by the embodiment of the invention is downloaded and installed in a terminal of a certain model, if the problem of silence occurs during audio and video call, an error message is reported to the cloud server, the method is used for informing the cloud server that the audio and video call method provided by the embodiment of the invention is silent when the terminal of the model is in audio and video call, and the cloud server closes the function of the audio and video call method provided by the embodiment of the invention when receiving a request for downloading the application from the terminal the same as the model.

In the audio and video call method provided by the embodiment of the invention, the initialization (init) and start (start) steps of the audio equipment are separated, the init step is advanced, the audio equipment is initialized when a call is initiated or a call request is received, and when the opposite side receives the request or answers the call, the start operation is directly carried out, so that the time consumption of the start step is reduced. Therefore, the occupation of system resources after the communication is communicated can be reduced, and the communication speed is further improved. In addition, in the audio and video call method provided by the embodiment of the invention, after the local audio equipment is monitored to be started and the event of receiving the first audio packet of the opposite party is monitored, audio and video call is started and interface timing is started after the local audio equipment and the event are all completed, so that the condition of starting audio and video call is not required to be waited for a preset time length forcibly, namely the connected state is converted into a call timing state when the condition of starting audio and video call is met, the user can be ensured to effectively sense the actual state of the call through the time on the interface, and the embodiment of the invention also has the protection of delaying the preset time length (2S), thereby preventing the call failure caused by the fact that a certain event is not received, and further improving the user experience.

An embodiment of the present invention further provides an audio/video communication device, fig. 9 is a schematic diagram of a structure of the audio/video communication device according to the embodiment of the present invention, and as shown in fig. 9, the device 900 includes: a first receiving module 901, a first determining module 902, a second determining module 903, and a first timing module 904, wherein:

the first receiving module 901 is configured to receive an audio/video call instruction, and send an audio/video call request to the first terminal in response to the audio/video call instruction;

the first determining module 902 is configured to determine a first time to receive a first audio/video data packet, where the first audio/video data packet is sent by the first terminal to receive the audio/video call request;

the second determining module 903 is configured to determine a second time when a notification message indicating that the start is successful is received, where the notification message is sent by an audio/video unit of the second determining module in response to the audio/video call request;

the first timing module 904 is configured to determine a later occurring time among the first time and the second time, and if the later occurring time is within a preset waiting time period, start a timer at the later occurring time to start timing and output the audio/video data packet by using the audio/video unit.

In other embodiments of the present invention, the apparatus 900 further comprises:

the first initialization module is used for initializing an audio and video unit of the first terminal when sending an audio and video call request to the first terminal or receiving an audio and video call instruction;

and the first starting module is used for starting the audio and video unit if receiving the audio and video call response sent by the first terminal after receiving the video call request.

In other embodiments of the present invention, the first initialization module further includes:

the first acquisition unit is used for acquiring configuration parameters of the audio and video unit, wherein the configuration parameters at least comprise a coding format, a bit rate and a sampling rate of the audio and video unit;

the second acquisition unit is used for acquiring the identification information and the configuration authority of the audio and video unit;

and the first sending unit is used for sending the configuration parameters to the audio and video unit according to the identification information of the audio and video unit.

The first initiating module further comprises:

and the second sending unit is used for sending a starting instruction to the audio and video unit of the second sending unit if the audio and video call response sent by the first terminal is received, wherein the starting instruction is used for informing the audio and video unit of starting to collect audio and video data packets.

In other embodiments of the present invention, the apparatus further comprises: a seventh determining module, configured to determine a ring mode of the first terminal when sending an audio/video call request to the first terminal or receiving an audio/video call instruction; and the second starting module is used for initializing and starting the audio and video unit of the second starting module if the ring mode of the second starting module is mute or vibration.

In other embodiments of the present invention, the apparatus further comprises:

the fifth determining module is used for determining a fifth moment when the audio and video call connection between the fifth determining module and the first terminal is successfully established;

a sixth determining module, configured to determine a preset waiting time period according to the fifth time and a preset waiting duration;

and the third timing module is used for starting a timer at a sixth moment and outputting the audio and video data packet by utilizing the audio and video unit if the first moment and/or the second moment are not within a preset waiting time period, wherein the sixth moment is obtained by adding the waiting time length to the fifth moment.

The above description of the apparatus embodiments, similar to the above description of the method embodiments, has similar beneficial effects as the method embodiments. For technical details not disclosed in the embodiments of the apparatus according to the invention, reference is made to the description of the embodiments of the method according to the invention for understanding.

Based on the foregoing embodiments, an embodiment of the present invention provides an audio/video communication device, where the device includes: a second receiving module, a third determining module, a fourth determining module, and a second timing module, wherein:

the third determining module is configured to determine a third time for receiving a first audio/video data packet, where the first audio/video data packet is sent by the second terminal in response to the audio/video call request, and the audio/video call response is sent by the second terminal in response to the audio/video call request;

the fourth determining module is configured to determine a fourth moment when a notification message indicating successful start is received, where the notification message is sent by an audio/video unit of the notification message in response to the audio/video call request;

and the second timing module is used for determining the later occurring time among the third time and the fourth time, and if the later occurring time is within a preset waiting time period, starting a timer at the later occurring time to start timing and simultaneously outputting the audio and video data packet by using the audio and video unit.

An embodiment of the present invention provides an audio and video communication device, fig. 10 is a schematic diagram of a composition structure of the audio and video communication device according to the embodiment of the present invention, and as shown in fig. 10, the audio and video communication device 1000 may include: at least one processor 1001, at least one communication bus 1002, a user interface 1003, at least one external communication interface 1004, and a memory 1005. Wherein the communication bus 1002 is configured to enable connective communication between these components. The user interface 1003 may include a display screen, and the external communication interface 1004 may include a standard wired interface and a wireless interface, among others. Wherein the processor 1001 is configured to:

In the embodiment of the invention, if the audio and video call method is realized in the form of a software functional module and is sold or used as an independent product, the method can also be stored in a computer readable storage medium. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: various media capable of storing program codes, such as a usb disk, a removable hard disk, a Read Only Memory (ROM), a magnetic disk, or an optical disk. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.

The embodiment of the invention provides a computer storage medium, wherein a computer executable instruction is stored in the computer storage medium and used for executing an audio and video communication method provided by the embodiment of the invention.

Based on the foregoing embodiments, an embodiment of the present invention provides an audio and video call device, where the audio and video call device may include: at least one processor, at least one communication bus, a user interface, at least one external communication interface, and memory. Wherein the communication bus is configured to enable connected communication between the components. Wherein the user interface may comprise a display screen and the external communication interface may comprise a standard wired interface and a wireless interface. Wherein the processor is configured to:

receiving an audio and video call request sent by a second terminal;

The embodiment of the invention further provides a computer storage medium, wherein a computer executable instruction is stored in the computer storage medium and used for executing the audio and video communication method provided by the embodiment of the invention.

The above description of the embodiments of the audio and video telephony device and the storage medium is similar to the description of the embodiments of the method described above, and has similar beneficial effects to the embodiments of the method. For technical details not disclosed in the embodiments of the audio and video telephony device and the storage medium of the present invention, please refer to the description of the embodiments of the method of the present invention for understanding.

It should be appreciated that reference throughout this specification to "one embodiment" or "an embodiment" means that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present invention. Thus, the appearances of the phrases "in one embodiment" or "in an embodiment" in various places throughout this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures, or characteristics may be combined in any suitable manner in one or more embodiments. It should be understood that, in various embodiments of the present invention, the sequence numbers of the above-mentioned processes do not mean the execution sequence, and the execution sequence of each process should be determined by its function and inherent logic, and should not constitute any limitation on the implementation process of the embodiments of the present invention. The above-mentioned serial numbers of the embodiments of the present invention are merely for description and do not represent the merits of the embodiments.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element.

In the several embodiments provided in the present application, it should be understood that the disclosed apparatus and method may be implemented in other ways. The above-described device embodiments are merely illustrative, for example, the division of the unit is only a logical functional division, and there may be other division ways in actual implementation, such as: multiple units or components may be combined, or may be integrated into another system, or some features may be omitted, or not implemented. In addition, the coupling, direct coupling or communication connection between the components shown or discussed may be through some interfaces, and the indirect coupling or communication connection between the devices or units may be electrical, mechanical or other forms.

The units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units; can be located in one place or distributed on a plurality of network units; some or all of the units can be selected according to actual needs to achieve the purpose of the solution of the embodiment.

In addition, all the functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may be separately regarded as one unit, or two or more units may be integrated into one unit; the integrated unit can be realized in a form of hardware, or in a form of hardware plus a software functional unit.

Those of ordinary skill in the art will understand that: all or part of the steps for realizing the method embodiments can be completed by hardware related to program instructions, the program can be stored in a computer readable storage medium, and the program executes the steps comprising the method embodiments when executed; and the aforementioned storage medium includes: various media that can store program codes, such as a removable Memory device, a Read Only Memory (ROM), a magnetic disk, or an optical disk.

Alternatively, the integrated unit of the present invention may be stored in a computer-readable storage medium if it is implemented in the form of a software functional module and sold or used as a separate product. Based on such understanding, the technical solutions of the embodiments of the present invention may be essentially implemented or a part contributing to the prior art may be embodied in the form of a software product, which is stored in a storage medium and includes several instructions for causing a computer device (which may be a personal computer, a server, or a network device) to execute all or part of the methods described in the embodiments of the present invention. And the aforementioned storage medium includes: a removable storage device, a ROM, a magnetic or optical disk, or other various media that can store program code.

The above description is only for the specific embodiments of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art can easily conceive of the changes or substitutions within the technical scope of the present invention, and all the changes or substitutions should be covered within the scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the appended claims.

Claims

1. An audio and video call method, characterized in that the method comprises:

2. The method of claim 1, further comprising:

initializing an audio/video unit of the first terminal when sending an audio/video call request to the first terminal or receiving an audio/video call instruction;

and if an audio and video call response sent by the first terminal for receiving the video call request is received, starting an audio and video unit of the first terminal.

3. The method of claim 2, wherein initializing the own audio-video unit comprises:

4. The method according to claim 2, wherein if an audio/video call response sent by the first terminal receiving the video call request is received, starting an audio/video unit thereof comprises:

and if an audio and video call response sent by the first terminal is received, sending a starting instruction to the audio and video unit of the first terminal, wherein the starting instruction is used for informing the audio and video unit of starting to collect audio and video data packets.

5. The method of claim 1, further comprising:

when an audio and video call request is sent to the first terminal or an audio and video call instruction is received, determining the own ringtone mode;

if the own ring mode is mute or vibration, initializing and starting the own audio and video unit.

6. The method of any one of claims 1 to 5, further comprising:

determining a fifth moment when the audio and video call connection between the first terminal and the second terminal is successfully established;

determining a preset waiting time period according to the fifth moment and a preset waiting time duration;

and if the first time and/or the second time are not within a preset waiting time period, starting a timer at a sixth time and outputting the audio and video data packet by utilizing the audio and video unit, wherein the sixth time is obtained by adding the waiting time length to the fifth time.

7. An audio and video call method, characterized in that the method comprises:

receiving an audio and video call request sent by a second terminal;

8. An audio-video call device, comprising:

9. The apparatus of claim 8, further comprising:

10. An audio-video call device, comprising:

11. An audio-video telephony device, wherein the device comprises: a memory, a communication bus, and a processor, wherein:

the memory is used for storing an audio and video call program;

12. An audio-video telephony device, wherein the device comprises: a memory, a communication bus, and a processor, wherein:

the memory is used for storing an audio and video call program;

receiving an audio and video call request sent by a second terminal;

13. A computer-readable storage medium, characterized in that the computer-readable storage medium has stored thereon an audio-video call program, which when executed by a processor implements the steps of the audio-video call method according to any one of claims 1 to 6 or claim 7.