TWI420387B - Internet real time vocal recording method and application thereof - Google Patents

Description

Instant voice recording method of webpage and its application

The invention is a method for network voice recording, in particular to a method for voice dialogue and recording in the internet through streaming audio.

The rapid development of e-commerce and the bright future are unquestionable. At present, the related applications of the Internet have sprung up. Although the life of ordinary people has become more and more convenient, it always makes people feel that they have lost their regrets. For example, the current home economy is fermenting, and the otaku house women can not only save a lot of time by shopping online, but also the style, type, style, price comparability and payment diversity provided on the Internet. And so on, it is hard to match the physical store, so the business model of the Internet has become one of the mainstream of the present and the future.

Although online shopping, online business practices, and web page product information are very convenient and informative, many people are still used to shopping in physical stores. The main reason is that they like to negotiate directly with the store staff to understand what they want to buy. Further information, such as function, performance, quality, manufacturing country, ingredients, bargaining, special offers today...etc.

However, the current web store or e-commerce webpage model can't achieve the effect of actually contacting the clerk. For example, when a user selects a product on an online shopping site, if there is a question about the specification of a certain product or wants to know more about the product, only the way to call the phone number of the webpage and the service of the online store can be used. The person asks or directly writes an email or text message to the webpage manager, and cannot directly and immediately communicate with the online store service personnel through the webpage or voicemail, thereby causing inconvenience to the user, which may reduce the user's use of the Internet shopping. Willingness.

In order to solve the technical problem that the existing online shopping webpage cannot directly contact the remote service personnel, causing inconvenience and reducing the willingness to participate in the network business behavior, the present invention uses the streaming voice transmission technology supported by the web browser. Let the local end user and the remote service personnel can provide communication or let the user record the message without having to install any software or perform additional installation of the plug-in before the user can communicate with the voice and improve the use. The purpose of convenience.

In order to solve the foregoing technical problem, the present invention provides a method for recording a real-time voice of a webpage, the method comprising: receiving a request message: a service provider receives a request message transmitted by a user terminal; and transmits a recording query message: the service Providing a message processing module to transmit a message to the user terminal of the user terminal via one of the service provider browsers; and recording the stream video message: the service provider receives the message The user-side browser transmits a user stream video and audio message, and records or stores the user stream video message to form a message sound file in the message processing module.

The method for recording the instant voice of the webpage further includes the step of sending a voice voice file, wherein the service provider broadcasts the voice voice file as a multimedia newsletter or an email attachment.

The method for recording the instant voice of the webpage further includes the step of sending a voice voice file, wherein the service provider first converts the voice voice file into a message text file, and then broadcasts the text message, the text message, or the text message. .

The method for recording the instant voice of the webpage further comprises the steps of: accepting the request to listen to the message request; performing the authentication procedure; and transmitting the message voice file step, after the completion of the authentication process and the broadcast of the message sound file.

The invention further provides a webpage instant voice dialogue and recording method, the method comprising the steps of: receiving a request message: a service provider receives a request message transmitted by a user browser of a user end; and determining whether to transmit the recording query message: The service provider determines whether to transmit a recording inquiry message according to whether a service personnel is online or not. When the judgment result is that the service personnel are online, a step of transmitting the streaming video message is performed. Otherwise, the following steps are performed: transmitting the recording inquiry Message: a message processing module of the service provider transmits a recording message to a user browser of the user terminal via one of the service provider browsers; and recording the streaming video message: The service provider receives a user stream video message transmitted by the user browser, and records or stores the user stream video message to form a message sound file in the message processing module; and transmits the stream video message : the provider of the provider browser transmits a provider string to a provider of audio and video objects The video and audio message is sent to the user end, wherein the provider audio and video object is a front-end application object built in the provider browser for transmitting and receiving streaming audio and video data; receiving the streaming video and audio message: the service provider receives the The user of the user streams the video and audio signals, so that the service provider and the user end perform two-way streaming video and audio messages.

The instant voice dialogue and recording method of the webpage further includes a step of sending a message sound file after the step of recording the stream video message, wherein the service provider uses the message sound file as a multimedia message or an email attachment. Broadcast.

The instant voice dialogue and recording method of the webpage further comprises the step of sending a message sound file after the step of recording the stream video message, wherein the service provider converts the message sound file into a message text file, and then uses plain text. Newsletters, text-only messages, or text-only messages are broadcast.

Thereby, the present invention has the following features and advantages:

1. The present invention provides a process for allowing a user to simply browse a web page, and selects a direct voice conversation with the service provider. After the user requests the conversation, the user does not need to install an external plug-in program or an extension object or program, so that In addition to direct communication, service personnel are also protected from the risk of poisoning or being invaded. Moreover, when the service personnel are not in the seat, the user can record the voice file on the service provider, and let the service provider listen to the message when it is available.

2. The user can also use the present invention to make a call to an external telephone system. The operator of the present invention only needs to connect the content of the present invention with the proxy server, so that the user can use the operator with other non-network telephone systems. The service staff speaks directly.

3. The present invention also provides a mechanism for synchronizing the content of the webpage that the user can watch with the service personnel, and the operator at one end can transmit the mouse cursor to the other party, letting the other party know the location of the mouse and fully understand the content of the webpage; This technical feature is more applicable to online online teaching.

Please refer to the first figure, which is an embodiment of a method for instant voice dialogue of a webpage according to the present invention. The instant voice dialogue method of the webpage is executed by a plurality of user terminals (10) and a service provider (20), and each user terminal (10) A web page provided by the service provider (20) can be logged in or read via the network (A) using a browser (12) of its own. The location, format, and content of the webpage provided by the service provider (20) are not limited. For example, the webpage may be a webpage that is attached to an external web server, so that each user terminal (10) can browse the webpage. The device (12) inputs the web address to view the webpage content, or the webpage may also be a webpage directly attached to the service provider (20) for each user terminal (10) to read the content. The so-called webpage format and content are not limited, which means that the webpage is not limited in expression. For example, the webpage may be a shopping webpage for posting products, a blog page, a Plurk webpage, and a webpage. Maps, etc., where the web page contains more than one linked object. The link object may be different according to the content and form of the webpage. For example, the link object may be a connection object related to the product in the shopping webpage (ICON of the product, ICON of the service personnel, and a phone number) ICON, the name of the service staff, ..., etc.); the linked object may be a graphic icon of the blogger in the blog page, the banner of the owner, etc.; the link object may be a friend of the canglang webpage a message bar; the link object may be a POI (point of interest) or a user's location on the network map; or the link object may also be a login status of other users on the webpage. Messages (for example, in the Google Mail webpage, the person who can display the contact list is logged in).

After the user terminal (10) presses or clicks the connection object, the browser (12) of the user terminal (10) transmits a request message to the service provider via the network (A) (20). The service provider (20) can receive the request message through a browser (22) and determine whether to accept the request message request. After the service personnel accept the request message, the service provider (20) The service personnel can perform a stream of video and audio through one of the audio-visual objects (222) of the browser (22) and the audio-visual object (122) of the browser (12) of the user terminal (10) ( Stream media), wherein when the user terminal (10) and the user and service personnel of the service provider (20) are performing streaming video and audio messaging, the user and the service personnel are respectively The audio and video interface (14) (24) receives the video and audio signals, and communicates through the network (A) in the form of streaming audio and video messages to achieve the effect of instant call. The audio interface (14) (24) can include a headset, a microphone, and a webcam. The audio-visual object (122) (222) may be a front-end application object built in the browser (12) (22) for transmitting and receiving streaming audio and video data, such as an Adobe Flash or a Microsoft Silver-light. Since Adobe Flash or Microsoft Silver-light is a standard built-in component for various browsers (such as FireFox, Microsoft Explorer, Google Chrome, Apple Safari, etc.), when users use streaming video messaging, There is no need to install additional software or plug-in or addon installation (such as Active X, Skype Addon), so that users can avoid the poisoning or hacking that they accept when installing the plug-in. (such as the Trojan horse to borrow the opportunity to implant) fear.

Similarly, if the link object represents the login status of the other user terminal (10), the user end (10) viewing the web page can click on the link object to access another user terminal (10) that has logged in. The call request is made, and the video and audio message is streamed according to the foregoing manner, and the technical effect of the two-way communication of the video and audio is achieved.

Taking the POI as an example, the web map can be a map of a housing agency, and the POI is the intermediary of the housing intermediator, that is, the intermediary in the house. On the website map of the Housing Agency, the advertisements for the rental and sale of the secondary media are displayed on the map in the form of interest points. The user can view the map of the home media through his browser (12) and select one of the interest points. After that, the service provider (20) performs streaming video and audio message transmission, so that the user can make a voice contact with the room service provider specific service personnel via the service provider (20) when needed, and directly negotiate the interest. Select the subject matter of the referral.

Further, the devices used by the user terminals (10) and the service providing terminal (20) are not limited, and for example, they may be computers, servers, or mobile devices (PDA phones, etc.). Taking the user end (A, B) (10) as a mobile device and the service providing end (20) as a server or a computer, the service providing end (20) can generate the user end (A) ( B) The actual geographical location of the mobile device (10) (the location of the GSM mobile phone base station (LBS) or the user end (A) through which the user terminal (A), the user terminal (B) can pass ), the satellite navigation location of the user end (B) determines the location of the user end (10) of the webpage map, so that the user end (A) (B) can browse the webpage map to find another The user selects the interest point of the physical location and directly dials the network call to another user. In practical applications, when the user terminals (A) and (B) are connected to the Internet (HSDPA, WCDMA, WiMAX) by 3G or 3.5G, for example, the user terminal (A) can browse the service provider (20). The provided web map is used to find and select the POI of the location of the user terminal (B), so that the voice connection after the user terminal (A) (B) can pass through the 3G. Or 3.5G mobile Internet data transmission, without the need to communicate through relatively expensive GSM and other telephone network systems, thereby saving huge communication costs.

Referring to the second figure, the service provider (20) may further include a webpage synchronization module (25), a message processing module (26), and an outbound processing module (27).

The webpage synchronization module (25) is an application disposed inside the service provider (20), and browses the user terminal (10) by using an attachment object (224) of the browser (22). The device (12) sends a webpage synchronization request, wherein an accessory object (124) of the browser (12) of the user terminal (10) receives the request for the webpage synchronization request, and generates a warning window or message displayed thereon. The browser (12) of the user terminal (10) causes the user of the user terminal (10) to determine whether to accept the webpage synchronization request of the service provider (20). When the user accepts the request from the service provider (20), the service provider (20) may present an open synchronization page to the accessory (124) of the user terminal (10) via the accessory (224). Commanding the accessory object (124) to cause the browser (12) of the user terminal (10) to open a new window or a page (TAB), and simultaneously opening the URL of the newly opened browser window or the page Synchronizing with the service provider (20) (for example, the webpage URL displayed by the browser (22) of the service provider (20) can be sent to the user terminal simultaneously when the command to open the synchronization webpage is transmitted. )). In this way, the service personnel of the service provider (20) can view the same webpage content as the user of the user terminal (10). Alternatively, the service provider (20) may also open a window or a page with the same web address as the web page currently being browsed by the user terminal (10) after the user terminal (10) accepts the webpage synchronization request.

The message processing module (26) can be a recordable server or a recordable application software installed on the service provider (20). The message processing module (26) is used as the service provider (20) after the user terminal (10) outputs a request signal to the service provider (20) because the service personnel are not on site or busy or offline. The recording can be started when the request signal cannot be accepted. The execution content can be as follows: the service provider (20) can transmit, via the accessory object (224), whether or not a recording message is sent to the accessory object (124) of the user terminal (10) via the user terminal (10). After confirming whether the recording message is recorded, the user terminal (10) can start transmitting voice, video and other signals through the video interface (14) to the service provider (20) by means of streaming audio and video signals, and the service provides After receiving the streaming video signal, the message processing module (26) stores the streaming video signal as a message sound file, so that the service provider of the service provider (20) can return or release the service personnel. After the busy line, you can listen to the recording of the user terminal (10).

Further, the user terminal (10) can assign or set the recorded message to a photo image file according to the foregoing recording step, so that the other user end (10) or the service provider end (20) is listed later. When the service personnel clicks or views the photo image file, the voice file recorded by the user terminal (10) is automatically played or selected. The photo image file may be provided by the service provider (20) or uploaded by the user terminal (10). The user terminal (10) uploads the photo image file to provide a webpage for the service provider (20) to allow each user terminal (10) to upload the photo image file by using a browser. For example, the photo image file may be a photo of one of the products (such as a house photo) provided by the service provider (20), and the service provider (20) is on the web page introducing the product. In addition, a message, a recording interface or a button object is provided. When the user terminal (10) has doubts about the product, the interface or button may be clicked to transmit the streaming video signal to the service provider. (20) storing the voice file as the voice file, and the service enhancer end (20) re-setting the connection relationship between the message sound file and the photo image file, so that the next time the photo image file appears in any user browser. When the page is played, the service personnel who automatically play or accept the user or the service provider (20) choose to play the voice file.

The outbound processing module (27) can be an application software or a separate server, such as a SIP (Session Initiation Protocol) add-on, and the outbound processing module (27) is used for the service provider (20). ) An interface to communicate with an external telephone system. The above-mentioned housing agency webpage is used as an illustrative example: in general, the service scope and base of the nation's housing intermediaries are all over the country. Therefore, the POI of the housing intermediary usually depends on the area of the service base. For division, for example, Taichung City may be divided into A District of Xitun District, Zone B of Xitun District, Beibei District, etc., among which Areas A and B of Xiqiao District are under the jurisdiction of Salespersons A and B. For example, suppose that after the user browses the area A of the Xiqiao area in the network map by using the user end (10), the user selects one of the interest selection points (POI) located in the area A of the Xitun area and then requests the message. a service provider (20), the service provider (20) finds a corresponding salesperson A according to the area where the interest selection point (POI) is located, and the service provider (20) uses the outbound processing module (27) ) and an external outbound management device (30) is connected to other telecommunication systems (mobile phones, local telephones, etc.), and if the salesperson A answers the call, the request message is received, and the audio and video interface thereof (14) starting to receive the user's video and audio signal and converting the user terminal (12), and transmitting the streaming video and audio message with the video and audio object (122), so that the user of the user terminal (10) can No difficulty and direct contact with the responsible salesperson to inquire about the details of the rental target that is of interest. The outbound management device (30) may be a SIP proxy server or an associated network connection device.

Therefore, the present invention is very convenient for the user, and can not only provide a voice connection with other users and service personnel on the network through a general browser without special installation of the plug-in program, and can also make the service through the webpage synchronization. The person can teach or explain the product directly on the webpage, so that there is no longer a language or operational barrier between the user and the service staff.

Further, after the user synchronizes with the service personnel, the service provider (20) can further transmit a mouse cursor on the browser of the service provider (20) through the accessory object (224). Giving the accessory (124) of the user terminal (10), allowing the browser (12) of the user terminal (10) to display the mouse cursor of the service provider (20), thereby allowing the user to Can fully understand the operational status of the service personnel.

Further, the service provider (20) can also receive the request message of the plurality of user terminals (10), and simultaneously perform streaming video message transmission or webpage synchronization for the plurality of user terminals (10), and can The embodiment is applied to video conferencing or video teaching; here, for the user, only one webpage can be opened, and the video conferencing or video teaching can be participated.

Further, the service provider (20) can also perform a voice connection with the user terminal (10), and then, according to the requirements of the user terminal (10), through the outbound processing module (27) The user terminal (10) transfers the outbound call to the outbound management device (30) to allow the user terminal (10) to make a call with the user of the other telephone system. Taking the webpage of the above-mentioned room broker as an example, when the user terminal (A) (10) makes a call to the service provider (20) of the home intermediary through the network, the wiring staff of the service provider (20) After the user of the user terminal (10) talks, the user terminal (10) is transferred to the regional mobile phone responsible for the service according to the user's needs. In order for the service provider (20) to smoothly perform the transfer work, the service provider (20) may further include an adapter object, which may be an object attached to the webpage, or installed in the service. Providing a special program of the terminal (20), the adapter object captures or receives the streaming video and audio message transmitted by the user terminal (10) by the audio interface (24), and after the area is responsible for the service answering the call, the transfer The object transmits the streaming video signal to the mobile phone of the service personnel via the outbound processing module (27) and the outbound management device (30), so that the service personnel and the user terminal (10) can perform Two-way streaming audio and video signal communication.

Referring to the third figure, in order to enable the service provider (20) to immediately know the message of the user terminal (10), the message processing module (26) can be further connected to a voice processing device (40). The voice processing device (40) can include a message output module (42) and a message listening module (44).

The message output module (42) may include or may be a Short Message Service (SMS or Multimedia Messaging Service, MMS system), an email server, a message publishing servo module, etc. Receiving or reading a message sound file recorded by the message processing module (26), and sending the message sound file to the service provider (20) by means of a multimedia message (MMS) or an email attachment One of the personnel is a message receiving device (50).

Alternatively, the message output module (42) may also be a front-end server or a sending service module including a voice-converted text function, which first converts the message sound file into a message text file, and then uses a plain text message (SMS). ) (send the service module via the SMS), plain text mail (via the email server), plain text messages (eg MSN messages, SKYPE messages, instant messaging, etc.) (via the message publishing the servo module) ), allowing the user to receive the text message converted by the voice message file by the message receiving device (50).

The message listening module (44) is a switch, a Public Switched Telephone Network (PSTN) or an Internet Protocol Private Branch Exchange (IP-PBX) that can be dialed in by one of the external telephones (60). Voice over Internet Protocol (VoIP), the message listening module (44) can set a phone number or a network phone number or code to accept the phone (60) to accept one of the user requests to listen to the message. After requesting, and after an authentication procedure, the voice file is played by the phone (60), and the person at the phone (60) listens to the voice message of the user terminal (10), wherein the authentication program can listen to the message. The module (44) requires the dialer of the telephone (60) to enter an authentication identity code or password.

(10). . . User side

(12). . . Browser

(122). . . Audio and video objects

(124). . . Accessory object

(14). . . Video interface

(20). . . Service provider

(twenty two). . . Browser

(222). . . Audio and video objects

(224). . . Accessory object

(twenty four). . . Video interface

(25). . . Web page synchronization module

(26). . . Message processing module

(27). . . Outbound processing module

(30). . . Outbound management device

(40). . . Voice processing device

(42). . . Message output module

(44). . . Message listening module

(50). . . Message receiving device

(60). . . phone

(A). . . network

The first figure is a schematic diagram of a system according to a first embodiment of the present invention.

The second figure is a schematic diagram of a system according to a second embodiment of the present invention.

The third figure is a schematic diagram of a system according to a third embodiment of the present invention.

(10). . . User side

(12). . . Browser

(122). . . Audio and video objects

(124). . . Accessory object

(14). . . Video interface

(20). . . Service provider

(twenty two). . . Browser

(222). . . Audio and video objects

(224). . . Accessory object

(twenty four). . . Video interface

(A). . . network

Claims (10)

A webpage instant voice conversation and recording method, the method comprising: receiving a request message: a service provider receives a request message transmitted by a user browser of a user terminal; and determining whether to transmit a recording inquiry message: the service providing The terminal determines whether to transmit a recording inquiry message according to whether the service personnel is online or not. When the judgment result is that the service personnel is online, a step of transmitting the streaming video and audio message is performed. Otherwise, the following steps are performed: transmitting the recording inquiry message: The message processing module of the service provider transmits a recorded message to a user browser of the user terminal via one of the service provider browsers; and records the streaming video message: the service provider Receiving a user stream video message transmitted by the user browser, and recording or storing the user stream video message to form a message sound file in the message processing module; transmitting the stream video message: the service Providing a provider of video and audio objects of the provider browser to transmit a provider stream video and audio message The user terminal, wherein the provider audio and video object is a front-end application object built in the provider browser for transmitting and receiving streaming audio and video data; receiving the streaming video and audio message: the service provider receives the user end The user streams the video and audio signals, so that the service provider and the user end perform two-way streaming video and audio messages. For example, in the instant voice dialogue and recording method of the webpage described in claim 1, the step of recording the streaming video and audio message further includes a step of sending a message sound file, wherein the service provider sends the message sound file to A multimedia message or an email attachment is broadcast. For example, in the instant voice dialogue and recording method of the webpage described in claim 1, after the step of recording the streaming video and audio message, the method further comprises the step of sending a voice file, wherein the service provider converts the voice file into a message first. After the text file, it will be broadcast in plain text message, plain text message or plain text message. The instant voice dialogue and recording method for a webpage as described in claim 1 or 2 or 3, comprising the steps of: accepting a request to listen to a message request; performing an authentication procedure; and transmitting a message sound file step, completing and passing the authentication procedure After the message sound file is broadcast. For the instant voice dialogue and recording method of the webpage as described in claim 1 or 2 or 3, in the step of transmitting the streaming video and audio message, the provider audio and video object receives and converts the video interface of the provider of the service provider. After the video signal, the provider stream video information. For the instant voice dialogue and recording method of the webpage as described in claim 1 or 2 or 3, in the step of transmitting the streaming video and audio message, one of the service providing end of the external dialing processing module receives an external telephone network. The video signal transmits the provider stream video and audio message through the provider audio and video object. For example, the instant voice dialogue and recording method of the webpage described in claim 4, the webpage is a shopping webpage for posting a product, a blog webpage, a webpage or a web map, and the linked object is the shopping webpage. a connected object related to the commodity; the linked object is an icon of the owner of the blog page or a sticker of the owner; the linked object is the surf page a message bar; the link object is an interest selection point or a user location on the network map. The instant voice dialogue and recording method of the webpage as described in claim 7, wherein: the provider audio-visual object is a front-end application object built in the provider browser for transmitting and receiving streaming audio and video data; and each The user end of the user end of the user browser, the user audio and video object receives the provider stream video and audio message, and the user video and audio object transmits the user stream video and audio message and the service provider. The user audio-visual object is a front-end application object built in the user browser and capable of transmitting and receiving streaming audio and video data. The instant voice dialogue and recording method of the webpage as claimed in claim 8, further comprising the step of: publishing a webpage synchronization request: one of the webpage synchronization modules of the service provider is attached to the provider of the provider browser The object sends a webpage synchronization request to the user end; the issuing the synchronizing webpage command: the webpage synchronization module of the service provider is sent after the service provider receives the request for synchronization of the user accessory of the user end Opening a synchronous webpage command to the user accessory of the user end, driving the user's browser of the user end to open a new window or a page, wherein the new window or the webpage displayed by the signboard browses with the provider The content of a webpage of the device is consistent; and the cursor cursor coordinates are issued: the service provider transmits a cursor position of the mouse cursor to the user terminal. Instant voice dialogue on the webpage as described in item 9 of the patent application scope And the recording method, the user audio and video object is an Adobe Flash or a Microsoft Silver-light; the provider audio and video object is an Adobe Flash or a Microsoft Silver-light.