The implementation method and the device of interactive picture and text communication service in real time
Technical field
The present invention relates to a kind of implementation method and device of new business of communication network, exactly, relate to the implementation method and the device of the real-time picture and text communication service of a kind of interactive mode, belong to the multimedia communication in the data communication
Technical field.
Background technology
At present, on the internet, opened the remote live communication service of following form:
(1) voice communication: the interchange of setting up communicating pair by voice mode, just IP phone (VOIP, Voice Over IP);
(2) video communication: the video image of real-time Transmission communicating pair and voice messaging;
(3) text chat: the Word message that communicating pair utilizes Internet chat software will need to exchange sends to the other side.
Now, in real work and life,, under different scenes, adopt different communication modes usually in order to reach abundant interchange.As in conference process, except utilizing the language narration, simultaneously also can be by figure or/and mode word is described illustrated object, language can not be expressed or situation beyond expression of words to remedy.And in some public places, because the audience of language performance around can influencing, the perhaps content of divulging a secret and being exchanged easily, people will realize interchange by alternate manner (gesture, figure, literal etc.) usually.
In above three kinds of communication modes, video communication can send the actual scene of communicating pair to the other side, makes both sides that the impression of face-to-face exchange be arranged, and can remedy the problem of pure voice communication institute information conveyed quantity not sufficient.Therefore, video communication is a kind of more satisfactory communication mode, but it has the following disadvantages: (1) needs configuration video acquisition and display device, expense costliness; (2) in the time need writing or describe illustrated object, need not stall to change video capture device, troublesome poeration with pen; (3) the needed transmission bandwidth of video information is bigger, and communication cost is higher; (4) having the same problem of voice communication, is exactly the session content of divulging a secret easily.
The text chat mode can be thought communicating pair that thought and the emotion expressed send the other side to by mode word, has certain accuracy.But, also have the following disadvantages: (1) form dullness, when literal is difficult to the exact expression thoughts and feelings, link up difficulty; (2) major defect is to transmit personal characteristics, as the calligraphy characteristic of communicating pair can not being passed (voice communication can be transmitted individual voice tone, and video communication then both can be transmitted voice, also can transmit personal image); (3) user must possess his writing ability or literal input capability, and applicable surface is restricted.
Summary of the invention
The purpose of this invention is to provide a kind of new communication service: the implementation method of interactive picture and text communication service in real time, to remedy the deficiency that communication modes such as existing voice communication, video communication and text chat exist.
Another object of the present invention provides a kind of device of realizing interactive picture and text communication service in real time.
The object of the present invention is achieved like this: the implementation method of the real-time picture and text communication service of a kind of interactive mode is characterized in that: comprise the following steps:
A, user are to the Virtual network operator place that carries out the real-time picture and text communication service of this interactive mode or its instant messaging (IM that runs, Instant Messenger) system or have on other network system of instant communication function and register application legal users name and corresponding password;
B, user use the picture and text terminal to be connected on the Internet, operation instant messaging program, and sign in to instantaneous communication system;
C, user establish a communications link by instant messaging program and the other side on the instantaneous communication system, make both sides enter the picture and text communication pattern; At this moment, the input and output of described picture and text terminal partly are called picture and text input area and picture and text viewing area;
D, under described picture and text communication pattern, the user uses input pen to write in the picture and text input area oneself to want the information of expressing and transmitting; Described information in writing process by the instant messaging program with the original form in its writing process, be sent in the picture and text viewing area of the other user's picture and text terminal in real time, its implementation is that the input process with this information is divided into plurality of unit time period, i.e. sampling period; When each unit interval section finishes, just the information change that takes place in this time period, comprise increase, revise or delete is sampled, and encapsulate with the form of packet, be packaged into corresponding IP data packet format according to the related request of instantaneous communication system or other network system again and send; Or the pattern that adopts aforesaid way and user to select the mode of " acknowledgement key " back transmission information to combine, when promptly any one condition in " unit interval section " and " acknowledgement key " takes place, all information can be sent immediately; Meanwhile, the other user is also with same input mode, and express oneself wanting and the information that transmits is write picture and text input area in its terminal, and be transmitted and be shown on this user's the picture and text terminal, thus the duplex of setting up, real-time picture and text ditch communication channel;
E, intercommunication finish, and this user or the other user all can formally finish this session by instant messaging program dismounting session channel just now.
Picture and text input area in the described picture and text terminal and picture and text viewing area all are divided into several input units and several display units respectively, wherein each input unit both can be used for character of " character input method " input or grapheme, also can be used for literal of handwriting input or grapheme, can also cross over a plurality of unit simultaneously and write picture and text input; Each display unit then with the other user's picture and text terminal in the picture and text input area in corresponding input unit corresponding; For literal hand-written in this input unit or figure, directly adopt the image expression mode to be sent to the picture and text viewing area of the other user's figure zhang terminal, for the Chinese character or the character of direct employing character input method input, then adopt the ASCII character expression way to transmit.
The handwritten text in the described expression input unit or the visual expression way of figure include but not limited to BMP (bitmap) form.
The input pen that described user uses be light pen or mouse or approach sensor be used for input picture or/and the input unit of literal.
Described unit interval section should be no more than 2000 milliseconds at the most within 500 milliseconds.
Described other network system with instant communication function includes but not limited to: GSM, CDMA, 3G mobile telephone network, WLAN (wireless local area network) WLAN or NGN system NGN.
Another object of the present invention is achieved in that a kind of device of realizing interactive picture and text communication service in real time, include the control circuit that microcomputer or digital signal processor are the center, it is characterized in that: this device comprises at least: be used to finish figure or/and the picture and text input module of literal input, when described each unit interval section finishes, the change information imported in this time period after the sampling is packaged into corresponding IP packet according to the regulation of instant messaging agreement and sends to the information package module of message transfer system, to the packet that receives from message transfer system, immediately untie encapsulation obtaining the information decapsulation module of graph text information in each unit interval section, and with after the decapsulation, based on input unit is that the graph text information of unit representation is presented at the picture and text display module in the corresponding display unit of this device.
The described graph text information that obtains from the packet that message transfer system receives includes: comprise the BMP form or/and the graph-text content of ASCII character form in number of unit, sequence number and position, the unit.
Described this device is the handheld pcs (PPC that is equiped with described picture and text input module, information package module, information decapsulation module and picture and text display module, Packet PC), personal digital assistant (PDA, Personal Digital Assistant) or mobile phone class have the communication terminal of picture and text input, processing and Presentation Function.
The present invention is with respect to existing communication service, have the following advantages and effect: adopt the handwriting input figure or/and behind the literal, no longer need to carry out character recognition, so not only can reduce the transmission operating cost of communication system, more help the input speed of the information that improves and the accuracy of message transmission.The load mode that figure combines with literal helps communication parties user's accurate communication and clear expression, helps improving communication efficiency.In communication process of the present invention, mutual both sides are real-time communications, can be truly some personal characteristics (as the calligraphy characteristic etc.) be passed to the other side, make communicating pair that sensation on the spot in person, that exchange Face to face be arranged.In addition, because figure can be expressed any spoken and written languages, therefore, the present invention can support the input of multilingual literal (comprising Chinese minority language and countries in the world zhang word) and figure, thereby can and use the personage of various language that fast, communication service easily is provided in the world for China.And, in communication process, can not influence other people, can not intercepted the information that is exchanged by other people yet, the more important thing is that communicating pair can exchange with own unique mode.For example, can express by the picture mode for deaf and dumb or illiteracy user; For confidential information, then available special figure or literal are expressed.The needed means of communication of the implementation method of business of the present invention is less demanding to the service quality QOS's of IP network, for example it is not very sensitive to time-delay, shake, requirement to bandwidth is also little, and these all are its superior part of comparing with video and voice communication and the characteristics that help using and promoting.Moreover communicator of the present invention does not need the encoding and decoding technique of signals such as configured voice, video, therefore, realizes that cost is lower easily.This device both can have been made a kind of picture and text communication terminal that is exclusively used in interactive picture and text communication service in real time, also can be at handheld pcs (PPC, Packet PC), personal digital assistant (PDA, Personal Digital Assistant) or in the communication terminal such as mobile phone set up picture and text input module of the present invention, information package module, information decapsulation module and picture and text display module, make it to become new model terminal with picture and text input, processing and Presentation Function.
Implementation method of the present invention mainly offers following customer group: wish accurately communication, the clear information that will transmit of expressing, expectation is vivid with the information of communicating pair, be presented in face of the other side in real time, with mutual acquisition more information (as individual character, the mastery of from calligraphy, finding out the other side; Find out the deep layer implication that the other side institute desire is expressed from graphic symbol, and this implication term is made peace, and literal be difficult to express again) the user, not wanting influences other people in communication process, perhaps do not want to allow other people know the user of the content of session, and writing skills is relatively poor, do not possess the user of literal input capability or specific group (as deaf and dumb, illiteracy or ethnic group etc.) user.
Description of drawings
Fig. 1 is the operating procedure schematic flow sheet of implementation method one embodiment of the interactive picture and text communication service in real time of the present invention.
Fig. 2 is the picture and text input area of picture and text communication terminal of the present invention and the division schematic diagram of picture and text viewing area and I/O unit thereof.
Fig. 3 is the operation principle schematic diagram that interactive picture and text communication service is in real time formed and carried out to the structure of picture and text communication terminal of the present invention.
Embodiment
Referring to Fig. 1, the present invention is the implementation method of the interactive picture and text communication service in real time of a kind of method, and the flow process of its operating procedure is as follows:
(1) user registration: the user is to this professional operator place or its instantaneous communication system of runing or have application for registration legal users name and corresponding password on other network system of instant communication function;
(2) user's picture and text terminal of using handheld PC (PPC, Packet PC) or personal digital assistant PDA or mobile phone etc. to have the picture and text input function is connected on the Internet, operation instant messaging program, and sign in to instantaneous communication system;
(3) user A establishes a communications link by instant messaging program on the instantaneous communication system and the other user B, makes both sides enter the picture and text communication pattern; Under the picture and text communication pattern, the I/O of picture and text terminal partly is called picture and text input area and picture and text viewing area;
(4) under the pattern of picture and text communication service, user A uses input pen to write in the picture and text input area oneself to want the information of expressing and transmitting; This information in writing process, just by the instant messaging program with the original form in its writing process, be sent in the picture and text viewing area of the other user's picture and text terminal in real time; When user A information is shown, user B is also with same input mode, the information that oneself will express and transmit is write picture and text input area in its terminal, and be transmitted and be shown on this user's the picture and text terminal, thereby set up two-way, mutual, real-time picture and text ditch communication channel;
(5) intercommunication finishes, and user A or user B all can formally finish this session by instant messaging program dismounting session channel just now.
Referring to Fig. 2, characteristics in the implementation method of the present invention are that the input area 11 with the picture and text terminal is divided into some input units, each input unit both can be used for character of " character input method " input or grapheme, also can be used for literal of handwriting input or grapheme, can also cross over a plurality of unit simultaneously and write picture and text input; In a word, the user's mode that can select definitely, intactly to express its information content that will transmit is come input information.The present invention directly adopts visual expression way (for example BMP form) to express pictograph in each input unit for hand-written figure and/or literal, rather than as pure character (as the ASCII fromat) expression way that communication terminal adopted obtains hand-written " figure " after through the identification of pattern recognition class software such as existing text chat class software or mobile phone, PDA etc.; And for the character of direct employing character input method input, the present invention will continue to adopt the expression of ASCII character class, and allows image expression mode (as the BMP form) and literal expression mode (as ASCII fromat) to mix use.For the division that cooperates picture and text input area 11 shows that with corresponding graph text information the present invention also is divided into some output units with the demonstration output area 12 of picture and text terminal, is used for the content that shows that distant terminal is imported in the input area of correspondence.
With existing text chat software is to push the transmission key behind input one segment information, the what is called that just this information is sent " wait for button after " sends differently then, and another characteristics in the implementation method of the present invention are just will be still uncompleted in the information input process, also the figure in writing process and/or character " immediately " have sent.At receiving terminal, then be the information formation that reproduces the transmitting terminal input according to the expression way of the picture and text combination of this information in real time, the information that the user is received be two-way interactive, in real time, the real reproduction.
In order to realize the working method of the real-time display message of the present invention, the present invention is divided into the plurality of unit time period (being similar to the digital video-audio signals sampling cycle) with the input process (as a hand-written picture or character) of information, when each unit interval section (being the sampling period) finished, just the information that comprises variations such as increase, modification or deletion that should take place in the time period sent.This unit interval hop count value should be arranged on below 500 milliseconds, is no more than 2000 milliseconds at the most.In the information input process, when every unit interval section finished, the present invention will automatically send " semi-finished product " figure or the character of just having imported, and does not need to wait for that the user pushes " acknowledgement key " like this.Certainly, the present invention also allows the user to select the input validation key to send the working method of information later on again, perhaps adopt the pattern that combines of above dual mode, when promptly any one condition in " unit interval section " and " acknowledgement key " takes place, all information can be sent immediately.
Referring to Fig. 3, the present invention is a kind of device 10 of realizing interactive picture and text communication service in real time, include signal processing and control circuit (not shown) that microcomputer or digital signal processor are the center, at least comprise in this device 10: be used to finish figure or/and the picture and text input module 101 of literal input, the information of input is packaged into packet and sends to message transfer system according to the regulation of communication protocol, and from the packet that message transfer system receives, untie the information encapsulation/decapsulation module 102 (this module also can separately become two standalone modules) of encapsulation to obtain graph text information, and with after the decapsulation, based on input unit is the graph text information of unit representation, is presented at the picture and text display module 103 in the corresponding display unit of this device in each unit interval section in real time.
Briefly introduce the function of each module below: picture and text input module 101 comprises two kinds of input modes at least: direct literal input mode, and express the information of being imported by character styles such as ASCII character; And " picture and text are write " input mode, and the information of being imported by graphical format (as the BMP form) sign.These two kinds of inputs and expression-form both can use respectively separately, also allowing them to mix uses, promptly in one section graph text information process of input, the information of some input unit obtains by direct literal input mode, and the information of some input unit then obtains by " picture and text are write " mode.Information package module 102 is one of the unit interval section (being the sampling period) set in the present invention or two conditions of acknowledgement key when setting up, and the information change (comprising increase, modification, deletion etc.) that takes place in one or more input units is encapsulated by avatars form (as the BMP form) or literal expression form (as the ASCII fromat) form with packet; Be packaged into corresponding IP data packet format according to the requirement of associated communication system (as the communication system-instantaneous communication system among Fig. 3) again and send with bi-directional communication function.102 of information decapsulation module are reverse process of information package module, being about to graph text information obtains out from the IP packet, these information may comprise: unitary space number, sequence number and position, ' picture and text ' content in the unitary space (BMP form and ASCII character form).Graph text information reappears module 103 and is used for the information of self information decapsulation module 102 in the future, in each unit interval section, will be in the viewing area of the information content of the unit representation picture and text terminal that is presented at receiving terminal based on input unit in time, this viewing area is divided into several output units, the information of the corresponding input unit of the information of each output unit.
Fig. 3 has also showed operation principle of the present invention by two apparatus of the present invention 10 and the communication system 20 with bi-directional communication function, among the figure, black thick dashed line and black heavy line are represented an information flow that sends and receive respectively, set up the communication pattern of a full duplex jointly.This communication system 20 with bi-directional communication function sends the information of its acquisition to recipient by network in real time.The implementation method of business of the present invention is to utilize the communication system 20 of existing support bi-directional communication function to carry out graph text information transmission in real time, these communication systems comprise on the Internet just at flourish instantaneous communication system, or the mobile phone GPRS/CDMA/3G network that is developing rapidly, communication networks such as WLAN (wireless local area network) WLAN, NGN system NGN.