JP2005142873A - Mobile phone and program - Google Patents

Abstract

A proxy response system capable of realizing a new communication by performing a call between mobile phones and exchanging proxy video data with each other.
A mobile phone 21 used by a user A first acquires proxy video data and a control rule table as one piece of package information and stores it in a package information storage unit. Next, the mobile phone 21 determines whether or not the mobile phone 22 used by the user B who is a call partner has package information. Only when the mobile phone 21 has package information, the mobile phone 21 passes through the exchange 30. Package information is exchanged and displayed through the connected lines. As described above, after the proxy video of the other party is displayed on the display screens of the mutual mobile phones, it is possible to make a call on a normal phone while viewing the proxy video.
[Selection] Figure 2

Description

  The present invention relates to a technology for making a call on a mobile phone and exchanging data such as video and music.

  Along with the advancement of network technology in recent years, videophones can be realized by making phone calls between mobile phones and exchanging data with each other by taking pictures of users' faces and backgrounds in real space. It is possible.

  However, because videophones take pictures of reality, it is difficult to speak with a smile at any time, depending on the situation, and women may not want to take pictures unless they are wearing makeup. is there. Here, in order to eliminate the inconvenience, if the video captured by the camera is not exchanged, it will be the same as a conventional call and there is no interest. This is because videophones are fun because the video and audio are synchronized.

  The present invention has been made in view of the above points, and provides a proxy response system capable of realizing new communication by making a call between mobile phones and exchanging proxy video and music data with each other. The issue is to provide.

  In one aspect of the present invention, a mobile phone having a display screen and a plurality of push buttons and capable of transmitting and receiving data by connecting a line via an exchange to a partner mobile phone used by a user of the other party. Proxy video data capable of displaying a proxy video on the display screen, a control code for controlling the change of the proxy video using the push button as a key, and an action of the proxy video generated by the change Package information acquisition means for acquiring a control rule table associating them as one package information, package information storage means for storing the package information acquired by the package information acquisition means, the counterpart mobile phone, and users Voice data transmitting / receiving means for transmitting / receiving voice data for making a call, based on the voice data One or more pieces of the package information of the partner mobile phone after connecting the line with the sound output means for outputting sound and before the users make a call with each other by the voice data transmitting / receiving means and the sound output means And a package extracted from the package information storage unit when the determination unit determines that the partner mobile phone has one or more pieces of the package information. Package information transmitting means for transmitting information to the other party mobile phone, other party package information receiving means for receiving package information held by the other party mobile phone as the other party package information from the other party mobile phone, and the other party package information receiving Based on the proxy video data included in the partner package information received by the means, the display Comprising a display means for displaying the representative image on the surface, a.

  The mobile phone configured as described above first acquires the proxy video data and the control rule table as one package information and stores it in a predetermined storage unit or the like. Next, the mobile phone used by the user determines whether the other party's mobile phone used by the other party has package information, and only when the package information is held via the exchange Package information is exchanged with each other through the connected line. Then, the mobile phone displays the proxy video of the other party on the display screen based on the proxy video data included in the partner package information received from the counterpart mobile phone. On the other hand, the partner mobile phone displays the proxy video of the user on the display screen based on the proxy video data included in the package information received from the mobile phone. As described above, after the proxy video is displayed on the display screens of the mutual mobile phones, it is possible to make a call while viewing the proxy video.

  According to this, it is possible to communicate with a virtual face or background based on the proxy video by exchanging package information with each other. Therefore, it is possible to create new values and business that are not found in ordinary videophones.

  In one aspect of the mobile phone, when the push button is pressed, a control code transmitting means for transmitting a control code associated with the push button by the control rule table to the mobile phone, and the mobile phone From the telephone, the partner control code receiving means for receiving the control code generated when the push button of the partner mobile phone is pressed by the user of the other party as a partner control code, and based on the partner control code, Video change means for specifying the action associated with the control rule table included in the partner package information and changing the proxy video to perform the specified action based on the proxy video data included in the partner package information And comprising.

  In the mobile phone configured as described above, when the user wants to perform a predetermined action on the proxy video displayed on the display screen of the other mobile phone, the control rule included in the package information held by the user Press the push button associated with the action in the table. Then, the mobile phone transmits a control code associated with the push button to the other mobile phone. Since the other party's mobile phone acquires the package information held by the user in advance, the intended action of the user can be specified based on the control rule table included in the package information and the received control code. . Therefore, the mobile phone of the other party can be changed so that the proxy video on the display screen performs the action intended by the user.

  The mobile phone can also receive a control code from the other mobile phone in the same procedure. In this case, the mobile phone changes based on the received control code so that the proxy video of the other party on the display screen performs a predetermined action.

  According to this, the user can easily change the emotion of his / her proxy video on the display screen of the other mobile phone by pressing a predetermined push button on his / her mobile phone. . In other words, changes in the user's fine feelings can be transmitted to the other party through the proxy video. Therefore, it is possible to create new values and business that are not found in ordinary videophones.

  In another aspect of the mobile phone, the package information acquisition means uses proxy video data that can be displayed on the display screen, music data for outputting sound in the mobile phone, and the push button as a key. A control rule table that associates a control code for controlling the output of the sound and music data necessary for outputting the sound is acquired as one package information, and the mobile phone includes the push button By pressing the control code transmitting means for transmitting the control code associated with the push button by the control rule table to the partner mobile phone, the push button of the partner mobile phone is sent from the partner mobile phone. The control code generated by being pressed by the user of the other party Based on the partner control code receiving means and the partner control code, the music data associated by the control rule table included in the partner package information is specified, and the music data and the voice data are synthesized Then, sound data creating means for creating sound data is further provided, and the sound output means outputs sound based on the sound data.

  In the mobile phone configured as described above, the user owns the user when he / she wants to output a predetermined sound such as BGM (Back Ground Music) or applause SE (Sound Effect) from the speaker of the other mobile phone. In the control rule table included in the package information, a control code associated with the music data for outputting the sound is transmitted to the mobile phone of the other party. Since the other party's mobile phone acquires the package information held by the user in advance, the music data intended by the user can be specified based on the control rule table and the control code included in the package information. Further, the mobile phone of the other party of the call creates sound data by synthesizing the voice data for conversation and the specified music data. By outputting sound data, the mobile phone of the other party can simultaneously output predetermined BGM and SE and voice for conversation.

  The mobile phone can also receive a control code from the other mobile phone in the same procedure. In this case, the mobile phone specifies a predetermined BGM or SE based on the received control code, and simultaneously outputs voice for conversation.

  According to this, the user can arbitrarily output music intended by the user on the other party's mobile phone by pressing a predetermined push button on his / her mobile phone. Therefore, it is possible to create a new value space and business that are not found in ordinary videophones.

  In another aspect of the mobile phone, the control rule table includes a control code for controlling the change of the proxy video and the output of the sound using the push button as a key, and the proxy video generated by the change. The package information acquisition means associates an action with music data necessary for controlling the output of the sound, and the package information acquisition means outputs the proxy video data that can be displayed on the display screen, the sound on the mobile phone. The music data to be output and the control rule table are acquired as one package information, and when the push button is pressed, the control code associated with the push button by the control rule table is obtained as the partner. The control code transmitting means for transmitting to the mobile phone and the partner mobile phone Included in the partner package information based on the partner control code receiving means, and the partner control code receiving means for receiving the control code generated when the push button of the mobile phone is pressed by the other party's user. Video change means for identifying the action associated by the control rule table and changing the proxy video to perform the action based on the proxy video data included in the partner package information; and the partner control code Further comprising sound data creating means for identifying the music data associated by the control rule table included in the counterpart package information and creating sound data by synthesizing the music data and the audio data. , The sound output means includes the sound data. Based on the output of the sound.

  In the mobile phone configured as described above, the user can easily execute a predetermined action on the proxy video displayed on the display screen of the other mobile phone by pressing a predetermined push button and transmitting a control code. Or a predetermined sound such as BGM or applause SE can be output from the speaker of the other mobile phone. In addition, the mobile phone receives a control code from the other party's mobile phone, and based on the control code, performs a predetermined action on the proxy partner's proxy video on the display screen or outputs a predetermined sound such as BGM. Is possible. Therefore, it is possible to create new values and business that are not found in ordinary videophones. In addition, it is possible to produce a pleasant communication by outputting an arbitrary sound as a hand for a normal call.

  In another aspect of the mobile phone, the package information acquisition unit acquires a plurality of the package information, and the mobile phone further includes a priority order setting unit that sets a priority order for each package information, The package information transmission means transmits one piece of the package information extracted from the package information storage means to the other mobile phone according to the priority order. According to this, even when the mobile phone acquires and stores a plurality of package information, the priority order is set for each package information and the package information is exchanged with the other mobile phone according to the priority order. . That is, by setting priorities, proxy response processing can be easily performed even when a plurality of package information is stored.

  In another aspect of the mobile phone, the mobile phone further includes a deletion unit that deletes the partner package information when the users end the call. According to this, even if a call is made with various partners by proxy response processing, the partner package information is not accumulated, so that the memory in the mobile phone can be used effectively. Further, fraudulent acts such as diversion of the partner package information can be prevented.

  In still another aspect of the mobile phone, the mobile phone further includes control code specifying means for automatically specifying the control code based on a volume of the audio data, and the control code specifying means is specified by the control code specifying means. The control code thus transmitted is transmitted to the mobile phone. According to this, the mobile phone automatically specifies the control code based on the volume of the audio data and transmits it to the other mobile phone instead of pressing the push button by the user. Therefore, for example, when the conversation is excited and the voice becomes loud, the proxy video automatically changes to a “laugh” action, and the user's feeling is reflected in the proxy video without the user being conscious. Can do.

  In another aspect of the present invention, the program is executed by a computer having a display screen and a plurality of push buttons and capable of transmitting and receiving data by connecting a line via an exchange to a partner mobile phone used by a user of the other party And the proxy video data that can display the proxy video on the display screen, the control code for controlling the change of the proxy video using the push button as a key, and the proxy generated by the change Package information acquisition means for acquiring a control rule table in which video actions are associated as one package information, package information storage means for storing the package information acquired by the package information acquisition means, the partner mobile phone, and use Voice data transmitting / receiving means for transmitting and receiving voice data for making calls between each other, A sound output means for outputting a sound based on the voice data; after connecting the line, before the user makes a call with the voice data transmitting / receiving means and the sound output means, The determination means for determining whether or not the package information is held, and the package information storage means when the determination means determines that the partner mobile phone holds one or more of the package information. Package information transmitting means for transmitting package information extracted from the partner mobile phone, partner package information receiving means for receiving package information held by the partner mobile phone as partner package information from the partner mobile phone, and the partner package Based on the proxy video data included in the partner package information received by the information receiving means. Te, display means for displaying the representative image on the display screen, as to function the computer.

  The above-described mobile phone can be realized by executing the above program by a computer. Moreover, each aspect of the above-described mobile phone can be realized in the same manner.

  According to the present invention, a new communication can be realized by making a call between mobile phones and exchanging proxy video data with each other.

  Preferred embodiments of the present invention will be described below with reference to the drawings. According to the present invention, a normal communication can be performed by exchanging audio data between mobile phones, and new communication can be realized by exchanging package information including proxy video and music data.

[Proxy response system]
First, the proxy response system according to the present invention will be described. FIG. 1 shows a schematic configuration of the proxy response system. A proxy response system 100 shown in FIG. 1 includes mobile phones 21 and 22, an exchange 30, and a server 31. The cellular phones 21 and 22 can make a call by connecting a line via the exchange 30. In the present embodiment, it is assumed that a line is formed by combining a plurality of channels with one physical line. The exchange 30 is connected to a server 31, and the mobile phones 21 and 22 are connected to the server 31 via the exchange 30 so as to be communicable. In other words, the exchange 30 functions as both a circuit exchange that connects mobile phones and an IP exchange that connects the mobile phone and the server 31. Furthermore, the mobile phones 21 and 22 are configured to be able to communicate directly at a short distance without going through the server 31 or the like, so that data can be transmitted and received between them.

  In FIG. 1, two mobile phones 21 and 22 are shown for convenience, but the proxy response system 100 is not limited to these, and a plurality of mobile phones are included as components. As direct communication means between short-distance mobile phones, both wired communication and wireless communication can be applied. Particularly, wireless communication includes wireless LAN, infrared communication, Bluetooth (registered trademark), etc. Various methods can be used. In this embodiment, Bluetooth, which is wireless communication, is applied.

  First, an outline of the proxy response method according to the present system will be described with reference to FIG. FIG. 2 is a conceptual diagram showing a flow of package information necessary for performing proxy response processing in the proxy response system 100. In the present embodiment, it is assumed that the user A who uses the mobile phone 21 makes a phone call to the user B who uses the mobile phone 22 and makes a proxy response process.

  The user A connects to the server 31 via the exchange 30 by the mobile phone 21 and downloads a proxy response program and package information necessary for performing proxy response processing. Here, the proxy response program is a basic application necessary for performing proxy response processing, and if it is downloaded for the first time, it is not necessary to download again. On the other hand, the package information includes video data to be displayed on the screen of the mobile phone 22 used by the user B who is a call partner, music data to be output as sound by the mobile phone 22, and a control rule table. Since there are a plurality of types for each video data, it can be appropriately downloaded by the user. That is, although one mobile phone can hold a plurality of package information, in this embodiment, it is assumed for convenience that one mobile phone holds one package information.

  After downloading the proxy response program and the package information, the user A calls the user B using the mobile phone 21. That is, the telephone number of the mobile phone 22 is input by pressing the push button of the mobile phone 21, and the line is connected between the mobile phones 21 and 22 via the exchange 30. Normally, when the lines are connected, the voices of the users A and B are exchanged as voice data so that a call can be made. However, as shown in FIG. Before exchanging the mobile phone 21, the mobile phone 21 confirms whether or not the mobile phone 22 has a proxy response program and package information. When it can be confirmed that the mobile phone 22 has the proxy response program and the package information, the mobile phone 21 and the mobile phone 22 exchange the package information held by each other.

  The mobile phone 21 that has received the package information from the mobile phone 22 displays the user B's proxy video on the screen based on the video data included in the package information. On the other hand, the mobile phone 22 that has received the package information from the mobile phone 21 displays the proxy video of the user A on the screen based on the video data included in the package information. Here, the proxy video is a video that displays a virtual face and background different from the real space on the screen of the mobile phone, for example, proxy video data included in package information held by the mobile phone 21 is displayed. It is assumed that the proxy video is “bird”, and the proxy video displayed by the proxy video data included in the package information held by the mobile phone 22 is “bear”. Specifically, when a call is made between mobile phones and a proxy video is displayed, for example, users who use the mobile phone may make videophone calls as virtual “bears” and “birds”, respectively. It becomes possible. In other words, “bear” is displayed on the screen of the mobile phone 21 as the proxy image of the user B as shown in the figure. On the other hand, “bird” is displayed on the screen of the mobile phone 22 as a proxy image of the user A.

  When the user A presses a specific push button of the mobile phone 21 during a call, a control code associated with the push button is transmitted to the mobile phone 22 as will be described in detail later. The mobile phone 22 changes the proxy video displayed on the screen by referring to the control rule table included in the package information received from the mobile phone 21 based on the control code. Specifically, in the control rule table, when the control code is associated with the action “the proxy video cry”, the mobile phone 22 changes the proxy video displayed on the screen to cry. .

  Further, as will be described in detail later, the user A uses the mobile phone 21 to transmit a control code to the mobile phone 22, so that an arbitrary sound can be generated in the mobile phone 22 based on the music data included in the package information. Can be output. Here, the arbitrary sound is a hand of conversation, such as BGM flowing in the background of conversation or SE of applause, and is a sound output from the mobile phone together with the voice of the conversation between the mobile phones. When the user B uses the mobile phone 22 to transmit a control code to the mobile phone 21 during a call, the mobile phone 21 performs the same processing as the above-described mobile phone 22.

  In the present embodiment, one of a plurality of channels constituting the line is assigned to transmit and receive voice data necessary for a call between mobile phones, and channels other than those assigned to the voice data are assigned. Assigned to send and receive package information and control codes.

  In this way, by exchanging package information between mobile phones, making a call, and making virtual faces, backgrounds, and voices act based on the package information, new value not found in conventional videophones Can create views and business. In addition, it is possible to produce a pleasant communication by outputting an arbitrary sound as a hand of conversation. For example, new values can be produced by flowing BGM in the background of a conversation or inserting a gag SE between conversations.

[mobile phone]
Next, the mobile phone will be described in detail. The mobile phone has a web browser function and a call function, receives data from the server 31 via the exchange 30, and exchanges data with other mobile phones by connecting a line via the exchange 30. It can be set as the terminal device in which etc. are possible.

  FIG. 3 is a block diagram of a mobile phone to which the present invention is applied. A cellular phone 21 includes a CPU 1 mainly composed of a microprocessor, a ROM 2 and a RAM 3 as main storages for the CPU 1, a GPU (Graphics Processing Unit) 7 and an SPU (Sound Processing Unit) 9 for image processing and sound processing, A key input unit 4 for input processing, an audio input unit 12, a video input unit 14, a data input unit 11, and a transmission / reception processing unit 5 for data transmission / reception processing are connected to each unit via a bus 15. Yes.

  In the ROM 2, an operating system is written as a program necessary for overall operation control of the mobile phone 21. The RAM 3 functions as a working memory, and downloaded application data and the like are written as necessary.

  The GPU 7 displays the destination phone number and e-mail address according to the input operation on the monitor 8 of a predetermined size made of the equipped liquid crystal or the like, displays the necessary functions as a guide, and creates it. This is a control to display the contents of the mail received during or inside. In addition, the GPU 7 receives proxy video data or the like included in the package information received from another mobile phone from the CPU 1 and displays it on the monitor 8. The SPU 9 reproduces music data, voice data, and the like such as music at the time of incoming call, BGM, and voice for a call and outputs them from the speaker 10.

  The key input unit 4 is provided with various keys for creating mail data and the like in addition to inputting the telephone number, home page address, and control code of the other party by pressing a push button. The voice input unit 12 acquires a user's voice through the microphone 13. The video input unit 14 acquires the face and background of the user in the real space with a small digital camera mounted on the mobile phone. The data input unit 11 creates mail data according to the operation of the key input unit 4, creates audio data according to the voice acquired by the audio input unit 12, or according to the video acquired by the video input unit 14. To create video data.

  The transmission / reception processing unit 5 processes data transmission / reception in various applications downloaded from an e-mail or a server, in addition to incoming / outgoing line control via a normal exchange 30 and transmission / reception of package information. Transmission / reception data is exchanged via the antenna 6. In addition, data transmitted and received by the mobile phone is communicated in packets.

  In addition to the above, the mobile phone 21 includes various components for executing the original operation, but description of portions that are not directly related to the present invention is omitted for the sake of convenience.

  Next, the internal configuration of the mobile phone will be described in detail. FIG. 4 shows the internal configuration of the mobile phone 21 in the proxy response system 100 of the present invention. Since the mobile phone 22 has the same internal configuration as the mobile phone 21, the description thereof is omitted for the sake of convenience.

  As shown in FIG. 4, the mobile phone 21 includes a proxy response program 201, a communication function 202, a package information acquisition function 203, a package information storage unit 204, a package information transmission function 205, a partner package information acquisition function 206, and a partner proxy video display. It has a function 207, a voice data transmission / reception function 208, a control code transmission / reception function 209, a partner proxy video change function 210, a sound output data creation function 211, a sound output function 212, and a partner package information deletion function 213.

  The proxy response program 201 is a program for performing a normal call by exchanging voice data between mobile phones and performing proxy response processing by exchanging package information including proxy video and music data.

  The communication function 202 is a function that enables transmission / reception of data by connecting a line to the mobile phone 22 of the communication partner via the exchange 30. The communication function 202 is a function that enables data transmission / reception with the server 31 via the exchange 30. The communication function 202 is a function that enables direct data transmission / reception with another mobile phone without using the server 31 at a short distance.

  The package information acquisition function 203 is a function for acquiring arbitrary package information from the server 31 via the exchange 30 by executing the proxy response program 201. FIG. 5 shows the internal structure of the package information. As shown in the figure, the package information is composed of proxy video data, music data, and a control rule table. The proxy video data is proxy video data for displaying characters such as bears and birds as shown in FIG. The music data is BGM related to the proxy video data included in the same package information, for example, SE data such as the theme song, text line, applause, one-shot gag of the animation when the proxy video is an anime character.

  Here, the control rule table included in the package information will be described in detail. FIG. 6 is a diagram schematically illustrating the data structure of the control rule table. FIG. 7 is a diagram showing a push button arrangement of a mobile phone. As shown in FIG. 6, the control rule table included in the package information is composed of push buttons, control codes, and action / music data. The push button corresponds to a push button of a mobile phone as shown in FIG. The control code is control information transmitted to the mobile phone of the call partner when the user presses any push button of the mobile phone used by the user during the proxy response process. The action is an action that occurs in the mobile phone of the other party of call by the control code transmitted to the mobile phone of the other party during the proxy response process. The music data is music data that is the source of the sound output from the mobile phone of the other party of call by the control code transmitted to the mobile phone of the other party during the proxy response process. For example, as shown in FIG. 6, an action in which a proxy image displayed on the mobile phone of the other party is laughed and music data for outputting predetermined BGM or SE from the mobile phone of the other party are set. . That is, the control rule table stores a control code transmitted by pressing the push button using the push button of the mobile phone as a key, an action generated by the control code, and music data to be output in association with each other. It is a table.

  The package information acquisition function 203 also has a function of storing the acquired package information in the package information storage unit 204.

  The package information transmission function 205 executes the proxy response program 201, so that when the mobile phone 21 is connected to another mobile phone 22 via the exchange 30 by the communication function 202, before making a call, This is a function for confirming whether the other mobile phone 22 has the proxy response program 201 and package information. The package information transmission function 205 is a function for extracting the package information from the package information storage unit 204 and transmitting the package information to the mobile phone 22 when the other mobile phone 22 has the proxy response program 201 and the package information. It is.

  The partner package information acquisition function 206 is a function of acquiring package information as partner package information from another mobile phone 22 connected to the line via the exchange 30 by executing the proxy response program 201.

  The partner proxy video display function 207 executes the proxy response program 201, so that the proxy video on the display screen of the mobile phone 21 based on the proxy video data included in the partner package information acquired by the partner package information acquisition function 206. It is a function to display.

  The voice data transmission / reception function 208 performs a normal call by exchanging voice data after exchanging the package information between the mobile phones connected to the line by the package information transmission function 205 and the partner package information acquisition function 206. It is a function.

  The control code transmission / reception function 209 is used when the proxy video displayed on the display screen of the mobile phone 22 of the other party is changed or when a predetermined BGM or SE is output from the mobile phone 22. 7 is a function for transmitting a control code to the mobile phone 22 through a line connected via the exchange 30 by pressing a push button of the mobile phone as shown in FIG. The control code transmission / reception function 209 is a function for receiving a control code corresponding to changing the action of the proxy video displayed on the display screen of the mobile phone 21 from the mobile phone 22 used by the other party.

  The partner proxy video change function 210 is a control rule table included in the partner package information acquired by the partner package information acquisition function 206 based on the control code received from the mobile phone 22 used by the partner by the control code transmission / reception function 209. This is a function to change the action of the proxy video displayed on the display screen of the mobile phone 21 by referring to.

  Here, it will be described in detail that the partner proxy video changing function 210 changes the proxy video based on the control code received from the mobile phone 22. FIG. 8 shows the change of the proxy image on the display screen that changes based on the control code. For example, when acquiring the control code “fghij” from the mobile phone 22, the partner proxy video change function 210 of the mobile phone 21 refers to the control rule table as shown in FIG. 6 based on the control code “fghij”. Identify the action “cry”. Then, as shown in FIG. 8, the partner proxy video changing function 210 changes the video so that “bear”, which is the proxy video of the other party on the display screen, “crys”.

  The sound data creation function 211 uses the control code transmission / reception function 206 to create a control rule table included in the partner package information acquired by the partner package information acquisition unit 206 based on the control code received from the mobile phone 22 used by the other party. This is a function for creating sound data for outputting a predetermined sound from the speaker of the mobile phone 21 by referring to it.

  Here, it will be described in detail that the sound data creation function 211 outputs a predetermined sound from the speaker based on the control code received from the mobile phone 22. FIG. 9A is a diagram schematically showing a flow in which the sound data creation function 211 of the mobile phone 21 on the control code receiving side creates sound data based on the control code. When the sound data creation function 211 of the mobile phone 21 first obtains the control code “uvwza” from the mobile phone 22, the sound data creation function 211 refers to the control rule table as shown in FIG. The music data “BGM1” is specified. Then, the sound data creation function 211 extracts music data corresponding to BGM1 included in the partner package information. Since the music data included in the normal package information is digital data, the sound data creation function 211 uses the D / A converter 17 to convert the music data corresponding to BGM1 into analog data. Then, the sound data creation function 211 synthesizes the voice data received for the call from the mobile phone 22 and the music data converted into analog data, and both the voice for the call and the BGM 1 are supplied from the speaker 10 by the SUP9. Create sound data for output.

  The sound output function 212 is a function for outputting the sound data created by the sound data creation function 211 from the speaker 10. Specifically, when the user B who is a call partner transmits a control code for outputting BGM1 to the mobile phone 21, the sound output function 212 outputs both BGM1 and voice for a call. That is, user A can enjoy a call while listening to BGM1. Further, when the user B who is a call partner transmits a control code for outputting the SE of the applause to the mobile phone 21, the sound output function 212 outputs the SE of the applause as a hand of voice for the call. That is, the user B can produce a call using SE other than normal voice.

  The partner package information deletion function 213 is a function that deletes the partner package information acquired by the partner package information acquisition function 206 when the call is terminated and the line with the mobile phone 22 of the call partner is disconnected. By deleting the partner package information in this way, it is possible to effectively use the memory and prevent illegal distribution of the package information.

[Proxy response processing]
Next, proxy response processing executed by the proxy response system 100 will be described. FIG. 10 is a flowchart of proxy response processing. It is assumed that the mobile phones 21 and 22 both acquire and hold a proxy response program and package information from the server 31 via the exchange 30. Specifically, it is assumed that the mobile phone 21 has package information of “bird” and the mobile phone 22 has package information of “bear”.

  The mobile phone 21 used by the user A first inputs the phone number of the mobile phone 22 by pressing a push button (step S1). As a result, the mobile phone 21 connects the line with the mobile phone 22 via the exchange 30. When the line is connected, the mobile phone 21 determines whether or not the mobile phone 22 used by the call partner has a proxy response program and package information before making a normal call (step S2). If the proxy response program is not held (step S3; NO), the proxy response process cannot be performed, and thus the process is terminated. On the other hand, when the proxy response program is held (step S3; YES), the mobile phones 21 and 22 exchange the package information held by each through the line. Specifically, the mobile phone 22 transmits package information of “bear” to the mobile phone 21 (step S4), and the mobile phone 21 transmits package information of “bird” to the mobile phone 22 (step S5).

  The mobile phone 21 displays the proxy video of “bear” on the display screen based on the proxy video data included in the package information transmitted from the mobile phone 22 in step S4. The mobile phone 21 receives voice data from the mobile phone 22 and makes a call (step S6). On the other hand, the mobile phone 22 displays the proxy video of “bird” on the display screen based on the proxy video data included in the package information transmitted from the mobile phone 21 in step S5. In addition, the mobile phone 22 receives voice data from the mobile phone 21 and makes a call (step S7).

  When the user B wants to perform a predetermined action on the “bear” displayed as the proxy video on the display screen of the mobile phone 21, the user B presses a push button associated with the action on the mobile phone 22. Then, the mobile phone 22 transmits a control code associated with the pressed push button to the mobile phone 21 (step S8). Based on the received control code, the mobile phone 21 refers to the control rule table included in the package information received in advance and identifies the corresponding predetermined action. Then, the mobile phone 21 changes the proxy video to perform the specified action (step S9).

  Specifically, when the user A wants to make the action “cry” on the “bear” displayed as the proxy image on the display screen of the mobile phone 21, the action “cry” is associated with the mobile phone 22. The pushed push button “2” is pressed, and the control code “fghij” is transmitted to the mobile phone 21. Based on the received control code “fghij”, the mobile phone 21 refers to the control rule table shown in FIG. 6 included in the previously received package information, and identifies the corresponding action “cry”. Then, as shown in FIG. 8, the mobile phone 21 changes the video so that the “bear” displayed as the proxy video performs a “crying” action.

  In addition, when the user B wants to output predetermined BGM or SE from the speaker 10 of the mobile phone 21, the user B presses a push button associated with music data that is the source of the BGM or SE on the mobile phone 22. . Then, the mobile phone 22 transmits a control code associated with the pressed push button to the mobile phone 21 (step S10). Based on the received control code, the mobile phone 21 refers to the control rule table included in the package information received in advance and identifies the corresponding predetermined music data (step S11). For example, when the predetermined music data is “BGM1”, the mobile phone 21 extracts music data corresponding to the BGM1 from the music data included in the package information received in advance. Further, the cellular phone 21 creates sound data by synthesizing the audio data received for the call and the music data corresponding to the extracted BGM1 (step S12), and performs output based on the sound data (step S12). S13). Thereby, the proxy response process ends.

  Note that the case where the user A changes the substitute image of “bird” displayed on the display screen of the mobile phone 22 or outputs a predetermined sound from the speaker 10 of the mobile phone 22 is almost the same as described above. For the sake of convenience, the description is omitted. In addition, users A and B may transmit the control code any number of times.

  According to this, package information for performing proxy response processing is exchanged with each other, and a virtual face, voice, and background are applied based on proxy video data and music data included in the package information. Communicate. Therefore, it is possible to create new values and business that are not found in ordinary videophones. In addition, it is possible to produce a pleasant communication by using a control code to output an arbitrary sound as a hand of conversation.

  In the above embodiment, when the user presses the push button of the mobile phone, an arbitrary control code is transmitted to the mobile phone used by the other party and the corresponding action or sound is output. The present invention is not limited to this, and the mobile phone may automatically specify the control code based on the voice of the user for the call and output the corresponding action or sound. Specifically, the volume is calculated from the user's voice data acquired by each mobile phone. If the volume is above a certain level, the proxy video is changed to laugh, and if the volume is below a certain level, the proxy video is changed. Can be changed to “cry”. That is, when the calculated volume is equal to or higher than a certain volume, the control code corresponding to the action “laugh” is automatically specified. On the other hand, if the calculated volume is below a certain volume, the control code corresponding to the action “cry” is automatically specified. In this case, the control code may be specified by the mobile phone on the audio data transmitting side and transmitted together with the audio data, or may be specified by the mobile phone on the audio data receiving side.

  Further, in the above embodiment, the package information is transmitted and received between the mobile phones that make a call over the telephone line. However, the present invention is not limited to this, and the mobile phone can wirelessly communicate with each other. When it is a short distance, it is possible to directly transmit / receive package information between mobile phones regardless of a telephone line via the exchange 30. Further, by storing the package information in an information storage medium such as a portable memory, the package information can be exchanged between a plurality of mobile phones.

  Further, in the above embodiment, the correspondence between the push button of the mobile phone used by the user and the control code is set in advance, but the present invention is not limited to this, The user can arbitrarily set the correspondence between the push button and the control code. In other words, when the user often uses the action “laugh”, the push button “1” that is most likely to be pressed is associated with a control code for outputting the action “laugh” to make it easy to use. Can be customized.

  In the above embodiment, the proxy video is a video of a character such as a bird or a bear. However, the present invention is not limited to this, and the proxy video such as a background video including the character is used. Can be set arbitrarily.

  In the above embodiment, the proxy response process is performed on the assumption that the number of package information stored in the package information storage unit 204 is one. However, the present invention is not limited to this, and the package information storage is not limited thereto. The proxy response process can be performed assuming that there is a plurality of package information stored in the unit 204. In this case, each of the plurality of package information can be arbitrarily set by the user, and the package information is transmitted to the mobile phone used by the other party in steps S4 and S5 of the proxy response process shown in FIG. When doing so, the package information with the highest priority is transmitted. The mobile phone applied to the present invention can be selected in advance from the proxy response mode and the normal mode, and the proxy response processing is performed only when the proxy response mode is set. To do. That is, when the normal mode is set, a videophone process in which a normal user himself / herself is displayed is performed.

  In the above embodiment, when a call is made by a mobile videophone, only the proxy video of the other party is displayed on the display screen of the mobile phone. However, the present invention is not limited to this. Instead of this, a child screen may be provided on the display screen, and the user's own proxy video may be displayed on the child screen. FIG. 11 shows an example in which a child screen is provided on the display screen, and both the proxy video of the other party and the proxy video of the user are displayed on one display screen. As shown in FIG. 11, the proxy image “bird” of user A is displayed large on the display screen of the mobile phone 22, and the proxy image “bear” of user B who is the user himself is small on the child screen 60. It is displayed. In this case, help 61 indicating the action and sound data corresponding to each push button of the mobile phone 22 can be displayed on the display screen. According to this, for example, when the correspondence between the push button and the action is different from the initial setting by customization, for example, the user can be prevented from being confused with the correspondence between the push button and the action. . Moreover, even if the user has little knowledge to perform PC operation or proxy response, the proxy video can be easily changed and the conversation can be excited by the help screen.

[First modification]
In the above embodiment, as shown in FIG. 9A, the case where the control code receiving side creates the sound data has been described. However, the present invention is not limited to this, and the control code transmitting side transmits the sound data. It may be created.

  Here, it will be described in detail that the mobile phone 22 on the control code transmitting side creates sound data and transmits the sound data to the mobile phone 21 through a line. FIG. 9B is a diagram schematically showing a flow in which the sound data creation function 211 of the mobile phone 22 creates sound data and transmits it to the mobile phone 21. First, the sound data creation function 211 of the mobile phone 22 refers to the control rule table stored in the package information storage unit 204 and identifies the action or music data corresponding to the push button arbitrarily pressed by the user. For example, when music data corresponding to BGM1 is specified, the sound data creation function 211 extracts music data corresponding to BGM1 stored in the package information storage unit 204. Since the music data included in the normal package information is digital data, the sound data creation function 211 uses the D / A converter 17 to convert the music data corresponding to BGM1 into analog data.

  Then, the sound data creation function 211 acquires the voice of the user A for a call from the voice input unit 12 through the microphone 13, and synthesizes the voice data based on the voice and the music data converted into analog data, The SPU 9 creates sound data for outputting both voice for calling and BGM1. Then, the mobile phone 22 transmits the created sound data to the mobile phone 21 used by the other party. The mobile phone 21 outputs a voice for calling and BGM1 from the speaker 10 based on the received sound data.

  In the above embodiment, the sound data is created using the music data included in the package information. However, the case where the sound data is created on the control code transmission side is limited to this. Instead, for example, it is possible to create sound data using music data held for a ringing melody. Therefore, it is not necessary to include a lot of music data in the package information transmitted / received on the line via the exchange 30. The package information can be quickly transmitted / received, and the processing load on both mobile phones can be reduced.

  In the above embodiment, the sound data is output only on the mobile phone on the control code receiving side, regardless of whether the mobile phone on the control code receiving side or the transmitting side creates the sound data. The present invention is not limited to this, and the acquired sound data can also be output by the mobile phone on the transmission side of the control code. That is, it is possible to output sound data on both the control code receiving side and transmitting side mobile phones. In this case, both the control code receiving side and the control code transmitting side can enjoy a conversation while listening to the same BGM.

[Second modification]
In the above embodiment, the mobile phone downloads proxy video data, music data, and a control rule table from the server 31 as one package information as shown in FIG. However, the present invention is not limited to this, and the proxy video data, the music data, and the control rule table may be individually downloaded from the server 31 as shown in FIG.

  The proxy response process is performed based on the proxy video data, music data, and control rule table that are associated with each other. Therefore, when individually downloading, it is assumed that an ID, which is identification information indicating relevance, is added in advance to the proxy video data, the music data, and the control rule table, and the user terminal is based on the ID, Assume that each data and table are associated and stored in the memory.

  According to this, it is not always necessary to download the proxy video data, music data, and control rule table as one package information, and can be individually downloaded, so that each data and table can be easily replaced or added. Can do.

  With this proxy response system, new communications can be realized by making a call between mobile phones and exchanging proxy video data with each other.

It is a figure which shows schematic structure of the proxy response system in this invention. It is a conceptual diagram which shows the flow of the package information in a proxy response system. 1 is a block diagram of a mobile phone to which the present invention is applied. It is a functional block diagram of the mobile telephone contained in the proxy response system shown in FIG. It is a figure which shows typically the structure of the package information in this invention. It is a figure which shows typically the data structure of the control rule table in this invention. It is a figure which shows the pushbutton arrangement | sequence of the mobile telephone to which this invention was applied. It is an example of a screen which changes based on a control code. It is a figure which shows typically the flow which produces sound data. It is a flowchart of the proxy response process in this embodiment. It is an example of a screen on which a child screen and help are displayed. It is a conceptual diagram which shows download of proxy image data, music data, and a control rule table in the 2nd modification.

Explanation of symbols

1 ... CPU
2 ... ROM
3 ... RAM
4 ... Key input unit 5 ... Transmission / reception processing unit 6 ... Antenna 7 ... GPU
8 ... Monitor 9 ... SPU
DESCRIPTION OF SYMBOLS 10 ... Speaker 11 ... Data input part 12 ... Audio | voice input part 13 ... Microphone 15 ... Bus 100 ... Proxy response system

Claims (8)

A mobile phone having a display screen and a plurality of push buttons, and capable of transmitting and receiving data by connecting a line via a switching device and a mobile phone used by a user of the communication partner,
The proxy video data capable of displaying the proxy video on the display screen, the control code for controlling the change of the proxy video using the push button as a key, and the action of the proxy video caused by the change are associated with each other Package information acquisition means for acquiring the control rule table as one package information;
Package information storage means for storing the package information acquired by the package information acquisition means;
Voice data transmitting and receiving means for transmitting and receiving voice data for making a call between the other mobile phone and the user;
Sound output means for outputting sound based on the audio data;
After connecting the line, before the users make a call with each other by the voice data transmitting / receiving means and the sound output means, it is determined whether the partner mobile phone has one or more pieces of the package information. A determination means;
Package information transmission for transmitting the package information extracted from the package information storage means to the partner mobile phone when the judgment unit determines that the partner mobile phone has one or more pieces of the package information Means,
Partner package information receiving means for receiving package information held by the partner mobile phone as partner package information from the partner mobile phone;
And a display unit configured to display the proxy video on the display screen based on the proxy video data included in the partner package information received by the partner package information receiving unit. A control code transmitting means for transmitting a control code associated with the push button by the control rule table to the partner mobile phone by pressing the push button;
A partner control code receiving means for receiving, as the partner control code, the control code generated when the push button of the partner mobile phone is pressed by the other party's user from the partner mobile phone;
Based on the partner control code, the action associated with the control rule table included in the partner package information is specified, and the action specified by the proxy video is based on the proxy video data included in the partner package information The mobile phone according to claim 1, further comprising: an image changing unit that changes the image so as to perform the operation. The package information acquisition means includes proxy video data that can be displayed on the display screen, music data for outputting sound in the mobile phone, and control for controlling the output of the sound using the push button as a key. A control rule table in which chords and music data necessary for outputting the sound are associated with each other is acquired as one package information;
The mobile phone
A control code transmitting means for transmitting a control code associated with the push button by the control rule table to the partner mobile phone by pressing the push button;
A partner control code receiving means for receiving, as the partner control code, the control code generated when the other party's mobile phone push button is pressed by the other party's user from the partner mobile phone;
Sound data creation for identifying the music data associated by the control rule table included in the partner package information based on the partner control code and creating sound data by synthesizing the music data and the voice data Further comprising means,
The mobile phone according to claim 1, wherein the sound output unit outputs a sound based on the sound data. The control rule table uses the push button as a key to control the change of the proxy video and the output of the sound, and the action of the proxy video generated by the change and the output of the sound. Is associated with the music data required for
The package information acquisition means acquires proxy video data that can be displayed on the display screen, music data for outputting sound in the mobile phone, and the control rule table as one package information,
A control code transmitting means for transmitting a control code associated with the push button by the control rule table to the partner mobile phone by pressing the push button;
A partner control code receiving means for receiving, as the partner control code, the control code generated when the other party's mobile phone push button is pressed by the other party's user from the partner mobile phone;
Based on the partner control code, the action associated with the control rule table included in the partner package information is specified, and the proxy video performs the action based on the proxy video data included in the partner package information. Image changing means to change to do,
Sound data creation for identifying the music data associated by the control rule table included in the partner package information based on the partner control code and creating sound data by synthesizing the music data and the voice data Further comprising means,
The mobile phone according to claim 1, wherein the sound output unit outputs a sound based on the sound data. The package information acquisition means acquires a plurality of the package information,
The mobile phone
It further comprises priority order setting means for setting a priority order for each package information,
The said package information transmission means transmits one said package information extracted from the said package information storage means to the other party mobile telephone according to the said priority. mobile phone.   The mobile phone according to any one of claims 1 to 5, further comprising a deleting unit that deletes the partner package information when the users end the call. Control code specifying means for automatically specifying the control code based on the volume of the audio data,
The mobile phone according to any one of claims 2 to 6, wherein the control code transmitting means transmits the control code specified by the control code specifying means to the counterpart mobile phone. A program executed by a computer having a display screen and a plurality of push buttons and capable of transmitting and receiving data by connecting a line via an exchange with a partner mobile phone used by a user of the other party,
The proxy video data capable of displaying the proxy video on the display screen, the control code for controlling the change of the proxy video using the push button as a key, and the action of the proxy video caused by the change are associated with each other Package information acquisition means for acquiring the control rule table as one package information,
Package information storage means for storing the package information acquired by the package information acquisition means;
Voice data transmitting / receiving means for transmitting and receiving voice data for making a call between the other mobile phone and the user;
Sound output means for outputting sound based on the audio data;
After connecting the line, before the users make a call with each other by the voice data transmitting / receiving means and the sound output means, it is determined whether the partner mobile phone has one or more pieces of the package information. Determination means,
Package information transmission for transmitting the package information extracted from the package information storage means to the partner mobile phone when the judgment unit determines that the partner mobile phone has one or more pieces of the package information means,
Partner package information receiving means for receiving package information held by the partner mobile phone as partner package information from the partner mobile phone;
A program for causing the computer to function as display means for displaying the proxy video on the display screen based on proxy video data included in the partner package information received by the counterpart package information receiving means.

Images