JP2008116625A - Portable terminal device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To control generated musical sound and a lighting state of an LED by shaking a device. <P>SOLUTION: A number key assigner 22 detects an operation of a number key and notifies a MIDI control module 24. The MIDI control module 24 outputs a MIDI message for generating sound pitch or musical sound with instrumental timbre corresponding to the key to a sound source 11. A three-dimensional acceleration detection part 21 detects an acceleration in three-dimensional arbitrary direction based on an input signal from a triaxial acceleration sensor 14 and notifies the MIDI control module 24. The MIDI control module 24 generates the MIDI message for controlling musical sound volume, pitch, cutoff frequency or the like corresponding to the acceleration and transmits it to the sound source 11, so as to control generated musical sound. Also, an LED 16 lights or flickers with a luminous color assigned to the number key, and the luminous mode is changed corresponding to the acceleration. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a mobile terminal device such as a mobile phone or a PHS.

A cellular phone device having a performance function has been proposed (Patent Document 1). According to this mobile phone device, while the numeric key, “#” key, and “*” key are pressed, the sound source data including the pitch data assigned to the key is sent to the sound source, and only during that time. The specified sound can be output. As a result, the mobile phone device can be used as a musical instrument.
A portable terminal device having a vibration sensor has been proposed (Patent Document 2). According to this portable terminal device, the vibration sensor for detecting the vibration of the portable terminal device is provided, and a musical sound can be generated when the output of the vibration sensor exceeds a certain value, and the portable terminal device can be used as a rhythm instrument. It can have the function of.
Furthermore, when the ringing melody is played, the caller information display device comprising a color LCD (Liquid Crystal Display), EL (electroluminescence), PDP (Plasma Display Panel), etc. is turned on according to the length of the note of the ringing melody. There has been proposed a communication terminal device that controls the length and color of light emitted (Patent Document 3). Thereby, the display at the time of the incoming call becomes gorgeous and the playfulness of the user can be satisfied.
JP 2001-356770 A JP 2003-125455 A JP 2001-320447 A

As described in Patent Document 1, it is known to give a portable terminal device a function as a musical instrument. However, it has not been possible to control the musical sound that has been played effectively or with entertainment.
In addition, what is described in Patent Document 2 directly generates musical sounds by detecting vibrations, and can control the performance when playing as a musical instrument using the operation keys of the portable terminal device. It wasn't.
Therefore, the present inventors have a tilt detecting means for detecting the acceleration in the predetermined direction and the tilt angle in the predetermined direction of the casing, and based on the detection result, the means for changing the mode of the musical sound data corresponding to the input operation Has been proposed (Japanese Patent Application No. 2005-218700).
In this proposed one, a method of using a tilt sensor to select whether or not to add vibrato when an acceleration of a certain level or more is applied in the direction of the tilt angle is shown here. Vibrato was constant and the user could not control the content of the vibrato at his own will.
Further, since the operation is performed by detecting the acceleration in the predetermined direction and the tilt angle in the predetermined direction, there is a problem that the user's operation is limited when playing the musical instrument using the portable terminal device.

  Accordingly, the present invention provides a portable terminal device that allows a user to finely control the performance expression by shaking the device during a performance in a portable terminal device that can play a musical instrument (performance) by pressing an operation key. It is intended to provide.

In order to achieve the above object, a mobile terminal device of the present invention includes a plurality of operation keys, detection means for detecting a state where the operation keys are pressed, and acceleration detection means for detecting acceleration in an arbitrary direction. Generating sound source control data for generating a musical tone having a pitch or an instrument tone assigned to the operation key when the operation unit detects that the operation key is pressed by the sound source unit and the detection unit; Musical sound generation control means for outputting to the sound source section and sound source control data for processing the musical sound generated by the sound source section according to the acceleration detected by the acceleration detection means, and outputting to the sound source section Musical tone control means.
The sound source control data for processing the musical sound is sound source control data for changing the pitch, volume or filter cutoff frequency of the musical sound.
Further, the acceleration detection means detects acceleration in any three-dimensional direction, and the musical sound control means detects the detected acceleration in the X-axis direction, acceleration in the Y-axis direction, and acceleration in the Z-axis direction. Sound source control data for changing the pitch, volume or filter cut-off frequency of the musical sound according to each acceleration is generated.
Furthermore, the musical sound control means generates sound source control data in which the direction in which the pitch, volume or filter cutoff frequency of the musical sound is changed in the reverse direction according to the detected sign of acceleration.
Furthermore, the musical sound control means generates sound source control data corresponding to the detected magnitude of the amount by which the pitch, volume or filter cutoff frequency of the musical sound is changed.
Furthermore, a light emission display unit that can emit light in a plurality of colors, and a light emission control unit that lights or blinks the light emission display unit with a light emission color assigned to the operation key while the operation key is pressed. And a light emission state control means for changing a light emission color or a blinking frequency of the light emission display unit according to the acceleration detected by the acceleration detection means.

According to such a portable terminal device of the present invention, after the operation key is pressed and sounding is started, processing such as addition of vibrato to the musical sound can be performed by shaking the portable terminal device. Various music expressions are possible. At this time, the azimuth and angle of shaking are not limited, and the music expression of the performer can be further increased.
Further, by controlling the direction of control in the opposite direction with positive and negative acceleration and controlling the depth of control with the magnitude of acceleration, it is possible to express in detail how to swing the mobile terminal device in vibrato or the like.
Further, by controlling the LED that is lit by shaking the mobile terminal device, a performance factor can be added to the music expression of the performer, and more entertainment can be exhibited.

FIG. 1 is a system configuration diagram of an embodiment of a mobile terminal device of the present invention. The mobile terminal device of the present invention is not limited to a mobile phone, but here, a case where it is a mobile phone will be described as an example.
In this figure, 1 is a control unit (CPU) for controlling the entire apparatus, 2 is a communication control program, a program for generating musical sounds, and various control programs such as a program for controlling a light emitting display unit such as an LED, ROM that stores constant data and the like, 3 is a RAM that is used as a work area and stores various data such as setting information to be described later, 4 is a display unit including a liquid crystal display (LCD), and 5 is a number An input unit having various operation keys such as a key and a call key, 6 is a wireless communication unit including a modulation / demodulation unit, 7 is an antenna connected to the wireless communication unit 6, and 8 is an audio process for encoding and decoding audio signals. Reference numerals 9 and 9 are reception speakers connected to the audio processing unit 8, and 10 is a transmission microphone.
Reference numeral 11 denotes a sound source having a plurality of tone generation channels, 12 denotes a D / A converter that converts musical tone data generated by the sound source 11 into an analog musical tone signal, and 13 denotes a speaker that reproduces the musical tone signal.

Reference numeral 14 denotes an acceleration sensor that detects acceleration generated when the cellular phone is shaken. The acceleration sensor 14 is a three-axis acceleration sensor that can measure acceleration in any three-dimensional direction, and includes an X-axis acceleration detection unit that detects acceleration in the X-axis direction, and Y that detects acceleration in the Y-axis direction. There are three acceleration detection units: an axial acceleration detection unit and a Z-axis acceleration detection unit that detects acceleration in the Z-axis direction. The acceleration sensor 14 can be replaced by a tilt sensor that detects tilt, a vibration sensor that detects vibration, a geomagnetic sensor that detects orientation, and the like. In these cases, a difference from the previous measurement value is used. Calculate acceleration.
Reference numeral 15 denotes a light emission control unit (LED controller) that controls light emission of the light emission display unit (LED in this embodiment) 16, and 16 denotes a light emission display that is provided on the casing of the mobile phone and emits light when an incoming call is received. Part (LED). The light-emitting display unit 16 can emit light in a plurality of emission colors. In this embodiment, the LED 16 can emit light in a plurality of emission colors. Also good.
Reference numeral 17 denotes a bus (data bus and address bus) for transferring data between the constituent elements.

The sound source 11 is a module that can control sound generation by the MIDI protocol, and a sound source method such as the FM method or the PCM method is not particularly specified, but the specification needs to satisfy GM system level 1.
The LED 16 is, for example, a red (R), green (G), and blue (B) LED in one package, and the LED controller 15 individually controls the brightness of the three colors of LEDs. By doing so, light can be emitted in a plurality of emission colors. For example, when each of RGB is lit individually, the emission colors are red, green, and blue, and R + G is yellow, R + B is purple (magenta), G + B is blue-green (cyan), and R + G + B is white for a total of seven colors. Color can be obtained. Further, more light emission colors can be obtained by providing a plurality of stages for the luminance of each RGB color. Furthermore, by changing the luminance of the RGB LEDs in terms of time, the emission color and luminance can be changed during lighting. Furthermore, a plurality of LEDs 16 may be provided, or a plurality of individual LEDs of RGB colors may be provided.

  In the portable terminal device of the present invention having such a configuration, when the user presses the operation key of the input unit 5, the tone generator or musical tone tone assigned to the operation key is generated by the sound source 11. In addition to being reproduced from the speaker 13, the LED 16 is lit or blinks in the luminescent color assigned to the operation key. At that time, when the user shakes the mobile terminal device, the volume and pitch of the generated musical sound are controlled according to the acceleration detected by the acceleration sensor 14, and the light emission state of the LED 16 is controlled. It is made to be done.

FIG. 2 is a diagram showing a functional configuration for executing the above-described operation in the mobile terminal device of the present invention. In this figure, a sound source 11, a D / A converter 12, a speaker 13, an acceleration sensor 14, an LED controller 15 and an LED 16 are the same as those shown in FIG.
The three-dimensional acceleration detection unit 21 reads acceleration information (αx, αy, αz) in each of the X-axis, Y-axis, and Z-axis directions detected by the acceleration sensor 14 at predetermined time intervals and adds it to the portable terminal device. The direction of the given acceleration is determined, the acceleration in that direction is obtained and output to the MIDI control module 24. Note that acceleration information (αx, αy, αz) in the XYZ axis directions may be output to the MIDI control module 24.
The number key assigner 22 includes twelve operation keys among the operation keys provided in the input unit 5 (in this embodiment, “0” to “9”, “#” and “*” number keys). Is scanned, and the timing at which the number key is pressed (timing when turned on) and the timing when it is released (timing when it is turned off) is transmitted to the MIDI control module 24 in real time.

The setting information file 23 includes (A) allocation information indicating a correspondence relationship between the twelve number keys and the tone pitch or musical instrument tone color to be generated and the emission color of the LED 16, and (B) the acceleration sensor 14. It is a file that stores two types of allocation information: allocation information indicating the correspondence between the detected acceleration and the content of control (processing) for the generated musical sound and the content of control for the light emission state of the LED 16.
In advance, the user assigns (A) which pitch key or instrument tone color to which number key and which light emission color of the LED 16 to be assigned, and (B) which element of the musical sound generated at the detected acceleration. And which element of the LED emission mode is to be assigned. The allocation information is stored in the RAM 3 or the like as the setting information file 23, and the setting for allocation is completed by reading this file at the time of activation.

The MIDI control module 24 responds to the operation key based on the allocation information (A) in the setting information file 23 when information indicating ON / OFF of the number key from the number key assigner 22 is input. A MIDI message (note on / note off) for generating a musical sound to be generated and a MIDI message (system exclusive or control change) for controlling the lighting of the LED 16 are generated and output to the sound source 11 and the LED controller 15.
Further, based on the acceleration information from the three-dimensional acceleration detector 21 and the allocation information (B) in the setting information file 23, the musical sound generated by the sound source 11 is referred to the acceleration / MIDI conversion table 25. A MIDI message (control change or pitch bend) for controlling the LED 16 and a MIDI message (system exclusive or control change) for controlling the lighting state of the LED 16 are generated and output to the sound source 11 and the LED controller 15.

The sound source 11 receives a note-on message from the MIDI control module 24 and generates a tone of the corresponding tone, and also generates a volume and pitch of the tone generated by receiving a MIDI message (control change or pitch bend) for controlling the tone. Control filter cutoff frequency, etc. The D / A converter 12 converts the digital musical tone data output from the sound source 11 into an analog musical tone signal and reproduces it by the speaker 13.
The LED controller 15 has a register in which control data designating the luminance of each of the RGB three-color LEDs included in the LED 16 is written. When the LED controller 15 receives a MIDI message (system exclusive or control change) from the MIDI control module 24, it writes the control data contained therein into the register and based on the control data written in the register. Then, the designated RGB LED is driven with the designated luminance. Thereby, each LED of RGB emits light with the designated luminance, and the LED 16 emits light with a desired emission color. A MIDI message including control data for causing each LED to emit light at a specified luminance and a MIDI message including control data for turning off each LED (light emission luminance is set to 0) are alternately sent to the LED controller 15 at desired time intervals. By sending it out, the LED 16 can blink at a desired frequency.
Here, the three-dimensional acceleration detection unit 21, the number key assigner 22, and the MIDI control module 24 are realized by a control program executed by the control unit 1.

FIG. 3 is a diagram showing an example of (A) musical tone pitch or instrument tone color and LED 16 emission color allocation information to be generated for each number key among the allocation information stored in the setting information file 23. is there. In the present invention, when the twelve number keys are pressed, the musical sound assigned to the keys can be generated. At this time, the pitch of the musical sound is assigned to each number key, and the drum ( Rhythm) There are two modes of operation, in which a musical instrument tone color is assigned.
FIG. 3A shows an example in which the generated musical tone is a melody tone, and the pitch of one octave, the seven emission colors of LED 16 and the lighting / flashing are assigned to the 12 number keys described above. Yes. In this case, the tone color of the generated musical tone can be designated by the user.
FIG. 3B shows an example in which the above-mentioned twelve number keys are assigned to the drum tone instrument tone color, the seven emission colors of the LED 16, and the lighting / flashing.
In the illustrated example, when the number key is not pressed ("None"), the sound is silent and no light, but a color can also be assigned. Further, although it blinks or lights up, the emission color or luminance may be changed over time while the number key is pressed.

Next, the control of the musical sound and the control of the lighting state of the LED executed in accordance with the acceleration information from the three-dimensional acceleration detector 21 will be described.
4A and 4B are diagrams showing elements controlled in accordance with detected acceleration. FIG. 4A shows a control element for a generated musical sound, and FIG. 4B shows a control element for a lighting state of an LED. Show.
As shown in FIG. 4A, the control elements for the musical sound include the volume of the generated musical sound, the pitch (pitch) of the generated musical sound, and the cut of the low-pass filter that passes the generated musical sound. There is an off frequency.
As described above, the MIDI control module 24 refers to the acceleration information from the three-dimensional acceleration detection unit 21 and outputs a MIDI message for controlling the musical sound generated by referring to the acceleration / MIDI conversion table 25. Generate and output to the sound source 11. As shown in the figure, when changing the volume, a control change message (expression of the control number 11) is generated. When controlling the pitch, a pitch bend message corresponding to the acceleration information is generated to control the filter cutoff frequency. When this is done, a control change message (a cut-off of the control number 74) is generated and sent to the sound source 11.

In addition, as a control element for changing the display state of the LED in accordance with the acceleration, there is a change in the blinking frequency and emission color of the LED 16 as shown in FIG.
When the blinking frequency or emission color of the LED 16 is changed in accordance with the acceleration, the MIDI control module 24 refers to the acceleration / MIDI conversion table 25, and a system corresponding to the acceleration information from the three-dimensional acceleration detection unit 21. An exclusive message is created and sent to the LED controller 15. As a result, the emission color can be changed from the first color to the second color by controlling the blinking frequency of the LED, or strengthening or weakening any color element of the RGB LEDs. .

Here, the detection is performed when the generated musical sound and the lit LED are controlled according to the magnitude of the acceleration in the three-dimensional arbitrary direction detected by the three-dimensional acceleration detector 21. It is desirable that the direction of control is reversed in accordance with the direction of the detected acceleration (positive or negative of the acceleration value in the detected acceleration direction). That is, when acceleration in an arbitrary direction in three dimensions is detected, control is performed in a direction in which a musical tone or an LED control element (volume, pitch, etc.) is increased in accordance with the acceleration in the direction (positive), and the reverse direction ( The control element is controlled to decrease in accordance with the negative acceleration.
Further, it is preferable to control the depth of control to be deep according to the magnitude of acceleration. That is, control is performed so that the change width of the controlled element (volume, pitch, etc.) is increased according to the detected magnitude (absolute value) of acceleration.

FIG. 5 shows an example in which vibrato is added to a musical sound according to an operation of shaking the mobile terminal device by controlling the pitch of the generated musical sound according to the acceleration.
As shown in FIG. 5A, when the mobile terminal device is shaken to the left and right, the pitch of the generated musical sound is changed to apply vibrato. FIG. 5B is a diagram showing the state, in which the vertical axis indicates the pitch (pitch) and the horizontal axis indicates the time. In the example shown in this figure, the pitch increases when the mobile terminal device is shaken to the right, and decreases when the mobile terminal device is shaken to the left, and one round trip of the operation of shaking the mobile terminal device corresponds to one cycle of vibrato. So that it is controlled. Further, the pitch change range (vibrato depth) is proportional to the detected acceleration magnitude (absolute value). Thereby, the fine expression of vibrato can be controlled by the manner of swinging the mobile terminal device.

Which direction to control the correspondence between the acceleration information and the control element for the sound source (volume, pitch or filter cutoff frequency) and the control element for the LED (flashing frequency or color change) according to the setting information and the positive or negative of the acceleration Is stored in the setting information file 23 as the allocation information (B). At this time, a plurality of control elements may be changed instead of one control element.
As a result, the MIDI control module 24 controls the MIDI sound generated by the MIDI control module 24 to control the generated musical sound based on the allocation information set by the setting information file 23 according to the three-dimensional acceleration in any direction. A MIDI message for controlling the lighting state is generated, and the lighting state of the LED is controlled.

In the above description, the acceleration sensor 14 detects acceleration in an arbitrary direction, and controls the assigned control element according to the direction and magnitude (absolute value). The control elements may be independently assigned to the acceleration in the direction of each axis of the Z axis.
FIG. 6 shows an example of the allocation information of (B) in the setting information file 23 in the case where the above-described control elements are allocated independently for the accelerations in the X-axis, Y-axis, and Z-axis directions. FIG.
In this example, the tone pitch control and LED emission color change are assigned to the acceleration information in the X-axis direction, and the tone volume control and the LED blinking frequency control are assigned to the acceleration information in the Y-axis direction. Allocation, control of both pitch and volume of musical tone and change in LED emission color are allocated to acceleration information in the Z-axis direction. When the acceleration information of each axis is a positive value, control is performed so that the value of each control element and the blinking frequency of the LED with respect to the musical tone are increased (+), and when the acceleration information is negative, the value is decreased (−). So that it is controlled. Further, the light emission color of the LED is controlled so as to be different depending on whether the acceleration information is positive or negative. In the example of the figure, the emission color is controlled to be red (R) according to the positive acceleration in the X-axis direction and white (W) color according to the negative acceleration, and the positive acceleration in the Z-axis direction is controlled. The color is controlled to be blue (B) according to the color and green (G) according to the negative acceleration.

Next, the acceleration / MIDI conversion table 25 referred to when the MIDI control module 24 generates a MIDI message for performing the corresponding control according to the acceleration information will be described.
FIG. 7A is a diagram showing a main part of an example of the acceleration / MIDI conversion table 25, and FIG. 7B is a diagram showing an example of a control characteristic of a pitch corresponding to the acceleration.
For simplification, FIG. 7A shows only a part of the acceleration / MIDI conversion table 25 for changing the pitch, but the volume, filter cutoff frequency, LED The control elements for the above are similarly configured.
In the table shown in FIG. 7 (a), the change in pitch at each time point of 0 msec, 20 msec, 40 msec, 60 msec,.. Stipulated in For example, when increasing the pitch, when the acceleration value is 20, the first (0 msec) is defined to be 0, +400 after 20 msec, +800 after 40 msec, +1200 (cent) after 60 msec,.
FIG. 7B is a diagram showing a part of the pitch control characteristics of FIG. 7A, where A is an acceleration value of +10, B is an acceleration value of +20, and C is an acceleration. The control characteristic when the value is +30 is shown. D represents the control characteristic of the pitch when the acceleration value is −10, E is the acceleration value −20, and F is the acceleration value −30.
Thus, in this example, the direction of control is reversed according to the sign of the detected acceleration value, and the rate of change is increased according to the absolute value of the acceleration value. Note that the control target value may be a value corresponding to the absolute value of the acceleration.

The MIDI control module 24 refers to the acceleration / MIDI conversion table 25, generates a pitch bend message for changing the pitch in accordance with the control characteristic corresponding to the detected acceleration, and sends it to the sound source 11. To do.
For example, it is assumed that the sign of acceleration in the X-axis direction is positive and the value is 20 under the allocation information shown in FIG. In this case, the MIDI control module 24 refers to the acceleration / MIDI control table of FIG. 7 and generates a pitch bend message for raising the pitch by 400 cents after 20 msec and sends it to the sound source 11. After 40 msec, the MIDI control module 24 sends the pitch to 800 cents. A pitch bend message to be raised is generated and sent to the sound source 11, and the following control is performed.
Similarly, with respect to volume, filter cutoff frequency, and LED light emission control, control characteristics corresponding to acceleration values are set in the acceleration / MIDI conversion table 25, and the MIDI control module 24 is set. A MIDI message for performing control corresponding to the control characteristics is generated and sent to the sound source 11 or the LED controller 15.

Next, the operation of the mobile terminal device configured as described above will be described with reference to the flowchart of FIG.
1. When the user gives an instruction to start performance, system setup is started (S1).
In this process, the tone color of the musical tone generated by the user is selected. Then, the control unit 1 (MIDI control module 24) reads the contents of the setting information file 23 which defines which light emission color of the LED 16 is assigned to each number key and which pitch or instrument tone is assigned. . When the tone color selected by the user is a melody tone color, the pitch is assigned to the number key as shown in FIG. 3A, and when the tone color is a drum tone, an instrument tone color is assigned. Allocation between the acceleration information and control elements is also set.
When the selected tone color is a melody tone color, a channel for performance is designated to the sound source 11 (usually channel 1), and a program change message of the tone color of the instrument that the user wants to perform is transmitted in advance. . When the selected tone color is a drum tone color, channel 10 is designated.

2. Next, the user starts control and performance of the LED 16 by pressing and releasing the number key.
The number key assigner 22 always scans which number key is pressed or released (S2).
3. If there is a number key that has been pressed and turned on (S3), a note-on message instructing the start of sounding is issued (S4). The note number at this time stores a value according to the setting in the setting information file 23. As a result, a corresponding musical tone is generated by the sound source 11 and reproduced from the speaker 13 via the D / A converter 12.
At the same time, a MIDI message (for example, a system exclusive message) for instructing lighting of the LED 16 in the emission color designated by the key is issued (S4). As described above, this message includes data instructing the LED 16 to be lit or blinking in the emission color according to the setting by the setting information file 23.

4). When the user performs an operation such as shaking the mobile terminal device during sound generation, the output of the acceleration sensor 14 changes, and acceleration information is output from the three-dimensional acceleration detection unit 21 (S5).
The MIDI control module 24 refers to the acceleration / MIDI conversion table 25 according to the detected acceleration and issues a set MIDI event (S6).
5. If there is a number key that has been released and turned off (S5), a MIDI message instructing LED off is issued and a note-off message instructing the end of sounding is issued (S8).
6.2 to 4 are continued until the performance is completed (S9).

In this way, while the number key is pressed, a musical tone having a preset pitch or tone color is generated, and the LED 16 is controlled to be lit or blinked with a preset emission color. Then, when the user shakes the mobile terminal device, it is possible to control the generated musical sound and the lighting state of the LED.
In the above-described embodiment, the triaxial acceleration sensor is used. However, the present invention is not limited to this, and a uniaxial or biaxial acceleration sensor may be used.

It is a block diagram which shows the whole structure of one Embodiment of the portable terminal device of this invention. It is a functional block diagram of the portable terminal device of this invention. It is a figure which shows the example of the allocation information of the pitch with respect to a number key, a timbre, and the luminescent color of LED. It is a figure which shows the element controlled by acceleration information, and the MIDI event (MIDI message) corresponding to it, (a) is a control element regarding control of a musical tone, (b) has shown the control element regarding light emission of LED16. It is a figure which shows an example in the case of controlling the pitch of a musical sound according to acceleration. It is a figure which shows the example of allocation in the case of allocating a control element independently with respect to the acceleration information of a X-axis, a Y-axis, and a Z-axis direction. It is a figure for demonstrating an acceleration / MIDI conversion table, (a) is a principal part of an example of an acceleration / MIDI conversion table, (b) is a figure which shows an example of the control characteristic of the pitch according to an acceleration. It is a flowchart which shows the flow of the process in the portable terminal device of this invention.

Explanation of symbols

  1: control unit, 2: ROM, 3: RAM, 4: display unit, 5: input unit, 6: wireless communication unit, 7: antenna, 8: audio processing unit, 9: speaker, 10: microphone, 11: sound source , 12: D / A converter, 13: speaker, 14: acceleration sensor, 15: LED controller, 16: LED, 21: three-dimensional acceleration detector, 22: number key assigner, 23: setting information file, 24: MIDI control module 25: Acceleration / MIDI conversion table

Claims (6)

Multiple operation keys and
Detecting means for detecting a state in which the operation key is pressed;
Acceleration detecting means for detecting acceleration in an arbitrary direction;
The sound generator,
When the detection means detects that the operation key is pressed, it generates sound source control data for generating a musical tone having a pitch or a musical instrument tone assigned to the operation key and outputs it to the sound source unit Musical sound generation control means,
And a musical sound control means for generating sound source control data for processing the musical sound generated by the sound source unit according to the acceleration detected by the acceleration detection means and outputting the data to the sound source unit. Terminal device.   2. The portable terminal device according to claim 1, wherein the sound source control data for processing the musical sound is sound source control data for changing a pitch, a volume, or a filter cutoff frequency of the musical sound. The acceleration detecting means detects acceleration in a three-dimensional arbitrary direction,
The musical tone control means generates sound source control data for changing the pitch, volume or filter cutoff frequency of the musical tone in accordance with the detected acceleration in the X-axis direction, acceleration in the Y-axis direction, and acceleration in the Z-axis direction. The mobile terminal device according to claim 1, wherein the mobile terminal device is generated.   The sound control means generates sound source control data in which the direction in which the pitch, volume, or filter cutoff frequency of the sound is changed is reversed according to the detected sign of acceleration. 3. The mobile terminal device according to 3.   4. The mobile phone according to claim 2, wherein the musical sound control means generates sound source control data corresponding to the detected magnitude of an amount by which the pitch, volume or filter cutoff frequency of the musical sound is changed. Terminal device. A light emitting display that can emit light in multiple colors;
Light emission control means for turning on or blinking the light emission display portion with the light emission color assigned to the operation key while the operation key is pressed;
6. The portable device according to claim 1, further comprising: a light emission state control unit that changes a light emission color or a blinking frequency of the light emitting display unit according to the acceleration detected by the acceleration detection unit. Terminal device.

Images