JP2012034263A - Portable terminal device - Google Patents

Abstract

A mobile terminal (smart phone) in which a mobile phone / PHS and a personal digital assistant (PDA) are integrated has a different shape from an original mobile phone and is a device that is difficult to speak as a telephone. In particular, the receiver for receiving a call is generally arranged at the upper part of the main display, and it is difficult to hear the other party's voice due to poor ear-earing. Causes include the position of his / her ear and the position of the receiver sound hole of the portable terminal, and sound leakage due to poor ear contact.
A function of detecting each element of the ear, a function of estimating the position of the user's ear canal from each detected element, and a distance between the estimated position of the ear hole and the receiver sound hole of the portable terminal are measured. A function is provided to the portable terminal, and the receiver volume is increased or varied when the distance between the portable terminal and the receiver sound hole is larger than a certain threshold.
[Selection] Figure 5

Description

  The present invention relates to a mobile terminal device such as a so-called smartphone.

  Some portable terminals in recent years can adjust a sound volume emitted from a sound hole of a receiver that generates a reception sound.

  FIG. 1 shows a configuration diagram of a portable terminal device with an automatic reception volume control function. Normally, when performing a voice call, the uplink voice is converted into an electric signal by the microphone unit 19 and the analog signal is voltage amplified by the transmission voice processing unit 18. The amplified audio signal is sent to the CPU control unit 1 and converted into a digital signal. Thereafter, the digital data is transferred to the transmission unit and transmitted to the base station. As for the downlink voice data, the radio wave from the base station is received by the transmission unit 9, demodulated by the CPU control unit 1, and further converted into an analog signal. The received voice processing unit 16 amplifies the power so that the receiver 17 can be driven. In this way, a voice call is realized. When a voice call is started, especially when an incoming call is received, a melody sound corresponding to a song title set in advance in the storage device 5 is sounded. More specifically, the melody sound source is output by the sound source oscillation unit, the power is amplified by the speaker amplifier unit 20, and the speaker unit 21 is driven.

JP 2001-309025 A JP 2002-165778 A Japanese Patent No. 3661262

Nikkei Electronics January 25, 2010 issue 35-39

  In recent years, mobile terminals have become multifunctional and highly functional, and have a design priority. This tendency is particularly remarkable in a mobile terminal (smart phone) in which a mobile phone / PHS and a personal digital assistant (PDA) are integrated. As a result, it can be said that in recent mobile terminals, consideration of basic functions as an original voice call has been reduced. In particular, a smartphone has a structure in which almost the entire surface of the terminal is a display, and a receiver that generates a reception sound is arranged on the upper side of the display, that is, at the end of the terminal. As a result, during a voice call, the user must change the reception volume or adjust the position of the ear and the terminal so that the reception sound can be heard to the maximum.

  However, the means for changing the reception volume provided in the conventional portable terminal is only complicated by the user manually setting the volume, and is complicated. In addition, setting the reception volume to a large value always consumes a large amount of current, resulting in shortening the standby time and call time.

  On the other hand, the receiver sound hole of the portable terminal and the position of the user's ear are matched to increase the sealing degree of the receiver sound hole and the ear as much as possible. Here, in the conventional telephone, ergonomics is taken into consideration, and the user can naturally correct the ear contact with easy position adjustment. However, in a portable terminal such as a smartphone, it is difficult to achieve both a shape that makes it easy to use a PDA-equivalent function and a shape that makes a telephone function easy to use. For example, in order to improve the contact between the receiver sound hole and the user's ear, at least the relative position relationship between the mobile terminal body and the user's ear canal is sensibly understood. Measures to establish are necessary. On the other hand, such unevenness is a request that cannot be realized without sacrificing operability in a mobile terminal such as a smartphone that places importance on operability by touching the display surface. Hereinafter, a specific description will be given with reference to Non-Patent Document 1. Non-Patent Document 1 shows the transition of mobile terminals from an initial mobile phone to a smartphone. From Non-Patent Document 1, as the functions of mobile terminals are advanced and advanced, and the UI function is strengthened, the phone function changes from a shape that is easy to use to a shape that emphasizes operability with fingers and pens. You can see how it goes. That is, in the smartphone, the telephone function is only part of the function of the terminal, and it has become difficult to realize a shape specialized for the telephone function.

  Accordingly, an object of the present invention is to provide a portable terminal that allows a user to easily listen to a sound without manually adjusting the volume or adjusting the position of the ear and the sound hole.

  The portable terminal device according to the first aspect of the present invention is used from a sound hole that outputs sound, a detection unit that is provided around the sound hole and detects contact or proximity of a human body, and a detection result of the detection unit. An estimation unit that estimates the position of the ear hole of the person, and a control unit that increases or decreases the sound output from the sound hole according to the distance between the position of the ear hole and the position of the sound hole estimated by the estimation unit. It is characterized by providing.

  Furthermore, in the mobile terminal device according to the second aspect of the present invention, the detection unit is a panel that includes a touch panel sensor or a proximity sensor and displays an operation screen of the mobile terminal device.

  In the mobile terminal device according to the third aspect of the present invention, the detection unit is a panel that incorporates an optical sensor and displays an operation screen of the mobile terminal device.

  In the mobile terminal device according to the fourth aspect of the present invention, the estimation unit estimates the position of the ear hole based on the ear feature point detected by the detection unit.

  Furthermore, in the mobile terminal device according to the fifth aspect of the present invention, the feature points of the ear include at least the tragus and the antitragus, and the estimation unit estimates each tip and ear hole of the tragus and the antitragus. The position of the ear canal is determined based on the triangle whose position is the apex.

  Furthermore, the portable terminal device according to the sixth aspect of the present invention further includes a storage unit that stores one triangle, and the estimation unit determines the position of the ear canal using a similar shape of the triangle.

  Furthermore, the mobile terminal device according to the seventh aspect of the present invention corrects the triangle based on the change in the estimated position of the ear canal while emitting sound from the sound hole.

  According to the mobile terminal device according to the first aspect of the present invention, since the sound output from the sound hole is increased or decreased according to the distance between the sound hole and the ear hole, the position adjustment of the ear and the sound hole is not performed or is difficult to perform. Even in this case, it is possible to make it easy to listen to the sound.

  Moreover, according to the 2nd aspect of this invention, a detection part is a panel which is provided with a touch panel sensor or a proximity sensor, and displays the operation screen of a portable terminal device. Such a panel is often mounted as a standard input / output device in a mobile terminal device such as a smartphone. Therefore, the position of the ear canal is not particularly required in a smartphone or the like without adding a device having a special function. Can be estimated.

  Moreover, according to the 3rd aspect of this invention, a detection part is a panel which incorporates an optical sensor and displays the operation screen of a portable terminal device. By using such a panel, information on the user's ear can be obtained optically, so that the position of the ear canal can be estimated more accurately.

  Moreover, according to the 4th aspect of this invention, an estimation part estimates the position of an ear canal based on the feature point of the ear detected by the detection part. According to this configuration, it is possible to accurately estimate the position of the ear canal with a small amount of information.

  According to the fifth aspect of the present invention, the feature point of the ear includes at least the tragus and the antitragus, and the estimation unit apexes the estimated position of each tip and ear hole of the tragus and the antitragus. The position of the ear canal is determined based on the triangle. According to this configuration, it is possible to estimate the position of the ear canal by a relatively lightweight calculation of estimating the vertex of the triangle.

  The sixth aspect of the present invention further includes a storage unit that stores one triangle, and the estimation unit determines the position of the ear canal using a similar shape of the triangle. According to this configuration, since it is not necessary to store a plurality of triangles used for estimating the position of the ear canal, the amount of information to be stored for estimating the position of the ear canal can be suppressed.

  According to the seventh aspect of the present invention, the triangle is corrected based on a change in the estimated position of the ear canal while sound is emitted from the sound hole. According to this configuration, the reference triangle can be corrected to an optimum shape for each user.

Configuration diagram of portable terminal device with automatic listening volume control function Illustration of common ear shape Figure when receiver sound hole and ear hole are in the same position Figure when receiver sound hole and ear hole are misaligned Front view with mobile device close to face side Front view when the mobile device is moved away from the side of the face Flow chart of automatic listening volume adjustment function

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. FIG. 1 shows a configuration diagram of a portable terminal with an automatic reception volume control function according to an embodiment of the present invention. A mobile terminal (smart phone) has various functions. A camera control unit 2 for controlling camera functions, a sensor unit 3 incorporating an image sensor, a clock control unit 4 for managing the time of a mobile terminal, a key input unit 6, a power control unit 7 equipped with a charging function, and a battery unit 8 It is equipped with. In order to realize a call function, a transmission unit 9 that realizes communication between a mobile terminal and a base station, a reception voice processing unit 16 that generates a reception voice, a receiver unit 17, a transmission voice processing unit 18 that generates transmission voice, a microphone The unit 19 includes a speaker amplifier unit 19 for amplifying a ring tone and a melody sound at the start of a call, and a speaker unit.

  The display includes a display control unit 11 that controls display contents and a display unit 14 that performs screen display, and displays an operation screen of the mobile terminal. When a liquid crystal panel is adopted as the display, a backlight control unit 12 and a backlight module 15 for controlling the backlight of the display are additionally mounted. In a display equipped with an organic EL, the backlight control unit 12 and the backlight module 15 are not necessary.

  In addition, in mobile terminals (smartphones), a display that can be operated by touching a panel (touch panel method) or approaching (proximity sensor method) has been announced. As the main method, a touch panel method, a resistive film method, an ultrasonic method, a capacitance method, an optical method, and the like have been proposed and commercialized. On the other hand, in proximity sensor systems, sensors of induction type, capacitance type, ultrasonic type, electromagnetic wave type, infrared type and the like have been commercialized. In the present invention, the touch panel method, the proximity sensor method, or both methods can be used together. Such a sensor corresponds to the sensor unit 13 in FIG. In the present embodiment, such a display is used as a means for detecting contact or approach of a human body (particularly an ear). In addition, when the touch panel system etc. are employ | adopted for the display, the key input part 6 does not need to be.

  The auricle authentication unit 10 has a function of estimating the position of the user's ear based on the detection result of the sensor unit 13. Further, the auricle authentication unit 10 performs the received voice processing to increase / decrease the volume output from the receiver unit 17 via the CPU control unit 1 according to the estimated distance between the ear position and the sound hole of the receiver unit 17. The unit 16 is instructed. In FIG. 1, the pinna authentication unit 10 and the CPU control unit 1 are distinguished from each other, but the pinna authentication unit 10 may be realized as a part of the function of the CPU control unit 1.

  Next, the process related to the estimation of the ear position according to the present embodiment will be described in detail. The collection and processing of information necessary for estimation of the ear position described below is performed by the auricle authentication control unit 10 controlling each component of the terminal device via the CPU control unit 1 or the ear unless otherwise specified. This is realized by the intermediate authentication control unit 10 itself performing calculations. First, an enlarged view of the ear shape according to the present embodiment is shown in FIG. The received sound is transmitted as sound waves from the ear canal to the back of the ear canal, and the sound can be heard. Therefore, it is necessary to apply the receiver sound hole to the portable terminal so as to cover at least the ear hole. At this time, of the ear-shaped elements, elements called tragus and anti-tragus contact the display surface of the mobile terminal. However, since the ear canal portion is connected to the external auditory canal, it does not contact the display surface, and it is impossible to estimate the position of the ear canal. Therefore, in order to estimate the position of the ear canal, the coordinates of the tips of the tragus and the tip of the tragus are read, and the positions of the tips of the tragus and the tip of the tragus are specified. The position of the ear canal can be roughly estimated from the position of the specified tragus and the tragus. In the present embodiment, assuming a triangle connecting the three points of the tragus, the antitragus, and the ear canal, normalizing it as a length 1 with the tip of the tragus and the antitragus as one side, and using this as a reference triangle This is stored in the storage device 5 of the portable terminal. In addition, since the user of a portable terminal makes an ear contact the display surface near a sound hole during a telephone call (or makes it approach), the auricle authentication control part 10 is based on the detection result of the display of a touch panel or a proximity sensor system, You can know the position of the tragus and the tragus. That is, it can be estimated that the point in contact with or close to the display is the tragus or the tragus. The storage device unit 5 is specifically composed of a flash memory, an HDD, or the like.

  Further, representative ear shape data is stored in advance in the storage unit 5 of the portable terminal. In the present embodiment, the ear shape data is assumed to be data on an XY coordinate plane with an arbitrary one corner among the four corners of the display surface as the origin. As specific ear shape data, the contact pressure due to the unevenness of the cartilage is recorded. In addition to the tragus, anti-tragus, and ear lobe shown in Fig. 2, there are more than 10 elements named around the ear canal, such as the external auditory canal, ear notch notch, and concha. It is adopted in the auricle authentication technology as described in References 1-3.

  The auricle authentication control unit 10 performs pattern matching between the ear shape data and the detected contact pressure in order to increase the accuracy of estimation of the position of the user's ear canal. By pattern matching, key elements of the ear, such as the ear ring and the earlobe, are detected, and it is confirmed that there are no major errors in the result of the ear recognition. For example, it is confirmed whether the left and right ears are upside down or the ears are upside down. If pattern matching is successful, the coordinates of the tip of the user's tragus and anti-tragus are detected, and the triangle with one side as the line segment connecting the two points is the normalized reference triangle described above It is enlarged and reduced so that it has a similar relationship with, and the apex that is diagonal is estimated to be the ear canal. Also, it is possible to determine which ear is left or right by pattern matching. Even when pattern matching cannot be performed, the gravity sensor can prevent erroneous determination such that the left and right ears are reversed. The tragus and antitragus are on both sides of the ear canal, and always touch the display surface when making a voice call. In addition, the reference triangle has a line-symmetric relationship between the left and right ears. Whether the portable terminal is placed on the right ear or the left ear can be determined by reading the shape of the ear ring (outer shape) and the earlobe (earlobe). For example, when the mobile terminal is placed on the right ear, both the ear ring and the ear lobe are convex in the rear of the user. In addition, by using a triangle that has a similar relationship to the reference triangle, the reference triangle that must be stored in the mobile device to determine the position of the ear canal is a line that connects the tips of the tragus and the antitragus The length of the minute is 1, and only a triangle whose diagonal apex is the ear hole is sufficient. That is, it is only necessary to store information about the shape of the triangle, that is, the angles at three locations and the length of each side. Thus, from the pattern matching of the shape and the information of this reference triangle, it is possible to calculate the coordinates of the tip of the tragus of the person with different ear sizes and the tip of the tragus, and the ear hole without touching the display Can be estimated with high accuracy.

  When the mobile terminal enters a call state and presses the mobile terminal against the user's ear, the tragus and the tip of the tragus come into contact with an arbitrary position on the display surface of the mobile terminal. The auricle authentication control unit 10 can perform pattern matching with the ear shape data stored in the mobile terminal and determine the coordinates of the tragus and the tip of the tragus. The position of the ear canal can be estimated from these coordinates. Since the coordinates of the receiver sound hole of the portable terminal are known in advance, as a result, it is possible to measure the amount of deviation between the position of the receiver sound hole and the user's ear hole. FIG. 3 shows a case where the positions of the receiver sound hole and the ear hole coincide. FIG. 4 shows a case where the positions of the receiver sound hole and the ear hole are shifted. In this way, by setting a threshold value according to the amount of deviation and exceeding the threshold value, it is possible to set the received sound volume to a level that is easy to hear by raising the received sound volume by one level. Further, when the amount of deviation is smaller than the threshold value, that is, when the ear contact is improved, the received sound volume can be lowered by one step and returned to the original sound volume.

  It should be noted that, depending on the habit of the user of the mobile terminal, the state of contact with the ears during a call varies widely. As a representative example, FIG. 5 shows a front view when the mobile terminal is brought close to the face side, and FIG. 6 shows a front view when the mobile terminal is moved away from the face side. When approaching the side of the face and the face of the mobile terminal as shown in FIG. 5, it can be assumed that the receiver sound hole portion of the display is in contact with the periphery of the auricle. It seems possible. In the case of FIG. 6, not only the position of the tragus and the tragus, but also the pattern matching of the ear shape cannot be performed, and thus the reception volume is not basically changed. However, when the reception volume is set to the maximum value such as level 6, it is expected that the volume is higher than necessary. In such a case, it is possible to display that the volume is too high on the display device or the like and prompt the user to change the volume setting. Further, since it is known that the volume is too high during a call, there is a high possibility that the display is difficult for the user to see. Therefore, it may be notified by other methods such as vibrating the mobile terminal instead of displaying on the display. In addition, even when ear-shaped pattern matching cannot be performed due to hair or the like, it is possible to set so as not to change the received sound volume in order to prevent malfunction.

  Next, the operation for adjusting the received sound volume will be described with reference to the flowchart of FIG. The auricle authentication control unit 10 detects the call state (S1), and automatically switches the operation mode of the portable terminal to the ear detection mode when the call starts state (S2). The touch panel sensor in this case is in a dedicated mode for capturing the ear shape. That is, normal user interface processing using a touch panel sensor is not performed, and the operation is performed in a mode specialized for ear shape recognition. In this case, this mode is maintained while the ear shape is recognized so as not to end the call even when the end call key is pressed.

  The auricle authentication control unit 10 obtains contact point coordinates and contact pressure information detected by the touch panel sensor after the touch panel sensor is activated. Then, pattern matching of the ear shape data recorded in the portable terminal is executed using the obtained coordinates of the contact point and the contact pressure, and then the coordinates of the tragus and the tragus are measured (S3). After the positions of the tragus and the tragus are determined, their distance is calculated (S4). Next, the position of the ear canal is determined from the reference triangle information (S5). Next, the distance x between the user's ear hole and the receiver sound hole is calculated (S6). When the value of x exceeds a predetermined threshold value X0 (S7), the received sound volume is increased by one level (S8). If the flow above the threshold is in a call and pressed against the user's ear, the call volume is made variable by making the position of the tragus and the tragus follow (S10). Since the distance x constantly changes during a call, a hysteresis characteristic is provided. When the call is finished, the ear shape is not recognized because the portable terminal is away from the ear. When it is determined that the ear shape is not recognized for a time sufficiently longer than the hysteresis characteristic (eg, 5 seconds to 10 seconds), the mode is switched from a mode specialized for ear shape recognition to a normal interface. Therefore, the function of the end call key becomes effective, and the call can be ended by pressing the end call key. (S12).

  In the above example, the case where the touch panel sensor is used has been described, but the present invention is not limited to this. A proximity sensor may be used instead of the touch panel sensor. In this case, not a point touching the display but a point close to the display is detected. When a proximity sensor is used, detection can be performed even when the pinna does not contact the display.

  The setting range of the receiver reception volume of the mobile terminal can be generally set in 6 levels from volume 1 to volume 6. At the time of purchase, the volume 4 is often set as a default value. The purchaser or the user can change the default value. However, when the maximum volume is set, the volume cannot be increased by one step, and thus the volume adjustment of the present invention cannot be performed. Therefore, it is effective when the volume is set to one level lower than the maximum volume.

  At present, most of the ear shape reading systems are those in the experimental stage as described in Patent Documents 1 to 3. In the future, the technology to read the ear shape is expected to evolve, but for the purpose of personal authentication etc., the ear shape is read by directly contacting the pinna in a system used by an unspecified number of users. It seems that it will take time to spread due to hygiene problems. In that respect, since the user is almost specified in the portable terminal, the problem of hygiene is also solved. Therefore, the contact type authentication system is more practical than the pinna authentication system. Although the present invention proposes to authenticate the position of a specific element of the pinna in order to estimate the position of the ear canal, it is considered that only the portable terminal is equipped with the pinna authentication system and personal authentication can be realized. .

  The embodiments of the present invention have been described above. However, the present invention is not limited to the above-described embodiment itself. The following modifications can be considered.

  In the above-described embodiment, the volume adjustment range is not particularly mentioned. For example, the automatic adjustment based on the distance between the ear hole and the receiver sound hole is not performed at a time, but is performed little by little in a plurality of stages. It is also good. This is because the volume adjustment according to the above-described embodiment is automatically performed in a state where the user has his ear close to the receiver sound hole. That is, when the auricle is misrecognized, if the volume increases or decreases all at once, the user may feel uncomfortable or have a disability. Therefore, it is conceivable to adjust the volume little by little so that safety measures can be taken when the user notices an abnormality.

  Moreover, in embodiment mentioned above, the position of the ear canal was judged based on the tragus and the antitragus. However, the determination method is not limited to this. Judgment may be made using other information such as the earlobe and earrings, or the estimation system may be enhanced by detecting more ear features and using them for ear hole estimation. In addition, the volume may be adjusted by simply estimating the vicinity of the point touched first during a call (possibly a tragus or an antitragus) as an ear hole.

  In the embodiment described above, the position of the ear canal is estimated using the reference triangle, but the present invention is not limited to this. After adjusting the volume based on the estimation result using the reference triangle, if the user still moves the ear position, the reference triangle itself may be corrected based on the movement. good. Thereby, the reference triangle can be corrected to an optimum shape for each user. The movement of the position of the ear can be determined by detecting the movement of the detected feature point of the ear with a touch panel sensor or the like. In this case, a learning function may be provided in which the reference triangle is not corrected by a single movement, but is corrected gradually in a plurality of times.

  Moreover, in embodiment mentioned above, although the position of the tragus and the tragus was detected using the touch panel sensor or the proximity sensor, it is not restricted to this. The feature point of the ear may be detected using a technique used for pinna authentication such as Patent Documents 1 to 3. In addition, a dedicated device may be provided in the vicinity of the receiver sound hole in order to detect an ear feature point. However, since mobile terminals such as smartphones often have either a touch panel sensor or a proximity sensor for operation, these sensors can be used to connect the auricle without providing additional sensors. The position can be detected.

  As an example using the pinna authentication technique, it is conceivable to take in as ear image data and discriminate it by pattern matching. In this case, the ear shape data is obtained by storing the contact pressure of each feature point as an image, and the position of the ear canal is estimated by pattern matching between this image and the ear image data. When implementing such a function, it is conceivable to use a liquid crystal display with a built-in optical sensor for each pixel as the display of the mobile terminal. That is, by using a display equipped with an image capturing function that incorporates a light sensor or the like in each dot, the outer shape of the user's ear (the ear ring) and the feature points of the ear, that is, the tragus, the tragus, the earlobe ) Etc. as image data, and pattern matching is performed with the captured data and typical ear shapes recorded in advance in the storage unit. Then, the coordinates of the user's ear hole (ear hole) when the outer shape of the mobile terminal is used as a reference are calculated, and the volume is changed according to the distance between the receiver sound hole and the ear hole. This device has been announced by various companies. According to this example, the position of the ear canal can be estimated more accurately than a touch panel sensor that reacts even when another part such as a finger or face touches.

  Further, both of the sensors may be used in combination, for example, detection of the tragus and anti-tragus using a touch panel sensor or the like and whether or not the determination is correct using an optical sensor or the like.

  In addition, the ear canal may be estimated using the technique of pinna authentication described in Patent Documents 1 to 3. Patent Document 1 describes a pinna authentication technique that combines existing techniques. Patent Document 2 discloses a technique for transmitting ultrasonic waves to the ear canal from the ear canal to the eardrum and analyzing the reflected waves to extract feature information. Patent Document 3 proposes a method of contacting an auricle with an optical plate in which an image sensor is incorporated, similar to the example using the optical sensor described above. Note that the auricle authentication technology may progress in the future, so if a new technology is born, it may be applied to the present invention.

  In the above-described embodiment, the timing at which the volume is adjusted is not particularly mentioned. However, for example, it may be always performed during a call or according to the position of the ear at the start of the call. Then, the volume may be adjusted and fixed thereafter.

  Moreover, although embodiment mentioned above assumed the portable terminal like a smart phone, it is not restricted to this. Applications to various devices such as conventional portable terminals and game machines are conceivable.

  Moreover, what combined embodiment mentioned above and each modification is also contained in this invention.

  INDUSTRIAL APPLICABILITY The present invention is useful in the field of equipment that listens to sound with an ear in contact with or close to the equipment body.

DESCRIPTION OF SYMBOLS 1 CPU control part 2 Camera control part 3 Sensor part 4 Clock control part 5 Memory | storage device part 6 Key input part 7 Power supply control part 8 Battery part 9 Transmission part 10 Auricular authentication control part 11 Display control part 12 Backlight part 13 Sensor part DESCRIPTION OF SYMBOLS 14 Display part 15 Backlight 16 Received voice control part 17 Receiver part 18 Transmitted voice processing part 19 Microphone part 20 Speaker amplifier part 21 Speaker part

Claims (7)

A sound hole for outputting sound,
A detection unit provided around the sound hole for detecting contact or proximity of a human body;
An estimation unit that estimates the position of the user's ear canal from the result of detection by the detection unit;
And a control unit that increases or decreases the sound output from the sound hole according to the distance between the position of the ear hole and the position of the sound hole estimated by the estimation unit. . The mobile terminal device according to claim 1, wherein the detection unit is a panel that includes a touch panel sensor or a proximity sensor and displays an operation screen of the mobile terminal device. The mobile terminal device according to claim 1, wherein the detection unit is a panel that incorporates an optical sensor and displays an operation screen of the mobile terminal device. The portable terminal device according to claim 1, wherein the estimation unit estimates a position of the ear hole based on a feature point of the ear detected by the detection unit. The ear feature points include at least tragus and antitragus,
The portable terminal device according to claim 4, wherein the estimation unit determines the position of the ear canal based on a triangle whose apexes are the estimated positions of the tragus and the tip of the anti-tragus and the ear canal. The portable terminal device further includes a storage unit that stores one triangle.
The portable terminal device according to claim 5, wherein the estimation unit determines a position of the ear canal using a similar shape of the triangle. The portable terminal device according to claim 5, wherein the portable terminal device corrects the triangle based on a change in an estimated position of the ear canal while sound is emitted from the sound hole.

Images