JP2006174288A - Mobile terminal device, collision prevention method, collision prevention program, and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To reliably notify an operator of a mobile terminal device of the presence of an obstacle by providing the mobile terminal device itself with a function of notifying the operator of the presence of an obstacle. Provided is a mobile terminal device capable of greatly reducing the possibility of a collision.
SOLUTION: A mobile terminal device according to the present invention includes obstacle detection means 103 for detecting an obstacle existing around the mobile terminal device, and an obstacle for informing the user of the mobile terminal device of the presence of the obstacle. The object notification means 104 is provided. The obstacle notification means 104 notifies the user of the presence of an obstacle when the obstacle detection means 103 detects an obstacle.
[Selection] Figure 1

Description

  The present invention relates to a mobile terminal device such as a mobile phone, and more particularly to a mobile terminal having a collision prevention function for preventing an operator of the mobile terminal device from colliding with an obstacle such as a person or a building while walking. It relates to the device.

In recent years, with the spread of portable terminal devices such as mobile phones with various application functions such as mail and Internet, the number of people who use application functions such as mail and Internet of portable terminal devices while walking or riding a bicycle has increased. I am doing.
Special table 2002-541536 (announced December 3, 2002) JP 7-306995 A (published November 21, 1995)

  However, there are many cases in which people who use application functions such as e-mail and the Internet of portable terminal devices cause inadvertent collision accidents while walking or riding a bicycle. However, none of the conventional portable terminal devices have a collision prevention function.

  Therefore, it is conceivable to apply a collision prevention function in another field to the mobile terminal device.

  For example, there is a technique disclosed in Patent Documents 1 and 2 as a general collision prevention technique.

  Patent Document 1 discloses a collision prevention system that prevents a collision involving a vehicle (automobile) by monitoring, controlling, recording, and reporting the speed and position of the vehicle.

  Further, Patent Document 2 includes an in-vehicle device and a portable device having an ID code and capable of transmitting and receiving. Thus, when a pedestrian who has a high probability of colliding with an automobile is found, A traffic safety system for informing a pedestrian of the danger of a collision and preventing an obstacle from colliding is disclosed.

  However, since the configuration as in Patent Document 1 is directed to an automobile, even if the danger of an automobile collision reaches a pedestrian, the danger cannot be notified to the pedestrian himself.

  Also in the configuration as in Patent Document 2, a device for preventing collision is required for both the automobile and the pedestrian (operator of the portable terminal device), and the device alone carried by the operator of the portable terminal device is required. There arises a problem that the danger of collision cannot be detected and notified.

  From the above, if the techniques disclosed in Patent Documents 1 and 2 are simply applied to the mobile terminal device, the mobile terminal device alone can detect an obstacle and notify the operator of the mobile terminal device. There was a high possibility that a collision with an obstacle could not be avoided.

  The present invention has been made in view of the above-described problems, and an object of the present invention is to operate the mobile terminal device by providing the mobile terminal device itself with a function of notifying the operator of the presence of an obstacle. An object of the present invention is to provide a portable terminal device that can reliably notify the presence of an obstacle to a person and greatly reduce the possibility of a collision with the obstacle.

  In order to solve the above-described problem, the mobile terminal device according to the present invention provides an obstacle detection means for detecting an obstacle present around the mobile terminal device and an operator of the mobile terminal device. An obstacle notifying means for notifying the presence of the obstacle, wherein the obstacle notifying means notifies the presence of an obstacle when the obstacle detecting means detects the obstacle.

  According to the above configuration, the obstacle detection unit that detects obstacles around the portable terminal device, and the obstacle that notifies the operator of the portable terminal device of the obstacle to the portable terminal device. Since the notification means is provided, both the detection of the presence of the obstacle and the notification to the operator of the portable terminal device can be performed by the portable terminal device alone.

  Thereby, it is possible to reliably notify the operator of the mobile terminal device of the presence of an obstacle and to greatly reduce the possibility of a collision with the obstacle.

  For example, an operator walking while using a mobile terminal device may collide with an obstacle such as a person in front or a building, but as described above, the presence of the obstacle is notified by the obstacle notification means. By doing so, it becomes possible to avoid a collision with an obstacle.

  A distance sensor for measuring a distance from the portable terminal device to the obstacle, wherein the obstacle detection means has a predetermined distance from the portable terminal device to the obstacle calculated from a detection value by the distance sensor; When an obstacle is present, it may be detected that an obstacle is present.

  In this case, the predetermined value serving as a threshold for detecting the presence of the obstacle is, for example, a distance necessary for the operator operating the mobile terminal device to recognize and avoid the obstacle while walking. Is preferred.

  Therefore, by setting the distance from the portable terminal device to the obstacle to the predetermined value, it is possible to take a sufficient time from the detection of the obstacle until the collision with the obstacle is avoided. Therefore, the possibility of colliding with an obstacle can be reduced.

  In addition, an application function such as e-mail and the Internet is provided, and the obstacle detection unit activates the distance sensor when the application function is executed, and from the mobile terminal device calculated from the detection value by the distance sensor. When the distance to the obstacle becomes a predetermined value, the presence of the obstacle may be detected.

  In this case, the distance sensor is activated in conjunction with the execution of the application function, and the obstacle detection operation is executed. Therefore, the operator moves to the obstacle detection mode without being aware of it. To come.

  Further, the display unit displays an application function execution screen such as an email or the Internet, and the obstacle notification unit displays information for notifying the presence of an obstacle on the display unit during execution of the application function. You may make it make it.

  In this case, since it is possible to visually notify the presence of an obstacle to an operator who is executing the application function, the presence of the obstacle can be recognized. Thereby, possibility that an operator and an obstacle will collide can be reduced.

  Further, the display means can display at least two screens, and the obstacle notification means has an obstacle on a display screen different from a screen executing the application function among the display screens of the display means. You may make it display the information for alert | reporting.

  As described above, by separately displaying the application function execution screen and the obstacle notification screen on the screen divided into two, it is possible to reduce the difficulty of viewing the notification information of the obstacle due to the mutual overlap of the screens. It becomes possible. Thereby, it becomes possible to notify the operator of the presence of an obstacle more reliably.

  In addition, the image processing apparatus includes an imaging unit that images the front as viewed from the mobile terminal device, and a display unit that displays an application function execution screen such as an email or the Internet. The image being picked up by the image pickup means may be displayed on the display means.

  In this case, since the image being picked up by the image pickup means is displayed on the display means during execution of the application function, the operator can grasp the forward situation while viewing the execution screen of the application function. Thereby, since the obstacle which exists ahead can be discovered quickly, possibility that an operator and an obstacle will collide can be reduced.

  The display unit may be divided into a screen for displaying the execution screen for the application function and a screen for displaying an image being captured by the imaging unit.

  As a result, the application function execution screen and the image being picked up by the image pickup means are separated, so that the recognition accuracy of the presence of an obstacle can be increased from the image being picked up by the image pickup means. The possibility of collision with an obstacle can be further reduced.

  Further, the obstacle notification unit may control the display unit so as to start displaying a captured image by the imaging unit in conjunction with execution of the application function.

  In this case, since the captured image of the imaging unit is displayed in conjunction with the execution of the application function, it is not necessary for the operator to activate the imaging unit and perform an operation for imaging. That is, it is possible to improve the operability of the device necessary for executing the obstacle detection / notification function in the portable terminal device having the obstacle detection and notification functions.

  In addition, a distance sensor that measures the distance from the mobile terminal device to the obstacle is provided, and the obstacle notification unit is configured according to the distance from the mobile terminal device to the obstacle calculated from the detection value by the distance sensor. You may make it change the display state of the image currently imaged by the imaging means currently displayed on the display means.

  In this case, since the display state of the image being picked up by the image pickup means changes according to the distance from the portable terminal device to the obstacle, it is possible to make the operator more easily recognize the presence of the obstacle. It becomes possible.

  For example, the obstacle notifying means steps the image being photographed by the imaging means displayed on the display means as the distance from the portable terminal device to the obstacle calculated from the detection value by the distance sensor becomes shorter. Should be made larger.

  The mobile terminal device further comprises a location information detection means for detecting a current location of the mobile terminal device, wherein the obstacle detection means has a movement amount of the mobile terminal device calculated from the location information detected by the location information detection means greater than or equal to a predetermined value. At some point, the obstacle detection operation may be started.

  The predetermined value here needs to detect whether or not the operator who operates the mobile terminal device is actually moving, so it may be set to 1 m, for example. That is, the obstacle detection means determines (detects) that the operator of the mobile terminal device is moving if the calculated movement amount exceeds 1 m.

  In this case, the obstacle detection operation by the obstacle detection means is started by the movement of the operator of the mobile terminal device, so there is no obstacle even if the operation for obstacle detection is not executed. Will be detected and notified.

  Furthermore, a distance sensor for measuring the distance from the mobile terminal device to the obstacle is provided, and the obstacle detection means is configured to detect when the distance from the mobile terminal device to the obstacle calculated by the distance sensor becomes a predetermined value. The presence of an obstacle may be detected.

  In this case, since the presence of an obstacle is detected when the distance from the portable terminal device calculated by the distance sensor to the obstacle reaches a predetermined value, the portable terminal device is carried. The operator who is doing so can quickly recognize the presence of the obstacle, and as a result, it is possible to avoid collision with the obstacle.

  The collision prevention method of the present invention is a collision prevention method for preventing a collision between an operator of a portable terminal device and an obstacle, the step of detecting the presence or absence of an obstacle around the portable terminal device, and the obstacle is detected. And a step of notifying the operator of the portable terminal device of the presence of an obstacle.

  Thereby, it is possible to reliably notify the operator of the mobile terminal device of the presence of an obstacle and to greatly reduce the possibility of a collision with the obstacle.

  Specific collision prevention methods include the following methods.

  The collision prevention method of the present invention is a collision prevention method for preventing a collision between an operator of a mobile terminal device having an imaging function for imaging the front and application functions such as e-mail and the Internet, and an obstacle. And the step of executing the imaging function in conjunction with the execution of the application function.

  In this case, during execution of the application function, an obstacle existing ahead can be quickly found from the image being picked up by the image pickup means, so that the possibility that the operator and the obstacle collide can be reduced. .

  In addition, another collision prevention method of the present invention includes a distance sensor that measures a distance from a mobile terminal device to an obstacle, and an operator of the mobile terminal device that has an application function such as e-mail and the Internet, and an obstacle. In the collision prevention method for preventing a collision, a step of executing the application function, a step of starting the distance sensor in conjunction with the execution of the application function, and a mobile terminal device calculated from a detection value by the distance sensor And a step of notifying the operator of the presence of the obstacle when the distance from the obstacle to the obstacle reaches a predetermined value.

  In this case, since the obstacle existing ahead can be quickly found by the distance sensor during the execution of the application function, the possibility that the operator and the obstacle collide can be reduced.

  Furthermore, the collision prevention method of the present invention includes a distance sensor that measures the distance from the portable terminal device to an obstacle, and a portable terminal device operator and an obstacle having a position detection function that detects the position of the portable terminal device. In the collision prevention method for preventing the collision of the mobile terminal device, the step of detecting the position of the mobile terminal device by the position detection function, and the amount of movement of the mobile terminal device calculated from the detected position information is greater than or equal to a predetermined value Activating the distance sensor, and notifying the operator of the presence of the obstacle when the distance to the obstacle calculated from the detection value by the distance sensor reaches a predetermined value. It is said.

  In this case, the obstacle detection operation by the obstacle detection means is started by the movement of the operator of the mobile terminal device, so there is no obstacle even if the operation for obstacle detection is not executed. Is detected and notified, and as a result, it is possible to avoid a collision with an obstacle.

  The above-described collision prevention method can be replaced with a computer-executable program.

  That is, the collision prevention program of the present invention provides a computer with a procedure for detecting the presence or absence of an obstacle around the portable terminal device, and when the obstacle is detected, the operator of the portable terminal device is obstructed. Is a collision prevention program that executes a procedure for informing the presence of the.

  And you may record said collision prevention program on a computer-readable recording medium.

  In this case, the above-described collision prevention method can be realized by a general-purpose computer.

  As described above, the portable terminal device according to the present invention notifies the obstacle detection means for detecting obstacles around the portable terminal device and the operator of the portable terminal device of the presence of the obstacle. Obstacle notification means, and the obstacle notification means notifies the presence of the obstacle when the obstacle detection means detects the obstacle, so that the mobile terminal device alone can detect the obstacle. It is possible to reliably detect the presence of an obstacle to the detection and the operator of the portable terminal device, and as a result, it is possible to greatly reduce the possibility of a collision with the obstacle. .

  An embodiment of the present invention will be described as follows. In the present embodiment, a mobile phone will be described as an example of the mobile terminal device.

  FIG. 2 is a block diagram showing a schematic configuration of the mobile phone according to the present embodiment.

  As shown in FIG. 2, the mobile phone according to the present embodiment is centered on the main control unit 1, the distance sensor 2, the shutter button 3, the camera unit 4, the image processing unit 5, the first memory 6, and the display unit 7. , Display control unit 8, backlight 9, TV tuner 10, TV antenna 11, GPS (Global Positioning System) control unit 12, GPS antenna 13, radio control unit 14, radio communication antenna 15, operation button unit 16, second memory 17, a light emitting diode (LED) 18, a microphone 19, and a speaker 20.

  Furthermore, the mobile phone is provided with a collision preventing unit 100 for realizing a collision preventing function for preventing a collision with an obstacle (a person, a wall, etc.) inside the main control unit 1. Details of the collision prevention unit 100 will be described later.

  Here, each component of the mobile phone will be described.

  The distance sensor 2 is a sensor for measuring the distance from the mobile phone to a person or wall that becomes an obstacle. The distance sensor 2 can use various types of sensors such as an infrared system, an ultrasonic system, and a laser system. In other words, the distance sensor 2 includes a transmitter and a receiver. If the infrared sensor is used, the infrared light transmitted from the transmitter toward the object whose distance is to be measured is reflected from the object and received by the receiver. The distance to the object is measured by measuring the time until it is done. This measurement principle is the same for ultrasonic (several tens of kHz to several MHz) systems and laser systems other than the infrared system described above.

  The detection result obtained by the distance sensor 2 is sent to the collision prevention unit 100 of the main control unit 1 and used for the collision prevention process. The details of the position where the distance sensor 2 is attached to the mobile phone will be described later.

  The shutter button 3 is a button operated by the user of the mobile phone when the subject is imaged using the camera unit 4.

  The camera unit 4 is an image pickup unit including an image pickup device such as a CCD (Charge Coupled Device), and picks up a subject based on an instruction from the main control unit 1. An imaging signal obtained by imaging by the camera unit 4 is sent to the image processing unit 5 at the subsequent stage.

  The image processing unit 5 performs processing for converting the sent imaging signal into a format that can be displayed on the display unit 7 in the subsequent stage. Note that the information processed by the image processing unit 5 is temporarily stored in the first memory 6 before being sent to the display unit 7, and is read out as required by an instruction from the main control unit 1.

  The display unit 7 includes a liquid crystal display (LCD), for example, and displays execution screens of various application functions provided in the mobile phone. The display unit 7 also displays the subject imaged by the camera unit 4 as described above.

  Display control of the display unit 7 is performed by the display control unit 8. The display control unit 8 performs display control of the display unit 7 based on a control signal from the main control unit 1.

  The display control unit 8 controls the display form on the display unit 7. Specific display control includes, for example, displaying an image captured by the camera unit 4 on the main screen executing the application function. Details of this display mode will be described later.

  The backlight 9 is a light that emits light from the back surface of the display screen in the liquid crystal display device of the display unit 7. The backlight 9 is controlled to be turned on / off based on a control signal from the main control unit 1.

  The TV tuner 10 and the TV antenna 11 are components for realizing a TV image receiving function in the mobile phone.

  The GPS control unit 12 and the GPS antenna 13 are components for realizing a position detection function for detecting the current position in the mobile phone. A signal received by the GPS control unit 12 is sent to the main control unit 1 and used for a collision prevention process in a collision prevention unit 100 described later. Details of this will be described later.

  The wireless control unit 14 and the wireless communication antenna 15 are components for performing wireless communication with the base station, that is, components for realizing communication functions such as telephone, e-mail, and Internet in the mobile phone.

  The TV antenna 11 and the GPS antenna 13 may be shared with the wireless communication antenna 15 or may be separate.

  The operation button unit 16 is a button for operating various functions of the mobile phone. A signal of pressing this button is sent to the main control unit 1.

  Unlike the first memory 6, the second memory 17 is a memory that mainly stores programs and data necessary for executing application functions. Programs and data stored in the second memory 17 are read by the main control unit 1 as necessary.

  The LED 18 is used as a means for visually notifying the user of the mobile phone of an incoming call. For example, in the case of an incoming call, the LED 18 is blinked. Moreover, you may make it blink LED18 in order to alert | report a user that there exists a possibility of a collision with an obstruction.

  The microphone 19 is used as a microphone during transmission when a telephone function is executed in the mobile phone.

  Further, the speaker 20 is used as a speaker at the time of reception when the telephone function is executed in the same manner as the microphone 19. The speaker 20 is also configured to emit a warning sound to notify the user that there is a risk of collision with an obstacle.

  Next, the appearance of the mobile phone having the above configuration will be described below. 3A and 3B show the appearance of the mobile phone according to the present embodiment, and FIG. 3C shows the display unit of the mobile phone. In the following description, a user (operator) of a mobile phone is referred to as a user.

  The mobile phone is a so-called clamshell type, and FIGS. 3A and 3B show an open state. FIG. 4A shows a portion that becomes an outer side when the mobile phone is closed, and shows a back side that is mainly used by a user when the mobile phone is opened. On the other hand, FIG. 5B shows a surface that is mainly used by the user when the mobile phone is opened. Therefore, in the present application, the side shown in FIG.

  As shown in FIGS. 3A and 3B, the mobile phone includes a main body 52 and a lid 51, and the main body 52 and the lid 51 are connected in a hinge shape. The lid 51 is provided with a display unit 7 for displaying a main screen on the front side, and a camera unit 4 for imaging the front side with the lid 51 opened on the back side. A wireless communication antenna 15 is provided on the back side of the main body 52.

  The main body 52 is provided with a shutter button 3 for operating the camera unit 4 on the front side and an operation button unit 16 for operating when executing various application functions.

  Further, as shown in FIG. 3C, the display unit 7 provided on the entire surface of the lid 51 is configured to display a main screen (main display screen) 7a and a sub screen (sub display screen) 7b. Has been.

  The parent screen 7a is mainly an execution screen for applications such as electronic mail and the Internet, and the child screen 7b is mainly an image screen captured by the camera unit 4. Note that the display contents of the parent screen 7a and the child screen 7b may be reversed. Further, only the parent screen 7a may be displayed, or the child screen 7b may be displayed in two panes so as not to overlap the parent screen 7a. Details of display examples of the parent screen 7a and the child screen 7b will be described later.

  Further, as shown in FIGS. 3A and 3B, the cellular phone having the above configuration is provided with the distance sensor 2 in the hinge portion which is a connecting portion between the lid 51 and the main body 52. Strictly speaking, the distance sensor 2 is provided in a sensor unit 200 attached to a concave attachment portion 52a on the upper side of the main body 52 as shown in FIG.

  The sensor unit 200 includes a distance sensor 2, a weight 201 provided below the distance sensor 2, and a shaft 202 that is rotatably attached to the attachment portion 52a. The shaft 202 can pass a wiring cable (not shown) between itself and the main body 52.

  The weight 201 is provided in a direction orthogonal to the measurement direction of the distance sensor 2.

  When such a sensor unit 200 is attached to the main body 52, as shown in FIG. 5, even if the lid 51 of the cellular phone is tilted in an open state, the distance sensor 2 is centered on the shaft 202 by the effect of the weight 201. It always faces the horizontal direction. Thereby, the distance sensor 2 can always continue to capture the front.

  Note that, as shown in FIG. 3A, the camera unit 4 is activated with the lid 51 open, so that the weight (not shown) is attached to the lower part of the camera unit 4 in the same manner as the distance sensor 2. ) And is rotatably supported with respect to the lid 51. However, the rotation of the camera unit 4 can be stopped if necessary.

  As described above, it is desirable that the camera unit 4 is always kept horizontal due to the effect of the weight when working as a collision prevention function, and is fixed so as not to rotate when used as a normal camera. Therefore, as shown in FIGS. 3A and 3B, the distance sensor 2 and the camera unit 4 are provided separately, and the camera unit 4 is a stopper (not shown) on which the camera unit 4 is rotated and fixed according to the application. May be provided.

  Next, an example of two-screen display on the display unit 7 will be described.

  FIG. 6 is an example of a small screen display by picture-in-picture. The picture-in-picture is a sub-screen (sub-display screen that displays the situation in front of the camera) in the display area of the main screen 7a (main screen (main display screen) that displays the contents of the application) in the display unit 7. )) Is displayed. Thereby, the child screen 7b can be displayed without changing the size of the parent screen 7a.

  FIG. 7 shows an example of sub-screen display by two-screen display. The two-screen display is a method of displaying so that the display area of the main screen 7a and the display area of the child screen 7b in the display unit 7 do not overlap. As a result, the size of the parent screen 7a is reduced, but the entire area of the parent screen 7a can be seen.

  FIG. 8 is an example of a small screen display by two display devices. In this display method, a display device (for example, a liquid crystal display (LCD) or the like) that displays the parent screen 7a in the display unit 7 and a display device that displays the child screen 7b are provided separately. As a result, the entire area can be viewed on both the parent screen 7a and the child screen 7b without changing the size of the parent screen 7a.

  FIG. 9 is an example of a small screen display by superimposition. Superimpose is a method of displaying another screen (picture or character) superimposed on a certain screen (background). Here, the main screen 7a is superimposed based on the child screen 7b in the display unit 7. An example is shown. Thereby, the variation of the viewpoint position is reduced, and the information of the sub-screen area can be obtained sufficiently as in the case of the parent screen.

  FIG. 10 is an example of a sub-screen blinking display. The sub-screen blinking display is to display or turn off the display of the sub-screen 7b on the display unit 7 at regular time intervals. As a result, the user's attention can be more reliably directed to the child screen 7b. Details of the sub-screen blinking display process will be described later.

  In this sub-screen blinking display, the main screen 7a and the sub-screen 7b may have a picture-in-picture relationship as shown in FIG. 6 or a two-screen display relationship as shown in FIG. Alternatively, a relationship including two display devices as shown in FIG. 8 may be used.

  As described above, the execution screen of the application provided in the mobile phone is displayed on the main screen 7a of the display unit 7, and the image captured by the camera unit 4 is displayed on the sub-screen 7b. Notification information for notifying the presence of an obstacle such as a person or a wall is displayed.

  Accordingly, when the user walks while executing the application of the mobile phone, an image in front of the user is displayed on the sub-screen 7b of the display unit 7, so that there is an obstacle such as a person or a wall for the user. Can be notified. In addition, in order to notify the user of the presence of an obstacle, a warning sound by the speaker 20 or a blinking display by the LED 18 may be used in addition to the image display.

  As a configuration for notifying the user of the presence of an obstacle as described above and avoiding a collision with the obstacle, in the present invention, the above-described collision prevention unit 100 provided in the main control unit 1 is provided. is there. The collision prevention unit 100 controls the display method of the main screen 7a and the sub screen 7b of the display unit 7. Details of the collision prevention unit 100 will be described below.

  As shown in FIG. 1, the collision prevention unit 100 includes an obstacle detection unit 103, an obstacle notification unit 104, a position information detection unit 105, an application execution unit 106, and a ROM 107 connected to a bus 102 connected to the CPU 101. The RAM 108 is provided.

  The obstacle detection means 103 is a means for detecting an obstacle present around the mobile phone main body (hereinafter referred to as the apparatus main body). A signal from the distance sensor 2 is input to the obstacle detection means 103. The obstacle detection unit 103 calculates the distance between the apparatus main body and the obstacle based on the detection signal from the distance sensor 2, for example, and detects the presence of the obstacle when the calculated distance is a predetermined value. A signal indicating this is output to the obstacle notification means 104.

  The obstacle notifying means 104 is means for notifying the user of the mobile phone of the presence of an obstacle (such as a person or a building wall). Based on the detection signal from the obstacle detection unit 103, the obstacle notification unit 104 notifies the user of the presence of the obstacle by at least one of the display unit 7, the LED 18, and the speaker 20, for example. It has become.

  That is, in order to notify the user of the presence of an obstacle, a vibration function used in the manner mode of the mobile phone, a ring tone or a light emitting function for notifying an incoming call of the mobile phone, or a combination thereof may be used. . What is necessary is just to change the magnitude | size of a vibration according to the proximity degree of an obstruction, or to make the volume of a ringtone gradually increase.

  The notification by the display unit 7 is executed by displaying information to be notified on the child screen 7b in the display screen. Here, the information to be notified is text information (distance information to the obstacle, etc.), image information (image being captured by the camera unit 4 provided in the mobile phone), image information (mark that appeals visually) Etc.). At this time, by changing the display state according to the distance to the obstacle, the presence of the obstacle can be more easily recognized by the user. For example, what is necessary is just to enlarge the magnitude | size of the small screen 7b which displays alerting | reporting information as the distance with an obstruction approaches.

  The notification by the LED 18 is executed by blinking the presence of an obstacle. Even in this case, the presence of the obstacle can be more easily recognized by the user by changing the blinking state of the LED 18 according to the distance of the obstacle. For example, the blinking speed may be increased as the distance from the obstacle approaches.

  Further, the notification by the speaker 20 is executed by the generation of an alarm sound for the presence of an obstacle. Even in this case, by changing the alarm sound generated from the speaker 20 according to the distance of the obstacle, the presence of the obstacle can be more easily recognized by the user. For example, the alarm sound may be increased as the distance from the obstacle approaches.

  The position information detecting means 105 is means for receiving the position information from the GPS control unit 12 and detecting the current position of the mobile phone. Using this, it is possible to detect the movement of the mobile phone. That is, the obstacle detection means 103 described above indicates the position information of the mobile phone obtained from the position information detection means 105 (the position of the mobile phone at a certain time and the position of the mobile phone after a predetermined time has passed). The amount of movement of the mobile phone is calculated based on the information. If the calculated movement amount exceeds a predetermined value, it is detected that the mobile phone is moving. The predetermined value here needs to detect whether or not the user of the mobile phone is actually moving, so it can be set to 1 m, for example. That is, the obstacle detection unit 103 determines (detects) that the user of the mobile phone is moving if the calculated movement amount exceeds 1 m.

  Thus, it is considered that the movement of the mobile phone is also moving the user of the mobile phone. By using this, when the user is moving, the obstacle detection unit 103 and the obstacle notification unit 104 are operated, so that the user can be notified of the presence of the obstacle. Yes. In this case, the presence of an obstacle is notified by an alarm sound of the speaker 20.

  The application execution means 106 is means for executing various applications provided in a mobile phone such as an electronic mail or the Internet based on an operation signal from the operation button unit 16 or the like.

  Here, when the application is executed by the application execution unit 106, the CPU 101 performs a collision prevention mode in which the obstacle detection unit 103, the obstacle notification unit 104, and the position information detection unit 105 perform obstacle detection and notification. Each means is controlled to execute.

  The ROM 107 is a storage unit that stores a program executed by each unit, and the RAM 108 is a storage unit that serves as a work area for processing the program.

  In order to realize the collision prevention mode, it is necessary to have the following configuration.

  That is, in the mobile phone having the above configuration, as shown in FIG. 1, the obstacle detection means 103 for detecting an obstacle around the mobile phone and the presence of the obstacle are notified to the user of the mobile phone. The obstacle notification means 104 is configured to notify the presence of an obstacle when the obstacle detection means 103 detects an obstacle.

  According to this configuration, the obstacle detecting means 103 for detecting an obstacle existing around the mobile phone and the obstacle detecting means for notifying the user of the mobile phone of the presence of the obstacle. 103 is provided, it is possible to perform both the detection of the presence of the obstacle and the notification to the user of the mobile phone with the mobile phone alone.

  Thereby, the presence of an obstacle can be reliably notified to the user of the mobile phone, and the possibility of collision with the obstacle can be greatly reduced.

  For example, a user who is walking while using a mobile phone may collide with an obstacle such as a person in front of the building or a building. As described above, the obstacle notification unit 104 notifies the presence of the obstacle. By doing so, it becomes possible to avoid a collision with an obstacle.

  In addition, a distance sensor 2 for measuring the distance from the mobile phone to the obstacle is provided, and the obstacle detection unit 104 sets the distance from the mobile phone to the obstacle calculated from the detection value by the distance sensor 2 to a predetermined value. When it becomes, it may be detected that an obstacle exists.

  In this case, the predetermined value serving as a threshold for detecting the presence of an obstacle is, for example, a distance necessary for the operator operating the mobile phone to recognize and avoid the obstacle while walking. preferable.

  Therefore, by setting the distance from the mobile phone to the obstacle to the predetermined value, it is possible to take a sufficient time from the detection of the obstacle until the collision with the obstacle is avoided. Therefore, the possibility of colliding with an obstacle can be reduced.

  In addition, an application function (application execution means 106) such as e-mail and the Internet is provided, and the obstacle detection means 104 activates the distance sensor 2 when the application function is executed, and the distance sensor 2 detects it. The presence of an obstacle may be detected when the distance from the mobile phone to the obstacle calculated from the value reaches a predetermined value.

  In this case, the distance sensor 2 is activated in conjunction with the execution of the application function, and the obstacle detection operation is executed. Therefore, even if the user is not conscious, the presence of the obstacle is detected and notified. The collision prevention mode is executed.

  Further, the display unit 7 displays an application function execution screen for e-mail, the Internet, etc., and the obstacle notification unit 104 displays information for notifying the presence of an obstacle during the execution of the application function. 7 may be displayed.

  In this case, since it is possible to visually notify the user who is executing the application function of the presence of the obstacle, the presence of the obstacle can be recognized. Thereby, possibility that a user and an obstacle will collide can be reduced.

  Further, as shown in FIG. 3C, the display unit 7 can display at least two screens, and the obstacle notification unit 104 executes an application function in the display screen of the display unit 7. You may make it display the information for alert | reporting presence of an obstruction on the display screen different from the screen which is.

  As described above, by separately displaying the application function execution screen and the obstacle notification screen on the screen divided into two, it is possible to reduce the difficulty of viewing the notification information of the obstacle due to the mutual overlap of the screens. It becomes possible. Thereby, it becomes possible to notify the user of the presence of an obstacle more reliably.

  In addition, the camera unit 4 as an imaging unit that images the front as viewed from the mobile phone, and a display unit 7 that displays an application function execution screen such as e-mail or the Internet, the obstacle notification unit 104 includes the application unit During the execution of the function, an image being captured by the camera unit 4 may be displayed on the display unit 7.

  In this case, the image being captured by the camera unit 4 is displayed on the display unit 7 during execution of the application function, so that the user can grasp the forward situation while viewing the execution screen of the application function. Thereby, since the obstacle which exists ahead can be discovered quickly, possibility that a user and an obstacle will collide can be reduced.

  The display unit 7 may be divided into a main screen 7a for displaying the execution screen for the application function and a sub-screen 7b for displaying an image being captured by the imaging means. This display example is shown in FIGS. 7 and 8, for example.

  As a result, the execution screen of the application function and the screen being imaged by the camera unit 4 are separated, so that the recognition accuracy of the presence of an obstacle can be improved from the screen being imaged by the camera unit 4. It is possible to further reduce the possibility that the obstacle collides with the obstacle.

  Further, the obstacle notification unit 104 may control the display unit 7 so as to start displaying the captured image by the camera unit 4 in conjunction with the execution of the application function.

  In this case, since the captured image of the camera unit 4 is displayed in conjunction with the execution of the application function, there is no need for the user to activate the camera unit 4 and perform an operation for imaging. That is, it is possible to improve the operability of the device necessary for executing the obstacle detection / notification function in the mobile phone having the obstacle detection and notification functions.

  In addition, a distance sensor 2 that measures the distance from the mobile phone to the obstacle is provided, and the obstacle notification unit 104 is configured according to the distance from the mobile phone to the obstacle calculated from the detection value by the distance sensor 2. You may make it change the display state of the image currently imaged with the camera part 4 currently displayed on the said display part 7. FIG.

  In this case, since the display state of the image being captured by the camera unit 4 changes according to the distance from the mobile phone to the obstacle, it is possible to make it easier for the user to recognize the presence of the obstacle. It becomes.

  For example, the obstacle notifying unit 104 is photographing with the camera unit 4 displayed on the display unit 7 as the distance from the mobile phone to the obstacle calculated from the detection value by the distance sensor 2 becomes shorter. What is necessary is just to enlarge an image in steps.

  Further, the mobile phone includes position information detection means 105 for detecting the current position of the mobile phone, and the obstacle detection means 103 has a mobile phone movement amount calculated from the position information detected by the position information detection means 105 greater than or equal to a predetermined value. At this time, the obstacle detection operation may be started.

  In this case, when the user of the mobile phone moves, the obstacle detection operation by the obstacle detection unit 103 is started. Therefore, the obstacle can be detected without performing the operation for obstacle detection. It will be detected and notified.

  Furthermore, a distance sensor 2 for measuring the distance from the mobile phone to the obstacle is provided, and the obstacle detection unit 103 is configured to detect when the distance from the mobile phone to the obstacle calculated by the distance sensor 2 reaches a predetermined value. In addition, the presence of an obstacle may be detected.

  In this case, since the presence of an obstacle is detected when the distance from the mobile phone to the obstacle calculated by the distance sensor 2 reaches a predetermined value, the mobile phone is carried. Can quickly recognize the presence of an obstacle and, as a result, can avoid a collision with the obstacle.

  Hereinafter, a specific flow of the collision prevention process will be described.

  First, the flow of the obstacle notification process using the camera unit 4 in the mobile phone having the above configuration will be described with reference to the flowchart shown in FIG.

  First, it is determined whether or not an e-mail or the like is being operated on a mobile phone in a standby state (step S1). That is, it is determined whether or not an application function such as mail is executed by the user. If it is determined that mail or the like is being operated, the camera unit 4 is activated (step S2).

  Then, it is determined again whether mail or the like is in operation (step S3). If it is determined that mail or the like is being operated, the camera image is displayed on the sub-screen 7b of the display unit 7 (step S4). That is, while the user uses the mail function, the camera unit 4 continues to operate, and displays an image captured by the camera unit 4 on the child screen 7b.

  If it is determined in step S3 that mail or the like is not being operated, the camera unit 4 is stopped (step S5). That is, when the mail function by the user is ended, the end of the mail function is detected and the operation of the camera unit 4 is stopped.

  The above processing is performed while the mobile phone is in a standby state. As described above, the method for displaying the image being captured by the camera unit 4 on the sub-screen 7b of the display unit 7 may be any of the methods shown in FIGS.

  According to the above processing, when the application such as the mail function is activated, the mobile phone provided with the camera unit 4 (mobile phone with camera) automatically activates the camera function, and the camera unit 4 is displayed on the sub-screen 7b of the display unit 7. The front image captured in is displayed.

  Thereby, when the user is executing the application function while walking, it is possible to recognize the presence of the obstacle, and thus it is possible to prevent the user from colliding with the obstacle.

  Next, the flow of the obstacle notification process using the distance sensor 2 will be described below with reference to the flowchart shown in FIG.

  First, it is determined whether or not an e-mail or the like is being operated on a mobile phone in a standby state (step S11). That is, it is determined whether or not an application function such as mail is executed by the user. Here, when it is determined that mail or the like is being operated, the distance sensor 2 is activated (step S12).

  Next, it is determined again whether mail or the like is being operated (step S13). If it is determined that mail or the like is being operated, it is determined whether an obstacle is approaching (step S14). ). Here, since the distance sensor 2 continues to operate while the user uses the mail function, the approach of the obstacle always monitors the distance to the obstacle obtained by the distance sensor 2 and reaches a predetermined distance. Judgment is made based on whether or not an obstacle is approaching.

  If it is determined that the obstacle is approaching, the obstacle approach is notified (step S15), and the process proceeds to step S13 where it is determined whether or not an operation such as mail is being performed again. As a method for notifying the obstacle approach in step S15, an alarm sound is generated from the speaker 20, the LED 18 is blinked, or the display screen of the display unit 7 is visually informed of the distance to the obstacle as will be described later. Or any of these notification methods, or a combination of these notification methods.

  On the other hand, if it is determined in step S13 that mail or the like is not being operated, the distance sensor 2 is stopped (step S16), and the process proceeds to step S11 for determining again whether or not mail is being operated.

  The above processing is performed while the mobile phone is in a standby state.

  According to the above processing, when the application such as the mail function is activated, the mobile phone automatically activates the distance sensor 2, monitors the distance to the obstacle, and detects that the obstacle is approaching the user. To inform you.

  Thereby, when the user is executing the application function while walking, it is possible to recognize the presence of the obstacle, and thus it is possible to prevent the user from colliding with the obstacle.

  The case where the collision prevention process using the camera unit 4 and the collision prevention process using the distance sensor 2 are separately executed has been described above. However, the collision prevention process using both the camera unit 4 and the distance sensor 2 is described. May be performed.

  Therefore, the flow of collision prevention processing using both the camera unit 4 and the distance sensor 2 will be described below with reference to the flowchart shown in FIG.

  First, it is determined whether or not an e-mail or the like is being operated on a mobile phone in a standby state (step S21). That is, it is determined whether or not an application function such as mail is executed by the user. If it is determined that mail or the like is in operation, the camera unit 4 and the distance sensor 2 are activated (step S22).

  Next, it is determined again whether or not mail or the like is operating (step S23). If it is determined that mail or the like is operating, it is determined whether or not an obstacle is approaching (step S24). ). Here, while the user uses the mail function, the camera unit 4 and the distance sensor 2 continue to operate. Therefore, the distance to the obstacle obtained by the distance sensor 2 is constantly monitored, and the obstacle is detected up to a predetermined distance. The approach of the obstacle is determined based on whether or not the object has approached, and an image being captured by the camera unit 4 is displayed on the sub-screen 7 b of the display unit 7.

  If it is determined that the obstacle is approaching, the child screen 7b of the display unit 7 is enlarged in order to notify the obstacle approach (step S25), and it is determined whether or not the mail is being operated again. The process proceeds to step S23 for determination.

  On the other hand, if it is determined in step S24 that the obstacle is not approaching, the child screen 7b of the display unit 7 is reduced (step S26), and it is determined again in step S23 whether or not mail or the like is being operated. Transition.

  If the camera unit 4 and the distance sensor 2 are activated and it is determined in step S23 that mail or the like is not being operated, the camera unit 4 and the distance sensor 2 are stopped (step S27). The process proceeds to step S21 where it is determined whether or not it is operating.

  According to the above processing, when a mobile phone equipped with the camera unit 4 and the distance sensor 2 executes an application function such as an e-mail, the camera unit 4 and the distance sensor 2 are automatically activated to reach the obstacle. The front image captured by the camera unit 4 is displayed on the sub-screen 7b of the display unit 7 while monitoring the distance, and the user is notified when the obstacle is detected.

  Thereby, when the user is executing the application function while walking, it is possible to recognize the presence of the obstacle, and thus it is possible to prevent the user from colliding with the obstacle.

  The example in which the timing of starting the distance sensor 2 has been described when the application function is started is not limited to this example. For example, the position detection unit using GPS is used to , That is, the movement of the user may be detected, and the distance sensor 2 may be activated at this detection timing.

  Next, the flow of collision prevention processing using the distance sensor 2 and the GPS control unit 12 will be described below with reference to the flowchart shown in FIG.

  First, it is determined whether or not the mobile phone in the standby state, that is, the mobile phone, that is, the user is moving (step S31). Here, the movement determination of the user is performed based on the position information acquired by the GPS control unit 12.

  If it is determined that the user is moving, the distance sensor 2 is activated (step S32).

  Next, it is determined again whether the user is moving (step S33). If it is determined that the user is moving, it is determined whether an obstacle is approaching (step S34). Here, since the distance sensor 2 continues to operate while the user uses the mail function, the approach of the obstacle always monitors the distance to the obstacle obtained by the distance sensor 2 and reaches a predetermined distance. Judgment is made based on whether or not an obstacle is approaching.

  If it is determined that the obstacle is approaching, the obstacle approach is notified (step S35), and the process proceeds to step S13 where it is determined again whether or not an operation such as mail is being performed. As a notification method of the obstacle approach in step S35, an alarm sound is generated from the speaker 20, the LED 18 is blinked, or the distance to the obstacle is visually notified on the display screen of the display unit 7 as will be described later. Or any of these notification methods, or a combination of these notification methods.

  On the other hand, if it is determined in step S34 that the obstacle is not approaching, the process proceeds to step S33 again to determine whether or not the user is moving.

  If it is determined in step S33 that the user is not moving, the distance sensor 2 is stopped (step S36), and the process proceeds to step S31 for determining again whether the user is moving.

  The above processing is performed while the mobile phone is in a standby state.

  According to the above processing, when the user moves, the mobile phone automatically activates the distance sensor 2, monitors the distance to the obstacle, and notifies the user when the obstacle is approached. It is supposed to be.

  Thereby, when the user is executing the application function while walking, it is possible to recognize the presence of the obstacle, and thus it is possible to prevent the user from colliding with the obstacle.

  As described above, the method of notifying the presence of an obstacle performed in the collision prevention process using the GPS control unit 12 is substantially the same as each of the processes described above, and thus the description thereof is omitted.

  However, in the present embodiment, when the mobile phone is in a standby state (for example, when the user is using a clamshell type mobile phone as shown in FIGS. Distance sensor even when the user is moving with the hand held in a closed state or when the mobile phone is in a pocket (ie, the user is not looking at the display screen of the display unit 7 of the mobile phone). As long as 2 is kept facing forward, the anti-collision function works. Therefore, the notification means is the above-described vibration function, ringtone, or the like, rather than the screen display by the display unit 7, or a combination thereof. Is preferred.

  Here, a specific processing flow of the example of the sub-screen blinking display shown in FIG. 10 will be described below with reference to the flowchart shown in FIG.

  First, the mobile phone is activated, and it is determined whether or not the anti-collision function is activated at any of the above timings (step S41).

  Next, if it is determined that the collision prevention function is operating, the display switching timer for the sub-screen 7b of the display unit 7 is started (step S42). Here, the display switching timer is realized by a timer in the main control unit 1 shown in FIG.

  Then, the display flag is initialized (step S43), and it is determined whether or not the collision prevention function is in operation (step S44). That is, it is monitored whether the collision prevention function is operating. The display flag here is a flag indicating either the camera mode or the non-camera mode. This camera mode is a mode in which an image captured by the camera unit 4 is displayed on the sub-screen 7 b of the display unit 7. On the other hand, the non-camera mode is a mode in which an image (for example, a black image) other than the image captured by the camera unit 4 is displayed on the child screen 7b of the display unit 7. That is, when the display flag is initialized, one of the above modes is set.

  If it is determined in step S44 that the collision prevention function is in operation, it is determined whether or not a timeout has occurred by the switching timer (step S45). In other words, as long as the collision prevention function continues, the timeout is checked by the switching timer. Here, when it is determined by the switching timer that timeout has occurred, the display flag is switched (step S46). Here, if the display flag indicating the camera mode is set by the initialization of the display flag in step S43, the display flag is switched to the display flag indicating the non-camera mode. Further, if the display flag is set to the display flag indicating the non-camera mode by the initialization of the display flag, the display flag is switched to the display flag indicating the camera mode.

  Then, it is determined whether or not the display flag is a display flag indicating the camera mode (step S47). If it is determined that the display flag is a display flag indicating the camera mode, an image (camera image) captured by the camera unit 4 is displayed on the sub-screen 7b of the display unit 7 (step S48).

  On the other hand, if it is determined in step S47 that the display flag is not a display flag indicating the camera mode, an all black image is displayed on the child screen 7b of the display unit 7 (step S49).

  If it is determined in step S44 described above that the collision prevention function is not in operation, the timer for switching the display of the child screen 7b of the display unit 7 is stopped (step S50), the process proceeds to step S41, and the collision prevention is performed again. Wait for the function to start.

  As realized by the above process, if the sub-screen is flashing as in the example of the sub-screen flashing display, the mobile phone user can use the flashing movement even while using application functions such as e-mail. The child screen can be captured in the peripheral vision more reliably. In the human visual system in which the movement is sensitively detected in the peripheral visual field and the details are grasped in the central visual field, the above-described blinking display of the small screen is particularly effective in preventing the collision.

  The various types of collision prevention processes described above can be replaced with computer-executable programs.

  That is, the collision prevention program according to the present invention provides a computer with a procedure for detecting the presence or absence of an obstacle around a mobile phone and, when an obstacle is detected, the presence of an obstacle to the user of the mobile phone. This is a collision prevention program for executing a notification procedure.

  And you may record said collision prevention program on a computer-readable recording medium.

  In this case, the above-described collision prevention method can be realized by a general-purpose computer.

  In the notification means for notifying the user of the approach of the obstacle while the application is running, the mobile phone displays information on the obstacle (for example, the distance to the obstacle or the risk of collision) on the screen of the display unit 7. Specific examples of this are shown in FIGS. Here, (a) in FIGS. 16 to 22 shows a display example when there is no obstacle within the predetermined range, and (b) shows a display example when the distance to the obstacle is 30 m. , (C) shows a display example when the distance to the obstacle is 10 m.

  FIG. 16A to FIG. 16C are display examples of distance information due to a change in character size. The character that displays the distance to the obstacle is enlarged according to the proximity degree of the obstacle, thereby alerting the user.

  FIG. 17A to FIG. 17C are display examples of distance information due to changes in the character display position. The position of the character that displays the distance to the obstacle is moved to the center of the screen according to the proximity of the obstacle, thereby alerting the user.

  FIG. 18A to FIG. 18C are display examples of distance information using a bar graph. The distance to the obstacle is represented by the length and color of the bar graph, and the bar graph is shortened according to the proximity degree of the obstacle, for example, by changing the color from “blue → yellow → red”, the user's Call attention.

  FIG. 19A to FIG. 19C are display examples of distance information by blinking characters. The character that displays the distance to the obstacle blinks if the distance to the obstacle is close to a predetermined distance, and the speed of the blinking is changed according to the degree of proximity of the obstacle. Arouse.

  FIG. 20A to FIG. 20C are display examples of distance information and collision risk using warning display marks. The distance to the obstacle is displayed in characters, a warning display mark is displayed if the distance to the obstacle is close to a predetermined distance, and the size and display position of the mark are changed according to the degree of proximity of the obstacle. This alerts the user.

  FIG. 21A to FIG. 21C are display examples of distance information and collision risk due to changes in the display area of the screen. The distance to the obstacle is displayed with characters, and the display area of the screen is reduced according to the degree of proximity of the obstacle, thereby alerting the user.

  FIG. 22A to FIG. 22C are display examples of distance information and collision risk by blinking the screen. By displaying the distance to the obstacle in text and blinking the entire screen if the distance to the obstacle is close to a predetermined distance, and changing the speed of the blink according to the proximity of the obstacle, the user Call attention.

  In FIG. 16 to FIG. 22, the distance to the obstacle is written in letters, and the collision risk of the obstacle is notified to the user. However, the present invention is not limited to this. The risk of collision may be indicated by a bar graph or by the size of characters and display area.

  FIG. 23A to FIG. 23C are examples of collision risk display using a bar graph. The risk of collision with an obstacle is indicated by the length and color of the bar graph, and the bar graph is lengthened according to the proximity of the obstacle, for example, by changing the color from blue to yellow to red. Call attention.

  FIG. 24A to FIG. 24C are examples of collision risk display using a risk meter. The risk of collision with an obstacle is indicated by the size of the meter (display area) that occupies the character and the screen. The danger display is changed according to the proximity of the obstacle, the meter is enlarged, and finally the meter A user's attention is drawn by making it spread over the whole screen.

  The mobile terminal device of the present invention may have the following configuration.

  That is, the camera image is displayed on the screen as a sub-screen while an application such as mail or the Internet is operating (otherwise, TV, game, memo pad, scheduler, video shooting, video playback).

in this case,
(A) Settings that do not display the sub-screen are possible (b) The position of the sub-screen can be changed (c) The size of the sub-screen can be changed (more easily enters the field of view)
(D) The child screen is displayed in two panes so as not to overlap the parent screen. (E) A display device can be arranged next to the main display device and displayed there.

  In addition, a distance sensor is installed in the mobile terminal, and the distance to obstacles ahead is measured while an application such as e-mail or the Internet is operating. When a distance is approached, an alarm is sounded to inform the user of the danger. You may be able to.

in this case,
(A) Flashing the screen and informing (Even in manner mode)
(B) The main body is vibrated to notify (c) The distance to the obstacle is displayed on the screen (d) The volume of the alarm sound can be changed (e) The volume of the alarm sound changes according to the distance to the obstacle (F) The intensity of vibration changes according to the distance to the obstacle (g) The display size can change according to the distance to the obstacle.

  In addition, a camera-equipped mobile device is equipped with a distance sensor, and while an application such as e-mail or the Internet is operating, the camera image is displayed as a sub-screen on the screen while measuring the distance to the obstacle in front. You may make it the magnitude | size of a subscreen change according to distance.

  In addition, a moving speed measuring means (position information detecting means) such as GPS is added to the portable terminal having the above-described configuration, and the same operation is performed while moving even if an application such as mail or the Internet is not operating. It may be.

  The present invention is not limited to the above-described embodiments, and various modifications can be made within the scope shown in the claims. That is, embodiments obtained by combining technical means appropriately modified within the scope of the claims are also included in the technical scope of the present invention.

  Note that each unit and each processing step of the portable terminal device according to the above embodiment is such that a calculation unit such as a CPU executes a program stored in a storage unit such as a ROM (Read Only Memory) or a RAM, and an input unit such as a keyboard. It can be realized by controlling output means such as a display or communication means such as an interface circuit. Therefore, the computer having these means can realize various functions and various processes of the portable terminal device of the present embodiment simply by reading the recording medium storing the program and executing the program. In addition, by recording the program on a removable recording medium, the various functions and various processes described above can be realized on an arbitrary computer.

  As this recording medium, a program medium such as a memory (not shown) such as a ROM may be used for processing by the microcomputer, or a program reader is provided as an external storage device (not shown). It may be a program medium that can be read by inserting a recording medium therein.

  In any case, the stored program is preferably configured to be accessed and executed by the microprocessor. Furthermore, it is preferable that the program is read out, and the read program is downloaded to a program storage area of the microcomputer and the program is executed. It is assumed that this download program is stored in advance in the main unit.

  The program medium is a recording medium configured to be separable from the main body, such as a tape system such as a magnetic tape or a cassette tape, a magnetic disk such as a flexible disk or a hard disk, or a disk such as a CD / MO / MD / DVD. Fixed disk, IC card (including memory card), etc., or semiconductor ROM such as mask ROM, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Read Only Memory), flash ROM, etc. In particular, there are recording media that carry programs.

  In addition, if the system configuration is capable of connecting to a communication network including the Internet, the recording medium is preferably a recording medium that fluidly carries the program so as to download the program from the communication network.

  Further, when the program is downloaded from the communication network as described above, it is preferable that the download program is stored in the main device in advance or installed from another recording medium.

  If it is possible to provide a camera function and a display unit for displaying the image and / or a distance sensor, various other portable terminal devices such as portable game machines, PDA (Personal Digital Assistants), The present invention can also be applied to the use of collision prevention for users (holders / users) such as portable terminals with TV functions, (digital) cameras, and (digital) video cameras.

It is a block diagram which shows the principal part structure of the mobile telephone concerning one embodiment of this invention. FIG. 2 is a schematic configuration block diagram showing the entire mobile phone shown in FIG. 1. It is a figure which shows an external appearance when the cover of the mobile phone shown in FIG. 2 is in an open state, (a) is a view seen from the back side, (b) is a view seen from the front side, (C) is a figure which shows the display state of a display part. It is a figure which shows the state which attaches a distance sensor unit to a main body. It is a figure which shows the direction which the distance sensor of the mobile telephone shown in FIG. 3 catches. It is a figure which shows the example of a display of the display part shown in FIG.3 (c). It is a figure which shows the other example of a display of the display part shown in FIG.3 (c). It is a figure which shows the other example of a display of the display part shown in FIG.3 (c). It is a figure which shows the other example of a display of the display part shown in FIG.3 (c). (A) (b) is a figure which shows the other example of a display of the display part shown in FIG.3 (c). It is a flowchart which shows an example of the flow of the collision prevention process in the mobile telephone shown in FIG. 6 is a flowchart showing another example of the flow of collision prevention processing in the mobile phone shown in FIG. 1. 6 is a flowchart showing still another example of the flow of collision prevention processing in the mobile phone shown in FIG. 1. 6 is a flowchart showing another example of the flow of collision prevention processing in the mobile phone shown in FIG. 1. 11 is a flowchart showing a flow of display processing of a display unit corresponding to the display example shown in FIG. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when an obstacle is not detected, (b) is the distance to an obstacle. It is a figure which shows a display example when is 30 m, (c) is a figure which shows a display example when the distance to an obstruction is 10 m. The example of a display which made the display part alert | report the distance to an obstacle is shown, (a) is a figure which shows the example of a display when a collision risk level is low, (b) is a collision risk level medium. (C) is a figure which shows the example of a display when a collision risk is very high. The example of a display which made the display part alert | report the distance to an obstruction is shown, (a) is a figure which shows the example of a display when a collision risk is small, (b) is a collision risk is medium. (C) is a figure which shows the example of a display when a collision risk degree is large.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Main control part 2 Distance sensor 3 Shutter button 4 Camera part (imaging means)
5 Image processing unit 6 First memory 7 Display unit 7a Main screen 7b Sub-screen 8 Display control unit 9 Backlight 10 TV tuner 11 TV antenna 12 GPS control unit 13 GPS antenna 14 Wireless control unit 15 Wireless communication antenna 16 Operation button unit 17 Second memory 18 LED
19 Microphone 20 Speaker 51 Lid 52 Main body 52a Attachment part 100 Collision prevention part 101 CPU
102 Bus 103 Obstacle Detection Unit 104 Obstacle Notification Unit 105 Position Information Detection Unit 106 Application Execution Unit 107 ROM
108 RAM
200 sensor unit 201 weight 202 axis

Claims (18)

Obstacle detection means for detecting obstacles around the mobile terminal device;
An obstacle notifying means for notifying the operator of the mobile terminal device of the presence of an obstacle,
The obstacle notification means
A portable terminal device that notifies the presence of an obstacle when the obstacle is detected by the obstacle detection means. It has a distance sensor that measures the distance from the mobile terminal device to the obstacle,
The obstacle detection means is
2. The presence of an obstacle is detected when a distance from the mobile terminal device calculated by the distance sensor to the obstacle reaches a predetermined value. Mobile terminal device. Equipped with application functions such as e-mail and internet,
The obstacle detection means is
When the application function is executed, the distance sensor is activated, and the presence of an obstacle is detected when the distance from the mobile terminal device to the obstacle calculated from the detection value by the distance sensor reaches a predetermined value. The mobile terminal device according to claim 2, wherein: Equipped with display means for displaying application function execution screens such as e-mail and the Internet,
The obstacle notification means
The mobile terminal device according to claim 1, wherein information for notifying the presence of an obstacle is displayed on the display means during execution of the application function. The display means can display at least two screens,
The obstacle notification means
5. The mobile terminal device according to claim 4, wherein information for notifying the presence of an obstacle is displayed on a display screen different from a screen executing an application function among display screens of the display means. . Imaging means for imaging the front as viewed from the mobile terminal device;
Display means for displaying an application function execution screen such as e-mail and the Internet,
The obstacle notification means
2. The portable terminal device according to claim 1, wherein an image being picked up by the image pickup means is displayed on the display means during execution of the application function.   7. The mobile terminal device according to claim 6, wherein the display unit divides and displays a screen that displays an execution screen of the application function and a screen that displays an image being captured by the imaging unit. . The obstacle notification means
The portable terminal device according to claim 6, wherein the display unit is controlled to start displaying a captured image by the imaging unit in conjunction with execution of the application function. It has a distance sensor that measures the distance from the mobile terminal device to the obstacle,
The obstacle notification means
The display state of the image being picked up by the image pickup means displayed on the display means is changed in accordance with the distance from the portable terminal device to the obstacle calculated from the detection value by the distance sensor. Item 7. The mobile terminal device according to Item 6. The obstacle notification means
As the distance from the portable terminal device to the obstacle calculated from the detection value by the distance sensor becomes shorter, the image being photographed by the imaging means displayed on the display means is enlarged stepwise. The mobile terminal device according to claim 9. Provided with position information detection means for detecting the current position of the mobile terminal device,
The obstacle detection means is
2. The portable terminal device according to claim 1, wherein an obstacle detection operation is started when a movement amount of the portable terminal device calculated from the position information detected by the position information detection unit is equal to or greater than a predetermined value. . It has a distance sensor that measures the distance from the mobile terminal device to the obstacle,
The obstacle detection means is
The mobile terminal device according to claim 11, wherein the presence of an obstacle is detected when a distance from the mobile terminal device to the obstacle calculated by the distance sensor reaches a predetermined value. In a collision prevention method for preventing a collision between an operator of a mobile terminal device and an obstacle,
Detecting the presence or absence of an obstacle around the portable terminal device;
And a step of notifying the operator of the portable terminal device of the presence of an obstacle when an obstacle is detected. In a collision prevention method for preventing a collision between an operator of a mobile terminal device having an imaging function for imaging the front and application functions such as e-mail and the Internet, and an obstacle,
Executing the application function;
And a step of executing the imaging function in conjunction with execution of the application function. In a collision prevention method for preventing a collision between an operator of a mobile terminal device having a distance sensor for measuring a distance from the mobile terminal device to an obstacle, and an application function such as e-mail and the Internet, and an obstacle,
Executing the application function;
Activating the distance sensor in conjunction with execution of the application function;
And a step of notifying the operator of the presence of an obstacle when the distance from the portable terminal device calculated by the distance sensor to the obstacle reaches a predetermined value. Method. In a collision prevention method for preventing a collision between an operator of a mobile terminal device having a distance sensor for measuring a distance from the mobile terminal device to an obstacle and a position detection function for detecting the position of the mobile terminal device and an obstacle,
Detecting the position of the mobile terminal device by the position detection function;
Activating the distance sensor when the amount of movement of the mobile terminal device calculated from the detected position information is a predetermined value or more;
And a step of notifying the operator of the presence of an obstacle when the distance to the obstacle calculated from the value detected by the distance sensor reaches a predetermined value. A collision prevention program for preventing a collision between an operator of a mobile terminal device and an obstacle,
A procedure for detecting the presence or absence of an obstacle around the portable terminal device;
A collision prevention program for causing a computer to execute a procedure for notifying the operator of the mobile terminal device of the presence of an obstacle when an obstacle is detected.   The computer-readable recording medium which recorded the collision prevention program of Claim 17.

Images