JP4058455B1 - Mobile device - Google Patents

Abstract

【Task】
When a mobile terminal holder is in a moving state such as walking or traveling on a bicycle, the mobile terminal determines a dangerous state caused by gazing at the screen of the mobile terminal, and notifies the mobile terminal owner of the danger state The purpose is to provide.
[Solution]
The imaging device of the mobile terminal is provided on the same surface as the display device, and the mobile terminal detects a vibration state of the mobile terminal, a acceleration, or a voltage associated therewith, and a detected state information. A moving state determining unit that determines that the moving state is determined when a predetermined reference value is satisfied, a camera activation instructing unit that transmits an activation instruction for the imaging device, and a face from an image captured by the imaging device. By detecting, a dangerous state determination unit that determines the dangerous state of the owner, and when it is determined that the person is in a dangerous state, a control instruction for notifying the owner is sent out And a danger determination time processing unit.
[Selection] Figure 1

Description

The present invention relates to a mobile terminal. More specifically, when the mobile terminal holder is in a moving state such as walking or traveling on a bicycle, the danger state generated by gazing at the screen of the mobile terminal is determined, and the mobile terminal owner is determined. It is related with the portable terminal which notifies.

  With the widespread use of mobile terminals (including portable communication terminals such as mobile phones, PHS, and PDAs in this specification), there are people who operate the mobile terminal while walking or riding a bicycle. In particular, when an e-mail, a website, or the like is operated on a mobile terminal, there are many cases where attention is paid to the screen of the mobile terminal, and confirmation of surrounding conditions is neglected.

  For this reason, the mobile terminal is obsessed with operation and may collide with people and objects (cars, telephone poles, installations on the road, etc.). In addition, it is difficult to pay attention to traffic lights and so on, which is extremely problematic for traffic safety.

  In order to avoid such a situation, in Patent Document 1 and Patent Document 2 below, the surroundings are imaged by the camera provided in the portable terminal, and the captured surrounding image is displayed on a part of the display device of the portable terminal. Discloses an invention that informs the holder of the portable terminal of the surrounding situation.

JP 2006-148632 A JP 2005-136695 A

  By using the invention as described above, the owner of the mobile terminal can check the surrounding situation only by looking at the display device, and can continue to operate the mobile terminal as it is. However, what the owner can grasp is limited to the range captured by the camera of the portable terminal. When the owner is walking or operating the mobile terminal while riding a bicycle, the display device of the mobile terminal is generally facing the face and the line of sight is often on the lower side. Then, the camera of the mobile terminal often faces downward, and the range that can be imaged by the camera of the mobile terminal is limited to the lower side, and most of it is occupied by the road.

  Therefore, even if the invention as described in the above patent document is used, the owner cannot sufficiently grasp the surrounding situation. It can also be said that operating the mobile terminal while walking or riding a bicycle in the first place is dangerous because it makes it difficult to check the surrounding situation. In order to prevent such a dangerous state, it is desired that the owner of the portable terminal recognizes the danger and suppresses it when walking or traveling by bicycle.

  In view of the above-described problems, the present inventor detects a state of walking or moving on a bicycle (these are referred to as “moving state” in this specification), and in such a case, the portable terminal Invented a portable terminal that suppresses the use of the portable terminal in a moving state by performing a predetermined process.

  The invention of claim 1 is a portable terminal having a display device and an imaging device on the same surface, wherein the portable terminal is in a moving state in which any one or more of vibration, acceleration, and accompanying voltage of the portable terminal is detected. A detection unit, a movement state determination unit that determines that the vehicle is in a movement state when a predetermined reference value is satisfied using the detected information, and the imaging device that determines that the movement state is at least determined A camera activation instructing unit that sends out an activation instruction, a dangerous state determining unit that determines a dangerous state of the owner by detecting a face from an image captured by the imaging device, and determining that the user is in the dangerous state And a danger determination time processing unit that sends a control instruction for notifying the owner to that effect when it is done.

  By configuring as in the present invention, it is determined whether the mobile terminal holder is in a moving state such as walking or riding a bicycle by vibration, acceleration, voltage, etc., and the moving state If it is, it is further determined whether or not the screen of the mobile terminal is being watched, and if it is being watched, a predetermined warning or the like can be given to the owner. As a result, the owner of the mobile terminal can recognize that it is dangerous to use the mobile terminal while moving, and the operation while moving can be suppressed. Therefore, it leads to ensuring the safety of the owner of the portable terminal.

Invention of Claim 2 is a portable terminal which has a display apparatus and an imaging device on the same surface, Comprising: The said portable terminal detects the vibration of the said portable terminal, the time which detected the said vibration, its presence, and its A vibration detection unit that stores at least the amplitude over time, and the number of vibrations detected in a predetermined time is determined based on time detected by the vibration detection unit or information on presence or absence of vibration, and the number of vibrations and A moving state determining unit that determines whether the moving state is detected using information on the amplitude of vibration at a predetermined time; and a camera starting instruction that sends out a starting instruction for the imaging device when it is determined that the moving state is at least and parts, by determining whether the captured face by detecting a plurality of feature points in an image taken by the image pickup device, a hazardous condition judging unit for judging hazardous condition of the holder If it is determined that the dangerous state, a mobile terminal having a danger determination time processing unit for sending a control instruction to notify with respect to the holder.

In determining the moving state, there is a method of detecting vibration. When walking or riding a bicycle, the owner moves and the vibration is transmitted to the portable terminal. If the frequency is greater than the reference value, it can be determined that the object is moving. In addition to the vibration, the determination is made taking into account the amplitude. By taking the amplitude into account, the magnitude of vibration can be determined. As a result, it is possible to determine even a detailed moving state such as moving or running, so that a more accurate determination of the moving state can be performed.

Invention of Claim 3 is a portable terminal which has a display apparatus and an imaging device on the same surface, Comprising: The said portable terminal detects any one or more of the acceleration of the said portable terminal, or the voltage accompanying it, The said acceleration or The time at which the voltage is detected or the presence / absence thereof, the acceleration value or the acceleration value that is stored in the portable terminal at least over time, the detected number of detected accelerations or the detected number of voltages at a predetermined time It is determined based on the time detected by the acceleration detection unit or information on the presence / absence thereof, and the moving state is determined by using the number of detected accelerations or the number of detected voltages and the value of acceleration or voltage during the predetermined time. a moving state determining unit determines, when it is at least determined if there in a moving state, and the camera activation instruction unit for sending an activation instruction of the imaging device, the imaging device By determining whether the captured face by detecting a plurality of feature points in the image captured, the hazardous condition judging unit for judging hazardous condition of the owner if was determined to the dangerous state And a danger determination time processing unit for sending a control instruction for notifying the owner of that fact.

  The determination of the moving state may be performed by detecting acceleration and a voltage associated therewith in addition to vibration. In an acceleration sensor or the like, this can be done by detecting pressure based on acceleration or inertia caused by acceleration, and detecting a voltage associated therewith. An acceleration sensor or the like can be used to detect such a thing. Even in such a case, when the user is walking or riding a bicycle, the owner is accelerated, so the mobile terminal is similarly accelerated. If the number of detected accelerations and the number of detected voltages associated therewith are greater than the reference value, it can be determined that the vehicle is moving.

  In the invention of claim 6, the portable terminal further includes an operation determination unit that detects whether an operation is performed on the input device of the portable terminal, and the camera activation instruction unit further includes A mobile terminal that determines the movement state in a movement state determination unit and performs the activation instruction when it is determined that an operation is performed in the operation determination unit.

  It may be configured to give an instruction to start the imaging device when it is determined to be in the moving state, but if it is further determined that the device is in the operating state as in the present invention, an instruction to start the imaging device is given. It is better to configure as follows. Just because a person is moving does not mean that the owner is using the portable terminal. In such a case, starting up the imaging apparatus consumes useless power. Therefore, when the mobile terminal is actually in use, that is, when the owner makes some input to the mobile terminal while moving, an instruction to start the imaging apparatus may be given. preferable. This can be achieved by the configuration of the present invention.

  In the invention of claim 7, the danger state determination unit detects a face from an image captured by the imaging device, and determines that the face is in a dangerous state when a face is detected in the image for a predetermined number or more or for a predetermined time or more. It is a portable terminal.

  The imaging device is provided on the same surface as the display device. In other words, if the display device is being viewed, the face of the owner who sees the display device should be reflected in the image captured by the imaging device. If the face can be detected in the image for a predetermined number or more, or for a predetermined time or more, the owner is considered to be in a state of gazing at the display device. That is, this state is a state in which the owner is neglecting the surrounding situation. Therefore, it may be determined that such a case is dangerous.

  In the invention of claim 8, the danger determination time processing unit turns off the display of the display device, sounds a warning sound, generates vibration, or displays a predetermined message on the display device as the control instruction. A mobile terminal that sends out any control instruction.

  There are various control instructions for prompting the owner to be dangerous, but the ones according to the present invention are typical. In particular, when the display device is turned off, the display device cannot be physically seen, so the owner of the mobile terminal must give up using the mobile terminal at that time and pay attention to the surroundings. It is effective because it can be directed to. Also, other control instructions are a hindrance to the use of the mobile terminal, which leads to the owner giving up on the use. This allows you to direct attention around you.

According to the present invention, when it is determined that the owner of the mobile terminal is in a moving state, the display of the display device of the mobile terminal is turned off, a warning sound is generated, vibration is generated, and notification of danger is given. Control processing such as displaying can be performed. This makes it possible for the owner of the mobile terminal to recognize that the use of the mobile terminal in the moving state is dangerous and to suppress the use.

  A conceptual diagram of a system configuration of the portable terminal 1 of the present invention is shown in FIG. Moreover, the conceptual diagram of an example of the hardware constitutions of the portable terminal 1 of this invention is shown in FIG.

  The portable terminal 1 according to the present invention includes a computing device 20 such as a CPU that executes computation processing of a program, a storage device 21 such as a RAM and ROM that stores information, a display device 22 that displays a screen, and characters and numbers. , An input device 23 for inputting symbols and the like, a communication device 24 that enables data transmission / reception and voice communication over the Internet, and an imaging device 25 that is a camera that images at least the owner of the mobile terminal 1. . Each function (each unit) realized on the portable terminal 1 is executed when a unit (program, module, or the like) that executes the process is read into the arithmetic device 20. When using the information stored in the storage device 21 in the processing, each function reads the corresponding information from the storage device 21 and uses the read information for processing in the arithmetic device 20 as appropriate. The imaging device 25 may be attached to a position where the holder captures the face of the portable terminal 1, preferably the face of the portable terminal 1 when the portable terminal 1 is used. Preferably, at least one imaging device 25 is provided on the same surface as the display device 22 of the mobile terminal 1. Thereby, in the state where the holder is looking at the display device 22, the holder of the portable terminal 1, preferably the face thereof, can be imaged by the imaging device 25.

  Each means in the present invention is only logically distinguished in function, and may be physically or practically the same area.

  The mobile terminal 1 includes a movement state detection unit 2, a movement state determination unit 3, an operation determination unit 4, a camera activation instruction unit 5, a dangerous state determination unit 6, and a danger determination time processing unit 7.

  The movement state detection unit 2 detects information on the movement state of the holder of the mobile terminal 1 (for example, detection of vibration information by a vibration sensor, detection of acceleration or voltage information by an acceleration sensor, etc.). For example, vibration information (such as the time of vibration and its amplitude) is recorded over time by a vibration sensor. Further, the movement state detection unit 2 can similarly detect the movement state by using an acceleration sensor in addition to the vibration sensor. As this acceleration sensor, a piezoelectric type, a semiconductor piezoresistive type, a capacitance type, or the like can be used. This can be used because the walking state and the exercise state can be determined by detecting the acceleration and voltage generated by the vibration. These vibration sensors and acceleration sensors may be used when the portable terminal 1 has a pedometer function.

  The movement state determination unit 3 determines the movement state of the holder of the mobile terminal 1 based on the movement state information detected by the movement state detection unit 2. As this moving state, there is a state where vibration or acceleration is generated in the holder of the portable terminal 1 such as walking or moving on a bicycle. In other words, vibration and acceleration occur when walking or moving on a bicycle. These are detected by the movement state detection unit 2 and recorded. And based on these information, it is determined whether it is a movement state. For example, when the movement state detection unit 2 is a vibration detection unit such as a vibration sensor, the time when the vibration is detected and its amplitude are recorded in the storage device 21. Then, the moving state is determined by determining how many vibration frequencies exist within a predetermined time or how much the average value of the amplitudes of those vibrations is. That is, when the frequency within a predetermined time is equal to or greater than a predetermined reference value, or the average value of the amplitude is equal to or greater than a predetermined reference value, it is determined as “moving state”. The same applies when an acceleration detection unit such as an acceleration sensor is used. The time at which the acceleration or voltage is detected, the acceleration value or the voltage value are recorded in the storage device 21 together with the time, and how many acceleration detections or voltage detections have occurred within a predetermined time, or the acceleration or voltage The moving state is determined by determining how much the average value is. That is, when the number of detected accelerations within a predetermined time is equal to or greater than a predetermined reference value, or the average value of acceleration is equal to or greater than a predetermined reference value, it is determined that the state is “moving state”. The determination of the moving state is an example, and may be determined by other methods.

  The operation determination unit 4 uses the input device 23 of the mobile terminal 1 to detect when the owner makes some input and determines that “the operation is being performed”.

  The camera activation instructing unit 5 determines that the moving state is determined in the moving state determination unit 3, and if the operation determination unit 4 further determines that “operation is being performed” in some cases, the mobile terminal 1. An instruction to activate the imaging device 25 provided in the above is issued. In response to this instruction, the imaging device 25 is activated in the portable terminal 1, and the imaging device 25 images the owner, preferably the face. The imaging device 25 activated as described above automatically captures images at predetermined timings and records the images in the storage device 21. In the case of automatic imaging, unlike general imaging, only internal processing is performed. Therefore, it is preferable not to emit a shutter sound that is normally reproduced by the imaging device 25 during imaging. In addition, a plurality of images may be taken every predetermined time with a still image, or a predetermined time may be taken with a moving image.

  The dangerous state determination unit 6 determines whether the owner of the mobile terminal 1 is in a dangerous state based on the image captured by the imaging device 25. Here, the dangerous state refers to a state in which the owner of the mobile terminal 1 is gazing at the display device 22 of the mobile terminal 1. Specifically, the face of the owner is detected from the captured image, and the predetermined time has elapsed. As described above (predetermined number or more), when a face is captured in the image captured by the imaging device 25, it is determined that the display device 22 is being watched and is in a dangerous state. Note that the face is shown here is a state in which most of the face (most parts of the face, such as eyebrows, eyes, nose, mouth, etc.) are shown in the image for a predetermined time (predetermined number). To tell.

  This is schematically shown in FIG. FIG. 4 schematically illustrates that the dangerous state is determined based on three images captured by the imaging device 25 at each predetermined timing. In FIG. 4A, the first image shows a face, but the second image shows only a part of the face, and the third image does not show a face. The image pickup device 25 is provided on the same surface as the display device 22 so that the face of the holder can be picked up. However, since the face cannot be picked up by the image pickup device 25, the holder has the display device of the mobile terminal 1. Therefore, it can be determined that it is not in a dangerous state. On the other hand, in FIG. 4B, the faces are shown from the first to the third sheet. Therefore, it is presumed that the owner is looking at the display device 22 of the portable terminal 1, and it can be determined that the person is in a dangerous state.

  Various known techniques can be used to determine whether or not a face is captured in the image captured by the imaging device 25 in this way. For example, a plurality of feature points are detected in a captured image, and the feature points are similar to the registered pattern of facial feature points (for example, eyebrows, eyes, nose, mouth, etc.) registered in advance. By comparing whether or not the ratios are similar, it is possible to determine whether or not a face appears in the image.

  It is possible that a face other than the owner appears in the image captured by the imaging device 25. In such a case, it can be determined whether or not the portion recognized as a face is the face of the owner by determining whether or not the portion of the image has a certain ratio or more. This is because the owner's face occupies a large ratio in the imaging device 25, and in the case of a small face, it is considered that it is a face of another person who happens to be mixed. This is schematically shown in FIG.

  When the danger determination time determination unit 6 determines that the owner is in a dangerous state, the danger determination time processing unit 7 gives an instruction to execute a predetermined process in the portable terminal 1 in that case. For example, the display on the display device 22 of the mobile terminal 1 is turned off, a warning sound is sounded, vibration is generated, or the display device 22 of the mobile terminal 1 is displayed as “It is very dangerous to use while moving”. To give instructions. In response to this, each process is executed in the portable terminal 1.

  Next, an example of the processing process of the present invention will be described with reference to the flowchart of FIG. 3 and the conceptual diagram of FIG.

  First, the holder of the portable terminal 1 of the present invention owns the portable terminal 1. And when it moves by walking or a bicycle, vibration is transmitted to the portable terminal 1 or acceleration is generated, so that the movement state detection unit 2 detects the vibration and acceleration. Information on the detected vibration time and amplitude, acceleration and voltage detection times and their values are stored in the storage device 21.

  Using the information thus detected, the moving state determination unit 3 is based on information such as the average number of vibrations and amplitudes within a predetermined time, the number of detected accelerations and voltages, and the average value of accelerations and voltages. Thus, it is determined whether or not the holder of the portable terminal 1 is in a moving state by determining whether or not they exceed a predetermined reference value (S100).

  When it is determined that the owner of the mobile terminal 1 is in the moving state (S110), the operation determination unit 4 detects whether or not there is an input in the input device 23 of the mobile terminal 1. For example, it is detected whether there is any input from the input device 23. When it is determined that there is an input (S120), the camera activation instructing unit 5 sends an instruction to activate the imaging device 25 on the same surface as the display device 22 of the mobile terminal 1, and activates the imaging device 25. (S130).

  The imaging device 25 captures a still image at a predetermined timing, or captures a predetermined time with a moving image.

  Based on the image thus captured, the dangerous state determination unit 6 determines the dangerous state of the owner (S140). When a plurality of still images are captured, as shown in FIG. 4, a face is detected from each image, and when a certain number of faces are captured, it is determined to be in a dangerous state, If it is not shown, it is determined that it is not in a dangerous state (S150). If a moving image is captured, it is determined that the face is in a dangerous state if the face is captured for a predetermined time or longer, and if it is not captured, it is determined that the face is not in a dangerous state (S150).

  In this way, when the dangerous state determination unit 6 determines that the owner is in a dangerous state, the danger determination time processing unit 7 turns off the display on the display device 22 of the mobile terminal 1 or sounds a warning sound. Or a vibration is generated, or an instruction to display “use during movement is very dangerous” is sent to the display device 22 of the portable terminal 1 (S160). In response to this, the mobile terminal 1 executes processing corresponding to each instruction.

By performing the processing as described above, the holder of the mobile terminal 1 is made aware that it is dangerous to use the mobile terminal 1 in the moving state and suppresses it.

According to the present invention, when it is determined that the owner of the mobile terminal 1 is in a moving state, the display device 22 of the mobile terminal 1 is turned off, a warning sound is generated, vibration is generated, and it is dangerous. The control process such as displaying the notification can be performed. As a result, the owner of the portable terminal 1 can recognize that the use of the portable terminal 1 in the moving state is dangerous and can suppress the use.

It is a figure which shows typically the concept of the system configuration | structure of the portable terminal of this invention. It is a figure which shows typically an example of the hardware constitutions of the portable terminal of this invention. It is a flowchart which shows an example of the process of this invention typically. It is a figure which shows typically judgment of a dangerous state. It is a figure which shows typically the case where it is determined whether the image reflected in the image is a holder.

Explanation of symbols

1: Mobile terminal 2: Movement state detection unit 3: Movement state determination unit 4: Operation determination unit 5: Camera activation instruction unit 6: Danger state determination unit 7: Danger determination processing unit 20: Computing device 21: Storage device 22: Display device 23: Input device 24: Communication device 25: Imaging device

Claims (11)

A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
A moving state detection unit that detects any one or more of vibration, acceleration, or a voltage accompanying the vibration of the mobile terminal;
A movement state determination unit that determines whether the movement state is performed using the detected information;
A camera activation instructing unit for transmitting an activation instruction for the imaging device when it is at least determined to be in a moving state;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
When it is determined that the danger state, the danger determination time processing unit for sending a control instruction for notifying the owner to that effect,
A portable terminal characterized by comprising: A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
A vibration detection unit that detects vibration of the mobile terminal, stores the time of the vibration or the presence / absence thereof, and amplitude thereof at least over time ;
The number of vibrations detected in a predetermined time is determined based on the time detected by the vibration detection unit or information on presence / absence of vibration, and the movement is performed using the number of vibrations and information on the amplitude of vibration in the predetermined time. A moving state determination unit that determines whether the state is
A camera activation instructing unit for transmitting an activation instruction for the imaging device when it is at least determined to be in a moving state;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
When it is determined that the danger state, the danger determination time processing unit for sending a control instruction for notifying the owner to that effect,
A portable terminal characterized by comprising: A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
Acceleration that detects at least one of the acceleration of the portable terminal or the voltage accompanying the acceleration, the time when the acceleration or voltage is detected or the presence / absence thereof, and the acceleration value or voltage value at least over time. A detection unit ;
The number of detected accelerations or the number of detected voltages in a predetermined time is determined based on the time detected by the acceleration detection unit or information on the presence or absence thereof, the number of detected accelerations or the number of detected voltages, and the predetermined time A moving state determination unit that determines whether the moving state using the acceleration value or the voltage value at
A camera activation instructing unit for transmitting an activation instruction for the imaging device when it is at least determined to be in a moving state;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
When it is determined that the danger state, the danger determination time processing unit for sending a control instruction for notifying the owner to that effect,
A portable terminal characterized by comprising: A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
A vibration detection unit that detects vibration of the mobile terminal, stores the time of the vibration or the presence / absence thereof, and amplitude thereof at least over time ;
The number of vibrations detected in a predetermined time is determined based on the time detected by the vibration detection unit or information on presence / absence of vibration, and the movement is performed using the number of vibrations and information on the amplitude of vibration in the predetermined time. A moving state determination unit that determines whether the state is
A camera activation instructing unit for transmitting an activation instruction for the imaging device when it is at least determined to be in a moving state;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
A risk determination time processing unit for sending a control instruction for notifying the owner to that effect when it is determined that the risk state is present;
The dangerous state determination unit
When the portion recognized as the face occupies a certain ratio or more in the image, the owner's dangerous state is determined as the face of the owner of the portable terminal.
A portable terminal characterized by that. A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
Acceleration that detects at least one of the acceleration of the portable terminal or the voltage accompanying the acceleration, the time when the acceleration or voltage is detected or the presence / absence thereof, and the acceleration value or voltage value at least over time. A detection unit ;
The number of detected accelerations or the number of detected voltages in a predetermined time is determined based on the time detected by the acceleration detection unit or information on the presence or absence thereof, the number of detected accelerations or the number of detected voltages, and the predetermined time A moving state determination unit that determines whether the moving state using the acceleration value or the voltage value at
A camera activation instructing unit for transmitting an activation instruction for the imaging device when it is at least determined to be in a moving state;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
A risk determination time processing unit that sends a control instruction for notifying the owner to that effect when it is determined to be in the dangerous state,
The dangerous state determination unit
When the portion recognized as the face occupies a certain ratio or more in the image, the owner's dangerous state is determined as the face of the owner of the portable terminal.
A portable terminal characterized by that. A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
A vibration detection unit that detects vibration of the mobile terminal, stores the time of the vibration or the presence / absence thereof, and amplitude thereof at least over time ;
The number of vibrations detected in a predetermined time is determined based on the time detected by the vibration detection unit or information on presence / absence of vibration, and the movement is performed using the number of vibrations and information on the amplitude of vibration in the predetermined time. A moving state determination unit that determines whether the state is
An operation determination unit for detecting an operation input from the input device of the mobile terminal;
A camera activation instructing unit that transmits an activation instruction of the imaging device when it is determined that it is in a moving state and an operation input is detected ;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
When it is determined that the danger state, the danger determination time processing unit for sending a control instruction for notifying the owner to that effect,
A portable terminal characterized by comprising: A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
Acceleration that detects at least one of the acceleration of the portable terminal or the voltage accompanying the acceleration, the time when the acceleration or voltage is detected or the presence / absence thereof, and the acceleration value or voltage value at least over time. A detection unit ;
The number of detected accelerations or the number of detected voltages in a predetermined time is determined based on the time detected by the acceleration detection unit or information on the presence or absence thereof, the number of detected accelerations or the number of detected voltages, and the predetermined time A moving state determination unit that determines whether the moving state using the acceleration value or the voltage value at
An operation determination unit for detecting an operation input from the input device of the mobile terminal;
A camera activation instructing unit that transmits an activation instruction of the imaging device when it is determined that it is in a moving state and an operation input is detected ;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
When it is determined that the danger state, the danger determination time processing unit for sending a control instruction for notifying the owner to that effect,
A portable terminal characterized by comprising: A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
A vibration detection unit that detects vibration of the mobile terminal, stores the time of the vibration or the presence / absence thereof, and amplitude thereof at least over time ;
The number of vibrations detected in a predetermined time is determined based on the time detected by the vibration detection unit or information on presence / absence of vibration, and the movement is performed using the number of vibrations and information on the amplitude of vibration in the predetermined time. A moving state determination unit that determines whether the state is
An operation determination unit for detecting an operation input from the input device of the mobile terminal;
A camera activation instructing unit that transmits an activation instruction of the imaging device when it is determined that it is in a moving state and an operation input is detected ;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
A risk determination time processing unit for sending a control instruction for notifying the owner to that effect when it is determined that the risk state is present;
The dangerous state determination unit
When the portion recognized as the face occupies a certain ratio or more in the image, the owner's dangerous state is determined as the face of the owner of the portable terminal.
A portable terminal characterized by that. A portable terminal having a display device and an imaging device on the same surface,
The portable terminal is
Acceleration that detects at least one of the acceleration of the portable terminal or the voltage accompanying the acceleration, the time when the acceleration or voltage is detected or the presence / absence thereof, and the acceleration value or voltage value at least over time. A detection unit ;
The number of detected accelerations or the number of detected voltages in a predetermined time is determined based on the time detected by the acceleration detection unit or information on the presence or absence thereof, the number of detected accelerations or the number of detected voltages, and the predetermined time A moving state determination unit that determines whether the moving state using the acceleration value or the voltage value at
An operation determination unit for detecting an operation input from the input device of the mobile terminal;
A camera activation instructing unit that transmits an activation instruction of the imaging device when it is determined that it is in a moving state and an operation input is detected ;
A risk state determination unit that determines the risk state of the owner by determining whether a face is captured by detecting a plurality of feature points in the image captured by the image capturing device;
A risk determination time processing unit that sends a control instruction for notifying the owner to that effect when it is determined to be in the dangerous state,
The dangerous state determination unit
When the portion recognized as the face occupies a certain ratio or more in the image, the owner's dangerous state is determined as the face of the owner of the portable terminal.
A portable terminal characterized by that. The dangerous state determination unit
Detecting a face from an image captured by the imaging device, and determining a dangerous state when a face is detected in the image for a predetermined number or more or a predetermined time or more;
The mobile terminal according to claim 1 , wherein the mobile terminal is a mobile terminal. The danger determination processing unit
As the control instruction, send out a control instruction for turning off the display of the display device, sounding a warning sound, generating vibration, or displaying a predetermined message on the display device,
The mobile terminal according to claim 1, wherein the mobile terminal is a mobile terminal.

Images