JP4497346B2 - Electronic equipment control device, electronic equipment control system - Google Patents

Description

  The present invention includes an electronic device control device suitable for a portable terminal that is always carried by a user, such as a mobile phone terminal and a PDA (Personal Digital Assistant), and the electronic device control device and other electronic devices. The present invention relates to an electronic device control system.

  In recent years, various electronic devices such as television receivers, video disk recorders, audio equipment, personal computers and peripheral equipment, air conditioners, dehumidifiers, humidifiers, air purifiers, negative ion generators, panels, etc. Various household electronic devices such as heaters and heaters such as hot carpets and lighting fixtures overflow around people. Most of these various devices are electronically controlled. For example, not only power on / off but also various other operations can be performed by a remote controller, a one push button, or the like.

  Here, in general, when the user goes out, for example, when the user goes out, the power switch of the various devices is turned off. On the other hand, when the user goes home, the power switch of the desired device among the various devices is turned on. For television receivers, the volume is adjusted according to a desired channel, and for a heater, the temperature is adjusted to a desired temperature. Each of these operations is often performed using a remote controller corresponding to each device.

  In addition, as a method of using the various electronic devices, for example, when the user is tired both physically and mentally, the user turns off the television receiver at the same time as, for example, darkens the illumination, and quietly uses the audio device. The user may heal the tired mind and body by operating each device to the setting desired by the user, such as playing a simple song or reducing the volume. On the other hand, when the user is healthy and fulfilling both physically and mentally, the user may, for example, brighten the lighting and watch a bright television broadcast program, or play an uptempo song on an audio device. May be performed.

  Note that Japanese Unexamined Patent Application Publication No. 2003-122992 (Patent Document 1) discloses a technique of automatic control according to a user's situation. This publication automatically changes the type and amount of information to be acquired according to the user's situation, and automatically selects the media (image, sound, etc.) to be acquired according to the user's situation. The technology is disclosed. The user situation described in this publication is, for example, a situation where the user is driving a vehicle, a situation where he is walking, and the mobile terminal described in this publication has, for example, the situation of the user. When the vehicle is in operation, the server automatically requests traffic information and weather forecast information.

JP 2003-122992 A (FIG. 1)

  By the way, for example, when the user is tired both physically and mentally, or when the user is both physically and mentally healthy, the user can adjust the brightness of the illumination, the television receiver, as described above. Various operations such as audio device playback song selection and volume adjustment, such as turning on / off and channel selection, etc. are performed. It ’s hard. That is, when the environment surrounding the user is to be changed to the user's favorite environment using these devices, the user has to perform a complicated operation for individually adjusting and setting each device.

  On the other hand, if the device is automatically controlled according to the user's situation as in the technology described in the above publication, the user may not need to operate the device. The device only provides information suitable for the user's situation, and does not affect the environment surrounding the user.

  The present invention has been made in view of the above-described problems. For example, an electronic device control apparatus that enables an environment surrounding a user to be an environment desired by the user without requiring an operation by the user, and An object is to provide an electronic device control system.

The electronic device control device of the present invention includes a communication unit for communicating with other electronic devices that perform a predetermined operation corresponding to control information sent from the device, and a user schedule held in the schedule information holding unit Based on the schedule information detected by the schedule detection unit according to the time measured by the time detection unit from the information, and the shooting data of the user's clothing taken by the camera unit, the physical and mental state of the user Control information for controlling other electronic devices so as to perform an operation corresponding to the user state information, and a state detection unit that determines and indicates information indicating the physical and mental state of the user as user state information The above-described problem is solved by including an information generation unit that generates the transmission information and a transmission control unit that transmits the control information from the communication unit to another electronic device.

The electronic device control system of the present invention includes an electronic device that performs a predetermined operation in response to control information sent from the electronic device control device, and the electronic device control device. The communication unit for communicating with the device, and the schedule information and the camera unit detected according to the time measured by the time detection unit from the user's schedule information held in the schedule information holding unit A state detection unit that determines the physical and mental state of the user based on the captured image data and uses the user state information as information indicating the physical and mental state of the user, and the user state information An information generation unit that generates control information for controlling the electronic device so as to perform a corresponding operation, and a transmission control unit that transmits the control information from the communication unit to the electronic device More, to solve the problems described above.

That is, according to the present invention, the electronic device performs a predetermined operation based on the user status information detected by the electronic device control apparatus.

In the present invention, the electronic device performs a predetermined operation according to the user status information detected by the electronic device control device, so that the environment surrounding the user can be changed even if the user does not operate each electronic device. Made to the environment you want.

  Hereinafter, an electronic device control apparatus and an electronic device control system according to embodiments of the present invention will be described with reference to the drawings. In this embodiment, a mobile phone terminal is cited as an example of an electronic device control device, and a television receiver, an illuminator, and an audio device are listed as examples of electronic devices controlled by the electronic device control device. A system comprising these will be described as an electronic device control system.

[Schematic configuration of electronic equipment control system]
FIG. 1 shows a schematic configuration of an electronic device control system according to an embodiment of the present invention.

  In FIG. 1, the television receiver 2 of the present embodiment performs short-range wireless communication with the mobile phone terminal 1 of the present embodiment, in addition to the basic functions provided in a normal television receiver. It has a function, a function of receiving EPG (Electronic Program Guide) data via, for example, the Internet or television data broadcasting, a function of recording and recording a television program. In addition, the television receiver 2 has a function of performing predetermined operations such as power on / off, volume adjustment, reception channel switching, recording, and playback based on control information from the mobile phone terminal 1 of the present embodiment. It also has.

  The illuminator 3 of the present embodiment has a function of performing short-range wireless communication with the mobile phone terminal 1 of the present embodiment, a brightness adjustment function, and the like in addition to the basic functions provided in a general illuminator. I have. The illuminator 3 also has a function of performing predetermined operations such as turning on / off and adjusting brightness based on control information from the mobile phone terminal 1 of the present embodiment.

  The audio device 4 of the present embodiment has a function for performing short-range wireless communication with the mobile phone terminal 1 of the present embodiment, such as the Internet and audio data broadcasting, in addition to the basic functions provided in a general audio device. A function of receiving radio program data via the network, a function of recording a radio program, a function of switching and reproducing a plurality of media such as a CD (compact disc), and the like. The audio device 4 also has a function of performing predetermined operations such as power on / off, volume adjustment, radio reception channel switching, recording, and playback based on control information from the mobile phone terminal 1 of the present embodiment. I have.

  As described above, the electronic device according to the embodiment of the present invention receives a predetermined operation based on the control information from the mobile phone terminal 1 according to the present embodiment, for example, receives and displays a television program, or a room where a user is present. It is an electronic device that performs operations such as illuminating and playing music.

  The mobile phone terminal 1 according to the present embodiment has a function provided in a general mobile phone terminal, and other peripheral electronic devices such as the television receiver 2, the illuminator 3, and the audio device 4 according to the embodiment of the present invention. A function for performing short-range wireless communication, a function for detecting the user's own state, the user's surrounding state, and the terminal's internal state as the user's own state information according to the present invention, and the respective states And a function of generating control information for the surrounding electronic devices such as the television receiver 2, the illuminator 3, and the audio device 4 to perform a predetermined operation. A specific configuration of the mobile phone terminal 1 of the present embodiment will be described later.

  Here, the user's own state means, for example, how many times the user's body temperature is, whether the user's pulse is fast or slow, how fast the user is moving, and what color or pattern the user is wearing Such as where the user's current position is, what the user's schedule is, and so on, such as "fun" state, "tired" state, "normal" state, etc. It also includes physical and mental states of the user, and states representing the user's own actions such as “sleeping” and “meal”. The user's surroundings include the current time (including morning, noon, night, etc.), the user's current position, the user's surrounding scenery, scenes, the sound environment around the user, and the user's surroundings. What kind of electronic equipment exists. Furthermore, the internal state of the terminal is, for example, whether a call application is being executed, a mail application is being executed, or a camera application is being executed. A specific configuration for detecting each of the user's own state, the state around the user, and the state inside the terminal will be described later.

  In addition, the following two modes are conceivable as control modes when the surrounding electronic device performs a predetermined operation based on the control information from the mobile phone terminal 1 of the present embodiment. On the other hand, for example, the mobile phone terminal 1 generates a control command for controlling the operation of each electronic device based on the user's own state, the state around the user, and the state inside the terminal, It is a control mode by directly transmitting the control command as control information to each electronic device, and the other is, for example, information representing each state of the user's own state, the state around the user, and the state inside the terminal, The control form is transmitted as control information from the mobile phone terminal 1 to each electronic device, and each electronic device controls its own operation based on the control information. Any of these control forms can be applied to the electronic device control system of the embodiment of the present invention.

  In the following description, as a control mode when the electronic device performs a predetermined operation based on the control information from the mobile phone terminal 1, the user's own state, the user's surrounding state, and the internal state of the terminal are set as the control mode. A description will be given by taking as an example a control form in which information representing each state is transmitted as control information to each electronic device, and each electronic device controls its own operation based on the control information. In addition, since the information representing each state of the user's own state, the state around the user, and the state inside the terminal can be said to be information representing the state of the user, the information is hereinafter referred to as user state information. .

[Configuration example of mobile phone terminal]
FIG. 2 shows an internal configuration example of the mobile phone terminal 1 according to the embodiment of the present invention.

  The control unit 11 is, for example, a CPU that operates based on a program that controls the entire mobile phone terminal 1, and controls various functions via the bus 10 according to the program. The control unit 11 can also recognize which application the user is executing on the mobile phone terminal 1 by the program being executed by the control unit 11. That is, for example, the control unit 11 indicates that the user is in a call when the call application is activated, and that the user is performing an email operation when the mail application is activated. When the television viewing application is activated, the terminal status such as that the user is viewing the television, and when the camera application is activated, the user is operating the camera, etc. It can be recognized.

  The communication circuit 12 communicates with the base station through the antenna 6. In addition, the cellular phone terminal 1 of the present embodiment can be connected to the Internet or the like through the antenna 6 and the communication circuit 12, and therefore, from a desired site on the Internet, around the place where the user is located. It is possible to obtain information such as what kind of store is present and weather forecast information.

  The display unit 13 displays the image signal supplied from the control unit 11 via the bus 10 on the monitor screen.

  The operation unit 14 includes operation devices such as a numeric keypad and a jog dial, generates an operation signal corresponding to the operation of these operation devices, and sends the operation signal to the control unit 11 via the bus 10.

  The memory 15 is, for example, a memory-holding rewritable memory, and holds phone book data, schedule management software, a program for operating the control unit 11, and the like.

  The data holding unit 16 is a memory holding type rewritable memory similar to the memory 15, and temporarily stores user status information indicating the user's own status, the user's surrounding status, or the status inside the terminal detected as described later. Hold on. Further, the data holding unit 16 includes user status information indicating the user's own status, the user's surrounding status, or the status inside the terminal, and control contents when the electronic device performs a predetermined operation according to the user status information. A map indicating correspondence may be stored. Further, the data holding unit 16 includes user schedule data, various image data, for example, weather forecast information obtained via the Internet, shopping information when the mobile phone terminal has a so-called electronic money function, Internet The shopping information etc. when connecting to the internet and purchasing online are also stored. In addition, the data holding unit 16 also records map data for detecting the current location in comparison with position data from a GPS receiving circuit 22 described later. In the system of the present embodiment, as a control mode when a surrounding electronic device performs a predetermined operation based on control information from the mobile phone terminal 1, the mobile phone terminal 1 is based on each state of the user. When taking a control form in which a control command for controlling the operation of each electronic device is generated and the control command is directly transmitted to each electronic device as control information, the data holding unit 16 includes user status information. And a correspondence table of the control commands of the respective electronic devices corresponding thereto. The data holding unit 16 may be included in the memory 15.

  The speaker drive circuit 17 drives the speaker 4 and outputs a call sound, a ring tone, and the like.

  The microphone input signal generator 18 amplifies the sound collected by the microphone 5 and performs analog / digital conversion to generate digital sound data.

  The short-range communication circuit 19 is a circuit for performing short-range radio such as Bluetooth (trademark), infrared communication (IrDA), and UWB (Ultra Wide Band), and an antenna 19a (infrared communication) as necessary. In this case, communication with the electronic devices such as the television receiver 2, the illuminator 3, and the audio device 4 is performed via an infrared transmission / reception unit). The mobile phone terminal of this embodiment can transmit user status information representing the current user's own state, the user's surrounding state, or the internal state of the terminal as control information from the short-range communication circuit 19 to each electronic device. It has become.

  The sensor 25 is, for example, a sensor that detects a body condition parameter that reflects a user's physical or psychological state such as body temperature or pulse, an air temperature sensor, a humidity sensor, an acceleration sensor, and the like. Are provided. The sensor for detecting body temperature and pulse is provided at a position where the user's finger touches when the user holds the mobile phone terminal 1 or when the mobile phone terminal 1 is, for example, a wristwatch type terminal. It is provided in the part which contacts the wrist. In addition, the sensor 25 may include a sensor that detects a user's brain wave, for example, by detecting a weak electromagnetic wave emitted from a human body.

  The sensor detection signal generation unit 20 performs analog / digital conversion on the detection signal from the sensor 25 and sends the digital signal to the control unit 11 via the bus 10.

  The camera 7 includes a lens system and an imaging device such as a CCD (Charge Coupled Diode), and can capture images of the user's surroundings such as the user's clothes and the user's location through the lens system. Is.

  The camera drive circuit 21 drives the camera 7, receives an image signal from the camera 7, and sends the image signal to the control unit 11 via the bus 10. At this time, the control unit 11 performs image analysis from the image pickup signal of the camera 7, for example, what kind of color the user is wearing, what color of the user is, where the user is, It is also possible to recognize the current weather and time zone from the brightness and color of the photographed image, and what electronic devices are present around the user.

  The timer 23 outputs a time count value and sends the time count value to the control unit 11 via the bus 10. Thereby, the control part 11 can detect the present | current time and time slot | zone (for example, morning, noon, night, etc.). Further, the control unit 11 can also know the elapsed time from the time when some processing or operation is performed in the past to the present, based on the time count value from the timer 23.

  The GPS reception circuit 22 receives a signal from a GPS satellite via the antenna 22 a and sends the GPS reception signal to the control unit 11. Therefore, the control unit 11 at this time recognizes the latitude / longitude of the current position from the GPS reception signal, and from the map data held in the data holding unit 16 and the latitude / longitude of the current position, the user (that is, the mobile phone) The location where the terminal 1) is present can be detected. In addition, the mobile phone terminal 1 uses the GPS reception signal and the time count value of the timer 23 to determine at what speed the user is moving in which direction, based on the moving speed and the map data. Detecting whether the user is walking, running, riding a bicycle, riding a car, train, airplane, ship, etc., and how far the user has moved You can also.

  In addition, although not shown, the mobile phone terminal according to the present embodiment also has a function of playing back music data downloaded via, for example, the Internet or music data held in a memory card or the like.

[Configuration example of electronic equipment]
FIG. 3 shows an internal configuration example of each electronic device included in the electronic device control system of the embodiment of the present invention. FIG. 3 shows only the components that the television receiver 2, the illuminator 3, and the audio device 4 have in common.

  In FIG. 3, the control unit 31 has a built-in program for controlling the entire electronic device, and controls various functions via the bus 30 according to this program.

  The basic function unit 34 has various configurations for executing basic operations normally provided in the electronic device. When the electronic device is the television receiver 2, the basic function unit 34 is a tuner that receives a television broadcast. Each configuration such as a monitor and a speaker for projecting the received television program, each configuration for emitting light in the case of the illuminator 3, and a radio reception tuner and a disc playback device in the case of the audio device 4 , Speaker, amplifier, etc.

  The memory 32 is, for example, a memory-holding rewritable memory, and responds to programs and data necessary for the control unit 31 to operate the electronic device, and user status information sent as control information from the mobile phone terminal 1. A program necessary for executing the operation is also stored.

  The data holding unit 33 is, for example, a memory holding type rewritable memory, and the user status information sent as control information from the mobile phone terminal 1 and how the electronic device operates according to the user status information. A correspondence table with the control contents indicating such is held. In the system of the present embodiment, the mobile phone terminal 1 generates a control command for controlling the operation of each electronic device based on each state of the user, and uses the control command as control information for each electronic device. In the case of adopting a control form in which data is directly transmitted, the data holding unit 33 stores a correspondence table between control commands from the mobile phone terminal 1 and control contents of the corresponding electronic device. The data holding unit 33 may be included in the memory 32.

  The interface 35 is provided as necessary, and has a configuration for connecting to an Internet line, for example.

  The short-range communication circuit 36 is a circuit for performing short-range radio such as Bluetooth, infrared communication, UWB, and the like, and is implemented through an antenna 36a (infrared transmission / reception unit in the case of infrared communication) as necessary. The mobile phone terminal 1 is communicated. Note that the electronic device of this embodiment can also communicate with other electronic devices by the short-range communication circuit 36.

  The timer 37 outputs a time count value and sends the time count value to the control unit 31 via the bus 30. Thereby, the control unit 31 can detect the current time and time zone. Further, the control unit 31 can also know the elapsed time from the time when some processing or operation is performed in the past to the present, based on the time count value from the timer 37.

[Control Flow of Electronic Device in Embodiment of Present Invention]
Next, specific electronic device control processing by the mobile phone terminal 1 according to the embodiment of the present invention will be described.

  FIG. 4 shows a flowchart of processing in the control unit 11 until the mobile phone terminal 1 generates control information and transmits it to the electronic device. The process shown in this flowchart is looped at regular time intervals.

  In FIG. 4, first, in step S1, the control unit 11 detects the body temperature of the sensor 25, the detection signal from the pulse sensor, the detection signal from the acceleration sensor, the imaging signal from the camera 7, the GPS reception signal from the GPU receiving circuit, Based on the time count value from the timer 23 or the like, the state of the user himself / herself is detected.

  That is, as an example, the control unit 11 detects that a state in which the body temperature is high and the pulse is fast continues for a long time from the body temperature / pulse detection signal and the time count value, or the GPS reception signal and the time count value. From the above, when it is detected that the user has moved for a long time and long time, or it is a late return time, or when it is detected that "work" is continuous from the schedule, the user's own The state of the user is detected so that the state is determined to be a “tired” state. On the other hand, the control unit 11 is in a state where the body temperature is high and the pulse is fast. However, when the control unit 11 detects that the game is “playing” from the schedule, or by analyzing the imaging signal of the camera 7, When it is detected that a lot of bright color components are included and the schedule is detected to be “holiday”, it is detected from the shopping information in the data holding unit 16 that the user has “a certain amount or more of favorite shopping” on that day. In such a case, the user's own state is detected such that the user's own state is determined to be a “fun” state. In addition, when the control unit 11 recognizes that the user is in the bedroom from the imaging signal of the camera 7 and detects that the body temperature and the pulse are stable, the user's own state is “sleeping”. Detect that there is. Of course, these detection examples are only examples, and the present invention is not limited to these detection examples. Note that it is possible for the user to set which of the user's own states is detected or how many of those states are to be detected, and the setting data is also stored in the data holding unit 16. Retained. After step S1, the control unit 11 advances the process to step S2.

  In step S2, the control unit 11 detects the detection signal from the temperature sensor or humidity sensor of the sensor 25, the weather forecast data acquired in advance and held in the data holding unit 16, and the time count value from the timer 23. Based on the image pickup signal from the camera 7, the GPS reception signal from the GPS reception circuit 22, the input audio signal from the microphone 5, and the like, it is detected what the surrounding state of the user is.

  That is, as an example, the control unit 11 detects that the current time zone is “morning”, “daytime”, “night” or the like from the time count value as a state around the user, or a detection signal from the humidity sensor, It is detected from the weather forecast data held in the data holding unit 16 that it is “rainy”. For example, the control unit 11 detects a person different from the user himself or his / her family from the image pickup signal of the camera 7, thereby detecting that the user is in a “visitor” state. Of course, these detection examples are only examples, and the present invention is not limited to these detection examples. Of the states around the user, which state is to be detected or how many states are to be detected can be set by the user, for example, and the setting data is also stored in the data holding unit 16. Retained. After step S2, the control unit 11 advances the process to step S3.

  When the processing proceeds to step S3, the control unit 11 detects what state is in the terminal depending on what application is activated and executed.

  That is, since the control unit 11 can recognize the application being executed, the control unit 11 recognizes that the mail operation is being performed, for example, when the mail application is being executed, and is on the call when the call application is being executed, for example. Can be recognized. It should be noted that it is possible for the user to set which one of the states inside the terminal is detected or how many of them are detected, and the setting data is also held in the data holding unit 16. After step S3, the control unit 11 advances the process to step S4.

  When the processing proceeds to step S4, the control unit 11 searches within the communicable range by the short-range communication circuit 19, and detects whether there is an electronic device that can operate according to the control information. In addition, the control unit 11 may detect whether there is an electronic device that can operate according to the control information by performing an image analysis of the imaging signal of the camera 7. After step S4, the control unit 11 advances the process to step S5.

  In step S5, the control unit 11 determines whether control information can be transmitted to an operable electronic device existing in the vicinity. As this judgment standard, for example, whether or not a predetermined time has passed since the previous transmission, the user's own state detected in the previous step S1 to step S3, the state around the user, the state inside the terminal, For example, whether the elapsed time has exceeded a predetermined time or the change in each state is large, using the difference between each state during the electronic device control and the current state, the difference between the previous control content and the current control content, etc. The current control content may be the same as the previous control content. In step S5, the control unit 11, for example, the elapsed time becomes a predetermined time or more, the difference between each state in the previous electronic device control and the current state, the previous control content, and the current control content. If it is determined that the difference is large, it is determined that the control information is transmitted. If it is determined in step S5 that control information should be transmitted, that is, it is the transmission timing of the control information, the control unit 11 proceeds to step S6, and if not, the process of this flowchart ends.

  In step S6, the control unit 11 sends the control information, which is the user state information obtained by the detection in steps S1 to S3, to the electronic device detected in step S4 via the short-range communication circuit 19. Send it. In the system of the present embodiment, when the mobile phone terminal 1 takes a control form in which the control command for each electronic device is transmitted, in step S6, control information that is the control command is transmitted to the electronic device.

  Hereinafter, a specific example of the control content of each electronic device based on the control information from the mobile phone terminal 1 of the present embodiment will be described.

[Specific control example of electronic device corresponding to user's own condition]
In FIG. 5, an example of the map which shows a response | compatibility with the present user's own state and the control content of each electronic device is shown.

  In FIG. 5, when the mobile phone terminal 1 determines that the user's own state is “fun” at home, the mobile phone terminal 1 transmits the control information corresponding to the user's own state of “fun” to the television. Wirelessly transmitted to the receiver 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to the user's own state of “fun” plays a television broadcast program (for example, a “variety” program) that matches the user's own state of “fun”. This program may be recorded in advance, or if it is broadcast in real time, the channel may be played as it is. Further, the illuminator 2 at this time is lit brightly, for example, in accordance with the user's own state of “fun”. Similarly, the audio device 4 plays, for example, a “bright song” in accordance with the user's own state of “fun”.

  Further, when the mobile phone terminal 1 determines that the user's own state is “tired”, the mobile phone terminal 1 receives the control information corresponding to the user's own state of “tired” from the television receiver. Wirelessly transmitted to the machine 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to the user's own state of “tired” operates in accordance with the user's own state of “tired” (for example, when the power is turned off, nothing is displayed. Not). Further, the illuminator 2 at this time is lit, for example, “dark” in accordance with the user's own state of “tired”. Similarly, the audio device 4 plays a so-called “healing song” that has an effect of healing the mind and body, for example, in accordance with the user's own state of being “tired”. As this music, a music classified as “healing music” from a plurality of media may be reproduced. If the music is broadcast on the radio, the radio channel may be played as it is.

  In addition, when the mobile phone terminal 1 determines that the user's own state is “normal”, the mobile phone terminal 1 sends the control information corresponding to the user's own state “normal” to the television receiver 2 and the illumination. Wirelessly transmitted to the device 3 and the audio device 4. The television receiver 2 that has received the control information corresponding to the “normal” user's own state performs an operation (for example, a preset operation) according to the user's own state “normal”. In addition, the illuminator 2 at this time is lit to, for example, “normal” brightness in accordance with the user's own state of “normal”. Similarly, the audio device 4 is turned off so as not to play any music or the like in accordance with the user's own state of “normal”.

  Further, when the mobile phone terminal 1 determines that the user's own state is “sleeping”, the mobile phone terminal 1 transmits control information corresponding to the user's own state of “sleeping” to the television receiver. 2, wireless transmission to the illuminator 3 and the audio device 4. The television receiver 2 that has received the control information corresponding to “sleeping” performs an operation (for example, an operation of turning off the power) that matches the user's own state of “sleeping”. Similarly, the illuminator 2 at this time is turned off (OFF) in accordance with the user's own state of “normal”, and the audio device 4 is also turned off so that no music or the like is played.

  In addition, when the mobile phone terminal 1 determines that the user's own state is “meal”, the mobile phone terminal 1 turns off the power of the television receiver 2 and the illuminator 3 lights up “brightly”. The audio device 4 plays “Classic” music.

  As described above, according to the system of the example of FIG. 5, each electronic device performs a predetermined operation based on the control information from the mobile phone terminal 1, thereby setting the environment around the user to the environment desired by the user. It is possible. That is, according to the system of the present embodiment, when the user is in a state of “fun”, “tired”, “normal”, etc., the user's “fun”, “tired”, “normal” state, etc. The television receiver 2, the illuminator 3, and the audio device 4 are automatically operated in order to realize an environment adapted to the above.

[Specific example of electronic device control corresponding to the user's surroundings]
FIG. 6 shows an example of a map showing the correspondence between the current state of the user and the control content of each electronic device.

  In FIG. 6, when it is determined that the cellular phone terminal 1 is in the “morning” time zone at home, the cellular phone terminal 1 is in the “morning” time zone. Corresponding control information is wirelessly transmitted to the television receiver 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to the “morning” time zone plays a television broadcast program (for example, a “news” program) that matches the state of the user in the “morning” time zone. Further, the illuminator 2 at this time is, for example, “turned off” in accordance with the “morning” time zone. Similarly, the audio device 4 turns off the power, for example, in accordance with the “morning” time zone.

  Similarly, when the mobile phone terminal 1 determines that the state around the user is “daytime” or “night”, the mobile phone terminal 1 receives control information corresponding to these “daytime” and “night” as a television image. Wirelessly transmitted to the machine 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to “daytime”, for example, plays “daytime drama”, the illuminator 2 “turns off”, and the audio device 4 plays music and the like at “high volume”. The television receiver 2 that has received the user status information indicating “night”, for example, plays a “sports” program, the illuminator 2 “lights”, and the audio device 4 plays music and the like at “volume low”.

  In addition, when the mobile phone terminal 1 determines that the state around the user is “rain” or “visitor”, the mobile phone terminal 1 performs control corresponding to the user's own state of “rain” or “visitor”. Information is wirelessly transmitted to the television receiver 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received control information corresponding to “rain” sends, for example, “weather forecast”, the illuminator 2 is “lighted”, and the audio device 4 is “no change”. The television receiver 2 that has received the user status information indicating “visitor” turns off the power, for example, the illuminator 2 lights “bright”, and the audio device 4 turns off the power.

  As described above, according to the system of the example of FIG. 6, each electronic device performs a predetermined operation, so that the environment around the user can be set to an environment that matches the user's state. . That is, according to the system of the present embodiment, when the state around the user is “morning”, “daytime”, “night”, etc., the state around these users such as “morning”, “daytime”, “night”, etc. The television receiver 2, the illuminator 3, and the audio device 4 are automatically adjusted in order to realize an environment adapted to the above.

[Specific control example of electronic device corresponding to the internal state of the terminal]
FIG. 7 shows an example of a map showing the correspondence between the current state inside the terminal and the control content of each electronic device.

  In FIG. 7, when the mobile phone terminal 1 determines that the state inside the terminal is “calling” at home, the mobile phone terminal 1 controls the control information corresponding to the state inside the terminal that is “calling”. Is wirelessly transmitted to the television receiver 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to the “call” sets, for example, “low volume”. At this time, the illuminator 2 is set to “normal” brightness, and the audio device 4 is set to “low volume”. Similarly, when the mobile phone terminal 1 determines that the internal state is “mail” or “camera” in use, the mobile phone terminal 1 sends control information corresponding to the “mail” or “camera” to the TV. Wirelessly transmitted to the John receiver 2, the illuminator 3, and the audio device 4. The television receiver 2 that has received the control information corresponding to “mail” maintains the current state as “no change”, for example, the illuminator 2 has a “normal” brightness, and the audio device 4 maintains the current state as “no change”. . The television receiver 2 that has received control information corresponding to “camera” maintains the current state as “no change”, for example, the illuminator 2 is set “bright”, and the audio device 4 maintains the current state as “no change”. .

  As described above, according to the system of the example of FIG. 7, the environment around the user can be changed to the environment desired by the user by causing each electronic device to perform a predetermined operation. That is, according to the system of the present embodiment, when the state inside the terminal is “call”, “mail”, “camera”, etc., the state inside these terminals is “morning”, “daytime”, “night”, etc. In order to realize an environment according to the state, the television receiver 2, the illuminator 3, and the audio device 4 are automatically operated.

[Summary]
As described above, according to the system of the embodiment of the present invention, each surrounding electronic device performs a predetermined operation based on the detection result of the user's own state, the user's surrounding state, the state inside the terminal, and the like. The environment surrounding the user can be changed to an environment desired by the user without the user himself / herself operating each electronic device.

  In the above-described example, each electronic device is controlled according to a correspondence table or map stored in advance in the data holding unit 33 of each electronic device or the data holding unit 16 of the mobile phone terminal 1. The user's own state, the state around the user, and the state inside the terminal can be associated with the control content of the electronic device, and the user can change the setting according to his / her preference. It is also possible to acquire the association information from other terminal devices or electronic devices using means or the like.

  Furthermore, the correspondence between each state and the control content can be changed as appropriate by feedback from the user or feedback from the electronic device, for example, and each state and control content can be prioritized by user settings. Is also possible. Further, the correspondence between each state and the control content of each electronic device may be one-to-one correspondence, or each state and the control content may be combined.

  Moreover, the transmission frequency of the control information from the mobile phone terminal 1 to the electronic device, the control content, the setting of which electronic device is controlled, and the like may be arbitrarily changed by the user. The transmission frequency of the control information can be set for each electronic device. In particular, when the transmission frequency is increased, the criterion for determining the transmission timing in step S5 in FIG. The transmission frequency may be set for each control content.

  In addition, the state of the user may be, for example, a state such as “I am tired but have fun”. Further, when determining the user's state, for example, by analyzing a word of an application being executed or an e-mail, it may be determined such as “working” or “relaxed”.

  Finally, the description of the above-described embodiment is an example of the present invention. For this reason, the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made according to the design or the like as long as the technical idea according to the present invention is not deviated.

  This embodiment is applicable not only to a mobile phone terminal but also to various portable electronic devices such as a PDA.

  In this embodiment, an example is given in which each electronic device performs a predetermined operation based on control information from the mobile phone terminal. However, the mobile phone terminal performs a predetermined operation based on control information from each electronic device. Or another electronic device may perform a predetermined operation based on control information from a certain electronic device.

It is a figure showing the schematic structure of the electronic equipment control system used as one embodiment to which the present invention is applied. It is a block diagram which shows the internal schematic structure of the mobile telephone terminal of this invention embodiment. It is a block diagram which shows the internal schematic structure of the electronic device of this embodiment. It is a flowchart of the process in a control part until the mobile telephone terminal of this invention produces | generates and transmits the control information for controlling an electronic device. It is a figure which shows an example of the map which shows a response | compatibility with the present user's own state, and the control content of each electronic device. It is a figure which shows an example of the map which shows a response | compatibility with the present user surrounding state, and the control content of each electronic device. It is a figure which shows an example of the map which shows a response | compatibility with the state inside the present terminal, and the control content of each electronic device.

Explanation of symbols

1 mobile phone terminal, 2 television receiver, 3 illuminator, 4 audio device, 4 speaker, 5 microphone, 6 antenna, 7 camera, 11, 31 control unit, 12 communication circuit, 13 display unit, 14 operation unit, 15 , 32 Memory, 16, 33 Data holding unit, 17 Speaker drive circuit, 18 Microphone input signal generation unit, 19, 36 Short range communication circuit, 20 Sensor detection signal generation unit, 21 Camera drive circuit, 22 GPS reception circuit, 23, 37 timer, 25 sensors, 34 basic functional parts, 35 interface

Claims (6)

A communication unit for communicating with other electronic devices that perform a predetermined operation in response to control information sent from the electronic device control device;
A schedule information holding unit for holding user schedule information, a time measuring unit for measuring time, and a schedule detecting unit for detecting schedule information from the schedule information holding unit according to the time measured by the time measuring unit; A camera unit that captures an image , and the physical and mental state of the user is determined based on the schedule information detected by the schedule detection unit and the shooting data of the user's clothing captured by the camera unit. , A state detection unit that uses the user state information as information representing the physical and mental state of the user,
An information generating unit that generates control information for controlling the other electronic device so as to perform an operation corresponding to the user state information obtained by the state detecting unit;
An electronic device control apparatus comprising: a transmission control unit that transmits control information generated by the information generation unit from the communication unit to another electronic device. The state detection unit includes a body state parameter detection unit that detects a user's body state parameter that varies due to a user's physical and psychological state, and the detected body state parameter is also detected by the user's physical state parameter. And used to determine mental state ,
The electronic device control device according to claim 1, wherein the information generation unit generates the control information based on the user state information obtained by determination using the body state parameter detected by the body state parameter detection unit. The state detection unit is measured by the position detection unit that detects the position of the electronic device control device, the time detection unit that measures time, the position information detected by the position detection unit, and the time detection unit. A movement detection unit that obtains the movement distance and movement time of the user based on the time, and information on the movement distance and movement time of the user detected by the movement detection unit is also the physical and mental state of the user Used to determine
2. The electronic device according to claim 1, wherein the information generation unit generates the control information based on the user state information obtained by determination using information on a movement distance and a movement time of the user detected by the movement detection unit. Equipment control device. The state detection unit includes a body state parameter detection unit that detects a user's body state parameter that varies due to a user's physical and psychological state, a time detection unit that measures time, and a user's movement distance and movement the movement detection section for obtaining a time has further at least one or more detection portion, also used to determine physical and mental state of the user information of one or more of the detecting block the detects,
2. The electronic device according to claim 1, wherein the information generation unit generates the control information based on the user state information obtained by determination using the information detected by the one or more detection units of the state detection unit. Equipment control device. The state detection unit includes a detection unit that detects at least one of the current position, current time, ambient image, and ambient environmental sound of the electronic device control device as a user ambient state, and the user surroundings detected by the detection unit And the information indicating the operating state inside the electronic device control apparatus are included in the user status information,
The information generation unit, the electronic equipment control apparatus according to claim 1, wherein generating the control information based on inclusive the user presence status information indicating the operating state of the internal state and the electronic equipment control system surrounding the user. An electronic device that performs a predetermined operation in response to control information sent from the electronic device control device;
A communication unit for communicating with the electronic device, and schedule information detected by the schedule detection unit according to the time measured by the time detection unit from the user's schedule information held in the schedule information holding unit ; A state detection unit that determines the physical and mental state of the user based on the shooting data obtained by the camera unit shooting the user's clothes and uses the information indicating the physical and mental state of the user as user state information And an information generation unit that generates control information for controlling the electronic device so as to perform an operation corresponding to the user state information detected by the state detection unit, and the information generation unit An electronic device control system comprising: an electronic device control device having a transmission control unit that transmits control information from the communication unit to the electronic device.

Images