JP2008310680A - Control system, program, and information storage medium - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a control system and the like, which are suitable to an integrated system comprising a plurality of subsystems. <P>SOLUTION: A control system 25 includes: a history information storage section 262 for storing user history information which is history information obtained by at least one sensor among an action sensor for measuring user action, a state sensor for measuring the user state, and an environment sensor for measuring the user environment, and which is history information about at least one of the action, the state, and the environment of the user; an event determination section 250 for determining occurrence of a usable event showing that the user having used a first subsystem newly becomes capable of using a second subsystem; and a history information update section 248 for further updating the user history information having been updated on the basis of sensing information from a first sensor as a sensor of the first subsystem on the basis of sensing information from a second sensor as a sensor of the second subsystem on the occurrence of the usable event. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to a control system, a program, and an information storage medium.

  As a conventional information providing system, for example, Patent Document 1 discloses a system that can flexibly guide not only information on points and facilities, but also a route or a halfway point to a place that the user wants to guide. ing.

  However, the system disclosed in Patent Document 1 has a problem that it is impossible to provide information as so-called push information, in which information required by the user is provided without the user performing an intentional acquisition act.

  As a solution to such a problem, an information providing system disclosed in Patent Document 2 is known. In this system, it is possible to provide information as push information by identifying a user's activity state by a wearable sensor and displaying information according to the activity state.

However, although this patent document 2 discloses an information providing system effective in a mobile environment, it does not disclose a control system suitable for an integrated system of a plurality of subsystems.
Japanese Patent Laid-Open No. 2000-215211 JP 2006-293535 A

  The present invention has been made in view of the above problems, and an object of the present invention is to provide a control system, a program, and an information storage medium suitable for an integrated system of a plurality of subsystems.

  The present invention is a control system for an integrated system of a plurality of subsystems, each of which has at least a sensor, a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and a user's History information storage means for storing user history information, which is history information obtained by at least one sensor of the environment sensor for measuring the environment, and is history information on at least one of the user's behavior, state, and environment; Event determining means for determining occurrence of an available event indicating that a user who has used one subsystem has newly entered a state where the second subsystem can be used, and the available event is generated In this case, the information is updated based on sensor information from the first sensor that is a sensor of the first subsystem. The chromatography The history information, based on the sensor information from the second sensor is a sensor of the second sub-system is further related to a control system comprising a history information updating means for updating. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  According to the present invention, history information about at least one of a user's behavior, state, and environment obtained from sensor information from at least one of a behavior sensor, a state sensor, and an environment sensor is history information as user history information. Stored in the storage means. When an available event of the second subsystem occurs, the user history information is updated based on the sensor information from the second sensor of the second subsystem. In this way, the user history information updated in the first subsystem can be continuously updated based on the sensor information from the second sensor of the second subsystem, and a plurality of subsystems can be updated. A control system suitable for an integrated system can be provided.

  In the present invention, the first history information storage means that is the history information storage means of the first subsystem and the second history information storage means that is the history information storage means of the second subsystem. Thus, information transfer means for transferring user history information may be included. In this way, the user history information stored in the first history information storage means can be transferred to the second history information storage means, and the user history information can be updated continuously and continuously.

  In the present invention, the information transfer means converts the user history information stored in the first history information storage means and the user history information stored in the second history information storage means into the same content information. The information synchronization process to maintain may be performed. In this way, the user history information can be maintained at the same content even when the subsystem is switched.

  Also, in the present invention, the history information update means, for the user history information transferred from the first history information storage means to the second history information storage means when the available event occurs, Update processing based on sensor information from the second sensor of the second subsystem may be performed. In this way, it is possible to seamlessly update the user history information based on the sensor information from the second sensor.

  The present invention further includes control processing means for starting a control operation of a second control target device that is a control target device of the second subsystem when the available event occurs, wherein the control processing means The control operation of the second device to be controlled using the user history information stored in the second history information storage unit may be started. In this way, it is possible to realize the control operation of the second device to be controlled that reflects the user history information updated in the first subsystem.

  In the present invention, the information transfer means transfers user history information from the first history information storage means to the second history information storage means in advance before the available event occurs. The control processing unit starts the control operation of the second control target device using the user history information previously transferred to the second history information storage unit when the available event occurs. May be. In this way, when an available event occurs, the control operation of the second device to be controlled based on the user history information can be started immediately, and the control can be made efficient.

  In the present invention, the event determination means provided in the local server of the second subsystem determines that the available event has occurred when a user approaches the location of the second subsystem. May be. In this way, an event determination process or the like with a heavy processing load can be assigned to a local server with a high processing capacity, so that the processing load on the device of the first subsystem can be reduced.

  In the present invention, the event determination means determines the occurrence of the available event by detecting a radio strength of communication performed between the first subsystem and the second subsystem. Also good. In this way, the radio necessary for information transfer can also be used for the determination process of available events.

  In the present invention, the event determination means determines that the available event has occurred when a device of the first subsystem is connected to a cradle that can be used in the second subsystem. May be.

  According to the present invention, there is provided control processing means for starting a control operation using user history information of a second control target device that is a control target device of the second subsystem when the available event occurs. May be included.

  The present invention is also a control system for an integrated system of a plurality of subsystems, each of which has at least a sensor, a behavior sensor for measuring user behavior, a state sensor for measuring user status, and a user History information storage means for storing user history information, which is history information obtained by at least one of environmental sensors that measure the environment of the user, and is history information about at least one of a user's behavior, state, and environment; A user whose user history information is updated by sensor information from the first sensor that is the sensor of the first subsystem using the first subsystem can newly use the second subsystem. Event determining means for determining the occurrence of an available event indicating that a state has been reached; and Case, relate to the control system including a said a control target device of the second subsystem of the second control target device, control processing means for starting the control operation using the user history information. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  According to the present invention, history information obtained from sensor information from at least one of a behavior sensor, a state sensor, and an environment sensor is stored in the history information storage unit as user history information. When an available event of the second subsystem occurs, the control operation of the second device to be controlled using the user history information is started. In this way, the control operation of the second device to be controlled reflecting the user history information updated in the first subsystem can be realized, and a control system suitable for an integrated system of a plurality of subsystems can be provided. .

  In the present invention, the control processing means turns on the power of the second control target device when the available event occurs, or sets the second control target device from the low power consumption mode to the normal power consumption mode. Control to return to the operation mode may be performed. In this way, the power of the second control target device can be turned off or set to the low power consumption mode until an available event occurs, so that power consumption can be reduced.

  In the present invention, the control processing unit turns off the power of the second control target device when an unusable event occurs in which the user cannot use the second control target device. Control for shifting the second control target device from the normal operation mode to the low power consumption mode may be performed. In this way, after the unusable event occurs, the power of the second device to be controlled can be turned off or set to the low power consumption mode, so that the power consumption can be reduced.

  In the present invention, the first history information storage means that is the history information storage means of the first subsystem and the second history information storage means that is the history information storage means of the second subsystem. The event determination means determines the approach state of the user with respect to the location of the second subsystem, and the information transfer means determines that the approach state is the first information transfer means for transferring the user history information. The user history information stored in the first history information storage means when the second approach state having a higher degree of approach than the first approach state becomes the second history information. When the control processing means transfers from the second approach state to the third approach state having a higher degree of approach than the second approach state, the control processing means transfers the information to the information storage means. Using user history information It may initiate the control operation of the second control target device. In this way, when the first approach state is changed to the second approach state, the user history information is transferred to the second subsystem side, and the second approach state is changed to the third approach state. In this case, the control operation of the second device to be controlled can be started, and the information transfer and the start of the control operation can be executed seamlessly.

  In the present invention, the information transfer means includes the user history information and the second history information stored in the first history information storage means during a period in which the user approach state is the second approach state. You may perform the information synchronous process which maintains the user history information memorize | stored in a memory | storage means to the information of the same content.

  In the present invention, the control processing unit may be configured to control the second control target device using user history information when the user approach state changes from the second approach state to the first approach state. The control operation may be stopped. In this way, when the user leaves, the operation of the second control target device can be stopped, and power consumption can be reduced.

  In the present invention, the event determination unit may determine the first, second, and third approach states by using at least two types of wireless communication that have different reception states depending on distances. In this way, the transfer process of user history information and the start process of the control operation of the second device to be controlled are efficiently realized using at least two types of wireless communication having different reception states according to the distance. it can.

  The present invention is also a control system for an integrated system of a plurality of subsystems having a mobile subsystem and a home subsystem, the behavior sensor for measuring user behavior, the state sensor for measuring user status, and the user History information storage means for storing user history information which is history information obtained by at least one of environmental sensors for measuring the environment and which is history information about at least one of the user's behavior, state and environment; When a user who has used a mobile subsystem determines the occurrence of an available event indicating that the home subsystem is ready for use, and when the available event occurs, The user history updated based on the sensor information from the sensor of the mobile subsystem. Information, based on the sensor information from the sensor of the home subsystem, related to a control system comprising a history information updating means for further updating. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  In the present invention, the event determination unit and the history information update unit may be provided in a home server that is a local server of the home subsystem. In this way, control reflecting the latest user history information can be performed even if the subsystem is switched.

  The present invention also provides a control system for an integrated system of a plurality of subsystems having at least one of a mobile subsystem and a home subsystem and an in-vehicle subsystem, a behavior sensor for measuring user behavior, and a user status History information obtained by at least one of a state sensor that measures the user's environment and an environment sensor that measures the user's environment, and stores user history information that is history information on at least one of the user's behavior, state, and environment A history information storage means that determines whether or not a user who has used the mobile subsystem or the home subsystem has newly become available for use of the in-vehicle subsystem An event determination means, and when the available event occurs, the mobile Control including user history information updated based on sensor information from the sensor of the subsystem or the home subsystem, and history information update means for further updating the user history information based on the sensor information from the sensor of the in-vehicle subsystem. Related to the system. The present invention also relates to a program that causes a computer to function as each of the above-described means, or a computer-readable information storage medium that stores the program.

  The present invention may further include a control processing unit that starts a control operation of a control target device of the in-vehicle subsystem using user history information when the available event occurs. In this way, the control operation of the control target device (for example, navigation device) of the in-vehicle subsystem reflecting the user history information updated in the mobile subsystem or the home subsystem can be realized.

  In the present invention, the history information update unit may update user history information based on operation information of the control target device or sensor information from sensors in the in-vehicle subsystem. In this way, the user history information can be seamlessly updated using these pieces of information, and more appropriate and accurate user history information can be obtained.

  Hereinafter, this embodiment will be described. In addition, this embodiment demonstrated below does not unduly limit the content of this invention described in the claim. In addition, all the configurations described in the present embodiment are not necessarily essential configuration requirements of the present invention.

1. Integrated System The integrated system of this embodiment is demonstrated using FIG. As shown in FIG. 1, the integrated system includes a plurality of subsystems such as a mobile subsystem, a home subsystem, or an in-vehicle subsystem. In addition, the subsystem of this embodiment is not limited to these, For example, various subsystems which have a sensor and a control object apparatus, such as a subsystem in a company, a subsystem in a shop, and a subsystem of vehicles (trains, airplanes) other than a car Can think.

  As shown in FIG. 1, a user (user) has a portable electronic device 20 (mobile gateway). Further, a wearable display 93 (mobile display) is mounted as a mobile control target device in the vicinity of one eye of the head. Furthermore, various sensors are worn on the body as wearable sensors (mobile sensors). Specifically, indoor / outdoor sensor 510, ambient temperature sensor 511, ambient humidity sensor 512, ambient light intensity sensor 513, arm-mounted motion measurement sensor 520, pulse (heart rate) sensor 521, body temperature sensor 522, peripheral skin temperature sensor 523, sweat sensor 524, foot pressure sensor 530, speech / mastication sensor 540, GPS (Global Position System) sensor 550 provided in portable electronic device 20, facial color sensor 560 provided in wearable display 500, pupil size sensor 561 Etc. are attached. The mobile electronic device 20, the mobile control target device, and the wearable sensor constitute a mobile subsystem (first subsystem in a broad sense).

  The portable electronic device 20 (mobile computer) is a portable information terminal such as a PDA (Personal Digital Assistant), a notebook PC, and the like, for example, a processor (CPU), a memory, an operation panel, a communication device, or a display (sub-display). Is provided. The portable electronic device 20 has, for example, a function of collecting sensor information from sensors, a function of performing calculation processing based on the collected sensor information, and control (display control) of a control target device (such as a wearable display) based on the calculation result. Etc.), a function of retrieving information from an external database, a function of communicating with the outside, and the like. Note that the portable electronic device 20 may be a device that is also used as a mobile phone, a wristwatch, or a portable audio device.

  The wearable display 93 is mounted in the vicinity of one of the user's eyes, and the size of the display unit is set to be smaller than the size of the pupil, and functions as an information display unit of a so-called see-through viewer. Information presentation to the user may be performed using headphones, a vibrator, or the like. In addition to the wearable display 93, various devices such as a wristwatch, a mobile phone, or a portable audio can be assumed as the mobile control target device.

  The indoor / outdoor sensor 510 is a sensor that detects whether the user is indoors or outdoors. For example, the user irradiates ultrasonic waves and measures the time until the ultrasonic waves are reflected back from the ceiling or the like. However, the indoor / outdoor sensor 510 is not limited to the ultrasonic method, and may be an active light method, passive ultraviolet method, passive infrared method, or passive noise method sensor.

  The ambient temperature sensor 511 measures the ambient temperature using, for example, a thermistor, a radiation thermometer, a thermocouple, or the like. The ambient humidity sensor 512 measures the ambient humidity using, for example, the change in electrical resistance due to humidity. The ambient light intensity sensor 513 measures the ambient light intensity using, for example, a photoelectric element.

  The arm-mounted motion measurement sensor 520 measures the movement of the user's arm with an acceleration sensor or an angular acceleration sensor. By using the motion measurement sensor 520 and the foot pressure sensor 530, it is possible to more accurately measure the user's daily motion and walking state. A pulse (heart rate) sensor 521 is attached to a finger or an ear, and measures changes in blood flow due to pulsation by changes in infrared light transmittance and reflectance. The body temperature sensor 522 and the peripheral skin temperature sensor 523 measure the user's body temperature and peripheral skin temperature using a thermistor, a radiation thermometer, a thermocouple, and the like. The perspiration sensor 524 measures the perspiration of the skin based on, for example, a change in the surface resistance of the skin. The foot pressure sensor 530 detects the pressure distribution of the sole on the shoe, and measures and determines the user's standing state, sitting state, walking state, and the like.

  The utterance / mastication sensor 540 is an earphone-type sensor for measuring the possibility that the user is speaking (conversation) or mastication (meal), and a bone conduction microphone is included in the body. Built-in external sound microphone. The bone conduction microphone detects a body sound which is a vibration generated from the body during speech and mastication and propagating through the body. The external sound microphone detects sound that is vibration that is conducted outside the body in response to an utterance and external sound including environmental noise. Then, by comparing the power of the sound captured by the bone conduction microphone and the external sound microphone in unit time, etc., the utterance possibility and mastication possibility are measured.

  The GPS sensor 550 is a sensor that detects the position of the user. A location information service of a mobile phone may be used instead of the GPS sensor 550. The face color sensor 560, for example, arranges an optical sensor near the face, and measures the face color by comparing the light intensity after passing through a plurality of optical bandpass filters. The pupil size sensor 561, for example, places a camera near the pupil and analyzes the camera signal to measure the size of the pupil.

  The home subsystem is a home control target device, for example, a home display such as a TV monitor or a PC monitor, a home AV device such as an audio device or an optical disk player, a robot such as a dog, cat, or humanoid, or a room temperature. It has an air conditioner that adjusts the lighting and lighting that adjusts the brightness. In addition to this, as home control target devices, various devices such as home appliances such as game machines, vacuum cleaners, rice cookers, refrigerators, microwave ovens, and security devices can be assumed.

  In addition, the home subsystem is a home sensor, for example, an environmental sensor that measures the temperature, humidity, light intensity, noise, user conversation, meal, etc. in the home, a robot-mounted sensor built into the robot, And a human detection sensor installed in a door, a urine test sensor installed in a toilet, and the like. In addition to this, various sensors such as a security sensor (security sensor, heat / smoke / gas sensor, etc.), an earthquake sensor, a power consumption measurement sensor, a pollen sensor, and the like can be assumed as the home sensor. These home control target devices and home sensors constitute a home subsystem (second subsystem in a broad sense).

  The in-vehicle subsystem includes car navigation systems (navigation devices) that provide road guidance, car AV equipment such as audio equipment and optical disk players, and air conditioners that adjust the temperature inside the car as in-vehicle control target equipment. Other in-vehicle control devices include safety devices such as airbags, seat adjustment devices, car door locking / unlocking devices using smart entry systems, communication devices, in-vehicle devices, etc. Various devices such as a computer can be assumed.

  The in-vehicle subsystem is also used as an in-vehicle sensor such as a driving state sensor that measures the speed of a vehicle, a moving distance, an operation state sensor that measures a user's driving operation and device operation, an in-vehicle temperature, humidity, luminous intensity, It has an environmental sensor that measures conversation and the like. In addition to this, various sensors such as a crime prevention sensor, a human detection sensor, and a pollen sensor can be assumed as the in-vehicle sensor. An in-vehicle subsystem (third subsystem in a broad sense) is configured by these in-vehicle control target devices and in-vehicle sensors.

  In the integrated system of FIG. 1, when the user is outdoors (in a mobile environment), sensor information (including sensor secondary information) is acquired (collected) from the wearable sensor (mobile sensor) of the mobile subsystem. The user history information is updated based on the acquired sensor information. The mobile control target device is controlled based on user history information and the like. The user history information is history information (log information) about at least one of the user's behavior, state, and environment.

  On the other hand, when the user is at home (in a home environment), sensor information from the home sensor of the home subsystem is acquired, and the user history information is updated based on the acquired sensor information. That is, the user history information updated in the mobile environment is seamlessly updated even when the user environment information is shifted to the home environment. The home control target device is controlled based on the user history information and the like.

  Further, when the user is in the vehicle (in the case of an in-vehicle environment), sensor information from the in-vehicle sensor of the in-vehicle subsystem is acquired, and the user history information is updated based on the acquired sensor information. That is, the user history information updated in the mobile environment or the home environment is seamlessly updated even when the user history information is transferred to the in-vehicle environment. Further, the in-vehicle control target device is controlled based on the user history information and the like.

  For example, when a user arrives at home or moves into a vehicle, the user is likely to remove a wearable sensor (such as an indoor / outdoor sensor) or a mobile control target device (such as a wearable display). Even in such a case, according to the integrated system of FIG. 1, sensor information can be acquired using a home sensor or an in-vehicle sensor instead of a wearable sensor, so that seamless user history information can be updated. For example, for meals when going out and meals at home, it is possible to keep a history of meal times, meal times, etc., and cumulative calculation of energy consumption and stress based on internal and external behavioral status and heart rate status Processing is also possible.

  In addition, instead of the mobile control target device, the home control target device and the in-vehicle control target device can be controlled, and the convenience for the user can be improved. For example, information based on user history information, etc. is displayed on a home display or car navigation display with a large display area, not a wearable display with a small display area, or control target devices (for example, air conditioners, lighting, car navigation systems, etc.) that could not be controlled in a mobile environment. Etc.) can be controlled, and convenience can be improved.

2. Control System FIG. 2 shows a configuration example of the control system 25 of the present embodiment suitable for the integrated system of FIG. The control system 25 is not limited to the configuration shown in FIG. 2, and various modifications such as omitting some of the components (for example, an information acquisition unit and an information storage medium) and adding other components. Implementation is possible.

  The information acquisition unit 230 acquires sensor information from a plurality of sensors in a plurality of subsystems. For example, the wearable sensor 12 (first sensor in a broad sense) of a mobile subsystem, the home sensor 14 (second sensor in a broad sense) of the home subsystem, and the in-vehicle sensor 16 (third sensor in a broad sense) of the in-vehicle subsystem. ) To obtain sensor information. Specifically, a behavior sensor that measures a user's behavior (walking, conversation, meal, movement of limbs, emotional expression, sleep, etc.) and a user's state (fatigue, tension, hunger, mental state, physical state, or user) Sensor information is acquired from a state sensor that measures an event that has occurred) or an environment sensor that measures a user's environment (location, brightness, temperature, humidity, etc.).

  The sensor may be the sensor device itself, or may be a sensor device including a control unit, a communication unit, and the like in addition to the sensor device. The sensor information may be sensor primary information obtained directly from the sensor, or sensor secondary information obtained by processing (information processing) the sensor primary information.

  The information acquisition unit 230 can be realized by the communication unit 232, the sensor I / F (interface) unit 234, and the like, for example. For example, the communication unit 232 is used when sensor information is acquired (received) from a sensor by short-range wireless or wireless LAN such as infrared rays or Bluetooth (Bluetooth is a registered trademark). On the other hand, the sensor I / F unit 234 is used when sensor information is acquired from a sensor by a wired electrical signal such as USB, IEEE 1394, or card I / F.

  The processing unit 240 performs various processes necessary for the operation of the control system 25 based on the sensor information acquired by the information acquisition unit 230. The function of the processing unit 240 can be realized by hardware such as various processors (CPU and the like) and ASIC (gate array and the like), a program stored in the information storage medium 284, and the like.

  The processing unit 240 can include a history information update unit 248 and an event determination unit 250. Note that some of these components may be omitted, or other components may be added.

  The history information update unit 248 performs history information update processing. Specifically, when a second subsystem available event (sensor available event, control target device available event) occurs, the second subsystem sensor from the second sensor Based on the sensor information, the user history information is updated. That is, the user history information is updated based on the sensor information acquired by the information acquisition unit 230. For example, a user (using the first subsystem) whose user history information has been updated with sensor information from a first sensor (eg, wearable sensor) that is a sensor of the first subsystem (eg, mobile subsystem) A user who has been updated in the first subsystem when the second subsystem (for example, the home subsystem) is newly available (when the user has moved to the environment of the second subsystem) The history information is further updated based on sensor information from the second sensor of the second subsystem. The updated user history information is stored in the history information storage unit 262.

  In this case, in order to save the memory capacity of the history information storage unit 262, when storing new history information, the old history information is deleted, and the new history information is stored in the storage area freed by the deletion. May be. Or when giving priority (weighting coefficient) to each history information and memorizing new history information, history information with low priority may be deleted. In this case, the priority setting for each piece of history information is determined based on whether or not the user history information is updated based on the history information, and whether or not the control target device is controlled based on the history information. May be. That is, a high priority is set for the history information used for updating the user history information and controlling the control target device. In this way, it is possible to leave only history information effective for updating based on sensor information and control of the control target device in the history information storage unit 262 while saving memory capacity. Of course, history information may be updated (overwritten) by calculating already stored history information and new history information.

  The event determination unit 250 performs various event determination processes. Specifically, it is determined whether a user who has used the first subsystem has an available event indicating that the user can newly use the second subsystem. For example, a sensor availability event (sensor accessible event) in which a user whose user history information is updated by sensor information from a sensor of the first subsystem can use a second sensor that is a sensor of the second subsystem. Occurrence of sensor information acquisition event). Alternatively, the occurrence of a device available event (device accessible event, device controllable event) that makes the second control target device that is the control target device of the second subsystem available is determined. Alternatively, it is determined whether an unusable event that disables the use of the second subsystem (second sensor, second control target device) occurs. For example, the event determination unit 250 can determine that an available event has occurred when the user approaches (moves) the location of the second subsystem. Alternatively, when information transfer is performed wirelessly, occurrence of an available event can be determined by detecting wireless strength. Alternatively, it can be used when a device of the first subsystem (for example, a portable electronic device) is connected to a cradle that can be used by the second subsystem (a cradle installed at the location of the second subsystem). It can be determined that an event has occurred.

  Then, when an available event occurs, the history information update unit 248 acquires sensor information from the second sensor of the second subsystem, and updates the user history information based on the acquired sensor information.

  The storage unit 260 serves as a work area for the processing unit 240, the information acquisition unit 230, and the like, and its functions can be realized by a memory such as a RAM or an HDD (hard disk drive). The history information storage unit 262 included in the storage unit 260 is history information obtained by at least one of a behavior sensor that measures the user's behavior, a state sensor that measures the user's state, and an environment sensor that measures the user's environment. Thus, user history information that is history information on at least one of the user's behavior, state, and environment is stored.

  An information storage medium (computer-readable medium) 284 stores programs, data, and the like, and its function can be realized by an optical disk (CD, DVD) or the like. The processing unit 240 performs various processes of the present embodiment based on a program (data) stored in the information storage medium 284. That is, in the information storage medium 284, a program for causing a computer (an apparatus including an operation unit, a processing unit, a storage unit, and an output unit) to function as each unit of the present embodiment (a program for causing the computer to execute processing of each unit). Is memorized.

  FIG. 3 shows a detailed configuration example of the control system 25 of the present embodiment. The control system 25 is not limited to the configuration shown in FIG. 3, and various modifications can be made.

  In FIG. 3, the processing unit 240 includes a sensor selection unit 242, a control target device selection unit 244, a calculation unit 246, and a control processing unit 252 in addition to the history information update unit 248 and the event determination unit 250. Note that some of these components may be omitted, or other components may be added.

  The sensor selection unit 242 performs sensor selection processing. Specifically, a sensor that can be used (accessed and information can be acquired) in a subsystem that is being used by the user (subsystem in which the user is located) is selected from a plurality of sensors in a plurality of subsystems. For example, when the user moves to the home subsystem (second subsystem), the home sensor 14 (second sensor, second sensor group) that can be used in the home subsystem is selected. When the user moves to the location of the in-vehicle subsystem (third subsystem), the in-vehicle sensor 16 (third sensor, third sensor group) that can be used in the in-vehicle subsystem is selected.

  More specifically, the sensor selection unit 242 includes time information (year, month, week, day, time, etc.), user location information (position, affiliation area, distance, etc.) and user status information (mental / physical state, An available sensor may be selected from a plurality of sensors based on TPO (Time Place Occasion) information that is at least one of events generated for the user. That is, even in the same subsystem, different sensors are selected according to the TPO information.

  The TPO information may be acquired based on sensor information from the sensor, or may be acquired based on schedule data (schedule information), download data from the Internet, or the like. The sensor selection may be direct (active) or indirect (passive). For example, instead of directly selecting the sensor itself, the sensor may be selected indirectly by selecting obtained sensor information. For example, when sensor information is communicated wirelessly, available sensor information may be selected based on tag information added to each sensor information, thereby indirectly selecting a sensor.

  For example, indoor navigation uses inertial navigation using an acceleration sensor instead of a GPS sensor for position detection. Therefore, when it is detected based on sensor information that the user has entered the room (for example, position information from the GPS sensor cannot be obtained correctly, or information indicating that the user is indoors is obtained by the indoor / outdoor sensor) Time), the sensor information from the acceleration sensor is selected and the position is calculated without selecting the sensor information from the GPS sensor. At this time, by stopping the GPS sensor, it is possible to save power, reduce wireless traffic, and reduce the load of sensor information processing.

  The control target device selection unit 244 performs control target device selection processing. Specifically, a control target device to be controlled using user history information is selected from a plurality of control target devices of a plurality of subsystems. In other words, a control target device that can be used (accessed and controlled) in a subsystem that is being used by the user (subsystem where the user is located) among a plurality of control target devices of a plurality of subsystems. Select. For example, when the user moves to the home subsystem (second subsystem), the home control target device 94 (second control target device in a broad sense) that can be used in the home subsystem is selected. When the user moves to the location of the in-vehicle subsystem (third subsystem), the in-vehicle control target device 96 (third control target device in a broad sense) that can be used in the in-vehicle subsystem is selected.

  Then, the control target device selection unit 244 selects the second control target device of the second subsystem when an available event occurs. Even when an available event occurs, if it is not necessary to select a control target device, the control target device may not be selected. That is, not only whether or not it is available but also whether or not selection is necessary is determined.

  More specifically, the control target device selection unit 244 may select a control target device that can be used from a plurality of control target devices based on the TPO information. That is, even in the same subsystem, different control target devices are selected according to the TPO information.

  The selection of the control target device may be direct (active) or indirect (passive). For example, instead of directly selecting the control target device itself, the control target device may be selected indirectly by outputting information (data, signal) necessary for the control target device.

  For example, during bathing, lighting / AV equipment control and air conditioning control in the living room are not necessary, and control of hot water temperature and bus TV (TV) is effective for the user. To do. In this case, it is possible to distribute video to the bus TV from the home server, or it is also possible to transmit only channel information that broadcasts a favorite program.

The calculation unit 246 performs various calculation processes for filtering processing (selection processing) and analysis processing of the sensor information acquired by the information acquisition unit 230. Specifically, the calculation unit 246 performs a multiplication process or an addition process of sensor information. For example, as shown in the following formula (1), digitized measurement values X _j of a plurality of sensor information from a plurality of sensors and respective coefficients are stored in a coefficient storage unit (not shown), and a two-dimensional matrix ( A product-sum operation with a coefficient A _ij represented by a matrix) is performed. Then, as shown in the following equation (2), the result of the product-sum operation is calculated as an n-dimensional vector Y _i using multidimensional coordinates. Note that i is the i coordinate in the n-dimensional space, and j is a number assigned to each sensor.

  Filtering processing that removes unnecessary sensor information from the acquired sensor information, and user behavior, state, and environment (TPO information) by performing arithmetic processing such as the above formulas (1) and (2) Analysis processing for identifying based on information can be realized. For example, if the coefficient A multiplied by the measured value X of the pulse (heart rate), the amount of sweat, and the body temperature is set to a value larger than the coefficient for the measured value of other sensor information, the above formulas (1) and (2 The numerical value Y calculated in () represents the “excitability” that is the user's state. In addition, by setting the coefficient multiplied by the measured value X of the utterance amount and the coefficient multiplied by the measured value X of the foot pressure to appropriate values, the user's behavior can sit and talk. You can identify whether you are talking, walking, talking quietly, or sleeping.

  The control processing unit 252 performs various processes for controlling the control target device. For example, when an available event occurs and the second control target device is selected, the control operation of the second control target device using the user history information is started. For example, control of the control target by the control unit of the second control target device is started. In this case, the control operation of the second device to be controlled using the sensor information from the second sensor of the second subsystem and the user history information may be started. Alternatively, when an available event occurs, control (instruction) for turning on the power of the second control target device (returning to the normal operation mode) may be performed. Alternatively, when an unusable event occurs in which the user cannot use the second control target device, the second control target device may be controlled to be turned off (low power consumption mode transition).

  The output information storage unit 264 included in the storage unit 260 stores output information transferred to the control target device by the information transfer unit 270.

  The information transfer unit (information output unit) 270 transfers information to devices to be controlled 92, 94, 96, etc. in the mobile, home, and vehicle, and functions as a communication unit 272 and a device I / F unit 274. It can be realized by. For example, when information (data) is transferred (transmitted) to the control target device by wireless communication or the like, the communication unit 272 is used. On the other hand, when information (control signal) is transferred (output) to a control target device by a wired electric signal, the device I / F unit 274 is used.

  Next, the operation of this embodiment will be described with reference to FIGS. 4 (A) and 4 (B). FIG. 4A is a flowchart regarding updating of user history information. Here, a user who uses the first subsystem (a user whose user information has been updated based on sensor information from the first sensor that is a sensor of the first subsystem) is the second subsystem. A case where the state is shifted to a state where the (second sensor) can be used will be described as an example.

  First, the event determination unit 250 determines whether or not the second subsystem (second sensor) can be used (step S1). For example, when the user moves to the location of the second subsystem, the second subsystem becomes available. When the sensor becomes available, the sensor selection unit 242 selects a sensor (second sensor) that can be used in the second subsystem (step S2). In this case, the sensor may be selected based on the user's TPO information.

  Then, the information acquisition unit 230 acquires sensor information from the selected sensor (step S3). Then, the history information update unit 248 updates the user history information based on the acquired sensor information, and stores the updated user history information in the history information storage unit 262 (step S4). If it is determined in step S1 that the use of the second subsystem is not yet possible, the user history information is updated based on the sensor information from the first sensor that is a sensor of the first subsystem. Will continue.

  FIG. 4B is a flowchart regarding control processing of the control target device. Here, a user who uses the first subsystem (a user who is controlling the first control target, which is the control target device of the first subsystem), is the second subsystem (second The case of shifting to a state in which the control target device) can be used will be described as an example.

  First, the event determination unit 250 determines whether or not the second subsystem (second control target device) can be used (step S11). When the device becomes available, the control target device selection unit 244 selects an available control target device (step S12). In this case, an available control target device may be selected based on the user's TPO information.

  Then, user history information is read from the history information storage unit 262 (step S13). Then, the information transfer unit 270 selects output information to the selected control target device from the output information storage unit 264 based on the read user history information (step S14), and the selected output information is selected as the control target device. To start the control operation of the device to be controlled (step S15). If it is determined in step S11 that the second subsystem cannot be used yet, the control of the control target device (first control target device) of the first subsystem is continued.

  For example, in FIG. 4A, if a sensor corresponding to the user's TPO information is selected, a different sensor can be selected depending on the location, time, and situation. Therefore, the meaning of the sensor information can be made different depending on the location, time, and situation of the sensor information, and more intelligent sensor information acquisition processing can be realized. In addition, the user history information can be appropriately updated by selecting an appropriate sensor according to the place, time, and situation.

  In sensor selection for acquiring sensor information for TPO determination, a sensor effective for TPO determination or a sensor capable of detecting a change in TPO may be selected. For example, in the above-described example, an acceleration sensor that is an effective sensor for indoor position determination (TPO determination) is selected indoors. However, with only the acceleration sensor, it is impossible to detect that the GPS sensor can be used from the indoor to the outdoor, and the sensor cannot be reselected. Therefore, in this case, it is desirable to select the indoor / outdoor sensor described above.

  For example, in a home subsystem, when a user is in the living room, a light intensity sensor or an air temperature sensor is selected for lighting control or air conditioning control. On the other hand, when the user is in the toilet, the urinalysis sensor is selected in order to create the history information of the user's health condition. When the user approaches the robot, the robot-mounted sensor is selected in order to make the robot correspond to the user or to update the history information of the user's action using the robot. Also, during daytime hours, an air temperature sensor is selected for air-conditioning control, and during night hours, a body temperature sensor is selected to measure the user's body temperature during sleep and create user's health status history information. Or select security sensors for security. In addition, when the user is in a busy situation, the light intensity sensor is selected for lighting control to relax the user. When the user is in a spare situation, for robot control to eliminate the user's spare time, Select a robot-mounted sensor.

  In FIG. 4B, if a control target device is selected according to the user's TPO information, a different control target device can be selected according to the location, time, and situation, and a more intelligent device. Control can be realized.

  For example, in the home subsystem, when the user is in the living room or in the time zone when the user is waking up, a control target device such as a home display, an AV device, or a robot is selected to eliminate the user's time. Alternatively, when the user approaches the home display, the AV device, or the robot, the device that the user has approached is selected. On the other hand, when the user is in the bedroom or in the night time, a control target device such as an air conditioner or lighting is selected in order to realize a comfortable sleep of the user. In a situation where the user is not energetic, a robot is selected to energize the user, and in a situation where the user is busy, a home AV device is selected to play music for relaxing the user.

  FIG. 5 shows more specifically examples of sensors and devices to be controlled that are selected by the TPO when moving from a house to a company via a car, outdoors, or indoors.

  When the user moves to the driver's seat in the vehicle, a running state sensor, an operation state sensor, an in-vehicle environment sensor, and the like are selected. In addition, a car navigation system, a car AV device, an air conditioner, a dozing prevention device, or the like is selected as a control target device.

  When the user goes out of the car and walks, wearable sensors such as GPS, acceleration, and pulse are selected. In addition, a control target device such as a wearable display, a mobile AV device, a mobile phone, and a wristwatch is selected. On the other hand, when the user is stationary indoors, wearable sensors such as GPS, acceleration, and pulse, and environment sensors embedded indoors are selected. Further, a terminal or display nearest to the user is selected as the control target device.

  When the user goes to the office and sits down, a wearable sensor such as a pulse, an environment / state sensor embedded in an indoor or workplace desk, and a sensor for monitoring the operation history of the PC are selected. Further, a desk terminal / PC, lighting, air conditioning, or the like is selected as the control target device.

  According to the method of the present embodiment described above, when the user moves between a plurality of subsystems, the user history information can be updated seamlessly.

  For example, in FIG. 6A, the user who has returned home connects the portable electronic device 20 to the cradle 21 and performs charging or the like. By such connection to the cradle 21, the robot 300, which is a control target device of the home subsystem, is selected and activated, and its use becomes possible. In this case, the history information storage unit of the portable electronic device 20 stores user history information updated in the mobile environment, and the robot 300 is controlled based on the user history information. Specifically, it is determined based on the user history information that the user went to a drinking party on the way home from work and was excited by conversation with colleagues. Then, when the user approaches, the robot 300 performs an utterance operation such as “Looks like today's drinking party was exciting”, for example. As a result, the user can feel the freshness of what the robot 300 knows about his / her behavior in a place where the robot 300 is not present, can be attached to the robot 300, and can realize unprecedented robot control. . Further, for example, when it is determined that the user is tired or unwell based on the user history information, the robot 300 performs an utterance operation that encourages the user. As a result, the user becomes more attached to the robot 300 that encourages the user as if he knew his / her state.

  In addition, when the user returns home and the robot 300 of the home subsystem can be used, the robot-mounted sensor can also be used. The user history information updated in the mobile environment can be updated based on the sensor information from the robot-mounted sensor.

  Specifically, as shown in FIG. 6B, the robot 300 is equipped with, for example, a contact sensor 319, a speech sensor 320, a pulse sensor 321, a body temperature sensor 322, a sweat sensor 323, and the like. The user's reaction to the utterance of the robot 300 is detected by the contact sensor 319 or the like mounted on the robot, so that the state of the user's spirit, body, etc. when returning home can be determined.

  For example, in response to the question from the robot 300 that “Today's drinking party seems to have risen” in FIG. 6 (A), it is contacted that the user responded positively as shown in FIG. 6 (B). When detected by the sensor 319 or the utterance sensor 320, it can be determined that the estimation result “going to a drinking party after work” is correct, and more accurate user history information can be created.

  In this embodiment, as shown in FIGS. 6A and 6B, the user returns home and wears wearable sensors such as a speech / mastication sensor 540, a pulse sensor 521, a body temperature sensor 522, and a sweat sensor 523, for example. When removed, the utterance sensor 320, the pulse sensor 321, the body temperature sensor 322, and the sweat sensor 323 mounted on the robot 300 are used instead of these wearable sensors. Then, the user history information that has been updated based on the sensor information from the wearable sensor in the mobile environment is updated using the sensor information from these robot-mounted sensors. That is, as shown by D1 in FIG. 6C, the user's speech volume, pulse, sweat volume, etc. are measured based on sensor information from the speech sensor 320, pulse sensor 321, and sweat sensor 323 mounted on the robot 300, The user history information obtained in the mobile environment is continuously updated. In this way, even when the user removes the wearable sensor, the user history information can be updated seamlessly.

  In FIG. 7A, when a user who gets in the vehicle attaches the portable electronic device 20 to the cradle 21 provided in the vehicle or establishes a short-distance wireless communication path such as Bluetooth, the control target of the in-vehicle subsystem Communication between the navigation device 700, which is a device, and the portable electronic device 20 becomes possible. Thereby, the user history information updated in the mobile environment or the home environment is transferred from the portable electronic device 20 to the navigation device 700, and display control of the car navigation display based on the transferred user history information becomes possible.

  Specifically, when it is determined that the user's exercise amount (walking amount) is insufficient based on the user history information, the car navigation display of the navigation device 700 has a healthy display as shown in FIG. A guidance screen recommending a special store is displayed. Thus, the user feels fresh and surprised by reacting as if he / she knew his / her action history, and can provide a navigation device 700 that has never been seen before. In addition, when the user's action history specified by the user history information is ahead of the user's schedule specified by the schedule, for example, navigation control such as setting a route with a margin is possible. become.

  In addition, instead of the built-in GPS sensor 550 of the portable electronic device 20 whose reception sensitivity has dropped in the vehicle, the vehicle's accurate movement route and the like can be determined by using in-vehicle sensors such as the GPS sensor 720 and the gyro sensor 721 of the navigation device 700. The user history information can be updated after identification. Specifically, in the in-vehicle environment, user history information is updated based on sensor information from the in-vehicle sensor (GPS) as indicated by E1 in FIG. When the user gets out of the vehicle and returns from the in-vehicle environment to the mobile environment, the user history information is updated based on the sensor information from the wearable sensor, as indicated by E2 and E3 in FIG. Accordingly, seamless update processing of user history information is possible, and more appropriate and accurate user history information can be obtained.

  Note that application examples of the technique of the present embodiment are not limited to FIGS. 6 (A) to 7 (C). For example, when the user comes home, removes the wearable display and approaches the home display, the home display control operation is started, and the user history information and information based thereon are displayed on the home display instead of the wearable display. Also good. Further, the history of the user's selection operation for images and programs displayed on the home display may be detected by an operation sensor, and the user history information may be updated based on the detected operation history.

  Further, when the user returns home, the air conditioning control may be performed by starting the control operation of the air conditioner in the house based on the user history information regarding the temperature obtained by the ambient temperature sensor which is a wearable sensor. For example, when it is determined that the user has returned in the hot weather based on the user history information, air conditioning control is performed so that the temperature of the house is lowered. Or, when a user who comes home removes a wearable sensor such as an ambient temperature sensor or an ambient light intensity sensor, the user selects an ambient temperature sensor or an ambient light intensity sensor embedded in the environment of the home subsystem instead of these wearable sensors. The user history information may be continuously updated.

  In addition, when the user moves into the vehicle, if the user is determined to be mentally tired based on user history information (state parameters) in the mobile environment or home environment, the control operation of the car AV device is started. For example, control such as playing healing music may be performed. Further, the user history information may be updated based on the operation information of the control target device of the in-vehicle subsystem or the sensor information from the sensor of the in-vehicle subsystem. Specifically, based on sensor information from environmental sensors in the vehicle and operation information (for example, information on steering wheel operation and navigation operation) on the control target device such as the user's car and car navigation, user history such as user status parameters Information update may be continued.

3. User History Information Next, specific examples of user history information update processing and user history information will be described. FIG. 8 is a flowchart illustrating an example of update processing of user history information.

  First, the information acquisition unit 230 acquires sensor information (step S21). Next, the calculation unit 246 performs calculation processing such as filtering and analysis of the acquired sensor information (step S22). Based on the calculation result, the user's behavior, state, environment, etc. (TPO, feeling) are estimated (step S23). The history information update unit 248 stores the user history such as the estimated user behavior and state in the history information storage unit 262 in association with the date and time (year, month, week, day, time), etc. Is updated (step S24).

  FIG. 9 schematically shows a specific example of user history information. The user history information in FIG. 9 has a data structure in which a history of user behavior and the like is associated with a time zone, a time, and the like. For example, the user departs from home at 8 o'clock, walks from his home to the station in the time zone from 8 o'clock to 8:20, and arrives at the nearest station A at 8:20. And, from 8:20 to 8:45, I got on the train, got off at the nearest B station of the company at 8:45, arrived at the company at 9:00, and started work. During the time zone from 10:00 to 11:00, meetings are held with members in the company, and lunch is served from 12:00 to 13:00.

  In this way, in FIG. 9, user history information is constructed by associating a history of user behavior or the like estimated by information from a sensor or the like with a time zone or a time.

  In FIG. 9, measurement values such as a user's utterance amount, a meal amount, a pulse rate, and a sweat amount, which are measured by a sensor or the like, are also associated with the time zone and time. For example, in the time zone from 8:00 to 8:20, the user is walking from the home to the station A, but the walking amount at this time is measured by the sensor and is associated with the time zone from 8:00 to 8:20. It is done. In this case, for example, measurement values of sensor information other than the walking amount such as walking speed and sweating amount may be further associated. By doing so, it becomes possible to grasp the user's momentum and the like in this time zone.

  In the time zone from 10 o'clock to 11 o'clock, the user is having a meeting with a colleague, and the amount of speech, etc. at this time is measured by a sensor and correlated with the time zone from 10 o'clock to 11 o'clock. In this case, for example, measurement values of sensor information such as a voice state and a pulse may be further associated. By doing so, it becomes possible to grasp the user's conversation volume, degree of tension, and the like during this time period.

  In the time zone from 20:45 to 21:45 or from 22:00 to 23:00, the user is playing a game or watching TV, but the pulse, sweating amount, etc. at this time are in these time zones. Associated. By doing so, it becomes possible to grasp the degree of excitement of the user in these time zones.

  In the time zone from 23:30, the user is sleeping, but a change in the user's body temperature at this time is associated with this time zone. By doing so, it becomes possible to grasp the health condition of the user during sleep.

  Note that the user history information is not limited to the form as shown in FIG. 9. For example, the user history information can be modified so that the history of the user's behavior or the like is not associated with the date and time.

  For example, in FIG. 10A, the mental state parameter of the user is calculated according to a predetermined arithmetic expression based on the utterance amount, the voice state, the pulse, the sweating amount, etc., which are measured values of sensor information. For example, if the utterance amount is large, the mental state parameter also becomes high, indicating that the user's mental state is good. In addition, based on a walking amount, walking speed, body temperature, and the like, which are measurement values of sensor information, a user body condition (health state) parameter (exercise amount parameter) is calculated according to a predetermined calculation formula. For example, if the amount of walking is large, the body condition parameter also increases, indicating that the user's body condition is good.

  As shown in FIG. 10B, the mental state and physical state parameters (state parameters in a broad sense) of the user can be displayed on a wearable display, home display, or car navigation display by visualizing them using a bar graph or the like. . Therefore, according to the present embodiment, the user history information such as the mental state and body state parameters updated in the mobile environment, for example, is used for the home display in the home environment and the car navigation display in the in-car environment as shown in FIG. The parameter can be visualized and displayed as in B). Alternatively, the robot in the home environment can be controlled based on the mental state and body state parameters updated in the mobile environment to encourage the user or to allow the robot to perform an operation that advises the user. Alternatively, in the in-vehicle environment, navigation according to the parameters of the user's mental state and physical state and music can be played.

  In addition, when a user moves between multiple subsystems (mobile, home, in-vehicle, etc.), sensor information from sensors available in each subsystem is acquired, and the user's mental state, physical state, etc. It is also possible to update state parameters continuously and seamlessly.

4). System Configuration Next, various system configuration examples of the present embodiment will be specifically described. In the following, in order to simplify the explanation, the case where the first subsystem is a mobile subsystem or the like, and the second subsystem is a home subsystem (robot) or an in-vehicle subsystem (navigation device) is mainly used. However, the present embodiment is not limited to this example.

4.1 First System Configuration Example FIG. 11 shows a first system configuration example. In FIG. 11, the portable electronic device 20 and the robot 300 are communicatively connected by a wireless LAN, a cradle, or the like. The processing of the control system 25 according to this embodiment described with reference to FIGS. 2 and 3 can be realized by the processing unit 340 of the robot 300. Alternatively, it may be realized by distributed processing by the processing unit 40 of the portable electronic device 20 and the processing unit 340 of the robot 300.

  In FIG. 11, when a user whose user history information is updated by sensor information from the sensor of the mobile subsystem returns home and approaches the robot 300, the event determination unit 350 displays the robot 300 (second subsystem information). It is determined that an available event of the second control target device has occurred.

  The information transfer unit 370 includes a history information storage unit 62 (first history information storage unit) of the portable electronic device 20 (first subsystem) and a history information storage unit of the robot 300 (second subsystem). The user history information is transferred to and from 362 (second history information storage unit). As a result, the user history information updated in the mobile environment is transferred to the history information storage unit 362 and stored therein. Note that information synchronization processing may be performed in which the user history information stored in the history information storage unit 62 and the user history information stored in the history information storage unit 362 are maintained in the same information.

  Further, the control processing unit 352 starts the control operation of the robot 300 when an available event of the robot 300 occurs. Specifically, the control operation using the user history information transferred to the history information storage unit 362 is started. That is, the robot control unit 386 starts control of the robot operation mechanism 390 (actuator, speaker, LED, etc.) to be controlled, and causes the robot 300 to perform various operations such as a speech operation.

  Further, the history information update unit 348 performs an update process on the user history information transferred to the history information storage unit 362 based on sensor information from the robot-mounted sensor 310 (second sensor of the second subsystem). .

  In this way, for example, as shown in FIG. 6A, when the user who returns home connects the portable electronic device 20 to the cradle 21 and approaches the robot 300, the robot 300 becomes available and starts up. Then, the robot 300 performs an operation such as an utterance operation according to the user history information in the mobile environment. As shown in FIG. 6B, when the user reacts to the speech operation or the like of the robot 300, the reaction is detected by the robot mounting sensor 310 (319 to 323). Then, as shown at D1 in FIG. 6C, the user history information is seamlessly updated based on the sensor information from the robot-mounted sensor 310.

  The event that can be used by the robot 300 can be determined based on whether or not the user has approached the robot 300 (home subsystem). Specifically, the occurrence of an available event can be determined by detecting the wireless strength of communication performed between the portable electronic device 20 (mobile subsystem) and the robot 300 (home subsystem). For example, when the user approaches the robot 300 and the wireless strength becomes higher than a given threshold value, it is determined that an available event (accessible, controllable event) has occurred. Alternatively, when the portable electronic device 20 (the device of the first subsystem) is connected to the cradle 21 of FIG. 6A located at the location of the home subsystem (second subsystem), the robot It may be determined that 300 available events have occurred.

  Further, when an available event occurs in this way, the robot 300 may be turned on to start up, or the robot 300 may be controlled to return from the low power consumption mode to the normal operation mode. Alternatively, when an unusable event in which the user cannot use the robot 300 occurs, the robot 300 may be turned off and stopped, or may be controlled to shift from the normal operation mode to the low power consumption mode.

4.2 Second System Configuration Example FIG. 12 shows a second system configuration example. In FIG. 12, a home server 120 that is a local server of the home subsystem is provided. The home server 120 performs processing for controlling various devices to be controlled (for example, a robot, an air conditioner, or lighting) of the home subsystem, and performs communication (information transfer) processing with the outside.

  In the system of FIG. 12, the portable electronic device 20 and the home server 120 are communicatively connected via a wireless LAN, a cradle, or the like, and the home server 120 and the robot 300 are communicatively connected via a wireless LAN or the like. 2 and 3 can be realized by the processing unit 140 of the home server 120. Alternatively, it may be realized by distributed processing by the processing unit 40 of the portable electronic device 20, the processing unit 140 of the home server 120, and the processing unit 340 of the robot 300.

  When the user who has the portable electronic device 20 approaches the house, communication between the portable electronic device 20 and the home server 120 becomes possible by the wireless LAN. Alternatively, communication can be performed by placing the portable electronic device 20 in a cradle.

  When the communication path is established, the history information is transferred from the history information storage unit 62 on the mobile side to the history information storage unit 162 on the home side. Specifically, user history information synchronization processing is performed between the history information storage units 62 and 162. The robot 300 operates under the control of the home server 120. That is, the control operation is started and operated based on the user history information stored in the history information storage unit 162 of the home server 120. Taking FIG. 6A as an example, the robot 300 is configured such that the control processing unit 152 of the home server 120 analyzes the user history information in the history information storage unit 162 and performs an utterance operation or the like corresponding to the user history information. Instruct to control. In this way, when the data size of the user history information is large, it is not necessary to provide a history information storage unit in the robot 300, so that the robot 300 can be reduced in cost and size. In addition, since transfer and calculation processing of user history information can be centrally processed and managed in the home server 120, more intelligent robot control is possible.

  Further, according to the system of FIG. 12, before the event that the robot 300 can be used occurs (for example, when it is detected that the user approaches or moves to the location of the second subsystem), the information transfer unit 170 The user history information can be transferred from the history information storage unit 62 to the history information storage unit 162 in advance. For example, before the user returns home and approaches the robot 300 (specifically, information from a GPS sensor that is one of the wearable sensors worn by the user indicates that the user has arrived at the nearest station) The information from the door opening / closing sensor, which is one of the home sensors, indicates that the user opened the front door, etc.), the user history information updated in the mobile environment is the history information of the home server 120 The data is transferred and written in advance in the storage unit 162. When the user approaches the robot 300 and an available event occurs, the control operation of the robot 300 using the user history information previously transferred to the history information storage unit 162 is started. That is, the robot 300 is activated, and the robot control unit 386 controls the robot operation mechanism 390 so as to perform an operation as shown in FIG. In this way, the robot control based on the user history information can be started immediately after the robot 300 is activated, and the control can be made efficient.

  In FIG. 12, the event determination unit 150 provided in the home server 120 (local server) of the home subsystem (second subsystem) determines available events. Specifically, it is determined that an available event has occurred when the user approaches the location of the home subsystem. Then, the control processing unit 152 provided in the home server 120 starts the control operation of the robot 300. A history information update unit 148 provided in the home server 120 updates user history information based on sensor information from the robot-mounted sensor 310 or the like. Note that the user history information may be updated based on sensor information from other home sensors or wearable sensors worn by the user.

  As described above, if the event determination unit 150, the control processing unit 152, the history information update unit 148, and the like are provided in the home server 120, control that always reflects the latest user history is performed even when the subsystem is switched. Is possible. In addition, processing such as event determination with heavy processing load that requires polling or the like can be assigned to the home server 120 with high processing capability, so that the processing load on the portable electronic device 20 (mobile subsystem) can be reduced. Further, if only the event determination unit 150 and the information transfer unit 170 of the home server 120 are operated, the other units can be set in a low power consumption mode (sleep state), so that power saving can be achieved.

4.3 Third System Configuration Example FIG. 13 shows a third system configuration example. In FIG. 13, an external server 620 that is the main server of the integrated system is provided. The external server 620 performs processing for controlling the control target devices of a plurality of subsystems constituting the integrated system, and performs communication (information transfer) processing between subsystems.

  In the system of FIG. 13, the portable electronic device 20 and the external server 620 are communicatively connected by a wireless WAN such as PHS, and the external server 620 and the robot 300 are also communicatively connected by a wireless WAN such as PHS. The processing of the control system 25 can be realized by the processing unit 640 of the external server 620. Alternatively, it may be realized by distributed processing by the processing unit 40 of the portable electronic device 20, the processing unit 640 of the external server 620, and the processing unit 340 of the robot 300.

  Each unit such as the portable electronic device 20 and the robot 300 appropriately communicates with the external server 620 to perform synchronization processing (transfer processing) of user history information. For example, the user history information is uploaded from the unit to the history information storage unit 662 of the external server 620 when the unit stops, and the user history of the history information storage unit 662 is transferred from the external server 620 to the unit when the unit starts. Download information. These upload and download processes are realized by the information transfer unit 670 and the like. In FIG. 13, the event determination unit 650 and the history information update unit 548 are provided in the external server 620, and the determination process of available events and the update process of user history information are performed in an integrated manner.

  In FIG. 13, it is not possible to determine the proximity of the user and the house based on the wireless strength. Therefore, in this case, the user's position may be determined based on, for example, the position registration information of the PHS base station, and it may be determined whether or not the user has approached the house. Or you may judge based on the GPS sensor of the wearable sensor 12. FIG. When it is determined that the user has approached the house, the robot 300 may be activated under the control of the external server 620 or the like.

4.4 Fourth System Configuration Example FIG. 14 shows a fourth system configuration example. In FIG. 13, an external server 620 as a main server and a home server 120 as a local server are provided.

  In the system of FIG. 14, the portable electronic device 20 and the external server 620 are communicatively connected by a wireless WAN such as PHS, and the external server 620 and the home server 120 are communicatively connected by a wired WAN such as ADSL. Are connected by wireless LAN or the like. The processing of the control system of this embodiment is realized by the processing unit 640 of the external server 620 and the like. Alternatively, it may be realized by distributed processing by the processing unit 40 of the portable electronic device 20, the processing unit 640 of the external server 620, the processing unit 140 of the home server 120, and the processing unit 340 of the robot 300.

  Each unit such as the portable electronic device 20 and the home server 120 appropriately communicates with the external server 620 to perform synchronization processing (transfer processing) of user history information. In addition, it is determined whether or not the user has approached the house by using position registration information of the PHS, a GPS sensor, a microphone, and the like. If the user has approached, the user history information in the history information storage unit 662 of the external server 620 is stored. Then, it is downloaded to the storage unit 160 of the home server 120 and the control operation of the robot 300 is started.

  According to the system shown in FIG. 14, user history information and update processing thereof can be centrally managed in the external server 620, so that it is possible to provide a control system suitable for an integrated system composed of many subsystems.

4.5 Fifth System Configuration Example FIG. 15 shows a fifth system configuration example. In FIG. 15, the portable electronic device 20 and the navigation device 700 are connected for communication by short-range radio such as Bluetooth, a cradle, or the like. The processing of the control system 25 can be realized by the processing unit 740 of the navigation device 700. Or you may implement | achieve by the distributed process by the process part 40 of the portable electronic device 20, and the process part 740 of the navigation apparatus 700. FIG. Further, the processing of the processing unit 740 may be realized by a processing unit of an in-vehicle computer.

  In FIG. 15, when a user whose user history information has been updated with sensor information from sensors in the mobile subsystem and home subsystem moves into the vehicle, the event determination unit 750 displays the navigation device 700 (the second subsystem first). It is determined that an available event of the second control target device has occurred.

  The information transfer unit 770 also includes a history information storage unit 62 (first history information storage unit) of the portable electronic device 20 (first subsystem) and a history information storage of the navigation device 700 (second subsystem). The user history information is transferred to and from the unit 762 (second history information storage unit). Thereby, the user history information updated in the mobile environment or the home environment is transferred to the history information storage unit 762 and stored therein.

  In addition, when an available event occurs, the control processing unit 752 starts a control operation of the car navigation display 790 and the like. Specifically, the control unit 786 controls the car navigation display 790 that is a control target, thereby causing a display operation using the user history information transferred to the history information storage unit 762 to be performed.

  The history information update unit 748 updates user history information based on sensor information from the in-vehicle sensor 16 (GPS sensor, gyro sensor, touch sensor, etc.) of the navigation device 700 (in-vehicle subsystem).

  In this way, for example, as shown in FIG. 7A, when a user who has boarded the vehicle connects the portable electronic device 20 to the cradle 21 or the user's boarding is detected by short-range wireless communication, Is established, and the user history information is transferred from the portable electronic device 20 to the navigation device 700. Then, as shown in FIG. 7B, display control of the car navigation display based on the user history information is performed. Further, based on sensor information from the in-vehicle sensor 16 such as a GPS sensor, a gyro sensor, and a touch sensor, the history of the user's behavior and state in the in-vehicle subsystem is identified. Then, as indicated by E1 in FIG. 7C, the user history information is seamlessly updated based on the sensor information from the in-vehicle sensor 16 (GPS sensor or the like). Further, when the user gets out of the car, for example, the user history information is transferred from the history information storage unit 762 of the navigation device 700 to the history information storage unit 62 of the portable electronic device 20. As shown at E2 and E3 in FIG. 7C, the user history information is seamlessly updated even when the vehicle environment is changed to the mobile environment.

5. Selection of Sensor and Control Target Device Next, a specific example of a method for selecting a sensor and a control target device will be described.

  For example, in FIG. 16A, when the user is in a mobile environment, if the event determination unit 50 determines that the wearable sensor 12 and the mobile control target device 92 can be used, the sensor selection unit 42 detects the wearable sensor 12. The control target device selection unit 44 selects the mobile control target device 92. Then, the history information update unit 48 updates the user history information based on the sensor information from the wearable sensor 12. Further, the control processing unit 52 starts the control operation of the mobile control target device 92.

  On the other hand, in FIG. 16B, the user moves from the mobile environment to the home environment, and the event determination unit 50 determines whether the home sensor 14 and the home control target device 94 can be used. If it is available, the sensor selection unit 42 selects the home sensor 14, and the control target device selection unit 44 selects the home control target device 94. Further, the history information update unit 48 updates the user history information based on the sensor information from the home sensor 14. In addition, the control processing unit 52 starts the control operation of the home control target device 94.

  As described above, in FIGS. 16A and 16B, the portable electronic device 20 updates the history information based on the sensor information regardless of whether the user is in the mobile environment or the home environment. It is excellent in that it controls the devices to be controlled, can share terminal devices, and does not require synchronization of user history information.

  However, when the user is in the home environment, there is a high possibility that the portable electronic device 20 will be removed. Further, if the portable electronic device 20 is always operated even in the home environment, the power of the portable electronic device 20 is wasted.

  17A to 18, when the user moves from the mobile environment (first subsystem environment) to the home environment (second subsystem environment), the portable electronic device 20 is stopped. Etc. are controlled.

  For example, in FIG. 17A, since the user is in a mobile environment, the mobile side is powered on (or normal operation mode), and the home control target device 94 is powered off (or low power consumption mode). Yes. The information transfer units 70 and 170 on the mobile side and the home side are always turned on (normal operation mode).

  Then, the mobile control target device selection unit 44 selects the mobile control target device 92, and the selected mobile control target device 92 is controlled. In addition, the mobile-side sensor selection unit 42 selects the wearable sensor 12, and the mobile-side history information update unit 48 updates the user history information based on the sensor information from the wearable sensor 12.

  On the other hand, in FIG. 17B, the user has moved from the mobile environment to the home environment. In this case, it is determined whether or not the home control target device 94 can be used. If the home control target device 94 can be used, the home control target device 94 is turned on (normal operation mode). Then, the mobile-side information transfer unit 70 reads the user history information from the history information storage unit 62 and transfers it to the home side. Then, the home-side information transfer unit 170 receives this user history information and writes it in the history information storage unit 162. Then, the home sensor 14 is selected, and updating of the user history information based on the sensor information from the home sensor 14 is started. In addition, control of the home control target device 94 using the user history information is started. The mobile side is turned off (low power consumption mode).

  In FIG. 18, the user has returned from the home environment to the mobile environment. In this case, the mobile side is turned on (normal operation mode). Then, the home-side information transfer unit 170 reads the user history information from the history information storage unit 162 and transfers it to the mobile side. Then, the mobile-side information transfer unit 70 receives this user history information and writes it in the history information storage unit 62. Then, the home control target device 94 is turned off (low power consumption mode).

  17A to 18, when the user is in a mobile environment, the home control target device 94 (or home subsystem) is turned off (low power consumption mode), and the user is at home. When in the environment, the mobile side is powered off, so the power consumption on the mobile side and the home side can be reduced. In this case, if the user history information is transferred as shown in FIG. 17B or FIG. 18, even if the user moves between subsystems, the user history information can be updated seamlessly. Even when the user is in a mobile environment or a home environment, the information transfer units 70 and 170 are always powered on (normal operation mode). It is possible to properly implement environmental change monitoring processing.

  FIG. 19 is a flowchart showing a detailed processing example of the method of FIGS. First, it is determined whether or not the home control target device 94 can be used (step S31). If it becomes available, the home control target device 94 is selected (step S32), and the power of the selected home control target device 94 is turned on (step S33). Alternatively, the low power consumption mode is returned to the normal operation mode.

  Next, the user history information is transferred from the history information storage unit 62 to the history information storage unit 162 of the home subsystem (step S34). Then, updating of the user history information using the sensor information from the home sensor 14 is started (step S35). Further, the control operation of the home control target device 94 using the user history information is started (step S36).

  Next, the portable electronic device 20 is turned off (step S37). Alternatively, the mode is shifted to the low power consumption mode. However, the information transfer unit (communication unit) 70 is always kept powered on (normal operation mode).

  Thus, next, it is determined whether or not the use of the home control target device 94 is disabled (step S38). While the home control target device 94 can be used, the updating of the user history information using the sensor information from the home sensor 14 and the control operation of the home control target device 94 using the same are continued. And when it becomes unavailable, the power source of the portable electronic device 20 is turned on (step S39). Alternatively, the low power consumption mode is returned to the normal operation mode. Then, the user history information is transferred from the history information storage unit 162 of the home subsystem to the history information storage unit 62 of the portable electronic device 20 (step S40). Then, the power source of the home control target device 94 is turned off (step S41). Alternatively, the mode is shifted to the low power consumption mode.

6). Transferring User History Information Using Wireless Next, a method for transferring user history information using wireless will be described. FIG. 20 shows a configuration example of a system that realizes this technique.

  In FIG. 20, information transfer units 70 and 370 are provided in the portable electronic device 20 and the robot 300, and information is transmitted wirelessly by communication units (communication modules) 72 and 372. For example, the information transfer unit 70 and the information transfer unit 370 store the user history information stored in the history information storage unit 62 on the mobile side and the history information storage on the home side when an available event of the robot 300 that is the control target device occurs. Transfer processing to the unit 362 (second history information storage unit) is performed.

  In this case, the information transfer unit 70 and the information transfer unit 370 perform information synchronization processing of user history information. Specifically, an information synchronization process for maintaining the user history information stored in the mobile history information storage unit 62 and the user history information stored in the home history information storage unit 362 in the same content information is performed. Do. The information synchronization process is performed by overwriting the history information of the currently used subsystem with the history information of the subsystem that is newly available. For example, when the mobile side is currently used and the home side becomes available, the mobile side history information is overwritten on the home side history information. In the opposite case, the history information on the home side is overwritten on the history information on the mobile side. In this way, the latest user history information is maintained and stored in the history information storage units 62 and 362, and even when the user moves between a plurality of subsystems, the user history information is seamless. Appropriate updates become possible.

  In FIG. 20, information transfer is performed wirelessly. Specifically, information transfer is realized by, for example, wireless LAN, weak wireless that is short-range wireless communication, Bluetooth, infrared rays, or the like. In this case, the occurrence of an available event of the robot 300 (control target device) can be determined by detecting the wireless strength. Specifically, when the portable electronic device 20 and the robot 300 are close to each other, the wireless strength increases, and it can be determined that the robot 300 can be used. On the other hand, when the portable electronic device 20 and the robot 300 are separated from each other, the wireless strength decreases, and it can be determined that the robot 300 is not usable. If such a method is used, the radio | wireless required for information transfer can be used for the determination process of an available event or an unusable event.

  In FIG. 21A, the user is moving toward the house to go home. In this case, as shown in FIG. 21B, areas 1, 2, and 3 centered on the house are set.

  Here, area 1 is an area outside the effective range of a wireless LAN or the like (hereinafter referred to as long-distance wireless communication in order to be distinguished from short-range wireless communication), and the portable electronic device 20 operates alone. It is an area. Area 2 is an area within the effective range of long-distance wireless communication, and is an area where user history information transfer processing (information synchronization processing) is performed. Area 3 is an area within an effective range of short-range wireless communication such as Bluetooth, and is an area where the robot 300 (home control target device in a broad sense) operates independently. Area 2 is an area outside the effective range of near field communication.

  For example, when the user enters the area 2 from the area 1, the robot 300 is activated, and the user history information is transferred (loaded) from the history information storage unit 62 on the mobile side to the history information storage unit 362 on the home side. When the user enters the area 3 from the area 2, the portable electronic device 20 is stopped and switched to the single operation of the robot 300.

  On the other hand, when the user enters the area 2 from the area 3, the portable electronic device 20 is activated, and the user history information is transferred from the history information storage unit 362 on the home side to the history information storage unit 62 on the mobile side. When the user enters area 1 from area 2, the robot 300 is stopped and switched to the single operation of the portable electronic device 20.

  That is, in FIG. 21B, the event determination unit 350 or the like determines the approaching state of the user to the location of the home subsystem (second subsystem). When the approaching state changes from the first approaching state (area 1) to the second approaching state (area 2) having a higher degree of approaching than the first approaching state, the information transfer unit 370 A process for transferring the user history information stored in the storage unit 62 to the history information storage unit 362 on the home side is performed. Then, when the user's approaching state changes from the second approaching state (area 2) to the third approaching state (area 3) having a higher degree of approaching than the second approaching state, The control operation of the robot 300 (second control target device) using the user history information is started.

  Further, the information transfer unit 370 stores the user history information stored in the history information storage unit 62 and the user stored in the history information storage unit 362 during the period in which the user approach state is the second approach state (area 2). Information synchronization processing is performed to maintain the history information as the same content information. That is, when the user approach state changes from the first approach state (area 1) to the second approach state (area 2), the user history information is transferred from the mobile side to the home side, and the third approach state When the second approach state (area 2) is entered from (area 3), the user history information is transferred from the home side to the mobile side. When the user approach state changes from the second approach state (area 2) to the first approach state (area 1), the control operation of the robot 300 using the user history information is stopped.

  In addition, these 1st, 2nd, 3rd approach states (area 1, 2, 3) can be judged by long-distance wireless communication and short-distance wireless communication, for example. That is, when a user (portable electronic device) is detected by short-range radio and long-range radio, it can be determined that the user is in area 3 (third approach state). In addition, the user cannot be detected by the short-range wireless, but if the user can be detected by the long-range wireless, it can be determined that the user is in the area 2 (second approach state). If the user cannot be detected by the short-range radio or the long-range radio, it can be determined that the user is in area 1 (first approach state). In this way, by using at least two types of wireless communications with different reception states depending on distances (for example, at least two types of wireless communications with different effective reach distances), the start and stop control of the portable electronic device 20 and the robot 300 can be performed. The user history information transfer process can be efficiently realized.

  FIG. 22 is a flowchart showing a detailed processing example of the method of FIGS. 21 (A) and 21 (B). First, it is determined whether or not the proximity state has changed (step S61). If it has not changed, polling is performed every predetermined time (step S62). On the other hand, if it has changed, it is determined whether or not the user has entered area 2 (step S63). If so, it is determined whether or not the user has entered area 2 from the area 1 side (step S64).

  When the area 2 is entered from the area 1 side, the robot side (each unit other than the communication unit) is activated (step S65). Then, handshaking between units is performed (step S66), and user history information is transferred from the mobile side to the robot side (step S67).

  On the other hand, when entering the area 2 from the area 3 side instead of the area 1 side, the mobile side is activated (step S68). Then, handshaking between units is performed (step S69), and the user history information is transferred from the robot side to the mobile side (step S70).

  If it is determined in step S63 that the user is not in area 2, it is determined whether or not the user has entered area 1 (step S71). When entering the area 1, the robot side (other than the communication unit) is stopped (step S72). On the other hand, if the user is not in area 1, it is determined that the user is in area 3, and the mobile side (other than the communication unit) is stopped (step S73).

  Although the present embodiment has been described in detail as described above, it will be easily understood by those skilled in the art that many modifications can be made without departing from the novel matters and effects of the present invention. Accordingly, all such modifications are intended to be included in the scope of the present invention. For example, in the specification or drawings, at least once, a broader or synonymous different term (first, second, third subsystem, first, second, third sensor, first, second, third Controllable devices, status parameters, etc.) (mobile subsystem, home subsystem, in-vehicle subsystem, wearable sensor, home sensor, in-vehicle sensor, mobile control target device, home control target device, in-vehicle control target device) , Mental / physical condition parameters, etc.) can be replaced with the different terms in any part of the specification or drawings. Further, the configuration and operation of the control system, subsystem, robot, navigation device, and the like are not limited to those described in the present embodiment, and various modifications can be made. For example, a modification in which one of the history information update unit and the control processing unit is omitted is possible.

Illustration of an integrated system of multiple subsystems The structural example of the control system of this embodiment. The detailed structural example of the control system of this embodiment. 4A and 4B are flowcharts for explaining the operation of the present embodiment. Explanatory drawing of the selection method of the sensor based on TPO information, and a control object apparatus. 6A to 6C show application examples of the method of the present embodiment. FIG. 7A to FIG. 7C show application examples of the method of this embodiment. The flowchart of the update process of user history information. Explanatory drawing of user log | history information. FIG. 10A and FIG. 10B are explanatory diagrams of user history information. The 1st system configuration example of this embodiment. The 2nd system configuration example of this embodiment. The 3rd system configuration example of this embodiment. The 4th system configuration example of this embodiment. The 5th system configuration example of this embodiment. FIG. 16A and FIG. 16B are explanatory diagrams of a method for selecting sensors and control target devices. FIGS. 17A and 17B are explanatory diagrams of a method for selecting a sensor and a device to be controlled. Explanatory drawing of the selection method of a sensor and a control object apparatus. The flowchart for demonstrating the selection method of a sensor and a control object apparatus. 1 is a configuration example of a system that implements a wireless method for transferring user history information. FIGS. 21A and 21B are explanatory diagrams of a method for transferring user history information by wireless. The flowchart for demonstrating the transfer method of the user historical information by radio | wireless.

Explanation of symbols

10 sensors, 12 wearable sensors, 14 home sensors, 16 in-vehicle sensors,
20 portable electronic device, 25 control system, 40 processing unit, 42 sensor selection unit,
44 control target device selection unit, 48 history information update unit, 50 event determination unit,
52 control processing unit, 60 storage unit, 62 history information storage unit, 64 output information storage unit,
70 information transfer unit, 90 controlled device,
92 mobile control target devices, 93 wearable displays,
94 home control target equipment, 96 in-car control target equipment,
120 home server, 140 processing unit, 148 history information update unit,
150 event determination unit, 152 control processing unit, 160 storage unit,
162 history information storage unit, 170 information transfer unit,
230 information acquisition unit, 232 communication unit, 234 sensor I / F unit, 240 processing unit,
242 Sensor selection unit, 244 Control target device selection unit, 246 calculation unit,
248 history information update unit, 250 event determination unit, 252 control processing unit,
260 storage unit, 262 history information storage unit, 270 information transfer unit,
272 communication unit, 274 device I / F unit,
300 robot, 310 robot mounting sensor 340 processing unit,
348 history information update unit, 350 event determination unit, 352 control processing unit,
360 storage unit, 362 history information storage unit, 370 information transfer unit,
386 robot controller, 390 robot operation mechanism,
620 Home server, 640 processing unit, 648 history information update unit,
650 event determination unit, 652 control processing unit, 660 storage unit,
662 history information storage unit, 670 information transfer unit,
700 navigation device, 740 processing unit, 748 history information updating unit,
750 event determination unit, 752 control processing unit, 760 storage unit,
762 history information storage unit, 770 information transfer unit, 786 control unit,
790 Car navigation display

Claims (27)

A control system for an integrated system of a plurality of subsystems, each of which has at least a sensor,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
An event determination means for determining occurrence of an available event indicating that a user who has used the first subsystem is now in a state where the second subsystem can be used;
When the available event occurs, the user history information updated by the sensor information from the first sensor that is the sensor of the first subsystem is changed to the second subsystem that is the sensor of the second subsystem. History information update means for further updating based on sensor information from the sensors;
A control system comprising: In claim 1,
User history information between the first history information storage means which is history information storage means of the first subsystem and the second history information storage means which is history information storage means of the second subsystem A control system comprising information transfer means for performing the transfer process. In claim 2,
The information transfer means includes
An information synchronization process is performed to maintain the user history information stored in the first history information storage means and the user history information stored in the second history information storage means as information of the same content. Control system. In claim 2 or 3,
The history information update means includes
The second sensor of the second subsystem for user history information transferred from the first history information storage means to the second history information storage means when the available event occurs A control system for performing update processing based on sensor information from In any of claims 2 to 4,
Control processing means for starting a control operation of a second control target device that is a control target device of the second subsystem when the available event occurs;
The control processing means includes
A control system for starting a control operation of the second device to be controlled using user history information stored in the second history information storage means. In claim 5,
The information transfer means includes
Before the available event occurs, user history information is transferred in advance from the first history information storage means to the second history information storage means,
The control processing means includes
When the available event occurs, a control system for starting the control operation of the second device to be controlled using the user history information previously transferred to the second history information storage means . In any one of Claims 1 thru | or 6.
The event determination means provided in the local server of the second subsystem;
A control system for determining that the available event has occurred when a user approaches the location of the second subsystem. In any one of Claims 1 thru | or 6.
The event determination means includes
A control system, wherein occurrence of the available event is determined by detecting a radio strength of communication performed between the first subsystem and the second subsystem. In any one of Claims 1 thru | or 6.
The event determination means includes
A control system, wherein when the device of the first subsystem is connected to a cradle that can be used in the second subsystem, it is determined that the available event has occurred. In any one of Claims 1 thru | or 9,
And a control processing unit that starts a control operation using user history information of a second control target device that is a control target device of the second subsystem when the available event occurs. Control system. A control system for an integrated system of a plurality of subsystems, each of which has at least a sensor,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
A user whose user history information is updated by sensor information from the first sensor that is the sensor of the first subsystem using the first subsystem can newly use the second subsystem. Event determination means for determining the occurrence of an available event indicating that a state has been reached;
Control processing means for starting a control operation using user history information of a second control target device that is a control target device of the second subsystem when the available event occurs;
A control system comprising: In claim 10 or 11,
The control processing means includes
When the available event occurs, the second control target device is turned on, or the second control target device is controlled to return from the low power consumption mode to the normal operation mode. And control system. In any of claims 10 to 12,
The control processing means includes
When an unusable event occurs in which the user cannot use the second control target device, the second control target device is turned off, or the second control target device is moved from the normal operation mode. A control system for performing control to shift to a low power consumption mode. In any of claims 10 to 13,
User history information between the first history information storage means which is history information storage means of the first subsystem and the second history information storage means which is history information storage means of the second subsystem Including information transfer means for performing transfer processing of
The event determination means includes
Determining the user's proximity to the location of the second subsystem;
The information transfer means includes
When the approaching state changes from the first approaching state to the second approaching state having a higher degree of approaching than the first approaching state, the user history information stored in the first history information storage means is , Transfer to the second history information storage means,
The control processing means includes
When the user approach state changes from the second approach state to a third approach state having a higher degree of approach than the second approach state, the second control target device using user history information A control system characterized by starting a control operation of. In claim 14,
The information transfer means includes
The user history information stored in the first history information storage means and the user history information stored in the second history information storage means during a period when the user approach state is the second approach state. And a control system for performing information synchronization processing for maintaining information of the same content. In claim 14 or 15,
The control processing means includes
Control that stops the control operation of the second device to be controlled using user history information when the user approach state changes from the second approach state to the first approach state. system. In any of claims 14 to 16,
The event determination means includes
The control system characterized in that the first, second, and third approach states are determined using at least two types of wireless communications that have different reception states depending on distances. A control system for an integrated system of a plurality of subsystems having a mobile subsystem and a home subsystem,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
An event determination means for determining occurrence of an available event indicating that a user who has used the mobile subsystem has newly entered a state in which the home subsystem can be used;
History information update for further updating the user history information updated with the sensor information from the sensor of the mobile subsystem based on the sensor information from the sensor of the home subsystem when the available event occurs Means,
A control system comprising: In claim 18,
The control system, wherein the event determination unit and the history information update unit are provided in a home server that is a local server of the home subsystem. A control system for an integrated system of a plurality of subsystems having at least one of a mobile subsystem and a home subsystem and an in-vehicle subsystem,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
Event determination means for determining occurrence of an available event indicating that a user who has used the mobile subsystem or the home subsystem is newly available for the in-vehicle subsystem;
When the available event occurs, the user history information updated based on the sensor information from the sensor of the mobile subsystem or the home subsystem is updated based on the sensor information from the sensor of the in-vehicle subsystem. , History information updating means for further updating,
A control system comprising: In claim 20,
A control system comprising control processing means for starting a control operation of a control target device of the in-vehicle subsystem using user history information when the available event occurs. In claim 21,
The history information update means includes
The user history information is updated based on operation information of the control target device or sensor information from sensors in the in-vehicle subsystem. A program for a control system for an integrated system of a plurality of subsystems, each subsystem having at least a sensor,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
An event determination means for determining occurrence of an available event indicating that a user who has used the first subsystem is in a state where the second subsystem can be used;
When the available event occurs, the user history information updated based on the sensor information from the first sensor that is the sensor of the first subsystem is the sensor of the second subsystem. Based on sensor information from the second sensor, as history information update means for further updating,
A program characterized by causing a computer to function. A program for a control system for an integrated system of a plurality of subsystems, each subsystem having at least a sensor,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
A user whose user history information is updated by sensor information from the first sensor that is the sensor of the first subsystem using the first subsystem can newly use the second subsystem. Event determination means for determining the occurrence of an available event indicating that a state has been reached;
As a control processing means for starting a control operation using user history information of a second control target device that is a control target device of the second subsystem when the available event occurs,
A program characterized by causing a computer to function. A control system program for an integrated system of a plurality of subsystems having a mobile subsystem and a home subsystem,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
An event determination means for determining occurrence of an available event indicating that a user who has used the mobile subsystem has newly entered a state in which the home subsystem can be used;
A history of further updating the user history information that has been updated based on the sensor information from the sensors of the mobile subsystem when the available event occurs, based on the sensor information from the sensors of the home subsystem As information update means,
A program characterized by causing a computer to function. A program for a control system for an integrated system of a plurality of subsystems having at least one of a mobile subsystem and a home subsystem and an in-vehicle subsystem,
History information obtained by at least one of a behavior sensor that measures a user's behavior, a state sensor that measures a user's state, and an environment sensor that measures a user's environment, and at least one of the user's behavior, state, and environment History information storage means for storing user history information which is history information about
Event determination means for determining occurrence of an available event indicating that a user who has used the mobile subsystem or the home subsystem is newly available for the in-vehicle subsystem;
When the available event occurs, the user history information updated based on the sensor information from the sensor of the mobile subsystem or the home subsystem is updated based on the sensor information from the sensor of the in-vehicle subsystem. As a history information update means for further updating,
A program characterized by causing a computer to function.   27. A computer-readable information storage medium, wherein the program according to any one of claims 23 to 26 is stored.

Images