[go: up one dir, main page]

WO2018168006A1 - Network system, information processing method, server, and terminal - Google Patents

Network system, information processing method, server, and terminal Download PDF

Info

Publication number
WO2018168006A1
WO2018168006A1 PCT/JP2017/031367 JP2017031367W WO2018168006A1 WO 2018168006 A1 WO2018168006 A1 WO 2018168006A1 JP 2017031367 W JP2017031367 W JP 2017031367W WO 2018168006 A1 WO2018168006 A1 WO 2018168006A1
Authority
WO
WIPO (PCT)
Prior art keywords
control signal
cpu
control
server
robot
Prior art date
Application number
PCT/JP2017/031367
Other languages
French (fr)
Japanese (ja)
Inventor
慎一郎 太田
実雄 阪本
竹内　正樹
孝之 永松
Original Assignee
シャープ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by シャープ株式会社 filed Critical シャープ株式会社
Publication of WO2018168006A1 publication Critical patent/WO2018168006A1/en

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F13/00—Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04Q—SELECTING
    • H04Q9/00—Arrangements in telecontrol or telemetry systems for selectively calling a substation from a main station, in which substation desired apparatus is selected for applying a control signal thereto or for obtaining measured values therefrom

Definitions

  • One embodiment of the present invention relates to a technique for remotely controlling a device using a control signal such as infrared rays.
  • JP-A-10-215493 discloses a peripheral device control device.
  • Patent Document 1 discloses a peripheral device control device.
  • Japanese Patent Application Laid-Open No. 2004-228561 eliminates the trouble and troublesome operation when learning a new remote control code set by connecting the peripheral device control device to the database service of the remote control code set.
  • An object of one embodiment of the present invention is to provide a network system, an information processing method, a server, a terminal capable of controlling each of a plurality of types of devices, and capable of specifying a control signal that is effective for devices around the device. Or to provide a terminal.
  • a network system acquires a first control signal from a remote controller and transmits the first control signal, and acquires a first control signal from the terminal and refers to a combination of a plurality of types of control signals.
  • a server that provides the terminal with data of a combination of one or more types of control signals including the first control signal.
  • a network system and information in which a terminal capable of controlling each of a plurality of types of devices can specify a control signal effective for its surrounding devices A processing method, server, or terminal is provided.
  • the network system 1 mainly includes a server 100, a communication terminal such as a robot 200 that provides various services to a user, an electric device such as an air conditioner 300A and a television 300B, an air conditioner 300A and a television. And a remote controller (also referred to as a remote controller) 200X for electrical equipment such as 300B.
  • a server 100 mainly includes a server 100, a communication terminal such as a robot 200 that provides various services to a user, an electric device such as an air conditioner 300A and a television 300B, an air conditioner 300A and a television.
  • a remote controller also referred to as a remote controller 200X for electrical equipment such as 300B.
  • Electrical devices are not limited to the air conditioner 300A and the television 300B, but include refrigerators, microwave ovens, washing machines, vacuum cleaners, air purifiers, humidifiers, dehumidifiers, rice cookers, lighting appliances, hard disk recorders, projectors, music AV (audio / visual) equipment such as players, game machines, personal computers, mobile phones, smartphones, built-in lighting, solar power generators, intercoms, water heaters, and housing equipment such as hot water washing toilet seat controllers, etc. .
  • these devices are also collectively referred to as an electric device 300.
  • the communication terminal is not limited to the robot 200 having a face and a torso.
  • the communication terminal is preferably a device that can be called a home assistant or a user assistant having various functions, but may be a device similar to the electrical device 300 described above.
  • one robot 200 can serve as a plurality of remote controllers 200X. More specifically, the robot 200 is capable of receiving a user command for controlling a plurality of types of electrical devices 300 and transmitting control signals for the plurality of types of electrical devices 300.
  • the server 100 and the robot 200 according to the present embodiment can also perform “voice guidance learning” in which the user registers control signals corresponding to standard control commands, “Dedicated individual learning” in which the user registers control commands and control signals is also possible.
  • the user inputs a command to the robot 200 for starting learning of a control signal of the dedicated remote controller 200X of the electric device 300. Then, based on the instruction from the server 100, the robot 200 requests the user for the type of home appliance and the manufacturer name, and also requests a predetermined control signal from the remote controller 200X.
  • the robot 200 detects a control signal from the remote controller 200X and transmits a home appliance name, a manufacturer name, and a control signal to the server 100.
  • the server 100 searches for a combination of control signals matching the condition from a database of combinations of a plurality of types of control signals corresponding to a plurality of types of home appliances and a plurality of types of manufacturers.
  • the server 100 downloads to the robot 200 a combination of control signals corresponding to the home appliance name, manufacturer name, and control signal.
  • a plurality of control signals that are acquired and used by each of the electric devices 300 for controlling one electric device 300 are collectively referred to as a combination of control signals.
  • the robot 200 stores a combination of control signals for the television downloaded from the server 100 in itself.
  • the robot 200 can control the television based on the user's voice command such as “turn on the television”.
  • the robot 200 stores only information for specifying a combination of control signals, and downloads a control signal from the server 100 based on the information and transmits it to the electric device 300 every time a control command from the user is received. May be.
  • the robot 200 starts to operate as a remote controller for the electric device 300 without manually inputting troublesome information to the robot 200.
  • the network system 1 can perform “voice guidance learning” and “discretion individual learning”.
  • a specific configuration of the network system 1 for realizing such a function will be described in detail.
  • server 100 includes a CPU (Central Processing Unit) 110, a memory 120, an operation unit 140, and a communication interface 160 as main components.
  • CPU Central Processing Unit
  • CPU 110 controls each unit of server 100 by executing a program stored in memory 120. For example, the CPU 110 executes various processes described later by referring to various data.
  • the memory 120 is realized by various RAMs (Random Access Memory), various ROMs (Read-Only Memory), and the like.
  • the memory 120 stores a program executed by the CPU 110, data generated by execution of the program by the CPU 110, input data, and the like.
  • the memory 120 stores a device information table 121 as shown in FIG.
  • the device information table 121 is a pattern for specifying a combination of a device ID, a device type, a user ID, a user name, an address, an address, and a control signal to be controlled for each device, for example. ID etc. are included.
  • the devices in the device information table 121 include the operated electric device 300 and the operated robot 200.
  • the memory 120 stores data of combinations of control signals for each manufacturer and each type of the electric device 300.
  • Each of the control signals includes a code for specifying a manufacturer, a code for checking an error, a code indicating a control signal, and the like, for example, as shown in FIG.
  • the memory 120 stores a standard instruction table 122 as shown in FIG.
  • the standard command table 122 includes typical control commands for each type of the typical electrical device 300.
  • a type ID that is 2-digit identification information is associated with each type of typical electrical device 300, and a control command ID that is 3-digit identification information for each typical control command.
  • the CPU 110 proceeds with “voice guidance learning” to be described later with reference to the standard command table 122.
  • the memory 120 stores a control signal pattern table 123 as shown in FIG.
  • the control signal pattern table 123 includes, for each control signal combination, a control signal pattern ID, a manufacturer ID, a manufacturer name, a type ID of the target electric device 300, a type name of the target electric device 300, It includes a plurality of control command IDs (three-digit identification information in FIG. 5), a plurality of control signals corresponding to each of the plurality of control commands, and the number of times the control signal pattern ID is finally adopted.
  • the control command is information corresponding to the name of a button on the remote control 200X, for example.
  • the memory 120 stores a guidance learning table 124 as shown in FIG.
  • the guidance learning table 124 is prepared in advance for each guidance learning, the guidance learning ID, the device ID of the robot 200 or remote controller that operates the electric device 300, the type of the electric device 300 to be operated, and one or more.
  • the control command ID (three-digit identification information in FIG. 5) and a plurality of control signals corresponding to the one or more control commands.
  • the memory 120 stores a discretionary individual learning table 125 as shown in FIG.
  • the discretionary individual learning table 125 includes, for each discretionary individual learning, an individual learning ID, a device ID of the robot 200 or remote controller that operates the electric device 300, a type of the electric device 300 to be operated, and one or a plurality of users.
  • a control instruction for a designated text and a control signal for each of the one or more control instructions are included.
  • the memory 120 further stores voice message data as shown in FIGS. 9 to 15 which is necessary when the remote control learning is advanced together with the user.
  • the operation unit 140 receives a command from a service manager and the like and inputs the command to the CPU 110.
  • the communication interface 160 transmits data from the CPU 110 to another device such as the robot 200 via the Internet, a carrier network, a router, or the like. Conversely, the communication interface 160 receives data from other devices such as the robot 200 via the Internet, a carrier network, a router, etc., and passes it to the CPU 110.
  • the electric device 300 includes a CPU 310, a memory 320, a display 330, an operation unit 340, a communication interface 360, a speaker 370, an infrared light receiving unit 380, and a device driving unit 390 as main components.
  • the CPU 310 controls each unit of the electric device 300 by executing a program stored in the memory 320 or an external storage medium.
  • the memory 320 is realized by various RAMs, various ROMs, and the like.
  • the memory 320 stores a program executed by the CPU 310, data generated by execution of the program by the CPU 310, data received from the server 100 or another server, data input via the operation unit 340, and the like.
  • Display 330 outputs characters and images based on signals from CPU 310.
  • Display 330 may simply be a light.
  • the operation unit 340 is realized by a button, a touch panel, or the like, receives a command from the user, and inputs the command to the CPU 310.
  • the display 330 and the operation unit 340 may constitute a touch panel.
  • the communication interface 360 is realized by a communication module such as a wireless LAN communication or a wired LAN.
  • the communication interface 360 exchanges data with other devices such as the server 100 by wired communication or wireless communication.
  • Speaker 370 outputs sound based on a signal from CPU 310.
  • the infrared light receiving unit 380 receives an infrared signal from the remote controller 200X, the robot 200, or the like, and inputs the signal to the CPU 310.
  • the device driving unit 390 controls each unit (such as a motor and a heater) of the electric device 300 based on a signal from the CPU 310.
  • the robot 200 includes, as main components, a CPU 210, a memory 220, a display 230, an operation unit 240, a camera 250, a communication interface 260, a speaker 270, a microphone 280, and a plurality of infrared transmission units 265A, 265B... And an infrared light receiver 290.
  • the CPU 210 controls each unit of the robot 200 by executing a program stored in the memory 220 or an external storage medium.
  • the memory 220 is realized by various RAMs, various ROMs, and the like.
  • the memory 220 is a program executed by the CPU 210, data generated by execution of the program by the CPU 210, data received from the server 100 or another server, data input via the operation unit 240, and control of the electric device 300. Stores signals and so on.
  • the memory 220 may store a combination of control signals of a plurality of types of electrical devices 300 for a long period of time, or the CPU 210 temporarily sends a corresponding control signal from the server 100 each time a control command is input. It may be obtained and transmitted from the infrared transmitters 265A, 265B.
  • Display 230 outputs characters, images, and the like based on signals from CPU 210.
  • Display 230 may simply be a light.
  • the operation unit 240 is realized by a button, a touch panel, or the like, receives a command from the user, and inputs the command to the CPU 210.
  • the display 230 and the operation unit 240 may constitute a touch panel.
  • the operation unit 240 may be a proximity sensor, a temperature sensor, or the like.
  • the CPU 210 detects that the user holds his / her hand over the robot 200 via a proximity sensor or a temperature sensor as the operation unit 240 and starts various operations.
  • the proximity sensor may be disposed in the vicinity of the forehead so that the robot 200 may detect that the user strokes or strikes the robot 200 and accepts it as a user operation.
  • the camera 250 takes an image and delivers the image data to the CPU 210.
  • the CPU 210 may specify the user's movement as an operation command based on the image data from the camera 250, or may provide the image data to the server 100 and the server 100 may specify the user's movement as the operation command. .
  • the communication interface 260 is realized by a communication module such as wireless LAN communication or wired LAN.
  • the communication interface 260 exchanges data with other devices such as the server 100 by wired communication or wireless communication.
  • Speaker 270 outputs sound based on a signal from CPU 210. More specifically, in the present embodiment, CPU 210 causes speaker 270 to output a voice message based on voice data received from server 100 via communication interface 260. Note that the process of converting text to audio data may be performed by the robot 200 or the server 100.
  • the microphone 280 creates an audio signal based on external audio and inputs it to the CPU 210. More specifically, in the present embodiment, CPU 210 transmits audio data acquired from microphone 280 to server 100 via communication interface 260.
  • the voice data analysis process may be performed by the robot 200 or the server 100.
  • the infrared transmitters 265A, 265B,... are arranged on the outer periphery of the robot 200, and transmit infrared signals in various directions around the robot 200 in response to signals from the CPU 210.
  • the infrared light receiving unit 290 receives an infrared signal from the remote controller 200X or the like and inputs the signal to the CPU 210. In addition, it is preferable that there are a plurality of infrared light receiving units 290 as well as the infrared transmitting unit.
  • robot 200 receives a remote control learning start voice instruction “learn remote control” from the user.
  • the CPU 210 of the robot 200 transmits the instruction to the server 100 via the communication interface 260.
  • the CPU 110 of the server 100 starts the “simple remote control learning” mode.
  • the CPU 110 instructs the robot 200 to ask the user the name of the electric device 300 to be controlled (step S111). Based on the instruction from the server 100, the CPU 210 of the robot 200 causes the speaker 270 to output a message “This is remote control learning. Which appliances do you want to learn: air conditioner, TV, lighting, or other appliances?” ( Step S112).
  • the CPU 110 of the server 100 executes the “discretion individual learning” mode described later (step S130) in the case of remote control learning of the electric device 300 other than the air conditioner, the television, and the lighting (NO in step S112).
  • the CPU 110 of the server 100 requests the maker name from the robot 200 via the communication interface 160 in the case of remote control learning of any one of the air conditioner, the television, and the lighting electric device 300 (YES in step S112).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a message “Television. Please tell me the maker name.”
  • CPU 210 transmits the sound received via microphone 280 to server 100 via communication interface 260 (step S113).
  • the CPU 110 of the server 100 recognizes that the target electric device 300 is manufactured by Company A from the audio data.
  • the CPU 110 requests a control signal from the robot 200 via the communication interface 160.
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “It is a TV of company A. Please point the remote control at this point and press the power button.”
  • the CPU 210 detects the control signal from the remote controller 200X with the infrared light receiver 290 (step S113).
  • CPU 110 transmits the detected control signal to server 100 via communication interface 260.
  • the CPU 110 of the server 100 searches for a combination of control signals including the received control signal (step S114).
  • step S ⁇ b> 114 when one or more combinations of control signals including the received control signal are found (YES in step S ⁇ b> 114), CPU 110 uses communication interface 160. Then, the robot 200 is caused to output a voice message “It is a television of company A. Please put me in front of the television.” The CPU 110 downloads a matched control signal combination or a predetermined control signal of the control signal combination to the robot 200 via the communication interface 160 (step S115).
  • the CPU 110 refers to the control signal pattern table 123 and provides the robot 200 with priority from the combination of the control signals having the highest rating. That is, in order to increase the possibility that the control signal downloaded to the robot 200 is correct, for example, as illustrated in FIG. 20, the CPU 110 sequentially selects combinations of control signals that are highly likely to match. Specifically, the CPU 110 refers to the control signal pattern table 123, and sequentially selects the combination of one or a plurality of control signals including the control signal received from the remote controller 200X from the most frequently used one. select.
  • CPU 210 transmits a power ON / OFF control signal from the combination of control signals from infrared transmitters 265A and 265B (step S116).
  • the CPU 210 causes the speaker 270 to output a voice message “Is the television turned on or has the television turned off?” (Step S117).
  • the CPU 210 transmits a message to that effect to the server 100.
  • the CPU 110 of the server 100 adds the pattern ID of the combination of control signals selected this time to the device information table 121 together with the device ID of the robot 200 and the type of the target electric device 300.
  • the CPU 110 increases the number of times of adoption corresponding to the pattern ID of the combination of control signals selected this time in the control signal pattern table 123 by one.
  • the CPU 110 ends the current “simple remote control learning” mode (step S150).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a message indicating that it has learned a control command for a combination of control signals including the signal, and ends the “simple remote control learning” mode.
  • step S 117 when the user issues a message “Do not respond” or “Cannot respond” (NO in step S 117), that is, a negative message via microphone 280. Is received, the CPU 210 transmits a message to that effect to the server 100.
  • CPU 110 of server 100 repeats the processing from step S115. That is, CPU 110 downloads the next highest rated signal among combinations of control signals including a control signal from remote controller 200X to robot 200 via communication interface 160 (step S115).
  • step S ⁇ b> 114 when CPU 110 does not find a combination of control signals including the received control signal (NO in step S ⁇ b> 114), CPU 110 performs “voice” described later.
  • the “guidance learning” mode is executed (step S120). In the present embodiment, CPU 110 executes the “voice guidance learning” mode even when a negative message is received a predetermined number of times or more in step S117.
  • step S120 the “voice guidance learning” mode (step S120) will be described with reference to FIG. 21 and FIG.
  • the CPU 110 of the server 100 causes the robot 200 to output a voice message “Sorry, it is a remote control signal that has not been registered. Please prepare a remote control for the television. .
  • the CPU 110 of the server 100 acquires the device ID of the robot 200 based on the data from the robot 200 (step S121).
  • CPU110 adds a new record to guidance learning table 124, and registers apparatus ID (step S122).
  • the CPU 110 registers the type of the target electric device 300 acquired in step S112 of FIG. 18 and the manufacturer name acquired in step S113 (step S123).
  • the CPU 110 refers to the standard command table 122 and identifies a control command for which no control signal has been registered yet for the target electric device 300 (step S124).
  • the CPU 110 requests a control signal from the robot 200 via the communication interface 160 (step S125).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the power button of the remote control toward me”.
  • the CPU 210 of the robot 200 receives a control signal from the remote controller 200X via any one of the infrared light receivers 290, the CPU 210 transmits the control signal to the server 100 via the communication interface 260.
  • step S126 When the CPU 110 of the server 100 receives the control signal from the robot 200 (YES in step S126), the CPU 110 registers the control signal in the guidance learning table 124 in association with the control command (step S127). CPU 110 determines whether there is another control command for which no control signal has been registered yet (step S128). If there is another control command for which no control signal is registered yet (YES in step S128), CPU 110 repeats the processing from step S124.
  • step S1291 the CPU 110 transmits a confirmation request to the robot 200 via the communication interface 160 (step S1291).
  • the CPU 210 of the robot 200 transmits a control signal from the infrared transmitters 265, 265,... For each registered control command, and outputs a voice message “Did the television react?” From the speaker 270. Then, CPU 210 re-acquires control signal from remote control 200X or re-transmits to electrical device 300 until a positive message is received only for a control command that has received a negative message from the user via microphone 280. Require the user to reconfirm with the user. When the acquisition / confirmation regarding all the control signals is completed, the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. If all control signals are correct, the CPU 210 transmits the fact to the server 100 via the communication interface 160.
  • CPU 110 of server 100 When there is an error in the control signal (when YES in step S1292), CPU 110 of server 100 re-registers the correct control signal received via communication interface 160 in guidance learning table 124 in association with the control command. (Step S1293). CPU 110 notifies robot 200 that registration has been completed via communication interface 160 (step S1295).
  • step S130 The CPU 110 of the server 100 acquires the device ID of the robot 200 based on the data from the robot 200 (step S131).
  • CPU110 adds a new record to discerning individual learning table 125, and registers apparatus ID (Step S132).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the name of the home appliance manufacturer and home appliance you want to register.”
  • the CPU 210 of the robot 200 receives the manufacturer name and the type of home appliance from the user via the microphone 280, the CPU 210 transmits the information to the server 100 via the communication interface 260.
  • the CPU 110 of the server 100 acquires the manufacturer name and the type of home appliance from the robot 200 via the communication interface 160, the CPU 110 registers it in the discretionary individual learning table 125 (step S135).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please tell me the name of the remote control button you want to register.”
  • the CPU 210 of the robot 200 receives the name of the button on the remote control from the user via the microphone 280, the CPU 210 transmits the information to the server 100 via the communication interface 260.
  • the CPU 110 of the server 100 acquires the name of the remote control button from the robot 200 via the communication interface 160 (YES in step S137), the text data control command is registered in the individual learning table 125 (step S138). ).
  • the voice data of the user's control command acquired from the microphone 280 by the CPU 210 of the robot 200 may be converted into text data and then sent to the server 100, or the voice data received by the CPU 110 of the server 100 from the robot 200 may be used. You may convert into text data.
  • the CPU 110 requests a control signal from the robot 200 via the communication interface 160 (step S139).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the power button of the remote control toward me”.
  • the CPU 210 of the robot 200 transmits the control signal to the server 100 via the communication interface 260.
  • step S140 When the CPU 110 of the server 100 receives the control signal from the robot 200 (YES in step S140), the CPU 110 associates the control signal with the control command and registers it in the individual learning table 125 (step S141).
  • the user can register a power-off control signal in association with the message “Let's go to sleep.” ”Can be registered in association with the message”, and the illuminance up control signal can be registered in association with the message “A little dark”. It is also possible to register a control signal in.
  • the CPU 110 sends an instruction for inquiring whether there is another control command for registering a control signal to the robot 200 via the communication interface 160 (step S142).
  • the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Do you want to continue registering the remote control button?”.
  • the CPU 210 of the robot 200 transmits the information to the server 100 via the communication interface 260.
  • CPU110 of the server 100 repeats the process from step S136, when there exists another control command which wants to register a control signal (when it is YES in step S143).
  • CPU 110 transmits a confirmation request to robot 200 via communication interface 160 (step S1491).
  • the CPU 210 of the robot 200 transmits a control signal from the infrared transmitters 265, 265... For each registered control command, and outputs a voice message “Did the air purifier react?” From the speaker 270. Let Then, CPU 210 re-acquires control signal from remote control 200X or re-transmits to electrical device 300 until a positive message is received only for a control command that has received a negative message from the user via microphone 280. Require the user to reconfirm with the user. When the acquisition / confirmation regarding all the control signals is completed, the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. If all control signals are correct, the CPU 210 transmits the fact to the server 100 via the communication interface 160.
  • step S1492 When there is an error in the control signal (YES in step S1492), the CPU 110 of the server 100 registers the correct control signal received via the communication interface 160 in the individual learning table 125 in association with the control command. This is corrected (step S1493). CPU 110 notifies robot 200 that the registration is completed via communication interface 160 (step S1495).
  • one control signal is registered for one control command, but a plurality of control signals may be registered for one control command. For example, in response to a control command “power OFF”, a control signal for “decrease volume” is output and then a control signal for “power OFF” is output, or “sound is low” For example, a control signal for “increasing the sound volume” may be output and then a control signal for “increasing the screen brightness” may be registered.
  • control commands may be registered in one control signal.
  • a control command “increase volume” and a control command “inaudible” may be registered in the control signal for “increase volume”.
  • confirmation processing (steps S1291 to 1293 and steps S1491 to S1493) is executed after registration of all control signals is completed in the “guidance learning” mode and the “discretion individual learning” mode. It was to be done. However, the confirmation process may be executed every time one control signal is registered.
  • step S127 every time the CPU 110 of the server 100 according to the present embodiment registers one control signal in association with the control command in the guidance learning table 124 ( In step S127), a confirmation request is transmitted to the robot 200 via the communication interface 160 (step S1271).
  • the CPU 210 of the robot 200 transmits a control signal registered in the server 100 this time from the infrared transmitters 265, 265... And outputs a voice message “Did the television react?” From the speaker 270.
  • the CPU 210 receives a negative message from the user via the microphone 280, until the positive message is received, the CPU 210 re-acquires the control signal from the remote controller 200X, re-transmits the electric signal to the electric device 300, or re-transmits the user. Ask the user for confirmation.
  • the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. Note that if the control signal is correct, the CPU 210 transmits that fact to the server 100 via the communication interface 160.
  • step S1272 If there is an error in the control signal (YES in step S1272), CPU 110 of server 100 re-registers the correct control signal received via communication interface 160 in guidance learning table 124 in association with the control command. (Step S1273). Thereafter, the CPU 110 executes processing from step S128.
  • step S141 every time the CPU 110 of the server 100 registers one control signal in the guidance learning table 124 in association with a control command (step S141).
  • a confirmation request is transmitted to the robot 200 via the communication interface 160 (step S1411).
  • the CPU 210 of the robot 200 transmits a control signal registered in the server 100 from the infrared transmitters 265, 265... And outputs a voice message “Did the air purifier react?” From the speaker 270. .
  • the CPU 210 receives a negative message from the user via the microphone 280, until the positive message is received, the CPU 210 re-acquires the control signal from the remote controller 200X, re-transmits the electric signal to the electric device 300, or re-transmits the user. Ask the user for confirmation.
  • the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. Note that if the control signal is correct, the CPU 210 transmits that fact to the server 100 via the communication interface 160.
  • step S1412 When there is an error in the control signal (YES in step S1412), the CPU 110 of the server 100 registers the correct control signal received via the communication interface 160 in the discriminating individual learning table 125 in association with the control command. This is done (step S1413). And CPU110 performs the process from step S142.
  • step S138 of the “discretion individual learning” mode of FIG. 22 and FIG. 24 a text control command corresponding to the voice input by the user is registered in the discernment individual learning table 125. It was something to do.
  • the CPU 110 may stick to the user's voice data received from the robot 200 as a control command and register it in the individual learning table 125B.
  • the memory 120 of the server 100 stores a discretion individual learning table 125B as shown in FIG.
  • the CPU 110 of the server 100 matches the audio data registered in step S138 with the input audio data, and the control command and The control signal is specified, and the control signal is provided to the robot 200 via the communication interface 160.
  • the robot 200 can send a music output control signal to a music player based on a baby's cry.
  • one control signal is registered for one control command, but a plurality of control signals may be registered for one control command. For example, in response to a control command “power OFF”, a control signal for “decrease volume” is output and then a control signal for “power OFF” is output, or “sound is low” For example, a control signal for “increasing the sound volume” may be output and then a control signal for “increasing the screen brightness” may be registered.
  • control commands may be registered in one control signal.
  • a control command “increase volume” and a control command “inaudible” may be registered in the control signal for “increase volume”.
  • the robot 200 according to the first to third embodiments transmits infrared rays as a control signal for the electric device 300, but may use other electromagnetic waves or sound waves, for example.
  • the above technique is convenient for a network system in which it is easy to send a control signal from a remote controller other than infrared rays but it is difficult to receive an answer from the electric device 300.
  • robot 200 having the face and the torso as shown in FIG. 1, and may be a communication terminal having another shape such as a self-propelled cleaner.
  • each device is not limited to the structure, function, and operation of the server 100, the robot 200, the remote controller 200X, and the electric device 300 as in the first to fourth embodiments. It may be shared by a plurality of devices. Conversely, some or all of the roles of a plurality of devices may be integrated into one device.
  • the robot 200 may have the role of the server 100 according to the first to fourth embodiments.
  • the CPU 210 of the robot 200 causes the speaker 270 to output a message “Please tell the name of the manufacturer.”
  • the CPU 210 causes the speaker 270 to output a message “Please point the remote control at me and press the power button”.
  • the CPU 210 detects a control signal from the remote controller 200X via the infrared light receiving unit 290, refers to its own database, and stores the home appliance name, manufacturer name, control signal, A combination of control signals matching the condition is retrieved from a combination of a plurality of types of control signals corresponding to.
  • the CPU 210 of the robot 200 registers a combination of control signals corresponding to the home appliance name, manufacturer name, and control signal in the memory 220 as a TV control signal.
  • the user receives a voice command such as “Turn on the TV” via the microphone 280, and the CPU 210 turns on the power for the TV via the infrared light emitting units 265a, 265b. Send a control signal.
  • a voice command such as “Turn on the TV” via the microphone 280
  • the CPU 210 turns on the power for the TV via the infrared light emitting units 265a, 265b.
  • the robot 200 according to the present embodiment may also have a “voice guidance learning” mode function and a “discretion individual learning” mode function that the server 100 according to the first to fourth embodiments has.
  • one embodiment of the present invention can also be applied to a case where the object is achieved by supplying a program to a system or apparatus. Then, a storage medium (or memory) storing a program represented by software for achieving one embodiment of the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores it. The effect of one embodiment of the present invention can also be enjoyed by reading and executing the program code stored in the medium.
  • the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes one aspect of the present invention.
  • Network system 100 Server 110: CPU 120: Memory 121: Device information table 122: Control signal pattern table 123: Standard command table 124: Guidance learning table 125: Individual learning table 125B: Individual learning table 140: Operation unit 160: Communication interface 200: Robot 200X: Dedicated remote controller 210 : CPU 220: Memory 230: Display 240: Operation unit 250: Camera 260: Communication interface 265: Infrared transmission unit 270: Speaker 280: Microphone 290: Infrared light receiving unit 300: Electric device 300A: Air conditioner 300B: Television 310: CPU 320: Memory 330: Display 340: Operation unit 360: Communication interface 370: Speaker 380: Infrared light receiving unit 390: Device driving unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)

Abstract

A network system (1) is provided with: a terminal (200) which acquires a first control signal from a remote controller (200X) and transmits the first control signal; and a server (100) which acquires the first control signal from the terminal (200), and by referring to multiple kinds of combinations of control signals, provides data of one or more kinds of combinations of control signals including the first control signal to the terminal (200).

Description

ネットワークシステム、情報処理方法、サーバ、および端末Network system, information processing method, server, and terminal
　本発明の一態様は、赤外線などの制御信号を利用して機器をリモートコントロールするための技術に関する。 One embodiment of the present invention relates to a technique for remotely controlling a device using a control signal such as infrared rays.
　従来から、赤外線などを利用して機器をリモートコントロールするための技術が知られている。たとえば、特開平１０－２１５４９３号公報（特許文献１）には、周辺機器コントロール装置が開示されている。特許文献１は、周辺機器コントロール装置をリモコンコードセットのデータベースサービスと接続することにより、新しいリモコンコードセットを学習させる際の手間と取り付きにくい操作を省くものである。 Conventionally, a technique for remotely controlling devices using infrared rays or the like is known. For example, JP-A-10-215493 (Patent Document 1) discloses a peripheral device control device. Japanese Patent Application Laid-Open No. 2004-228561 eliminates the trouble and troublesome operation when learning a new remote control code set by connecting the peripheral device control device to the database service of the remote control code set.
特開平１０－２１５４９３号公報Japanese Patent Laid-Open No. 10-215493
　本発明の一態様の目的は、複数種類の機器のそれぞれを制御することが可能な端末が、自分の周囲の機器に有効な制御信号を特定することができるネットワークシステム、情報処理方法、サーバ、または端末を提供することにある。 An object of one embodiment of the present invention is to provide a network system, an information processing method, a server, a terminal capable of controlling each of a plurality of types of devices, and capable of specifying a control signal that is effective for devices around the device. Or to provide a terminal.
　本発明のある態様に従うと、ネットワークシステムが提供される。ネットワークシステムは、リモコンからの第１の制御信号を取得して当該第１の制御信号を送信する端末と、端末からの第１の制御信号を取得して、複数種類の制御信号の組み合わせを参照することによって、当該第１の制御信号を含む１または複数種類の制御信号の組み合わせのデータを端末に提供するサーバと、を備える。 According to an aspect of the present invention, a network system is provided. The network system acquires a first control signal from a remote controller and transmits the first control signal, and acquires a first control signal from the terminal and refers to a combination of a plurality of types of control signals. And a server that provides the terminal with data of a combination of one or more types of control signals including the first control signal.
　以上のように、本発明の一態様によれば、複数種類の機器のそれぞれを制御することが可能な端末が、自分の周囲の機器に有効な制御信号を特定することができるネットワークシステム、情報処理方法、サーバ、または端末が提供される。 As described above, according to one aspect of the present invention, a network system and information in which a terminal capable of controlling each of a plurality of types of devices can specify a control signal effective for its surrounding devices. A processing method, server, or terminal is provided.
第１の実施の形態にかかるネットワークシステム１の全体構成と簡単リモコン学習時の動作概要とを示す図である。It is a figure which shows the whole structure of the network system 1 concerning 1st Embodiment, and the operation | movement outline | summary at the time of simple remote control learning. 第１の実施の形態にかかるネットワークシステム１のサーバ１００の構成を示すブロック図である。It is a block diagram which shows the structure of the server 100 of the network system 1 concerning 1st Embodiment. 第１の実施の形態にかかる機器情報テーブル１２１を示すイメージ図である。It is an image figure which shows the apparatus information table 121 concerning 1st Embodiment. 第１の実施の形態にかかる制御信号の例を示すイメージ図である。It is an image figure which shows the example of the control signal concerning 1st Embodiment. 第１の実施の形態にかかる標準命令テーブル１２２を示すイメージ図である。It is an image figure which shows the standard command table 122 concerning 1st Embodiment. 第１の実施の形態にかかる制御信号パターンテーブル１２３を示すイメージ図である。It is an image figure which shows the control signal pattern table 123 concerning 1st Embodiment. 第１の実施の形態にかかるガイダンス学習テーブル１２４を示すイメージ図である。It is an image figure which shows the guidance learning table 124 concerning 1st Embodiment. 第１の実施の形態にかかるこだわり個別学習テーブル１２５を示すイメージ図である。It is an image figure which shows the discreet individual learning table 125 concerning 1st Embodiment. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第１の図である。It is a 1st figure which shows the relationship between the voice message and information processing concerning 1st Embodiment. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第２の図である。It is a 2nd figure which shows the relationship between the voice message and information processing concerning 1st Embodiment. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第３の図である。It is a 3rd figure which shows the relationship between the audio | voice message concerning 1st Embodiment, and information processing. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第４の図である。It is a 4th figure which shows the relationship between the voice message concerning 1st Embodiment, and information processing. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第５の図である。It is a 5th figure which shows the relationship between the voice message and information processing concerning 1st Embodiment. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第６の図である。It is a 6th figure which shows the relationship between the voice message and information processing concerning 1st Embodiment. 第１の実施の形態にかかる音声メッセージと情報処理との関係を示す第７の図である。It is a 7th figure which shows the relationship between the voice message and information processing concerning 1st Embodiment. 第１の実施の形態にかかる電気機器３００の構成を示すブロック図である。It is a block diagram which shows the structure of the electric equipment 300 concerning 1st Embodiment. 第１の実施の形態にかかるロボット２００の構成を示すブロック図である。It is a block diagram which shows the structure of the robot 200 concerning 1st Embodiment. 第１の実施の形態にかかるネットワークシステム１における制御信号特定のための情報処理を示すフローチャートである。It is a flowchart which shows the information processing for the control signal specification in the network system 1 concerning 1st Embodiment. 第１の実施の形態にかかるネットワークシステム１における「簡単リモコン学習」モードにおける動作概要を示すフローチャートである。It is a flowchart which shows the operation | movement outline | summary in the "easy remote control learning" mode in the network system 1 concerning 1st Embodiment. 第１の実施の形態にかかるレーティングを示すイメージ図である。It is an image figure which shows the rating concerning 1st Embodiment. 第１の実施の形態にかかるネットワークシステム１における「音声ガイダンス学習」モードにおける情報処理を示すフローチャートである。It is a flowchart which shows the information processing in the "voice guidance learning" mode in the network system 1 concerning 1st Embodiment. 第１の実施の形態にかかるネットワークシステム１における「こだわり個別学習」モードにおける情報処理を示すフローチャートである。It is a flowchart which shows the information processing in the "discretion individual learning" mode in the network system 1 concerning 1st Embodiment. 第２の実施の形態にかかるネットワークシステム１における「音声ガイダンス学習」モードにおける情報処理を示すフローチャートである。It is a flowchart which shows the information processing in the "voice guidance learning" mode in the network system 1 concerning 2nd Embodiment. 第２の実施の形態にかかるネットワークシステム１における「こだわり個別学習」モードにおける情報処理を示すフローチャートである。It is a flowchart which shows the information processing in the "discretion individual learning" mode in the network system 1 concerning 2nd Embodiment. 第３の実施の形態にかかるこだわり個別学習テーブル１２５を示すイメージ図である。It is an image figure which shows the discreet individual learning table 125 concerning 3rd Embodiment. 第５の実施の形態にかかるネットワークシステム１の全体構成と簡単リモコン学習時の動作概要とを示す図である。It is a figure which shows the whole structure of the network system 1 concerning 5th Embodiment, and the operation | movement outline | summary at the time of simple remote control learning.
　以下、図面を参照しつつ、本発明の実施の形態について説明する。以下の説明では、同一の部品には同一の符号を付してある。それらの名称および機能も同じである。したがって、それらについての詳細な説明は繰り返さない。 Hereinafter, embodiments of the present invention will be described with reference to the drawings. In the following description, the same parts are denoted by the same reference numerals. Their names and functions are also the same. Therefore, detailed description thereof will not be repeated.
　＜第１の実施の形態＞
　＜ネットワークシステム１の全体構成＞
　まず、図１を参照して本実施の形態にかかるネットワークシステム１の全体構成について説明する。本実施の形態にかかるネットワークシステム１は、主に、サーバ１００と、各種サービスをユーザに提供してくれるロボット２００などの通信端末と、エアコン３００Ａやテレビ３００Ｂなどの電気機器と、エアコン３００Ａやテレビ３００Ｂなどの電気機器のためのリモートコントローラ（リモコンともいう。）２００Ｘと、を含む。 <First Embodiment>
<Overall configuration of network system 1>
First, the overall configuration of the network system 1 according to the present embodiment will be described with reference to FIG. The network system 1 according to the present embodiment mainly includes a server 100, a communication terminal such as a robot 200 that provides various services to a user, an electric device such as an air conditioner 300A and a television 300B, an air conditioner 300A and a television. And a remote controller (also referred to as a remote controller) 200X for electrical equipment such as 300B.
　なお、電気機器は、エアコン３００Ａやテレビ３００Ｂに限らず、冷蔵庫、電子レンジ、洗濯機、掃除機、空気清浄器、加湿器、除湿器、炊飯器、照明などの家電、ハードディスクレコーダ、プロジェクタ、音楽プレーヤ、ゲーム機、パーソナルコンピュータ、携帯電話、スマートフォンなどのＡＶ（オーディオ・ビジュアル）機器、組み込み照明、太陽光発電機、インターホン、給湯器、温水洗浄便座コントローラなどの住宅設備、などであってもよい。なお、以下では、これらの装置を総称して、電気機器３００ともいう。 Electrical devices are not limited to the air conditioner 300A and the television 300B, but include refrigerators, microwave ovens, washing machines, vacuum cleaners, air purifiers, humidifiers, dehumidifiers, rice cookers, lighting appliances, hard disk recorders, projectors, music AV (audio / visual) equipment such as players, game machines, personal computers, mobile phones, smartphones, built-in lighting, solar power generators, intercoms, water heaters, and housing equipment such as hot water washing toilet seat controllers, etc. . Hereinafter, these devices are also collectively referred to as an electric device 300.
　また、通信端末も、顔や胴体を有するロボット２００には限られない。通信端末は、各種の機能を有するホームアシスタントあるいはユーザアシスタントといえる機器であることが好ましいが、上記の電気機器３００と同様の機器であってもよい。 Further, the communication terminal is not limited to the robot 200 having a face and a torso. The communication terminal is preferably a device that can be called a home assistant or a user assistant having various functions, but may be a device similar to the electrical device 300 described above.
　＜ネットワークシステム１の簡単リモコン学習時の動作概要＞
　本実施の形態においては、ロボット２００が、一台で、複数のリモコン２００Ｘの役割を果たすことができるものである。より詳細には、ロボット２００は、複数種類の電気機器３００を制御するためのユーザ命令を受け付けて、複数種類の電気機器３００の制御信号を発信することができるものである。ここでは、動作概要として、ロボット２００に電気機器３００の制御信号を覚えさせるための処理のうちの「簡単リモコン学習」について説明する。なお、後述するように、本実施の形態におけるサーバ１００やロボット２００は、他にも、標準的な制御命令に対応する制御信号をユーザが登録していく「音声ガイダンス学習」や、ユーザ所望の制御命令と制御信号とをユーザが登録する「こだわり個別学習」も可能である。 <Outline of operation of network system 1 when learning simple remote control>
In the present embodiment, one robot 200 can serve as a plurality of remote controllers 200X. More specifically, the robot 200 is capable of receiving a user command for controlling a plurality of types of electrical devices 300 and transmitting control signals for the plurality of types of electrical devices 300. Here, as an outline of the operation, “simple remote control learning” in the process for causing the robot 200 to remember the control signal of the electric device 300 will be described. As will be described later, the server 100 and the robot 200 according to the present embodiment can also perform “voice guidance learning” in which the user registers control signals corresponding to standard control commands, “Dedicated individual learning” in which the user registers control commands and control signals is also possible.
　（１）まず、ユーザが、ロボット２００のために、電気機器３００の専用リモコン２００Ｘの制御信号の学習を開始するための命令をロボット２００に入力する。すると、ロボット２００は、サーバ１００からの指示に基づいて、ユーザに家電の種類とメーカ名とを要求し、リモコン２００Ｘからの所定の制御信号も要求する。 (1) First, for the robot 200, the user inputs a command to the robot 200 for starting learning of a control signal of the dedicated remote controller 200X of the electric device 300. Then, based on the instruction from the server 100, the robot 200 requests the user for the type of home appliance and the manufacturer name, and also requests a predetermined control signal from the remote controller 200X.
　（２）ユーザがロボット２００に向けてリモコン２００Ｘの所定のボタンを押すと、ロボット２００は、リモコン２００Ｘからの制御信号を検知して、家電名とメーカ名と制御信号とをサーバ１００に送信する。サーバ１００は、複数種類の家電と複数種類のメーカとに対応した複数種類の制御信号の組み合わせのデータベースから、当該条件にマッチする制御信号の組み合わせを検索する。 (2) When the user presses a predetermined button on the remote controller 200X toward the robot 200, the robot 200 detects a control signal from the remote controller 200X and transmits a home appliance name, a manufacturer name, and a control signal to the server 100. . The server 100 searches for a combination of control signals matching the condition from a database of combinations of a plurality of types of control signals corresponding to a plurality of types of home appliances and a plurality of types of manufacturers.
　（３）サーバ１００は、家電名とメーカ名と制御信号とに対応する制御信号の組み合わせをロボット２００にダウンロードする。本実施の形態においては、電気機器３００の各々が１つの電気機器３００の制御のために取得・利用する複数の制御信号を、まとめて、制御信号の組み合わせという。 (3) The server 100 downloads to the robot 200 a combination of control signals corresponding to the home appliance name, manufacturer name, and control signal. In the present embodiment, a plurality of control signals that are acquired and used by each of the electric devices 300 for controlling one electric device 300 are collectively referred to as a combination of control signals.
　（４）ロボット２００は、サーバ１００からダウンロードしたテレビのための制御信号の組み合わせを自身に格納する。 (4) The robot 200 stores a combination of control signals for the television downloaded from the server 100 in itself.
　（５）そのあとは、ユーザの「テレビをつけて。」などという音声命令に基づいて、ロボット２００がテレビを制御することができる。ただし、ロボット２００は、制御信号の組み合わせを特定するための情報のみを格納して、ユーザからの制御命令を受け付ける度に当該情報に基づいてサーバ１００から制御信号をダウンロードして電気機器３００に発信してもよい。 (5) After that, the robot 200 can control the television based on the user's voice command such as “turn on the television”. However, the robot 200 stores only information for specifying a combination of control signals, and downloads a control signal from the server 100 based on the information and transmits it to the electric device 300 every time a control command from the user is received. May be.
　このように、本実施の形態においては、ユーザがロボット２００に面倒な情報を手入力することなく、ロボット２００が電気機器３００のリモコンとして動作し始めてくれる。本実施の形態にかかるネットワークシステム１は、上述した通り「音声ガイダンス学習」や「こだわり個別学習」も可能である。以下、このような機能を実現するためのネットワークシステム１の具体的な構成について詳述する。 As described above, in this embodiment, the robot 200 starts to operate as a remote controller for the electric device 300 without manually inputting troublesome information to the robot 200. As described above, the network system 1 according to the present embodiment can perform “voice guidance learning” and “discretion individual learning”. Hereinafter, a specific configuration of the network system 1 for realizing such a function will be described in detail.
　＜サーバ１００のハードウェア構成＞
　まず、本実施の形態にかかるネットワークシステム１を構成するサーバ１００の構成の一態様について説明する。図２を参照して、サーバ１００は、主たる構成要素として、ＣＰＵ（Central Processing Unit）１１０と、メモリ１２０と、操作部１４０と、通信インターフェイス１６０とを含む。 <Hardware Configuration of Server 100>
First, an aspect of the configuration of the server 100 configuring the network system 1 according to the present embodiment will be described. Referring to FIG. 2, server 100 includes a CPU (Central Processing Unit) 110, a memory 120, an operation unit 140, and a communication interface 160 as main components.
　ＣＰＵ１１０は、メモリ１２０に記憶されているプログラムを実行することによって、サーバ１００の各部を制御する。たとえば、ＣＰＵ１１０は、各種のデータを参照することによって後述する各種の処理を実行する。 CPU 110 controls each unit of server 100 by executing a program stored in memory 120. For example, the CPU 110 executes various processes described later by referring to various data.
　メモリ１２０は、各種のＲＡＭ（Random　Access　Memory）、各種のＲＯＭ（Read-Only　Memory）などによって実現される。メモリ１２０は、ＣＰＵ１１０によって実行されるプログラムや、ＣＰＵ１１０によるプログラムの実行により生成されたデータ、入力されたデータなどを記憶する。 The memory 120 is realized by various RAMs (Random Access Memory), various ROMs (Read-Only Memory), and the like. The memory 120 stores a program executed by the CPU 110, data generated by execution of the program by the CPU 110, input data, and the like.
　本実施の形態にかかるメモリ１２０は、図３に示すような機器情報テーブル１２１を記憶する。機器情報テーブル１２１は、たとえば機器毎に、機器ＩＤと、機器の種類と、ユーザのＩＤと、ユーザ名と、住所と、アドレスと、制御される際の制御信号の組み合わせを特定するためのパターンＩＤなどを含む。機器情報テーブル１２１の機器には、操作される側の電気機器３００も、操作する側のロボット２００なども含まれる。 The memory 120 according to the present embodiment stores a device information table 121 as shown in FIG. The device information table 121 is a pattern for specifying a combination of a device ID, a device type, a user ID, a user name, an address, an address, and a control signal to be controlled for each device, for example. ID etc. are included. The devices in the device information table 121 include the operated electric device 300 and the operated robot 200.
　メモリ１２０は、メーカ毎および電気機器３００の種類毎の制御信号の組み合わせのデータを記憶する。なお、制御信号の各々は、たとえば図４に示すように、メーカを特定するためのコードやエラーをチェックするためのコードや制御信号を示すコードなどを含むものである。 The memory 120 stores data of combinations of control signals for each manufacturer and each type of the electric device 300. Each of the control signals includes a code for specifying a manufacturer, a code for checking an error, a code indicating a control signal, and the like, for example, as shown in FIG.
　メモリ１２０は、図５に示すような、標準命令テーブル１２２を記憶する。標準命令テーブル１２２は、典型的な電気機器３００の種類毎に、典型的な制御命令を含む。なお、本実施の形態においては、典型的な電気機器３００の種類毎に２ケタの識別情報である種類ＩＤが対応付けられ、典型的な制御命令毎に３ケタの識別情報である制御命令ＩＤが対応付けられる。ＣＰＵ１１０は、標準命令テーブル１２２を参照しながら、後述する「音声ガイダンス学習」を進めていく。 The memory 120 stores a standard instruction table 122 as shown in FIG. The standard command table 122 includes typical control commands for each type of the typical electrical device 300. In the present embodiment, a type ID that is 2-digit identification information is associated with each type of typical electrical device 300, and a control command ID that is 3-digit identification information for each typical control command. Are associated. The CPU 110 proceeds with “voice guidance learning” to be described later with reference to the standard command table 122.
　メモリ１２０は、図６に示すような、制御信号パターンテーブル１２３を記憶する。制御信号パターンテーブル１２３は、制御信号の組み合わせ毎に、制御信号パターンＩＤと、メーカＩＤと、メーカ名と、対象となる電気機器３００の種類ＩＤと、対象となる電気機器３００の種類名と、複数の制御命令ＩＤ（図５の３ケタの識別情報）と、当該複数の制御命令のそれぞれに対応する複数の制御信号と、制御信号パターンＩＤが最終的に採用された回数とを含む。なお、制御命令とは、たとえば、リモコン２００Ｘのボタンの名前に相当する情報である。 The memory 120 stores a control signal pattern table 123 as shown in FIG. The control signal pattern table 123 includes, for each control signal combination, a control signal pattern ID, a manufacturer ID, a manufacturer name, a type ID of the target electric device 300, a type name of the target electric device 300, It includes a plurality of control command IDs (three-digit identification information in FIG. 5), a plurality of control signals corresponding to each of the plurality of control commands, and the number of times the control signal pattern ID is finally adopted. The control command is information corresponding to the name of a button on the remote control 200X, for example.
　メモリ１２０は、図７に示すような、ガイダンス学習テーブル１２４を記憶する。ガイダンス学習テーブル１２４は、ガイダンス学習毎に、ガイダンス学習ＩＤと、電気機器３００を操作するロボット２００やリモコンの機器ＩＤと、操作される側の電気機器３００の種類と、１または複数の予め準備された制御命令ＩＤ（図５の３ケタの識別情報）と、当該１または複数の制御命令に対応する複数の制御信号を含む。 The memory 120 stores a guidance learning table 124 as shown in FIG. The guidance learning table 124 is prepared in advance for each guidance learning, the guidance learning ID, the device ID of the robot 200 or remote controller that operates the electric device 300, the type of the electric device 300 to be operated, and one or more. The control command ID (three-digit identification information in FIG. 5) and a plurality of control signals corresponding to the one or more control commands.
　メモリ１２０は、図８に示すような、こだわり個別学習テーブル１２５を記憶する。こだわり個別学習テーブル１２５は、こだわり個別学習毎に、個別学習ＩＤと、電気機器３００を操作するロボット２００やリモコンの機器ＩＤと、操作される側の電気機器３００の種類と、１または複数のユーザ指定のテキストの制御命令と、当該１または複数の制御命令毎の制御信号を含む。 The memory 120 stores a discretionary individual learning table 125 as shown in FIG. The discretionary individual learning table 125 includes, for each discretionary individual learning, an individual learning ID, a device ID of the robot 200 or remote controller that operates the electric device 300, a type of the electric device 300 to be operated, and one or a plurality of users. A control instruction for a designated text and a control signal for each of the one or more control instructions are included.
　メモリ１２０は、さらに、ユーザと一緒にリモコン学習を進めていく際に必要な、図９から図１５に示すような音声メッセージのデータを格納する。 The memory 120 further stores voice message data as shown in FIGS. 9 to 15 which is necessary when the remote control learning is advanced together with the user.
　図２に戻って、操作部１４０は、サービスの管理者などの命令を受け付けて、当該命令をＣＰＵ１１０に入力する。 Returning to FIG. 2, the operation unit 140 receives a command from a service manager and the like and inputs the command to the CPU 110.
　通信インターフェイス１６０は、ＣＰＵ１１０からのデータを、インターネット、キャリア網、ルータなどを介してロボット２００などの他の装置に送信する。逆に、通信インターフェイス１６０は、インターネット、キャリア網、ルータなどを介してロボット２００などの他の装置からのデータを受信して、ＣＰＵ１１０に受け渡す。 The communication interface 160 transmits data from the CPU 110 to another device such as the robot 200 via the Internet, a carrier network, a router, or the like. Conversely, the communication interface 160 receives data from other devices such as the robot 200 via the Internet, a carrier network, a router, etc., and passes it to the CPU 110.
　＜電気機器３００のハードウェア構成＞
　次に、図１６を参照して、ネットワークシステム１を構成する電気機器３００の構成の一態様について説明する。電気機器３００は、主たる構成要素として、ＣＰＵ３１０と、メモリ３２０と、ディスプレイ３３０と、操作部３４０と、通信インターフェイス３６０と、スピーカ３７０と、赤外線受光部３８０と、機器駆動部３９０とを含む。 <Hardware Configuration of Electric Device 300>
Next, with reference to FIG. 16, one aspect of the configuration of the electric device 300 configuring the network system 1 will be described. The electric device 300 includes a CPU 310, a memory 320, a display 330, an operation unit 340, a communication interface 360, a speaker 370, an infrared light receiving unit 380, and a device driving unit 390 as main components.
　ＣＰＵ３１０は、メモリ３２０あるいは外部の記憶媒体に記憶されているプログラムを実行することによって、電気機器３００の各部を制御する。 The CPU 310 controls each unit of the electric device 300 by executing a program stored in the memory 320 or an external storage medium.
　メモリ３２０は、各種のＲＡＭや、各種のＲＯＭなどによって実現される。メモリ３２０は、ＣＰＵ３１０によって実行されるプログラムや、ＣＰＵ３１０によるプログラムの実行により生成されたデータ、サーバ１００や他のサーバから受信したデータ、操作部３４０を介して入力されたデータなどを記憶する。 The memory 320 is realized by various RAMs, various ROMs, and the like. The memory 320 stores a program executed by the CPU 310, data generated by execution of the program by the CPU 310, data received from the server 100 or another server, data input via the operation unit 340, and the like.
　ディスプレイ３３０は、ＣＰＵ３１０からの信号に基づいて、文字や画像などを出力する。ディスプレイ３３０は、単にライトであってもよい。 Display 330 outputs characters and images based on signals from CPU 310. Display 330 may simply be a light.
　操作部３４０は、ボタン、タッチパネルなどによって実現され、ユーザからの命令を受け付けて、当該命令をＣＰＵ３１０に入力する。なお、ディスプレイ３３０と操作部３４０とは、タッチパネルを構成してもよい。 The operation unit 340 is realized by a button, a touch panel, or the like, receives a command from the user, and inputs the command to the CPU 310. The display 330 and the operation unit 340 may constitute a touch panel.
　通信インターフェイス３６０は、無線ＬＡＮ通信あるいは有線ＬＡＮなどの通信モジュールによって実現される。通信インターフェイス３６０は、有線通信あるいは無線通信によってサーバ１００などの他の装置との間でデータをやり取りする。 The communication interface 360 is realized by a communication module such as a wireless LAN communication or a wired LAN. The communication interface 360 exchanges data with other devices such as the server 100 by wired communication or wireless communication.
　スピーカ３７０は、ＣＰＵ３１０からの信号に基づいて、音声を出力する。 Speaker 370 outputs sound based on a signal from CPU 310.
　赤外線受光部３８０は、リモコン２００Ｘやロボット２００などからの赤外線信号を受信して、当該信号をＣＰＵ３１０に入力する。 The infrared light receiving unit 380 receives an infrared signal from the remote controller 200X, the robot 200, or the like, and inputs the signal to the CPU 310.
　機器駆動部３９０は、ＣＰＵ３１０からの信号に基づいて、電気機器３００の各部（モータやヒータなど）を制御する。 The device driving unit 390 controls each unit (such as a motor and a heater) of the electric device 300 based on a signal from the CPU 310.
　＜ロボット２００のハードウェア構成＞
　次に、図１７を参照して、ネットワークシステム１を構成するロボット２００の構成の一態様について説明する。ロボット２００は、主たる構成要素として、ＣＰＵ２１０と、メモリ２２０と、ディスプレイ２３０と、操作部２４０と、カメラ２５０、通信インターフェイス２６０と、スピーカ２７０と、マイク２８０と、周囲に複数の赤外線発信部２６５Ａ，２６５Ｂ・・・と、赤外線受光部２９０とを含む。 <Hardware configuration of robot 200>
Next, an aspect of the configuration of the robot 200 that configures the network system 1 will be described with reference to FIG. The robot 200 includes, as main components, a CPU 210, a memory 220, a display 230, an operation unit 240, a camera 250, a communication interface 260, a speaker 270, a microphone 280, and a plurality of infrared transmission units 265A, 265B... And an infrared light receiver 290.
　ＣＰＵ２１０は、メモリ２２０あるいは外部の記憶媒体に記憶されているプログラムを実行することによって、ロボット２００の各部を制御する。 The CPU 210 controls each unit of the robot 200 by executing a program stored in the memory 220 or an external storage medium.
　メモリ２２０は、各種のＲＡＭや、各種のＲＯＭなどによって実現される。メモリ２２０は、ＣＰＵ２１０によって実行されるプログラムや、ＣＰＵ２１０によるプログラムの実行により生成されたデータ、サーバ１００や他のサーバから受信したデータ、操作部２４０を介して入力されたデータ、電気機器３００の制御信号などを記憶する。なお、メモリ２２０が複数種類の電気機器３００の制御信号の組み合わせを長期間格納するものであってもよいし、制御命令が入力される度にＣＰＵ２１０がサーバ１００から対応する制御信号を一時的に取得して赤外線発信部２６５Ａ，２６５Ｂ・・・から発信するものであってもよい。 The memory 220 is realized by various RAMs, various ROMs, and the like. The memory 220 is a program executed by the CPU 210, data generated by execution of the program by the CPU 210, data received from the server 100 or another server, data input via the operation unit 240, and control of the electric device 300. Stores signals and so on. The memory 220 may store a combination of control signals of a plurality of types of electrical devices 300 for a long period of time, or the CPU 210 temporarily sends a corresponding control signal from the server 100 each time a control command is input. It may be obtained and transmitted from the infrared transmitters 265A, 265B.
　ディスプレイ２３０は、ＣＰＵ２１０からの信号に基づいて、文字や画像などを出力する。ディスプレイ２３０は、単にライトであってもよい。 Display 230 outputs characters, images, and the like based on signals from CPU 210. Display 230 may simply be a light.
　操作部２４０は、ボタン、タッチパネルなどによって実現され、ユーザからの命令を受け付けて、当該命令をＣＰＵ２１０に入力する。なお、ディスプレイ２３０と操作部２４０とは、タッチパネルを構成してもよい。 The operation unit 240 is realized by a button, a touch panel, or the like, receives a command from the user, and inputs the command to the CPU 210. The display 230 and the operation unit 240 may constitute a touch panel.
　また、操作部２４０は、近接センサや温度センサなどであってもよい。この場合は、ＣＰＵ２１０は、操作部２４０としての近接センサや温度センサを介して、ユーザがロボット２００に手をかざしたことを検知して、各種の動作を開始する。たとえば、近接センサが額の近辺に配置されることによって、ユーザがロボット２００をなでたり・たたいたりすることをロボット２００が検知して、ユーザ操作として受け付けてもよい。 Further, the operation unit 240 may be a proximity sensor, a temperature sensor, or the like. In this case, the CPU 210 detects that the user holds his / her hand over the robot 200 via a proximity sensor or a temperature sensor as the operation unit 240 and starts various operations. For example, the proximity sensor may be disposed in the vicinity of the forehead so that the robot 200 may detect that the user strokes or strikes the robot 200 and accepts it as a user operation.
　カメラ２５０は、画像を撮影して、画像データをＣＰＵ２１０に受け渡す。ＣＰＵ２１０は、カメラ２５０からの画像データに基づいてユーザの動きを操作命令として特定してもよいし、画像データをサーバ１００に提供してサーバ１００がユーザの動きを操作命令として特定してもよい。 The camera 250 takes an image and delivers the image data to the CPU 210. The CPU 210 may specify the user's movement as an operation command based on the image data from the camera 250, or may provide the image data to the server 100 and the server 100 may specify the user's movement as the operation command. .
　通信インターフェイス２６０は、無線ＬＡＮ通信あるいは有線ＬＡＮなどの通信モジュールによって実現される。通信インターフェイス２６０は、有線通信あるいは無線通信によってサーバ１００などの他の装置との間でデータをやり取りする。 The communication interface 260 is realized by a communication module such as wireless LAN communication or wired LAN. The communication interface 260 exchanges data with other devices such as the server 100 by wired communication or wireless communication.
　スピーカ２７０は、ＣＰＵ２１０からの信号に基づいて、音声を出力する。より詳細には、本実施の形態においては、ＣＰＵ２１０は、通信インターフェイス２６０を介してサーバ１００から受信した音声データに基づいてスピーカ２７０に音声メッセージを出力させる。なお、テキストから音声データに変換する処理は、ロボット２００で行われてもよいし、サーバ１００で行われてもよい。 Speaker 270 outputs sound based on a signal from CPU 210. More specifically, in the present embodiment, CPU 210 causes speaker 270 to output a voice message based on voice data received from server 100 via communication interface 260. Note that the process of converting text to audio data may be performed by the robot 200 or the server 100.
　マイク２８０は、外部からの音声に基づいて音声信号を作成し、ＣＰＵ２１０に入力する。より詳細には、本実施の形態においては、ＣＰＵ２１０は、マイク２８０から取得した音声データを、通信インターフェイス２６０を介してサーバ１００に送信する。なお、音声データの解析処理は、ロボット２００で行われてもよいし、サーバ１００で行われてもよい。 The microphone 280 creates an audio signal based on external audio and inputs it to the CPU 210. More specifically, in the present embodiment, CPU 210 transmits audio data acquired from microphone 280 to server 100 via communication interface 260. The voice data analysis process may be performed by the robot 200 or the server 100.
　赤外線発信部２６５Ａ，２６５Ｂ・・・は、ロボット２００の外周に配置されており、ＣＰＵ２１０からの信号に応じて、ロボット２００の周囲の各方向に赤外線信号を発信する。 The infrared transmitters 265A, 265B,... Are arranged on the outer periphery of the robot 200, and transmit infrared signals in various directions around the robot 200 in response to signals from the CPU 210.
　赤外線受光部２９０は、リモコン２００Ｘなどからの赤外線信号を受信して、当該信号をＣＰＵ２１０に入力する。なお、赤外線受光部２９０も赤外線発信部と同様に複数あることが好ましい。 The infrared light receiving unit 290 receives an infrared signal from the remote controller 200X or the like and inputs the signal to the CPU 210. In addition, it is preferable that there are a plurality of infrared light receiving units 290 as well as the infrared transmitting unit.
　＜ネットワークシステム１における情報処理＞
　以下では、主に図１８を参照しながら、本実施の形態にかかるネットワークシステム１における制御信号特定のための情報処理について説明する。まず、図１８と図１９と図９を参照して、ロボット２００は、ユーザから「リモコン学習して」というリモコン学習開始の音声指示を受け付ける。ロボット２００のＣＰＵ２１０は、通信インターフェイス２６０を介して、当該指示をサーバ１００に送信する。サーバ１００のＣＰＵ１１０は、「簡単リモコン学習」モードを開始する。 <Information processing in network system 1>
Hereinafter, information processing for specifying a control signal in the network system 1 according to the present embodiment will be described mainly with reference to FIG. First, referring to FIGS. 18, 19, and 9, robot 200 receives a remote control learning start voice instruction “learn remote control” from the user. The CPU 210 of the robot 200 transmits the instruction to the server 100 via the communication interface 260. The CPU 110 of the server 100 starts the “simple remote control learning” mode.
　ＣＰＵ１１０は、ロボット２００に制御対象の電気機器３００の名前をユーザに聞くように指示する（ステップＳ１１１）。ロボット２００のＣＰＵ２１０は、サーバ１００からの指示に基づいてスピーカ２７０から、「リモコン学習ですね。学習したい家電はエアコン、テレビ、照明、その他の家電、のどれですか？」というメッセージを出力させる（ステップＳ１１２）。 The CPU 110 instructs the robot 200 to ask the user the name of the electric device 300 to be controlled (step S111). Based on the instruction from the server 100, the CPU 210 of the robot 200 causes the speaker 270 to output a message “This is remote control learning. Which appliances do you want to learn: air conditioner, TV, lighting, or other appliances?” ( Step S112).
　サーバ１００のＣＰＵ１１０は、エアコン、テレビ、照明以外の電気機器３００のリモコン学習の場合（ステップＳ１１２にてＮＯである場合）、後述する「こだわり個別学習」モードを実行する（ステップＳ１３０）。 The CPU 110 of the server 100 executes the “discretion individual learning” mode described later (step S130) in the case of remote control learning of the electric device 300 other than the air conditioner, the television, and the lighting (NO in step S112).
　サーバ１００のＣＰＵ１１０は、エアコン、テレビ、照明のいずれかの電気機器３００のリモコン学習の場合（ステップＳ１１２にてＹＥＳである場合）、通信インターフェイス１６０を介して、ロボット２００にメーカ名を要求する。ロボット２００のＣＰＵ２１０は、スピーカ２７０から「テレビですね。メーカ名を教えて下さい。」というメッセージを出力させる。ＣＰＵ２１０は、マイク２８０を介して受け付けた音声を、通信インターフェイス２６０を介してサーバ１００に送信する（ステップＳ１１３）。 The CPU 110 of the server 100 requests the maker name from the robot 200 via the communication interface 160 in the case of remote control learning of any one of the air conditioner, the television, and the lighting electric device 300 (YES in step S112). The CPU 210 of the robot 200 causes the speaker 270 to output a message “Television. Please tell me the maker name.” CPU 210 transmits the sound received via microphone 280 to server 100 via communication interface 260 (step S113).
　サーバ１００のＣＰＵ１１０は、音声データから対象となっている電気機器３００がＡ社製であることを認識する。ＣＰＵ１１０は、通信インターフェイス１６０を介して、ロボット２００に制御信号を要求する。ロボット２００のＣＰＵ２１０は、スピーカ２７０から「Ａ社のテレビですね。リモコンをこちらに向けて電源ボタンを押してください。」という音声メッセージを出力させる。ＣＰＵ２１０は、リモコン２００Ｘからの制御信号を赤外線受光部２９０で検知する（ステップＳ１１３）。 The CPU 110 of the server 100 recognizes that the target electric device 300 is manufactured by Company A from the audio data. The CPU 110 requests a control signal from the robot 200 via the communication interface 160. The CPU 210 of the robot 200 causes the speaker 270 to output a voice message “It is a TV of company A. Please point the remote control at this point and press the power button.” The CPU 210 detects the control signal from the remote controller 200X with the infrared light receiver 290 (step S113).
　ＣＰＵ１１０は、検知した制御信号を、通信インターフェイス２６０を介してサーバ１００に送信する。サーバ１００のＣＰＵ１１０は、受信した制御信号を含む制御信号の組み合わせを検索する（ステップＳ１１４）。 CPU 110 transmits the detected control signal to server 100 via communication interface 260. The CPU 110 of the server 100 searches for a combination of control signals including the received control signal (step S114).
　図１８と図１９と図１０とを参照して、受信した制御信号を含む制御信号の１または複数の組み合わせが見つかった場合（ステップＳ１１４にてＹＥＳである場合）、ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に「Ａ社のテレビですね。テレビの前に私を置いて下さい。」という音声メッセージを出力させる。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に、マッチした制御信号の組み合わせ、または制御信号の組み合わせのうちの所定の制御信号をダウンロードする（ステップＳ１１５）。 18, 19, and 10, when one or more combinations of control signals including the received control signal are found (YES in step S <b> 114), CPU 110 uses communication interface 160. Then, the robot 200 is caused to output a voice message “It is a television of company A. Please put me in front of the television.” The CPU 110 downloads a matched control signal combination or a predetermined control signal of the control signal combination to the robot 200 via the communication interface 160 (step S115).
　この際、ＣＰＵ１１０は、制御信号パターンテーブル１２３を参照して、最もレーティングが高い制御信号の組み合わせから優先してロボット２００に提供する。すなわち、ロボット２００にダウンロードされる制御信号が正しいものである可能性を高めるために、たとえば、図２０に示すように、ＣＰＵ１１０は、マッチする可能性が高い制御信号の組み合わせから順に選択する。具体的には、ＣＰＵ１１０は、制御信号パターンテーブル１２３を参照して、リモコン２００Ｘから受信した制御信号を含む１または複数の制御信号の組み合わせのうちの、最も採用された回数が多いものから順番に選択する。 At this time, the CPU 110 refers to the control signal pattern table 123 and provides the robot 200 with priority from the combination of the control signals having the highest rating. That is, in order to increase the possibility that the control signal downloaded to the robot 200 is correct, for example, as illustrated in FIG. 20, the CPU 110 sequentially selects combinations of control signals that are highly likely to match. Specifically, the CPU 110 refers to the control signal pattern table 123, and sequentially selects the combination of one or a plurality of control signals including the control signal received from the remote controller 200X from the most frequently used one. select.
　ＣＰＵ２１０は、赤外線発信部２６５Ａ，２６５Ｂから制御信号の組み合わせのうちの電源ＯＮ／ＯＦＦの制御信号を発信する（ステップＳ１１６）。ＣＰＵ２１０は、スピーカ２７０に「テレビはつきましたか、あるいはテレビは消えましたか。」という音声メッセージを出力させる（ステップＳ１１７）。 CPU 210 transmits a power ON / OFF control signal from the combination of control signals from infrared transmitters 265A and 265B (step S116). The CPU 210 causes the speaker 270 to output a voice message “Is the television turned on or has the television turned off?” (Step S117).
　図１８と図１９と図１１を参照して、ユーザが「ついたよ。」とか「反応したよ。」というメッセージを発した場合（ステップＳ１１７にてＹＥＳである場合）、すなわちマイク２８０を介して肯定的なメッセージを受け付けた場合、ＣＰＵ２１０は、その旨をサーバ１００に送信する。サーバ１００のＣＰＵ１１０は、今回選択された制御信号の組み合わせのパターンＩＤをロボット２００の機器ＩＤや対象の電気機器３００の種類とともに機器情報テーブル１２１に追加する。また、ＣＰＵ１１０は、制御信号パターンテーブル１２３の今回選択された制御信号の組み合わせのパターンＩＤに対応する採用回数を１増加させる。そして、ＣＰＵ１１０は、今回の「簡単リモコン学習」モードを終了する（ステップＳ１５０）。なお、ロボット２００のＣＰＵ２１０は、当該信号を含む制御信号の組み合わせの制御命令を覚えた旨をスピーカ２７０に出力させて、今回の「簡単リモコン学習」モードを終了する。 Referring to FIGS. 18, 19, and 11, when the user issues a message “I'm on” or “Responded” (YES in step S 117), that is, via microphone 280. When receiving a positive message, the CPU 210 transmits a message to that effect to the server 100. The CPU 110 of the server 100 adds the pattern ID of the combination of control signals selected this time to the device information table 121 together with the device ID of the robot 200 and the type of the target electric device 300. In addition, the CPU 110 increases the number of times of adoption corresponding to the pattern ID of the combination of control signals selected this time in the control signal pattern table 123 by one. Then, the CPU 110 ends the current “simple remote control learning” mode (step S150). The CPU 210 of the robot 200 causes the speaker 270 to output a message indicating that it has learned a control command for a combination of control signals including the signal, and ends the “simple remote control learning” mode.
　図１８と図１２を参照して、ユーザが「反応しないよ」とか「つかない。」というメッセージを発した場合（ステップＳ１１７にてＮＯである場合）、すなわちマイク２８０を介して否定的なメッセージを受け付けた場合、ＣＰＵ２１０は、その旨をサーバ１００に送信する。サーバ１００のＣＰＵ１１０は、ステップＳ１１５からの処理を繰り返す。すなわち、ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に、リモコン２００Ｘからの制御信号を含む制御信号の組み合わせのうちの次にレーティングが高いものをダウンロードする（ステップＳ１１５）。 Referring to FIG. 18 and FIG. 12, when the user issues a message “Do not respond” or “Cannot respond” (NO in step S 117), that is, a negative message via microphone 280. Is received, the CPU 210 transmits a message to that effect to the server 100. CPU 110 of server 100 repeats the processing from step S115. That is, CPU 110 downloads the next highest rated signal among combinations of control signals including a control signal from remote controller 200X to robot 200 via communication interface 160 (step S115).
　図１８と図１３を参照して、ステップＳ１１４において、ＣＰＵ１１０は、受信した制御信号を含む制御信号の組み合わせが見つからなかった場合（ステップＳ１１４にてＮＯである場合）、ＣＰＵ１１０は、後述する「音声ガイダンス学習」モードを実行する（ステップＳ１２０）。なお、本実施の形態においては、ステップＳ１１７において、否定的なメッセージを所定回数以上受け付けた場合も、ＣＰＵ１１０は、「音声ガイダンス学習」モードを実行する。 Referring to FIG. 18 and FIG. 13, in step S <b> 114, when CPU 110 does not find a combination of control signals including the received control signal (NO in step S <b> 114), CPU 110 performs “voice” described later. The “guidance learning” mode is executed (step S120). In the present embodiment, CPU 110 executes the “voice guidance learning” mode even when a negative message is received a predetermined number of times or more in step S117.
　以下では、図２１と図１４とを参照して、「音声ガイダンス学習」モード（ステップＳ１２０）について説明する。サーバ１００のＣＰＵ１１０は、通信インターフェイス１６０を介して、ロボット２００に「申し訳ありません。登録されていないリモコン信号です。信号を登録しますので、テレビのリモコンをご用意ください。」という音声メッセージを出力させる。 Hereinafter, the “voice guidance learning” mode (step S120) will be described with reference to FIG. 21 and FIG. The CPU 110 of the server 100 causes the robot 200 to output a voice message “Sorry, it is a remote control signal that has not been registered. Please prepare a remote control for the television. .
　サーバ１００のＣＰＵ１１０は、ロボット２００からのデータに基づいて、ロボット２００の機器ＩＤを取得する（ステップＳ１２１）。ＣＰＵ１１０は、ガイダンス学習テーブル１２４に新たなレコードを追加して、機器ＩＤを登録する（ステップＳ１２２）。ＣＰＵ１１０は、図１８のステップＳ１１２で取得した対象の電気機器３００の種類やステップＳ１１３で取得したメーカ名を登録する（ステップＳ１２３）。 The CPU 110 of the server 100 acquires the device ID of the robot 200 based on the data from the robot 200 (step S121). CPU110 adds a new record to guidance learning table 124, and registers apparatus ID (step S122). The CPU 110 registers the type of the target electric device 300 acquired in step S112 of FIG. 18 and the manufacturer name acquired in step S113 (step S123).
　ＣＰＵ１１０は、標準命令テーブル１２２を参照して、対象の電気機器３００に関して、未だ制御信号が登録されていない制御命令を特定する（ステップＳ１２４）。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に制御信号を要求する（ステップＳ１２５）。 The CPU 110 refers to the standard command table 122 and identifies a control command for which no control signal has been registered yet for the target electric device 300 (step S124). The CPU 110 requests a control signal from the robot 200 via the communication interface 160 (step S125).
　これによって、ロボット２００のＣＰＵ２１０はスピーカ２７０に「私に向けてリモコンの電源ボタンを押してください。」という音声メッセージを出力させる。ロボット２００のＣＰＵ２１０は、いずれかの赤外線受光部２９０を介してリモコン２００Ｘからの制御信号を受けると、通信インターフェイス２６０を介して当該制御信号をサーバ１００に送信する。 Thereby, the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the power button of the remote control toward me”. When the CPU 210 of the robot 200 receives a control signal from the remote controller 200X via any one of the infrared light receivers 290, the CPU 210 transmits the control signal to the server 100 via the communication interface 260.
　サーバ１００のＣＰＵ１１０は、ロボット２００からの制御信号を受信すると（ステップＳ１２６においてＹＥＳである場合）、当該制御信号を制御命令に対応付けてガイダンス学習テーブル１２４に登録する（ステップＳ１２７）。ＣＰＵ１１０は、ほかに未だ制御信号が登録されていない制御命令があるか否かを判断する（ステップＳ１２８）。ほかに未だ制御信号が登録されていない制御命令がある場合（ステップＳ１２８においてＹＥＳである場合）、ＣＰＵ１１０は、ステップＳ１２４からの処理を繰り返す。 When the CPU 110 of the server 100 receives the control signal from the robot 200 (YES in step S126), the CPU 110 registers the control signal in the guidance learning table 124 in association with the control command (step S127). CPU 110 determines whether there is another control command for which no control signal has been registered yet (step S128). If there is another control command for which no control signal is registered yet (YES in step S128), CPU 110 repeats the processing from step S124.
　ほかに未だ制御信号が登録されていない制御命令がない場合（ステップＳ１２８においてＮＯである場合）、ＣＰＵ１１０は通信インターフェイス１６０を介してロボット２００に確認要求を送信する（ステップＳ１２９１）。 Otherwise, if there is no control command for which no control signal has been registered (NO in step S128), the CPU 110 transmits a confirmation request to the robot 200 via the communication interface 160 (step S1291).
　ロボット２００のＣＰＵ２１０は、登録された制御命令毎に、赤外線発信部２６５，２６５・・・から制御信号を発信させて、スピーカ２７０から「テレビは反応しましたか？」という音声メッセージを出力させる。そして、ＣＰＵ２１０は、マイク２８０を介してユーザの否定的なメッセージを受け付けた制御命令に関してのみ、肯定的なメッセージを受け付けるまで、制御信号のリモコン２００Ｘからの再取得や電気機器３００への再発信やユーザへの再確認をユーザに要求する。ＣＰＵ２１０は、すべての制御信号に関する取得・確認が完了すると、通信インターフェイス２６０を介して正しい制御信号を制御命令に対応付けてサーバ１００に送信する。なお、ＣＰＵ２１０は、すべての制御信号が正しかった場合、通信インターフェイス１６０を介してその旨をサーバ１００に送信する。 The CPU 210 of the robot 200 transmits a control signal from the infrared transmitters 265, 265,... For each registered control command, and outputs a voice message “Did the television react?” From the speaker 270. Then, CPU 210 re-acquires control signal from remote control 200X or re-transmits to electrical device 300 until a positive message is received only for a control command that has received a negative message from the user via microphone 280. Require the user to reconfirm with the user. When the acquisition / confirmation regarding all the control signals is completed, the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. If all control signals are correct, the CPU 210 transmits the fact to the server 100 via the communication interface 160.
　サーバ１００のＣＰＵ１１０は、制御信号の誤りがあったとき（ステップＳ１２９２においてＹＥＳである場合）、通信インターフェイス１６０を介して受信した正しい制御信号を制御命令に対応付けてガイダンス学習テーブル１２４に登録しなおす（ステップＳ１２９３）。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に登録が完了した旨を通知する（ステップＳ１２９５）。 When there is an error in the control signal (when YES in step S1292), CPU 110 of server 100 re-registers the correct control signal received via communication interface 160 in guidance learning table 124 in association with the control command. (Step S1293). CPU 110 notifies robot 200 that registration has been completed via communication interface 160 (step S1295).
　図２２と図１５とを参照して、「こだわり個別学習」モード（ステップＳ１３０）について説明する。サーバ１００のＣＰＵ１１０は、ロボット２００からのデータに基づいて、ロボット２００の機器ＩＤを取得する（ステップＳ１３１）。ＣＰＵ１１０は、こだわり個別学習テーブル１２５に新たなレコードを追加して、機器ＩＤを登録する（ステップＳ１３２）。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に、対象となる電気機器３００の種類を要求する（ステップＳ１３３）。 With reference to FIG. 22 and FIG. 15, the “discretion individual learning” mode (step S130) will be described. The CPU 110 of the server 100 acquires the device ID of the robot 200 based on the data from the robot 200 (step S131). CPU110 adds a new record to discerning individual learning table 125, and registers apparatus ID (Step S132). CPU110 requests | requires the kind of electric equipment 300 used as the object from the robot 200 via the communication interface 160 (step S133).
　これによって、ロボット２００のＣＰＵ２１０はスピーカ２７０に「登録したい家電のメーカと家電の名前を押してください。」という音声メッセージを出力させる。ロボット２００のＣＰＵ２１０は、マイク２８０を介してユーザからメーカ名と家電の種類を受け付けると、通信インターフェイス２６０を介して当該情報をサーバ１００に送信する。 Thereby, the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the name of the home appliance manufacturer and home appliance you want to register.” When the CPU 210 of the robot 200 receives the manufacturer name and the type of home appliance from the user via the microphone 280, the CPU 210 transmits the information to the server 100 via the communication interface 260.
　サーバ１００のＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００からメーカ名と家電の種類を取得すると、こだわり個別学習テーブル１２５に登録する（ステップＳ１３５）。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に、制御命令の名称を要求する（ステップＳ１３６）。 When the CPU 110 of the server 100 acquires the manufacturer name and the type of home appliance from the robot 200 via the communication interface 160, the CPU 110 registers it in the discretionary individual learning table 125 (step S135). CPU110 requests | requires the name of a control command from the robot 200 via the communication interface 160 (step S136).
　これによって、ロボット２００のＣＰＵ２１０はスピーカ２７０に「登録したいリモコンのボタンの名前を教えてください。」という音声メッセージを出力させる。ロボット２００のＣＰＵ２１０は、マイク２８０を介してユーザからリモコンのボタンの名前を受け付けると、通信インターフェイス２６０を介して当該情報をサーバ１００に送信する。 Thereby, the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please tell me the name of the remote control button you want to register.” When the CPU 210 of the robot 200 receives the name of the button on the remote control from the user via the microphone 280, the CPU 210 transmits the information to the server 100 via the communication interface 260.
　サーバ１００のＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００からリモコンのボタンの名前を取得すると（ステップＳ１３７においてＹＥＳである場合）、テキストデータの制御命令をこだわり個別学習テーブル１２５に登録する（ステップＳ１３８）。なお、ロボット２００のＣＰＵ２１０がマイク２８０から取得したユーザの制御命令の音声データをテキストデータに変換してからサーバ１００に送信してもよいし、サーバ１００のＣＰＵ１１０がロボット２００から受信した音声データをテキストデータに変換してもよい。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に制御信号を要求する（ステップＳ１３９）。 When the CPU 110 of the server 100 acquires the name of the remote control button from the robot 200 via the communication interface 160 (YES in step S137), the text data control command is registered in the individual learning table 125 (step S138). ). The voice data of the user's control command acquired from the microphone 280 by the CPU 210 of the robot 200 may be converted into text data and then sent to the server 100, or the voice data received by the CPU 110 of the server 100 from the robot 200 may be used. You may convert into text data. The CPU 110 requests a control signal from the robot 200 via the communication interface 160 (step S139).
　これによって、ロボット２００のＣＰＵ２１０はスピーカ２７０に「私に向けてリモコンの電源ボタンを押してください。」という音声メッセージを出力させる。ロボット２００のＣＰＵ２１０は、リモコン２００Ｘからの制御信号を受けると、通信インターフェイス２６０を介して当該制御信号をサーバ１００に送信する。 Thereby, the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Please press the power button of the remote control toward me”. When receiving the control signal from the remote controller 200X, the CPU 210 of the robot 200 transmits the control signal to the server 100 via the communication interface 260.
　サーバ１００のＣＰＵ１１０は、ロボット２００からの制御信号を受信すると（ステップＳ１４０においてＹＥＳである場合）、当該制御信号を制御命令に対応付けてこだわり個別学習テーブル１２５に登録する（ステップＳ１４１）。 When the CPU 110 of the server 100 receives the control signal from the robot 200 (YES in step S140), the CPU 110 associates the control signal with the control command and registers it in the individual learning table 125 (step S141).
　このように、本実施の形態にかかる「こだわり個別学習」モードにおいては、ユーザは「もう寝なさい。」というメッセージに対応付けて電源ＯＦＦの制御信号を登録することができるし、「聞こえない。」というメッセージに対応付けて音量アップの制御信号を登録することができるし、「ちょっと暗いなあ。」というメッセージに対応付けて照度アップの制御信号を登録することができるし、方言が入ったメッセージに制御信号を登録することも可能になる。 As described above, in the “discretion individual learning” mode according to the present embodiment, the user can register a power-off control signal in association with the message “Let's go to sleep.” ”Can be registered in association with the message”, and the illuminance up control signal can be registered in association with the message “A little dark”. It is also possible to register a control signal in.
　ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に、ほかに制御信号を登録したい制御命令があるか否かを問い合わせるための指示を送る（ステップＳ１４２）。これによって、ロボット２００のＣＰＵ２１０はスピーカ２７０に「リモコンボタンの登録を続けますか？」という音声メッセージを出力させる。ロボット２００のＣＰＵ２１０は、ユーザ音声を受け付けると、通信インターフェイス２６０を介して当該情報をサーバ１００に送信する。 The CPU 110 sends an instruction for inquiring whether there is another control command for registering a control signal to the robot 200 via the communication interface 160 (step S142). As a result, the CPU 210 of the robot 200 causes the speaker 270 to output a voice message “Do you want to continue registering the remote control button?”. When receiving the user voice, the CPU 210 of the robot 200 transmits the information to the server 100 via the communication interface 260.
　サーバ１００のＣＰＵ１１０は、ほかに制御信号を登録したい制御命令がある場合（ステップＳ１４３においてＹＥＳである場合）、ＣＰＵ１１０は、ステップＳ１３６からの処理を繰り返す。 CPU110 of the server 100 repeats the process from step S136, when there exists another control command which wants to register a control signal (when it is YES in step S143).
　ほかに未だ制御信号が登録されていない制御命令がない場合（ステップＳ１４３においてＮＯである場合）、ＣＰＵ１１０は通信インターフェイス１６０を介してロボット２００に確認要求を送信する（ステップＳ１４９１）。 Otherwise, if there is no control command for which no control signal is registered (NO in step S143), CPU 110 transmits a confirmation request to robot 200 via communication interface 160 (step S1491).
　ロボット２００のＣＰＵ２１０は、登録された制御命令毎に、赤外線発信部２６５，２６５・・・から制御信号を発信させて、スピーカ２７０から「空気清浄機は反応しましたか？」という音声メッセージを出力させる。そして、ＣＰＵ２１０は、マイク２８０を介してユーザの否定的なメッセージを受け付けた制御命令に関してのみ、肯定的なメッセージを受け付けるまで、制御信号のリモコン２００Ｘからの再取得や電気機器３００への再発信やユーザへの再確認をユーザに要求する。ＣＰＵ２１０は、すべての制御信号に関する取得・確認が完了すると、通信インターフェイス２６０を介して正しい制御信号を制御命令に対応付けてサーバ１００に送信する。なお、ＣＰＵ２１０は、すべての制御信号が正しかった場合、通信インターフェイス１６０を介してその旨をサーバ１００に送信する。 The CPU 210 of the robot 200 transmits a control signal from the infrared transmitters 265, 265... For each registered control command, and outputs a voice message “Did the air purifier react?” From the speaker 270. Let Then, CPU 210 re-acquires control signal from remote control 200X or re-transmits to electrical device 300 until a positive message is received only for a control command that has received a negative message from the user via microphone 280. Require the user to reconfirm with the user. When the acquisition / confirmation regarding all the control signals is completed, the CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. If all control signals are correct, the CPU 210 transmits the fact to the server 100 via the communication interface 160.
　サーバ１００のＣＰＵ１１０は、制御信号の誤りがあったとき（ステップＳ１４９２においてＹＥＳである場合）、通信インターフェイス１６０を介して受信した正しい制御信号を制御命令に対応付けてこだわり個別学習テーブル１２５に登録しなおす（ステップＳ１４９３）。ＣＰＵ１１０は、通信インターフェイス１６０を介してロボット２００に登録が完了した旨を通知する（ステップＳ１４９５）。 When there is an error in the control signal (YES in step S1492), the CPU 110 of the server 100 registers the correct control signal received via the communication interface 160 in the individual learning table 125 in association with the control command. This is corrected (step S1493). CPU 110 notifies robot 200 that the registration is completed via communication interface 160 (step S1495).
　なお、本実施の形態においては、１つの制御命令に対して１つの制御信号を登録するものであったが、１つの制御命令に対して複数の制御信号を登録するものであってもよい。たとえば、「電源ＯＦＦ」という制御命令に対して、「音量を下げる」ための制御信号を出力してから「電源ＯＦＦ」のための制御信号を出力するように登録したり、「音が小さい」という制御命令に対して、「音量を上げる」ための制御信号を出力してから「画面の明るさを上げる」のための制御信号を出力するように登録したりしてもよい。 In the present embodiment, one control signal is registered for one control command, but a plurality of control signals may be registered for one control command. For example, in response to a control command “power OFF”, a control signal for “decrease volume” is output and then a control signal for “power OFF” is output, or “sound is low” For example, a control signal for “increasing the sound volume” may be output and then a control signal for “increasing the screen brightness” may be registered.
　なお当然に、１つの制御信号に、２つの制御命令を登録してもよい。たとえば、「音量を上げる」ための制御信号に、「音量を上げて」という制御命令と、「聞こえない」という制御命令を登録してもよい。 Of course, two control commands may be registered in one control signal. For example, a control command “increase volume” and a control command “inaudible” may be registered in the control signal for “increase volume”.
　＜第２の実施の形態＞
　第１の実施の形態においては、「ガイダンス学習」モードと「こだわり個別学習」モードにおいて、すべての制御信号の登録が終わってから、確認処理（ステップＳ１２９１～１２９３、ステップＳ１４９１～ステップＳ１４９３）が実行されるものであった。しかしながら、制御信号が１つ登録されるたびに、確認処理が実行されてもよい。 <Second Embodiment>
In the first embodiment, confirmation processing (steps S1291 to 1293 and steps S1491 to S1493) is executed after registration of all control signals is completed in the “guidance learning” mode and the “discretion individual learning” mode. It was to be done. However, the confirmation process may be executed every time one control signal is registered.
　すなわち、「ガイダンス学習」モードにおいては、図２３に示すように、本実施の形態にかかるサーバ１００のＣＰＵ１１０は、１つの制御信号を制御命令に対応付けてガイダンス学習テーブル１２４に登録するたびに（ステップＳ１２７）、通信インターフェイス１６０を介してロボット２００に確認要求を送信する（ステップＳ１２７１）。 That is, in the “guidance learning” mode, as shown in FIG. 23, every time the CPU 110 of the server 100 according to the present embodiment registers one control signal in association with the control command in the guidance learning table 124 ( In step S127), a confirmation request is transmitted to the robot 200 via the communication interface 160 (step S1271).
　ロボット２００のＣＰＵ２１０は、赤外線発信部２６５，２６５・・・から今回サーバ１００に登録された制御信号を発信させて、スピーカ２７０から「テレビは反応しましたか？」という音声メッセージを出力させる。そして、ＣＰＵ２１０は、マイク２８０を介してユーザの否定的なメッセージを受け付けると、肯定的なメッセージを受け付けるまで、制御信号のリモコン２００Ｘからの再取得や電気機器３００への再発信やユーザへの再確認をユーザに要求する。ＣＰＵ２１０は、通信インターフェイス２６０を介して正しい制御信号を制御命令に対応付けてサーバ１００に送信する。なお、ＣＰＵ２１０は、制御信号が正しかった場合、通信インターフェイス１６０を介してその旨をサーバ１００に送信する。 The CPU 210 of the robot 200 transmits a control signal registered in the server 100 this time from the infrared transmitters 265, 265... And outputs a voice message “Did the television react?” From the speaker 270. When the CPU 210 receives a negative message from the user via the microphone 280, until the positive message is received, the CPU 210 re-acquires the control signal from the remote controller 200X, re-transmits the electric signal to the electric device 300, or re-transmits the user. Ask the user for confirmation. The CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. Note that if the control signal is correct, the CPU 210 transmits that fact to the server 100 via the communication interface 160.
　サーバ１００のＣＰＵ１１０は、制御信号の誤りがあったとき（ステップＳ１２７２においてＹＥＳである場合）、通信インターフェイス１６０を介して受信した正しい制御信号を制御命令に対応付けてガイダンス学習テーブル１２４に登録しなおす（ステップＳ１２７３）。その後、ＣＰＵ１１０は、ステップＳ１２８からの処理を実行する。 If there is an error in the control signal (YES in step S1272), CPU 110 of server 100 re-registers the correct control signal received via communication interface 160 in guidance learning table 124 in association with the control command. (Step S1273). Thereafter, the CPU 110 executes processing from step S128.
　同様に、「こだわり個別学習」モードにおいては、図２４に示すように、サーバ１００のＣＰＵ１１０は、１つの制御信号を制御命令に対応付けてガイダンス学習テーブル１２４に登録するたびに（ステップＳ１４１）、通信インターフェイス１６０を介してロボット２００に確認要求を送信する（ステップＳ１４１１）。 Similarly, in the “discretion individual learning” mode, as shown in FIG. 24, every time the CPU 110 of the server 100 registers one control signal in the guidance learning table 124 in association with a control command (step S141). A confirmation request is transmitted to the robot 200 via the communication interface 160 (step S1411).
　ロボット２００のＣＰＵ２１０は、赤外線発信部２６５，２６５・・・から今回サーバ１００に登録された制御信号を発信させて、スピーカ２７０から「空気清浄機は反応しましたか？」という音声メッセージを出力させる。そして、ＣＰＵ２１０は、マイク２８０を介してユーザの否定的なメッセージを受け付けると、肯定的なメッセージを受け付けるまで、制御信号のリモコン２００Ｘからの再取得や電気機器３００への再発信やユーザへの再確認をユーザに要求する。ＣＰＵ２１０は、通信インターフェイス２６０を介して正しい制御信号を制御命令に対応付けてサーバ１００に送信する。なお、ＣＰＵ２１０は、制御信号が正しかった場合、通信インターフェイス１６０を介してその旨をサーバ１００に送信する。 The CPU 210 of the robot 200 transmits a control signal registered in the server 100 from the infrared transmitters 265, 265... And outputs a voice message “Did the air purifier react?” From the speaker 270. . When the CPU 210 receives a negative message from the user via the microphone 280, until the positive message is received, the CPU 210 re-acquires the control signal from the remote controller 200X, re-transmits the electric signal to the electric device 300, or re-transmits the user. Ask the user for confirmation. The CPU 210 transmits a correct control signal to the server 100 in association with the control command via the communication interface 260. Note that if the control signal is correct, the CPU 210 transmits that fact to the server 100 via the communication interface 160.
　サーバ１００のＣＰＵ１１０は、制御信号の誤りがあったとき（ステップＳ１４１２においてＹＥＳである場合）、通信インターフェイス１６０を介して受信した正しい制御信号を制御命令に対応付けてこだわり個別学習テーブル１２５に登録しなおす（ステップＳ１４１３）。そして、ＣＰＵ１１０は、ステップＳ１４２からの処理を実行する。 When there is an error in the control signal (YES in step S1412), the CPU 110 of the server 100 registers the correct control signal received via the communication interface 160 in the discriminating individual learning table 125 in association with the control command. This is done (step S1413). And CPU110 performs the process from step S142.
　＜第３の実施の形態＞
　第１および第２の実施の形態においては、図２２および図２４の「こだわり個別学習」モードのステップＳ１３８において、ユーザに入力された音声に対応するテキストの制御命令をこだわり個別学習テーブル１２５に登録するものであった。しかしながら、ステップＳ１３８においては、ＣＰＵ１１０は、ロボット２００から受信したユーザの音声データそのものを制御命令としてこだわり個別学習テーブル１２５Ｂに登録してもよい。当然ながら、本実施の形態においては、サーバ１００のメモリ１２０は、図２５に示すようなこだわり個別学習テーブル１２５Ｂを記憶する。 <Third Embodiment>
In the first and second embodiments, in step S138 of the “discretion individual learning” mode of FIG. 22 and FIG. 24, a text control command corresponding to the voice input by the user is registered in the discernment individual learning table 125. It was something to do. However, in step S138, the CPU 110 may stick to the user's voice data received from the robot 200 as a control command and register it in the individual learning table 125B. Of course, in the present embodiment, the memory 120 of the server 100 stores a discretion individual learning table 125B as shown in FIG.
　このため、制御信号の登録後に、ユーザの制御命令が入力される際には、サーバ１００のＣＰＵ１１０は、ステップＳ１３８で登録された音声データと入力された音声データとをマッチングして、制御命令および制御信号を特定し、通信インターフェイス１６０を介して当該制御信号をロボット２００に提供する。 For this reason, when a user's control command is input after registering the control signal, the CPU 110 of the server 100 matches the audio data registered in step S138 with the input audio data, and the control command and The control signal is specified, and the control signal is provided to the robot 200 via the communication interface 160.
　これによって、幼児や滑舌がよくないユーザの制御命令も認識されやすくなるし、外国語に対応付けて制御信号を登録することも可能になるし、言葉以外の泣き声や笑い声や叫び声でも制御信号を登録することが可能になる。たとえば、赤ん坊の泣き声に基づいて、ロボット２００が音楽プレーヤに音楽の出力の制御信号を発信することも可能である。 This makes it easier to recognize control commands from infants and users who do not have a good tongue, and it is possible to register control signals in association with foreign languages. Can be registered. For example, the robot 200 can send a music output control signal to a music player based on a baby's cry.
　なお、本実施の形態においては、１つの制御命令に対して１つの制御信号を登録するものであったが、１つの制御命令に対して複数の制御信号を登録するものであってもよい。たとえば、「電源ＯＦＦ」という制御命令に対して、「音量を下げる」ための制御信号を出力してから「電源ＯＦＦ」のための制御信号を出力するように登録したり、「音が小さい」という制御命令に対して、「音量を上げる」ための制御信号を出力してから「画面の明るさを上げる」のための制御信号を出力するように登録したりしてもよい。 In the present embodiment, one control signal is registered for one control command, but a plurality of control signals may be registered for one control command. For example, in response to a control command “power OFF”, a control signal for “decrease volume” is output and then a control signal for “power OFF” is output, or “sound is low” For example, a control signal for “increasing the sound volume” may be output and then a control signal for “increasing the screen brightness” may be registered.
　なお当然に、１つの制御信号に、２つの制御命令を登録してもよい。たとえば、「音量を上げる」ための制御信号に、「音量を上げて」という制御命令と、「聞こえない」という制御命令を登録してもよい。 Of course, two control commands may be registered in one control signal. For example, a control command “increase volume” and a control command “inaudible” may be registered in the control signal for “increase volume”.
　＜第４の実施の形態＞
　第１から第３の実施の形態のロボット２００は、電気機器３００の制御信号として赤外線を発信するものであったが、たとえば、他の電磁波や音波などを利用してもよい。赤外線以外の、リモコンからは制御信号を発信しやすいが、電気機器３００からの回答を受け取り難いネットワークシステムに上記の技術は便利である。 <Fourth embodiment>
The robot 200 according to the first to third embodiments transmits infrared rays as a control signal for the electric device 300, but may use other electromagnetic waves or sound waves, for example. The above technique is convenient for a network system in which it is easy to send a control signal from a remote controller other than infrared rays but it is difficult to receive an answer from the electric device 300.
　また、図１のような顔や胴体などを有するロボット２００には限られず、自走式の掃除機など、他の形状を有する通信端末であってもよい。 Further, it is not limited to the robot 200 having the face and the torso as shown in FIG. 1, and may be a communication terminal having another shape such as a self-propelled cleaner.
　＜第５の実施の形態＞
　なお、第１から第４の実施の形態のような、サーバ１００やロボット２００やリモコン２００Ｘや電気機器３００の構造・機能・動作に限られず、各装置の役割が、他のサーバや端末やデータベースなどの複数の装置に分担されてもよい。逆に、複数の装置の役割の一部または全部が１つの装置に集約されてもよい。 <Fifth embodiment>
Note that the role of each device is not limited to the structure, function, and operation of the server 100, the robot 200, the remote controller 200X, and the electric device 300 as in the first to fourth embodiments. It may be shared by a plurality of devices. Conversely, some or all of the roles of a plurality of devices may be integrated into one device.
　たとえば、図２６に示すように、第１から第４の実施の形態にかかるサーバ１００の役割をロボット２００が有してもよい。この場合は、（１）まず、ユーザが、リモコンの動作の学習を開始するための命令をロボット２００に入力すると、ロボット２００のＣＰＵ２１０は、スピーカ２７０に「家電の名前を話して下さい。」というメッセージを出力させる。ユーザが「テレビ」などと発すると、ロボット２００のＣＰＵ２１０は、スピーカ２７０に「メーカの名前を話して下さい。」というメッセージを出力させる。ユーザが「Ａ社」などと発すると、ＣＰＵ２１０は、「リモコンを私に向けて、電源ボタンを押してください。」というメッセージをスピーカ２７０に出力させる。 For example, as shown in FIG. 26, the robot 200 may have the role of the server 100 according to the first to fourth embodiments. In this case, (1) First, when the user inputs an instruction for starting learning of the operation of the remote controller to the robot 200, the CPU 210 of the robot 200 says “Please speak the name of the home appliance” to the speaker 270. Output a message. When the user utters “TV” or the like, the CPU 210 of the robot 200 causes the speaker 270 to output a message “Please tell the name of the manufacturer.” When the user utters “Company A” or the like, the CPU 210 causes the speaker 270 to output a message “Please point the remote control at me and press the power button”.
　（２）ユーザが電源ボタンを押すと、ＣＰＵ２１０は、赤外線受光部２９０を介して、リモコン２００Ｘからの制御信号を検知して、自身のデータベースを参照して、家電名とメーカ名と制御信号とに対応した複数種類の制御信号の組み合わせから、当該条件にマッチする制御信号の組み合わせを検索する。 (2) When the user presses the power button, the CPU 210 detects a control signal from the remote controller 200X via the infrared light receiving unit 290, refers to its own database, and stores the home appliance name, manufacturer name, control signal, A combination of control signals matching the condition is retrieved from a combination of a plurality of types of control signals corresponding to.
　（３）ロボット２００のＣＰＵ２１０は、家電名とメーカ名と制御信号とに対応する制御信号の組み合わせを、テレビの制御信号としてメモリ２２０に登録する。 (3) The CPU 210 of the robot 200 registers a combination of control signals corresponding to the home appliance name, manufacturer name, and control signal in the memory 220 as a TV control signal.
　（４）そのあとは、マイク２８０を介してユーザの「テレビをつけて。」などという音声命令を受け付けて、ＣＰＵ２１０は、赤外線発光部２６５ａ，２６５ｂ・・・を介してテレビ用の電源ＯＮの制御信号を発信する。 (4) Thereafter, the user receives a voice command such as “Turn on the TV” via the microphone 280, and the CPU 210 turns on the power for the TV via the infrared light emitting units 265a, 265b. Send a control signal.
　本実施の形態にかかるロボット２００も、第１～第４の実施の形態のサーバ１００が有する「音声ガイダンス学習」モードの機能や「こだわり個別学習」モードの機能も有していてもよい。 The robot 200 according to the present embodiment may also have a “voice guidance learning” mode function and a “discretion individual learning” mode function that the server 100 according to the first to fourth embodiments has.
　＜その他の応用例＞
　本発明の一態様は、システム或いは装置にプログラムを供給することによって達成される場合にも適用できることはいうまでもない。そして、本発明の一態様を達成するためのソフトウェアによって表されるプログラムを格納した記憶媒体（あるいはメモリ）を、システム或いは装置に供給し、そのシステム或いは装置のコンピュータ（又はＣＰＵやＭＰＵ）が記憶媒体に格納されたプログラムコードを読出し実行することによっても、本発明の一態様の効果を享受することが可能となる。 <Other application examples>
It goes without saying that one embodiment of the present invention can also be applied to a case where the object is achieved by supplying a program to a system or apparatus. Then, a storage medium (or memory) storing a program represented by software for achieving one embodiment of the present invention is supplied to the system or apparatus, and the computer (or CPU or MPU) of the system or apparatus stores it. The effect of one embodiment of the present invention can also be enjoyed by reading and executing the program code stored in the medium.
　この場合、記憶媒体から読出されたプログラムコード自体が前述した実施の形態の機能を実現することになり、そのプログラムコードを記憶した記憶媒体は本発明の一態様を構成することになる。 In this case, the program code itself read from the storage medium realizes the functions of the above-described embodiment, and the storage medium storing the program code constitutes one aspect of the present invention.
　また、コンピュータが読出したプログラムコードを実行することにより、前述した実施の形態の機能が実現されるだけでなく、そのプログラムコードの指示に基づき、コンピュータ上で稼動しているＯＳ（オペレーティングシステム）などが実際の処理の一部または全部を行い、その処理によって前述した実施の形態の機能が実現される場合も含まれることは言うまでもない。 Further, by executing the program code read by the computer, not only the functions of the above-described embodiments are realized, but also an OS (operating system) running on the computer based on the instruction of the program code However, it is needless to say that a case where the function of the above-described embodiment is realized by performing part or all of the actual processing and the processing is included.
　さらに、記憶媒体から読み出されたプログラムコードが、コンピュータに挿入された機能拡張ボードやコンピュータに接続された機能拡張ユニットに備わる他の記憶媒体に書き込まれた後、そのプログラムコードの指示に基づき、その機能拡張ボードや機能拡張ユニットに備わるＣＰＵなどが実際の処理の一部または全部を行い、その処理によって前述した実施の形態の機能が実現される場合も含まれることは言うまでもない。 Furthermore, after the program code read from the storage medium is written to another storage medium provided in the function expansion board inserted into the computer or the function expansion unit connected to the computer, based on the instruction of the program code, It goes without saying that the CPU of the function expansion board or function expansion unit performs part or all of the actual processing and the functions of the above-described embodiments are realized by the processing.
　今回開示された実施の形態はすべての点で例示であって制限的なものではないと考えられるべきである。本発明の範囲は、上記した説明ではなく、特許請求の範囲によって示され、特許請求の範囲と均等の意味および範囲内でのすべての変更が含まれることが意図される。 The embodiment disclosed this time should be considered as illustrative in all points and not restrictive. The scope of the present invention is defined by the terms of the claims, rather than the description above, and is intended to include any modifications within the scope and meaning equivalent to the terms of the claims.
１　　　　　：ネットワークシステム
１００　　　：サーバ
１１０　　　：ＣＰＵ
１２０　　　：メモリ
１２１　　　：機器情報テーブル
１２２　　　：制御信号パターンテーブル
１２３　　　：標準命令テーブル
１２４　　　：ガイダンス学習テーブル
１２５　　　：個別学習テーブル
１２５Ｂ　　：個別学習テーブル
１４０　　　：操作部
１６０　　　：通信インターフェイス
２００　　　：ロボット
２００Ｘ　　：専用リモコン
２１０　　　：ＣＰＵ
２２０　　　：メモリ
２３０　　　：ディスプレイ
２４０　　　：操作部
２５０　　　：カメラ
２６０　　　：通信インターフェイス
２６５　　　：赤外線発信部
２７０　　　：スピーカ
２８０　　　：マイク
２９０　　　：赤外線受光部
３００　　　：電気機器
３００Ａ　　：エアコン
３００Ｂ　　：テレビ
３１０　　　：ＣＰＵ
３２０　　　：メモリ
３３０　　　：ディスプレイ
３４０　　　：操作部
３６０　　　：通信インターフェイス
３７０　　　：スピーカ
３８０　　　：赤外線受光部
３９０　　　：機器駆動部 1: Network system 100: Server 110: CPU
120: Memory 121: Device information table 122: Control signal pattern table 123: Standard command table 124: Guidance learning table 125: Individual learning table 125B: Individual learning table 140: Operation unit 160: Communication interface 200: Robot 200X: Dedicated remote controller 210 : CPU
220: Memory 230: Display 240: Operation unit 250: Camera 260: Communication interface 265: Infrared transmission unit 270: Speaker 280: Microphone 290: Infrared light receiving unit 300: Electric device 300A: Air conditioner 300B: Television 310: CPU
320: Memory 330: Display 340: Operation unit 360: Communication interface 370: Speaker 380: Infrared light receiving unit 390: Device driving unit

Claims (8)

  1. 　リモコンからの第１の制御信号を取得して当該第１の制御信号を送信する端末と、
    　前記端末からの前記第１の制御信号を取得して、複数種類の制御信号の組み合わせを参照することによって、当該第１の制御信号を含む１または複数種類の制御信号の組み合わせのデータを前記端末に提供するサーバと、を備えるネットワークシステム。     A terminal for acquiring a first control signal from a remote controller and transmitting the first control signal;
    By acquiring the first control signal from the terminal and referring to a combination of a plurality of types of control signals, data of a combination of one or a plurality of types of control signals including the first control signal is obtained. And a server provided to the network system.
  2. 　前記サーバは、前記第１の制御信号を含む複数種類の制御信号の組み合わせを前記端末に送信することによって、前記端末に前記複数種類の制御信号を発信させながらユーザからの音声に基づいて１つの制御信号の組み合わせを特定する、請求項１に記載のネットワークシステム。 The server transmits a combination of a plurality of types of control signals including the first control signal to the terminal, thereby causing the terminal to transmit one of the plurality of types of control signals based on a voice from a user. The network system according to claim 1, wherein a combination of control signals is specified.
  3. 　複数の音声情報の各々に対応付けて、１または複数の制御信号を登録する、請求項１または２に記載のネットワークシステム。 3. The network system according to claim 1, wherein one or a plurality of control signals are registered in association with each of the plurality of audio information.
  4. 　音声情報とリモコンからの制御信号とを取得する端末と、
    　複数の音声情報の各々に対応付けて１または複数の制御信号を記憶することによって、前記端末に入力された音声に対応する制御信号を前記端末に出力させるためのサーバと、を備えるネットワークシステム。     A terminal that acquires audio information and a control signal from a remote control;
    And a server for causing the terminal to output a control signal corresponding to the voice input to the terminal by storing one or a plurality of control signals in association with each of the plurality of voice information.
  5. 　端末が、リモコンからの第１の制御信号を取得するステップと、
    　サーバが、前記端末からの前記第１の制御信号を取得するステップと、
    　前記サーバが、複数種類の制御信号の組み合わせを参照することによって、前記第１の制御信号を含む１または複数種類の制御信号の組み合わせのデータを前記端末に提供するステップと、を備える情報処理方法。     A terminal acquiring a first control signal from a remote control;
    A server obtaining the first control signal from the terminal;
    The server providing the terminal with data of one or a plurality of types of control signal combinations including the first control signal by referring to a combination of a plurality of types of control signals. .
  6. 　端末からの第１の制御信号を取得するための通信インターフェイスと、
    　複数種類の制御信号の組み合わせを参照することによって、前記第１の制御信号を含む１または複数種類の制御信号の組み合わせのデータを前記通信インターフェイスを介して前記端末に提供するためのプロセッサと、を備えるサーバ。     A communication interface for obtaining a first control signal from the terminal;
    A processor for providing data of a combination of one or more types of control signals including the first control signal to the terminal via the communication interface by referring to a combination of a plurality of types of control signals; Server to provide.
  7. 　プロセッサが、通信インターフェイスを介して端末からの第１の制御信号を取得するステップと、
    　前記プロセッサが、複数種類の制御信号の組み合わせを参照することによって、前記第１の制御信号を含む１または複数種類の制御信号の組み合わせのデータを前記通信インターフェイスを介して前記端末に提供するステップと、を備えるサーバの情報処理方法。     A processor obtaining a first control signal from a terminal via a communication interface;
    Providing the terminal with data of one or a plurality of types of control signal combinations including the first control signal by referring to a combination of a plurality of types of control signals to the terminal via the communication interface; An information processing method for a server comprising:
  8. 　発信部と、
    　リモコンからの第１の制御信号を取得するための受信部と、
    　複数種類の制御信号の組み合わせを参照することによって、当該第１の制御信号を含む１または複数種類の制御信号の組み合わせを特定し、その後に入力された制御命令に基づいて前記特定された制御信号の組み合わせのうちの対応する制御信号を前記発信部から発信させるためのプロセッサと、を備える端末。     A sending part;
    A receiving unit for obtaining a first control signal from the remote control;
    By referring to a combination of a plurality of types of control signals, a combination of one or a plurality of types of control signals including the first control signal is specified, and then the specified control signal is based on a control command input thereafter. And a processor for transmitting a corresponding control signal of the combination from the transmitter.
PCT/JP2017/031367 2017-03-14 2017-08-31 Network system, information processing method, server, and terminal WO2018168006A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2017048343A JP2018152757A (en) 2017-03-14 2017-03-14 Network system, information processing method, server, and terminal
JP2017-048343 2017-03-14

Publications (1)

Publication Number Publication Date
WO2018168006A1 true WO2018168006A1 (en) 2018-09-20

Family

ID=63522884

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2017/031367 WO2018168006A1 (en) 2017-03-14 2017-08-31 Network system, information processing method, server, and terminal

Country Status (2)

Country Link
JP (1) JP2018152757A (en)
WO (1) WO2018168006A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7311272B2 (en) * 2019-01-29 2023-07-19 シャープ株式会社 air conditioner
WO2021028994A1 (en) * 2019-08-09 2021-02-18 Ｇｒｏｏｖｅ Ｘ株式会社 Device controller, device control method, and device control program

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006025208A (en) * 2004-07-08 2006-01-26 Yamaha Corp Peripheral equipment control unit
JP2007228520A (en) * 2006-02-27 2007-09-06 Kenwood Corp Remote control unit and program
JP2009081550A (en) * 2007-09-25 2009-04-16 Toshiba Corp Infrared remote controller and infrared remote control method

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006025208A (en) * 2004-07-08 2006-01-26 Yamaha Corp Peripheral equipment control unit
JP2007228520A (en) * 2006-02-27 2007-09-06 Kenwood Corp Remote control unit and program
JP2009081550A (en) * 2007-09-25 2009-04-16 Toshiba Corp Infrared remote controller and infrared remote control method

Also Published As

Publication number Publication date
JP2018152757A (en) 2018-09-27

Similar Documents

Publication Publication Date Title
US11451618B2 (en) Universal voice assistant
US11665757B2 (en) Universal audio device pairing assistant
US11445011B2 (en) Universal voice assistant
WO2016021728A1 (en) Information device and control device
CN111915870A (en) Method, device, television and storage medium for adding remote control code value by voice
JP2002354556A (en) Method for registering controlled apparatus to controller and control system
JP2014230060A (en) Network system, cooperation method of household appliances, server, household appliances, and program
WO2018168006A1 (en) Network system, information processing method, server, and terminal
JP6681582B2 (en) Information terminal control method and air conditioning control system in air conditioning control system
JP7277210B2 (en) Network systems, communication terminals and programs
KR20120005315A (en) Home appliance integrated control system
JP2018170744A (en) Remote control system, remote control method, and program
TWM580840U (en) Electric appliance control device with infrared receiving unit and radio frequency unit
WO2018079063A1 (en) Network system, server, information processing method, air conditioner and program
EP4335230A1 (en) Universal audio device pairing assistant
CN111183416B (en) Household electrical appliance system
JP2018152756A (en) Network system, information processing method, server, and communication terminal
TWM614494U (en) Internet-of-Things system with signal extender
JP2018142776A (en) Network system, information processing method, server, and terminal
JP7308118B2 (en) Network system, information processing method, communication terminal, and program
CN113129578A (en) Matching method, control method, system and storage medium of infrared equipment
TW201807672A (en) Pairing learning system and learning method for pairing system replaces an electronic product corresponding to the remote controller from the original manufacturer
TW201928899A (en) Fully-automatic code-searching method of all-purpose remote control system and device in which a lamp fixture or television is activated/de-activated to generate variation of brightness
JP2022061119A (en) Network systems, information processing methods, servers, and electrical equipment
JP2019184153A (en) Network system, server and information processing method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17900515

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17900515

Country of ref document: EP

Kind code of ref document: A1