JP2005268941A - Remote control device, remote control method and program thereof - Google Patents

Abstract

【Task】
To provide a remote control device, a remote control method, and a program thereof capable of remotely controlling a plurality of target devices without adding any functions to the devices to be remotely controlled.
[Solution]
A character string is recognized from the image of the device imaged from the camera unit 101, the device to be remotely controlled is identified from the recognized character string by referring to the device information database 108, and the operation unit 105 is identified. After setting as an operation unit of the device, an infrared signal for remote control is output to the device by operating the operation unit. Thus, the user can easily remotely control a plurality of devices without adding any function to the device only by imaging the device.
[Selection] Figure 6

Description

  The present invention relates to a remote control device, a remote control method, and a program thereof capable of remotely controlling a device.

Conventionally, as a technique for remotely controlling a plurality of devices with a single remote controller, an ID is assigned to each device, and the ID is assigned to the remote controller based on a barcode pattern or the like attached to the device to indicate the ID. Is recognized, displays a screen for controlling the device corresponding to the recognized ID on the touch panel of the remote controller, and transmits a control signal to the device by operating the touch panel. (For example, refer to Patent Document 1).
JP 2001-8279 A (paragraph [0012], FIG. 1 etc.)

  However, in the above-described technology, since it is necessary to add some function to each device such as attaching a barcode to each device in advance, it is not possible to remotely control an existing device that does not have the function. There has been a problem in that it takes time and cost to design and manufacture the device.

  In view of the circumstances as described above, an object of the present invention is to provide a remote control device, a remote control method, and a program thereof capable of remotely controlling a plurality of target devices without adding any functions to the devices to be remotely controlled. Is to provide.

  In order to solve the above-described problem, a remote control device of the present invention includes an operation unit, a first storage unit that stores device information related to a device to be remotely controlled, an imaging unit that images the device, and the captured image. Extraction means for extracting character information from the image information of the device, first determination means for determining a device to be remotely controlled based on the extracted character information and the device information stored by the storage means, And a first transmission unit configured to transmit remote control information for remotely controlling the device to the determined device by an operation of the operation unit.

  Here, the above devices are all devices that can be remotely controlled by a remote control device, such as various AV (Audio and Visual) devices, televisions, home appliances such as a DVD (Digital Versatile Disk) recorder, and the like.

  The remote control information is, for example, an infrared signal emitted from the remote control device, and includes a predetermined control signal desired by the user for the device.

  According to this configuration, it is possible to identify the device to be remotely controlled by extracting character information from the image information captured by the imaging unit, and to transmit the remote control information to the identified device. By simply imaging the device, it is possible to easily remotely control a plurality of devices without adding any functions to the device. In addition, it is possible to remotely control any device regardless of the manufacturing time and release time of the device to be remotely controlled.

  The remote control device includes second storage means for storing operation unit information indicating a relationship between the operation unit and the remote control information transmitted by operation of the operation unit in association with the device information; Setting means for setting the operation unit as an operation unit for remotely controlling the device determined by the first determination unit based on the stored operation unit information; and the first transmission unit The remote control information may be transmitted by operating the set operation unit.

  Here, the operation unit is, for example, a push button, a cross button, a touch panel, a jog dial, or the like. Depending on the type of device, the operation unit is assigned with the functions of each device, such as playback and pause for an audio player, channel change and volume change for a television.

  For example, when the remote control information such as “play” and “pause” is transmitted by the audio player, the operation unit information is such that the button A is a play button and the button B is a pause button. Information indicating the correspondence between the remote control information transmitted by the operation of the control unit and the operation unit.

  Thereby, the operation unit information corresponding to the device is stored, and when the remote control information is transmitted to each device, the operation unit is switched by switching the operation unit information. The remote control information can be accurately transmitted to each device.

  The remote control device may further include display means for displaying operation method information indicating an operation method of the operation unit corresponding to the device determined by the first determination means. Accordingly, the user can easily operate the operation unit by referring to the operation method information.

  The remote control device further includes third storage means for storing image information captured by the imaging means in association with the device information, and means for extracting the stored image information, The first determining means may determine a device for remote control based on the device information corresponding to the extracted image information.

  Accordingly, by storing the image information of the device in association with the device information, for example, character information is extracted from the captured image information, and the remote control target device is determined and remote control is performed. Later, when remote control is performed again, the device can be easily determined from the stored image information without extracting the character information from the image information and determining the device. Therefore, it is possible to save time and effort required for re-imaging and re-extraction processing of the character information, and power consumption of the remote control device can be reduced.

  The remote control device may further include an updating unit that updates the device information and the operation unit information.

  Here, the update means adding, deleting, or rewriting information.

  As a result, for example, when a device to be remotely controlled is added, it becomes possible to remotely control the added device by adding the device information. Conversely, when a device is not used. By deleting the device information of the device, the device information can be organized and the storage area in the remote control device can be used efficiently. In addition, by rewriting the operation unit information, it is possible to change the operation method of the operation unit so as to match the user's preference.

  In the remote control device, the device information may include manufacturer name information, model name information, and type information of the device. Thus, for example, the manufacturer name information and model name information written on the surface of the device are recognized as character information from the image information and compared with the information included in the device information, so that the device to be remotely controlled Can be specified.

  In addition, when the device for remote control is determined by the first determination unit, the display unit is configured to manufacture the determined device before displaying the operation method information or together with the operation method information. Trader name information, model name information, and corresponding type information may also be displayed.

  There may be a plurality of the remote control devices, and in order to transfer the remote control information to the device, the remote control device may further include a second transmission means for transmitting the remote control information to another remote control device.

  Thus, for example, after extracting character information from the image information and performing remote control of the device once, the device to be remotely controlled is determined based on the image information stored in the third storage means, When performing remote control of a device, the user may be at a position different from the previous time, and there may be an obstacle between the position and the device, or the distance from the device may be far away. If the remote control information cannot be transmitted, the remote control information can be transmitted to the other remote control device and transferred to the device so that the remote control of the device can be performed. Become.

  The remote control device includes receiving means for receiving remote control information for remotely controlling the device transmitted from the other remote control device, and transfer means for transferring the received remote control information to the device. May further be provided.

  Thereby, contrary to the case where the remote control information is transferred to the other remote control device described above, when the other remote control device exists at a position where the remote control information cannot be transmitted, the other remote control information is transmitted. By receiving the remote control device transmitted from the control device and transferring it to the device, the remote control device can be remotely controlled by the other remote control device.

  The remote control device may further include a second determination unit that determines which of the first transmission unit and the second transmission unit transmits the remote control information. Accordingly, the first transmission unit and the second transmission unit are appropriately selected according to the situation such as whether the user exists at a position where the user can directly transmit the remote control information to the device, The device to be remotely controlled can be accurately controlled.

  The remote control method of the present invention includes a step of storing device information related to a device to be remotely controlled, a step of imaging the device, a step of extracting character information from the image information of the imaged device, and the extraction A step of determining a device to be remotely controlled based on the stored character information and the stored device information, and a remote control for remotely controlling the device to the determined device by operating an operation unit And a step of transmitting information.

  The program of the present invention also includes a step of storing device information related to a remote control target device, a step of imaging the device, and a step of extracting character information from the image information of the captured device. And determining the device to be remotely controlled based on the extracted character information and the stored device information, and remotely controlling the device to the determined device by operating the operation unit. It is characterized by functioning as a step of transmitting remote control information.

  According to the present invention, it is possible to remotely control a plurality of target devices without adding any functions to the devices to be remotely controlled.

Hereinafter, embodiments of the present invention will be described with reference to the drawings.
(First embodiment)
First, a first embodiment of the present invention will be described. FIG. 1 is a block diagram showing a configuration of a remote control device (remote controller; hereinafter referred to as a remote controller) 100 to which the present invention is applied. In the present embodiment, the user performs remote control of each device in the home using the remote controller 100.

  As shown in the figure, the remote controller 100 of the present invention includes a camera unit 101, an infrared output unit 102, an infrared input unit 103, a liquid crystal display unit 104, an operation unit 105, a calculation unit 106, a frame memory 107, and a device information database 108. Composed.

  The camera unit 101 includes a lens (not shown), a CCD (Charge Coupled Devices), and the like, and takes an image of each device. The captured image is stored in the frame memory 107 in units of frames.

  The infrared output unit 102 outputs an infrared signal to each device as remote control information for remotely controlling each device. The infrared input unit 103 inputs the infrared signal from the other remote controller when the remote controller 100 transfers the infrared signal output from the other remote controller in the home to the device.

  The liquid crystal display unit 104 includes, for example, a TFT (Thin Film Transistor) and the like, and displays the operation method of the operation unit 105 when remotely controlling each device, and the manufacturer name, model name, and type of the device to be remotely controlled. Or an image of the device captured by the camera unit 101 and stored in the frame memory 107 is displayed.

  The operation unit 105 includes various buttons such as a push button and a cross button, and serves as an interface for outputting an infrared signal for remotely controlling each device from the infrared output unit 102. In addition, it also serves as an interface for making a selection from each menu displayed on the liquid crystal display unit 104. Details of the operation unit 105 will be described later. The operation unit 105 may be operated by using the liquid crystal display unit 104 as a touch panel instead of a button and pressing a virtual button on the touch panel.

  The calculation unit 106 extracts various character strings from the image of the device captured by the camera unit 101 and stored in the frame memory 107, performs character recognition, and performs various calculations such as calculation processing when specifying a remote control target device. Or exchange information with each unit to control the entire remote controller 100. When specifying the remote control target device, the device information database 108 is referred to. Details of the device information database 108 will also be described later.

  FIG. 2 is a view showing the appearance of the remote controller 100. As shown in the figure, the above-described camera unit 101, infrared output unit 102, and infrared input unit 103 are provided at the upper end of the remote control 100, and the liquid crystal display unit 104 is provided on the upper surface of the remote control 100. .

  Below the liquid crystal display unit 104, an image button 201, a relay button 202, a cross button 203, a number button 204, and an Up / Down button 205 are provided as the operation unit 105, respectively.

  The camera unit 101 captures an image of the device when the user presses the image button 201 with the camera unit 101 directed toward the device. The relay button 202 is used when an infrared signal for the device is relayed to another remote controller and transferred to the device. Details of the operation for relaying will be described later.

  The cross button 203 includes four buttons, top, bottom, left, and right, and is used when, for example, one menu is selected from various menus displayed on the liquid crystal display unit 104. Further, the cross button 203 can be set as a button for executing each function of each device for each device to be remotely controlled.

  The numeric buttons 204 are composed of, for example, twelve buttons from 1 to 12, and infrared signal codes corresponding to the respective functions are assigned on a one-to-one basis according to the functions of each device. For example, when the remote control 100 functions as a TV remote control, each button of the number buttons 204 corresponds to the number of each channel of the TV, and when functioning as a remote control of an audio player, each button is a CD to be played back. It corresponds to the number of songs such as MD.

  In addition, for example, four Up / Down buttons 205 are provided with the Up button and the Down button as one set. Similar to the numeric buttons 204, the Up / Down button 205 is also assigned functions of each device. For example, when functioning as a TV remote control, the Up / Down button 205 at the left end increases or decreases the volume. The Up / Down button 205 adjacent to the channel is used to switch the channel to the channel having the previous or next number. When functioning as a remote control for an audio player, it may be used, for example, when raising or lowering the volume, returning to the previous song, or going to the next song.

  When the remote controller 100 functions as a remote controller for each device, the setting of each button is switched with reference to the setting of each button stored in the device information database 108 when the device to be remotely controlled is specified. To use.

  FIG. 3 is a diagram showing data stored in the device information database 108. As shown in the figure, in the device information database 108, the manufacturer name (Maker) and type name (Type) of each device, the type of device (Class) such as a television and a DVD recorder, and the setting of each button of the operation unit 105 are displayed. Information (Setting) data is stored.

  When the arithmetic unit 106 extracts a character string from the device image information captured by the camera unit 101 of the remote controller 100 and specifies the device, data matching the extracted character string is stored in the device information database 108. The device is identified by searching from each manufacturer name and model name and confirming the match.

  When a device is specified, the type of the device is extracted from the device information database 108 together with the manufacturer name and model name and displayed on the liquid crystal display unit 104.

  When a device to be remotely controlled is added, or when the device is no longer used, the data can be updated by adding or deleting data in the device information database 108. The update may be performed, for example, by displaying a menu screen for data update on the liquid crystal display unit, and selecting or inputting the data appropriately using the cross button 203, the numeric button 204, or the like.

  Further, the operation method of each button when operating the operation unit 105 is displayed on the liquid crystal display unit according to the setting information.

  FIG. 4 is a diagram showing details of the setting information of each button. As shown in the figure, the setting information includes the code of the infrared signal output by each button of the cross button 203, the number button 204, and the Up / Down button for each device type and type. Are assigned and stored for all devices to be remotely controlled.

  In the figure, Setting 1-1 and Setting 1-2 indicate the setting information of the television, and Setting 3-3 indicates the setting information of the audio player. When the remote control target device is specified, the calculation unit 106 calls the setting information corresponding to the device and sets each button to function according to the setting information.

  In addition, since the said setting information can also be changed, each button can be customized according to a user's preference, for example. Similar to the data update described above, the customization may be executed by displaying a menu screen for customization on the liquid crystal display unit 104 and appropriately selecting or inputting on the screen.

  As described above, when a device to be remotely controlled is specified, an operation method of the operation unit 105 for transmitting infrared data to the device is displayed on the liquid crystal display unit 104. FIG. 5 is a diagram showing an example of the screen.

  This figure shows an example of a screen when the remote control target device is identified as a television. As shown in the figure, the manufacturer name (Sony (registered trademark)), model name (KV-XXXX), and type (TV) of the device to be remotely controlled are displayed at the top of the screen. Below that, the respective operation methods of the cross button 203, the numeric buttons 204, and the Up / Down button 205 are displayed. In this example, the cross button 203 is used when the upper and lower buttons switch the television channel up or down one channel, and when the left and right buttons increase or decrease the volume. The number button 204 corresponds to each channel of the television. The Up / Down button 205 is a set of buttons at the left end (1) that is used to increase / decrease the volume, and the other Up / Down buttons 205 are not used in this case.

  The information on the screen is extracted from the device information database 108 by the calculation unit 106 at the stage when the device to be remotely controlled is specified, and the character string position, size, color, and the like are set when displayed. After that, it is sent to the liquid crystal display unit 104. Although not shown, the position, size, color, and the like of the character string are also stored as data in the setting information in the device information database 108, and are set for each device based on the data. This data can be rewritten by the user to customize the display form of the character string or the like according to the user's preference.

  Next, operations of the remote controller 100 configured as described above until the device is remotely controlled will be described. FIG. 6 is a flowchart showing an operation flow until the remote controller 100 remotely controls the device.

  As shown in the figure, first, the calculation unit 106 of the remote controller 100 scans each button of the operation unit 105 to confirm whether or not the button of the operation unit 105 has been pressed by the user (step 301). If it is determined that no button has been pressed (NO in step 301), confirmation is repeated until the button is pressed.

  If it is determined that the user has pressed any button (YES in step 301), it is confirmed whether the pressed button is the image button 201 or another button (step 302). If the image button 201 is pressed (YES in step 302), the camera unit 101 images the device and captures the image (step 303). The captured image is transferred to the frame memory 107 and stored in units of frames. If the button other than the image button 201 is pressed (NO in step 302), a transmission code corresponding to the pressed button is transmitted to the infrared output unit 102. At this time, if the identification of the device to be remotely controlled has not been completed, a message prompting the device identification (for example, “the device is not identified”) is output to the liquid crystal display unit 104, and the button Ignore the press operation.

  Note that the image does not need to be in color in order to specify a device to be remotely controlled, and therefore, when storing in the frame memory 107, it is not necessary to receive a color difference signal from the image data. By thinning out the color difference signals, the amount of data can be reduced, the memory size can be reduced, and the transfer time from the camera unit 101 to the frame memory 107 can be shortened.

  Next, the computing unit 106 extracts a character string from the captured image in order to specify a device to be remotely controlled (step 304).

  Specifically, first, a portion composed of high-luminance pixels is detected in an image, and luminance dispersion is obtained therefrom to create a luminance dispersion image. On the other hand, the edge is detected from a portion having a high edge in the image, and the obtained value is binarized on the basis of a constant value based on the strength of the edge to create a binarized image. Here, the edge refers to a boundary between the region and another region when a portion having similar characteristics such as density value, color, and pattern of the image is defined as one region. It has changed.

  Then, a character string extraction candidate image is created by obtaining a logical product of the luminance dispersion image and the binarized image, and a rough character string region is cut out from the background from the character string extraction candidate image. If the calculation unit 106 determines that the character string area cannot be extracted from the image even after a certain period of time has passed, a message prompting the user to import the image again (for example, “character string from image”). Cannot be extracted. Please capture the image again. ") Is displayed on the liquid crystal display unit 104.

  Next, the character string is recognized from the character string area (step 305). Specifically, the image of the character string area is divided for each character, and each divided image is decomposed into the number of pixels of m rows × n rows, and further luminance distribution and edges are obtained from each image. Cut out the part. Then, the character portion is subjected to OCR (Optical Character Reader) processing to specify a character string.

  Subsequently, the device to be remotely controlled is specified based on the recognized character string (step 306). Specifically, at the stage where three consecutive characters can be recognized by the above processing, the character string is compared with the manufacturer name and model name in the device information database 108 to confirm the match. If the manufacturer names match, the device information database 108 is searched to further specify the model name. If the model name can be identified, the device identification will be completed, but if the model name cannot be identified, a message prompting you to import the image again (for example, “Device cannot be identified. Import the image again. , Etc. ”is displayed on the liquid crystal display unit 104.

  On the other hand, when the model name can be identified first, the device identification process can be completed at that time because the device can be identified by the manufacturer name linked to the model name in the device information database 108. If neither the manufacturer name nor the model name can be specified, a message prompting to capture an image again is displayed on the liquid crystal display unit 104 as described above.

  When the device identification is completed, the calculation unit 106, as shown in FIG. 5 above, identifies the manufacturer name and model name of the identified device and the device information stored in the device information database 108 in conjunction with them. The type is displayed on the liquid crystal display unit 104. Further, the calculation unit 106 refers to the setting information of each button in the device information database shown in FIG. 4 above, and uses the button group of the operation unit 105 as the remote control 100 of the specified device to remotely control the device. Is set so that an infrared code for transmission can be transmitted and activated (step 307).

  Subsequently, as shown in FIG. 5, a screen showing the operation method of each button of the operation unit 105 is displayed on the liquid crystal display unit 104 together with the manufacturer name and the like (step 308). At this time, for example, the backlight of buttons that can be used in the button group of the operation unit 105 is turned on, and the backlight of buttons that cannot be used is turned off. You may make it do. Once the device is specified, the setting of the operation unit 105 is effective until a different device is specified.

  When the user repeats the operation and becomes accustomed to the operation so that the operation can be performed without referring to the screen of the operation method, the operation information is not displayed. You may make it display the image of an apparatus.

  Then, the arithmetic unit 106 confirms again whether or not the button group of the operation unit 105 is pressed when there is no image capture or when the remote control target device is specified (step 301). If it is detected that a button other than the image button is pressed (NO in step 302), a transmission code corresponding to the pressed button is sent to the infrared output unit 102. The infrared output unit 102 modulates the received code with infrared rays or the like, and outputs an infrared signal for remote control to the device to be remotely controlled (step 309). As a result, the device is remotely controlled. The remote controller 100 repeats the above operation as long as the user operates the operation unit 105, and performs remote control by switching the device to be remotely controlled by the above processing each time the image button 201 is newly pressed.

  Through the above operation, the remote controller 100 recognizes a character string from the image of the device imaged by the camera unit 101, identifies the device from the recognized character string by referring to the device information database 108, and identifies the specified character string. Infrared signals for remote control can be output to the selected device, so that it is possible to easily remotely control a plurality of devices by simply imaging the device without adding any functions to the device. it can.

  By the way, after one device is specified and the device is remotely controlled, another device is specified and remotely controlled, and when the one device is remotely controlled again, the one device is imaged once. In this case, the image must be picked up again in spite of the identification, and this work may be troublesome for the user. For example, once the television is imaged and the television is specified as a device to be remotely controlled, and the television is remotely controlled, the DVD recorder is imaged while viewing the television, the DVD recorder is identified and remotely controlled, If the user again wants to remotely control the television, the television must be imaged again to identify the television.

  Therefore, the remote controller 100 according to the present embodiment can switch the device to be remotely controlled by using the captured image without re-imaging the device once identified. Hereinafter, the switching process will be described.

  As described above, when a device is imaged by the camera unit 101, the captured image is stored in the frame memory 107. After the device is identified from the image by the character recognition process described above, the image and the manufacturer name, model name, and type of the identified device are stored in association with each other. When the remote control is performed again, a list of device images is displayed on the liquid crystal display unit 104. Then, when the user selects an image of one device on the screen, a device corresponding to the image is set as a remote control target.

  FIG. 7 is a diagram showing an example of the screen displayed on the liquid crystal display unit 104. As shown in the figure, on the liquid crystal display unit 104, for example, images of devices already captured and specified are displayed on a screen divided into four parts, for example. In the figure, the upper left image shows a TV, the upper right shows a DVD recorder, and the lower left shows an audio player. For example, an image display button may be prepared in the operation unit 105 and the screen may be displayed by pressing the button. On the screen, for example, the user presses the cross button 203 to select and determine a device to be remotely controlled, so that the device is determined as a device to be remotely controlled. In the figure, a television surrounded by a thick frame is selected.

  The image of the device is a liquid crystal image obtained by storing in the frame memory 107 images specified within a predetermined past time, for example, within the past hour, among images captured and specifying a device to be remotely controlled. You may make it display on the display part 104, for example, you may make it display the predetermined number of images specified in the past, such as the past 4 sheets.

  As a result, if the device is a device that has been imaged once and remotely controlled, the user can easily determine the device to be remotely controlled by the above-described image switching process without performing imaging again each time remote control is performed. Can be controlled.

  Further, once a device to be remotely operated is determined and the device is remotely controlled, and the user moves to another position, even if the user has the remote control 100, for example, between the remote control 100 and the device. There may be a case where there is an obstacle or the distance to the device is long and the infrared signal does not reach the device and remote control cannot be performed. Therefore, even if the remote control 100 in this embodiment cannot output an infrared signal directly from the remote control 100, the remote control is performed by relaying the infrared signal to another remote control in the vicinity of the device. can do.

  FIG. 8 is a diagram illustrating a state in which an infrared signal is relayed to another remote controller. As shown in the figure, an obstacle exists between the remote control target television and the remote control 100, and the infrared signal of the remote control 100 cannot be output to the television. Therefore, the remote controller 100 outputs the infrared signal to another remote controller 100 ′ (hereinafter referred to as a relay remote controller) existing in the vicinity of the television, and causes the relay remote controller 100 ′ to relay the infrared signal and transfer it to the television. Even if there is no obstacle, the same processing is performed when the remote controller 100 is located far from the television and the infrared signal does not reach. The relay remote controller 100 ′ has the same configuration and functions as the remote controller 100. In the description of the relay remote controller 100 ′, for the same configuration as the remote controller 100, for example, an infrared output unit 102 ′, As in the infrared input unit 103 ′, “′” is attached for explanation.

  In this case, in the remote controller 100, by pressing a button for transmitting the infrared signal, such as the cross button 203 or the numeric button 204, while pressing the relay button 202 of the operation unit 105, the relay remote controller 100 ' An infrared signal is transmitted. In this case, since it is difficult to image the device due to the obstacles or the like, or even if it is possible to extract the character string, the user has already captured the image as described above. By displaying an image of the device and selecting it from there, the operation is performed after the device to be remotely controlled is determined.

  Specifically, the relay remote controller 100 ′ first receives an infrared signal from the remote controller 100 through the infrared input unit 103 ′. In addition to a code for remote control, a code indicating device information such as a manufacturer name, a model name, and a type of a device to be remotely controlled is added to the infrared signal. The relay remote controller 100 ′ extracts the manufacturer name, model name, and type included in the infrared signal by the calculation unit 106 ′, and specifies a remote control target device such as a television. The device is remotely controlled by outputting an infrared signal to the identified device via the infrared output unit 102 '. The series of processing in the relay remote controller 100 ′ is automatically performed.

  Assuming a case where an infrared signal cannot be transmitted depending on the orientation of the relay remote control 100 ′ with respect to the remote control 100 or the orientation of the relay remote control 100 with respect to the device, for example, an infrared standard that is transmitted in a wide range in a radial manner is used. You may make it employ | adopt for relay remote control 100 '.

  Accordingly, for example, after the user performs remote control with the remote controller 100, the user exists in a position different from the previous time, and there is an obstacle between the position and the device, Even if the infrared signal cannot be transmitted due to a long distance, the infrared remote control 100 ′ is transmitted to the relay remote controller 100 ′ and transferred to the device, thereby performing remote control of the device. It becomes possible.

  Similarly to the relay remote controller 100 ', the remote controller 100 can also receive an infrared signal from another remote controller, relay the infrared signal, and transfer the infrared signal to the device as the relay remote controller 100'. .

  The present invention is not limited to the embodiments described above, and various modifications can be made.

  For example, the present invention can be applied to a mobile phone having an infrared input / output function. As a result, it is possible to remotely operate any device without having to prepare a separate remote controller simply by installing a program and data necessary for executing the processing of the remote controller 100 described above on an existing mobile phone. Become. Furthermore, if the present invention is applied to a mobile phone that can be connected to the network such as the Internet or a wireless LAN, for example, data stored in the device information database 108 can be downloaded from a Web site on the Internet, The data can be freely exchanged between the two, and the convenience of the user is further improved.

  In the above-described embodiment, an example in which home devices are remotely controlled has been described. However, the present invention is not limited to home devices, and an environment in which devices that can be remotely controlled by a remote controller such as an office or a store exist. It can be applied in any environment.

Furthermore, the present invention can be applied to a network system as described in the following embodiments.
(Second Embodiment)
First, a network system that is a premise in the present embodiment will be described.

  FIG. 9 shows an example of the network system according to the present invention, in which a plurality of information processing apparatuses 1, 2, 3, 4 are connected via the network 9. The information processing apparatuses 1, 2, 3, 4 are, for example, various AV devices and portable devices.

  As for the information processing apparatus 1, the information processing apparatus 1 includes an information processing controller 11 as a computer function unit. The information processing controller 11 includes a main processor 21-1, sub processors 23-1, 23-2, and 23-3, a DMAC (direct memory access controller) 25-1, and a DC (disk controller) 27-1.

  The main processor 21-1 performs schedule management of program execution (data processing) by the sub processors 23-1, 23-2, and 23-3 and general management of the information processing controller 11 (information processing apparatus 1). . However, a program other than the management program may be operated in the main processor 21-1. In that case, the main processor 21-1 also functions as a sub processor. The main processor 21-1 has an LS (local storage) 22-1.

  There may be one sub-processor, but preferably there are a plurality of sub-processors. This example is a plurality of cases. Each of the sub processors 23-1, 23-2, and 23-3 executes a program in parallel and independently under the control of the main processor 21-1, and processes data. Further, in some cases, the program in the main processor 21-1 can be configured to operate in cooperation with the programs in the sub-processors 23-1, 23-2, and 23-3. A function program described later is also a program that operates in the main processor 21-1. The sub processors 23-1, 23-2, and 23-3 also have LS (local storage) 24-1, 24-2, and 24-3.

  The DMAC 25-1 accesses a program and data stored in a main memory 26-1 including a DRAM (dynamic RAM) connected to the information processing controller 11, and the DC 27-1 is used for the information processing controller 11. Are accessed to the external recording units 28-1 and 28-2.

  The external recording units 28-1 and 28-2 may be fixed disks (hard disks) or removable disks, and are optical disks such as MO, CD ± RW, DVD ± RW, memory disks, SRAM (static RAM), ROM, and the like. Various types can be used. Therefore, although DC27-1 is called a disk controller, it is an external recording unit controller. As in the example of FIG. 9, the information processing controller 11 can be configured so that a plurality of external recording units 28 can be connected to the information processing controller 11.

  The main processor 21-1, the sub processors 23-1, 23-2, and 23-3, the DMAC 25-1, and the DC 27-1 are connected by a bus 29-1.

  An identifier that can uniquely identify the information processing apparatus 1 including the information processing controller 11 throughout the entire network is assigned to the information processing controller 11 as an information processing apparatus ID.

  Similarly, an identifier that can identify each of the main processor 21-1 and each of the sub processors 23-1, 23-2, and 23-3 is assigned as a main processor ID and a sub processor ID.

  The information processing controller 11 is preferably configured as a one-chip IC (integrated circuit). Other information processing apparatuses 2, 3, and 4 are configured in the same manner as described above. Here, units having the same parent number in FIG. 9 are assumed to perform the same function even if they have different branch numbers, unless otherwise noted. Further, in the following description, when the branch number is omitted, it is assumed that the difference in the branch number does not occur.

  As described above, each sub-processor 23 in one information processing controller independently executes a program and processes data, but different sub-processors simultaneously read or write to the same area in the main memory 26. If done, data inconsistencies can occur. Therefore, access from the sub processor 23 to the main memory 26 is performed according to the following procedure.

  As shown in FIG. 10A, the main memory 26 is composed of memory locations that can specify a plurality of addresses. Each memory location is allocated an additional segment for storing information indicating the state of the data. The additional segment includes an F / E bit, a sub processor ID, and an LS address (local storage address). Each memory location is also assigned an access key to be described later. The F / E bit is defined as follows.

  The F / E bit = 0 indicates that the data being processed being read by the sub-processor 23 or invalid data that is not the latest data because it is empty and cannot be read. The F / E bit = 0 indicates that data can be written to the memory location, and is set to 1 after writing.

  The F / E bit = 1 indicates that the data at the memory location has not been read by the sub-processor 23 and is the latest unprocessed data. The data in the memory location can be read and set to 0 after being read by the sub-processor 23. Further, the F / E bit = 1 indicates that the memory location cannot write data.

  Furthermore, it is possible to set a read reservation for the memory location in the state where the F / E bit = 0 (reading impossible / writing possible). When a read reservation is made for a memory location with the F / E bit = 0, the sub processor 23 adds the sub processor ID and LS of the sub processor 23 as read reservation information to an additional segment of the memory location where the read reservation is made. Write the address.

  Thereafter, when data is written to the memory location reserved for reading by the sub-processor 23 on the data writing side and the F / E bit is set to 1 (readable / not writable), it is preliminarily stored in the additional segment as read reservation information. Read to the written sub-processor ID and LS address.

  When it is necessary to process data in multiple stages by a plurality of sub-processors, the sub-processor 23 that performs the process in the previous stage controls the read / write of the data in each memory location in this way. Immediately after the data is written at a predetermined address on the main memory 26, another sub-processor 23 that performs the subsequent processing can read the data after the preprocessing.

  As shown in FIG. 10B, the LS 24 in each sub-processor 23 is also configured by memory locations that can specify a plurality of addresses. An additional segment is similarly allocated for each memory location. The additional segment includes a busy bit.

  When the sub-processor 23 reads the data in the main memory 26 to the memory location of its own LS 24, it reserves by setting the corresponding busy bit to 1. No other data can be stored in the memory location where the busy bit is 1. After reading to the memory location of the LS 24, the busy bit becomes 0 and can be used for any purpose.

  As shown in FIG. 10A, the main memory 26 connected to each information processing controller further includes a plurality of sandboxes. The sandbox defines an area in the main memory 26, and each sandbox is assigned to each sub processor 23 and can be used exclusively by the sub processor. That is, each sub-processor 23 can use a sandbox assigned to itself, but cannot access data beyond this area. The main memory 26 is composed of a plurality of memory locations, and the sandbox is a set of these memory locations.

  Further, in order to realize exclusive control of the main memory 26, a key management table as shown in FIG. 10C is used. The key management table is stored in a relatively high-speed memory such as SRAM in the information processing controller, and is associated with the DMAC 25. Each entry in the key management table includes a sub processor ID, a sub processor key, and a key mask.

  The process when the sub processor 23 uses the main memory 26 is as follows. First, the sub processor 23 outputs a read or write command to the DMAC 25. This command includes its own sub-processor ID and the address of the main memory 26 that is the use request destination.

  Before executing this command, the DMAC 25 refers to the key management table and checks the sub processor key of the sub processor of the use request source. Next, the DMAC 25 compares the checked sub-processor key of the use request source with the access key allocated to the memory location shown in FIG. Execute the above command only when two keys match.

  In the key mask on the key management table shown in FIG. 10C, when the arbitrary bit becomes 1, the corresponding bit of the sub-processor key associated with the key mask may become 0 or 1. it can. For example, assume that the sub-processor key is 1010. Normally, this sub-processor key only allows access to a sandbox with 1010 access keys. However, if the key mask associated with this sub-processor key is set to 0001, the match determination between the sub-processor key and the access key is masked only for the digit whose key mask bit is set to 1. This sub-processor key 1010 enables access to a sandbox having an access key whose access key is either 1010 or 1011.

  As described above, the sandbox exclusivity of the main memory 26 is realized. That is, when it is necessary to process data in multiple stages by a plurality of sub-processors in one information processing controller, by configuring as described above, the sub-processor that performs the process in the previous stage and the process in the subsequent stage are processed. Only the sub processor that performs the access can access a predetermined address in the main memory 26, and data can be protected.

  For example, it can be used as follows. First, immediately after the information processing apparatus is activated, the values of the key masks are all zero. It is assumed that a program in the main processor is executed and operates in cooperation with a program in the sub processor. When the processing result data output by the first sub-processor is temporarily stored in the main memory and desired to be input to the second sub-processor, the corresponding main memory area must naturally be accessible from either sub-processor. is there. In such a case, the program in the main processor appropriately changes the value of the key mask and provides a main memory area that can be accessed from a plurality of sub processors, thereby enabling multi-stage processing by the sub processors. .

More specifically, it is a multi-step process in the order of data from another information processing apparatus → processing by the first sub processor → first main memory area → processing by the second sub processor → second main memory area. When processing is done,
Sub-processor key of the first sub-processor: 0100
First main memory area access key: 0100,
Sub-processor key of the second sub-processor: 0101,
Access key for second main memory area: 0101
In such a setting, the second sub-processor cannot access the first main memory area. Therefore, by setting the key mask of the second sub processor to 0001, it is possible to allow the second sub processor to access the first main memory area.

  In the network system of FIG. 9, software cells are transmitted between the information processing apparatuses 1, 2, 3, and 4 for distributed processing between the information processing apparatuses 1, 2, 3, and 4. That is, the main processor 21 included in the information processing controller in a certain information processing apparatus generates a software cell including a command, a program, and data, and transmits it to another information processing apparatus via the network 9 to perform processing. Can be dispersed.

  FIG. 11 shows an example of the configuration of the software cell. The software cell in this example is composed of a transmission source ID, a transmission destination ID, a response destination ID, a cell interface, a DMA command, a program, and data as a whole.

  The transmission source ID includes the network address of the information processing apparatus that is the transmission source of the software cell, the information processing apparatus ID of the information processing apparatus, and the main processor 21 and each sub processor included in the information processing controller in the information processing apparatus. 23 identifiers (main processor ID and sub-processor ID) are included.

  The transmission destination ID and the response destination ID include the same information about the information processing apparatus that is the transmission destination of the software cell and the information processing apparatus that is the response destination of the execution result of the software cell, respectively.

  The cell interface is information necessary for using the software cell, and includes a global ID, necessary sub-processor information, a sandbox size, and a previous software cell ID.

  The global ID can uniquely identify the software cell throughout the network, and is created based on the transmission source ID and the date and time (date and time) of creation or transmission of the software cell.

  The necessary sub-processor information sets the number of sub-processors necessary for executing the software cell. The sandbox size sets the amount of memory in the main memory 26 and the LS 24 of the sub processor 23 necessary for executing the software cell. The previous software cell ID is an identifier of the previous software cell in a group of software cells that request sequential execution of streaming data or the like.

  The execution section of the software cell is composed of DMA commands, programs, and data. The DMA command includes a series of DMA commands necessary for starting the program, and the program includes a sub processor program executed by the sub processor 23. The data here is data processed by a program including the sub processor program.

  Further, the DMA command includes a load command, a kick command, a function program execution command, a status request command, and a status return command.

  The load command is a command for loading information in the main memory 26 into the LS 24 in the sub processor 23, and includes a main memory address, a sub processor ID, and an LS address in addition to the load command itself. The main memory address indicates an address of a predetermined area in the main memory 26 from which information is loaded. The sub processor ID and the LS address indicate the identifier of the sub processor 23 to which the information is loaded and the address of the LS 24.

  The kick command is a command for starting execution of a program, and includes a sub processor ID and a program counter in addition to the kick command itself. The sub processor ID identifies the sub processor 23 to be kicked, and the program counter gives an address for the program execution program counter.

  As will be described later, the function program execution command is a command for requesting execution of a function program from another information processing apparatus to another information processing apparatus. The information processing controller in the information processing apparatus that has received the function program execution command identifies a function program to be activated by a function program ID described later.

  The status request command is a command for requesting transmission of device information related to the current operation state (situation) of the information processing device indicated by the transmission destination ID to the information processing device indicated by the response destination ID. Although the function program will be described later, it is a program categorized into the function program in the software configuration diagram stored in the main memory 26 of the information processing controller shown in FIG. The function program is loaded into the main memory 26 and executed by the main processor 21.

  The status reply command is a command in which the information processing apparatus that has received the status request command responds to the information processing apparatus indicated by the response destination ID included in the status request command with its own apparatus information. The status reply command stores device information in the data area of the execution section.

  FIG. 12 shows the structure of the data area of the software cell when the DMA command is a status return command.

  The information processing device ID is an identifier for identifying the information processing device including the information processing controller, and indicates the ID of the information processing device that transmits the status reply command. The information processing device ID is included in the information processing controller in the information processing device by the main processor 21 included in the information processing controller in the information processing device when the power is turned on. It is generated based on the number of sub processors 23 to be processed.

  The information processing device type ID includes a value representing the characteristics of the information processing device. The characteristics of the information processing apparatus are, for example, an audio player, a remote controller described later, and the like. Further, the information processing device type ID may represent functions such as voice information reproduction and remote control. It is assumed that values representing the characteristics and functions of the information processing apparatus are determined in advance, and it is possible to grasp the characteristics and functions of the information processing apparatus by reading the information processing apparatus type ID.

  The MS (master / slave) status indicates whether the information processing apparatus is operating as a master apparatus or a slave apparatus, as will be described later. When this is set to 0, it operates as a master apparatus. If it is set to 1, it indicates that it is operating as a slave device.

  The main processor operating frequency represents the operating frequency of the main processor 21 in the information processing controller. The main processor usage rate represents the usage rate in the main processor 21 for all programs currently running on the main processor 21. The main processor usage rate is a value representing the ratio of the processing capacity in use to the total processing capacity of the target main processor. For example, the main processor usage rate is calculated by using MIPS, which is a unit for evaluating the processor processing capacity, or per unit time. Calculated based on processor usage time. The same applies to the sub-processor usage rate described later.

  The number of sub-processors represents the number of sub-processors 23 included in the information processing controller. The sub processor ID is an identifier for identifying each sub processor 23 in the information processing controller.

  The sub processor status represents the state of each sub processor 23, and there are states such as “unused”, “reserved”, and “busy”. “unused” indicates that the sub-processor is not currently used and is not reserved for use. “reserved” indicates a reserved state that is not currently used. Busy indicates that it is currently in use.

  The sub-processor usage rate represents the usage rate of the sub-processor for a program that is currently being executed by the sub-processor or that is reserved for execution by the sub-processor. That is, the sub processor usage rate indicates the current usage rate when the sub processor status is busy, and indicates the estimated usage rate that is to be used later when the sub processor status is reserved.

  One set of sub processor ID, sub processor status, and sub processor usage rate is set for one sub processor 23, and the number of sets corresponding to the sub processor 23 in one information processing controller is set.

  The total main memory capacity and the main memory usage represent the total capacity and the currently used capacity of the main memory 26 connected to the information processing controller, respectively.

  The number of external recording units represents the number of external recording units 28 connected to the information processing controller. The external recording unit ID is information that uniquely identifies the external recording unit 28 connected to the information processing controller. The external recording unit type ID represents the type of the external recording unit (for example, hard disk, CD ± RW, DVD ± RW, memory disk, SRAM, ROM, etc.).

  The external recording unit total capacity and the external recording unit usage amount represent the total capacity and the currently used capacity of the external recording unit 28 identified by the external recording unit ID, respectively.

  The external recording unit ID, the external recording unit type ID, the external recording unit total capacity, and the external recording unit usage amount are set for one external recording unit 28 and connected to the information processing controller. The number of sets corresponding to the number of external recording units 28 is set. That is, when a plurality of external recording units are connected to one information processing controller, a different external recording unit ID is assigned to each external recording unit, the external recording unit type ID, the external recording unit total capacity, and the external recording unit Department usage is also managed separately.

  The main processor 21 included in the information processing controller in a certain information processing device generates a software cell having the above configuration and transmits it to the other information processing device and the information processing controller in the device via the network 9. . The transmission source information processing device, the transmission destination information processing device, the response destination information processing device, and the information processing controller in each device are identified by the transmission source ID, the transmission destination ID, and the response destination ID, respectively. .

  The main processor 21 included in the information processing controller in the information processing apparatus that has received the software cell stores the software cell in the main memory 26. Furthermore, the transmission destination main processor 21 reads the software cell and processes the DMA command included therein. Specifically, the transmission destination main processor 21 first executes a load command. As a result, information is loaded from the main memory address instructed by the load command into a predetermined area of the LS 24 in the sub processor identified by the sub processor ID and LS address included in the load command. The information loaded here is a sub-processor program or data included in the received software cell, or other designated data.

  Next, the main processor 21 outputs the kick command together with the program counter included in the kick command to the sub processor indicated by the sub processor ID included therein. The instructed sub processor executes the sub processor program according to the kick command and the program counter. After the execution result is stored in the main memory 26, the main processor 21 is notified that the execution has been completed.

  Note that the processor that executes the software cell in the information processing controller in the information processing apparatus of the transmission destination is not limited to the sub-processor 23, but the main processor 21 executes a program for main memory such as a function program included in the software cell. It can also be specified to execute.

  In this case, the transmission source information processing apparatus includes a main memory program and data processed by the main memory program instead of the sub processor program, and the DMA command is sent to the transmission destination information processing apparatus. A software cell as a load command is transmitted, and the main memory 26 stores the main memory program and data processed thereby. Next, the transmission source information processing apparatus identifies the main processor ID, the main memory address, and the main memory program for the information processing controller in the transmission destination information processing apparatus for the transmission destination information processing apparatus. A software cell that includes an identifier such as a function program ID (to be described later) and a program counter and whose DMA command is a kick command or a function program execution command is transmitted to cause the main processor 21 to execute the main memory program.

  As described above, in the network system of the present invention, the transmission source information processing apparatus transmits the sub processor program or the main memory program to the transmission destination information processing apparatus by the software cell, and transmits the sub processor program to the transmission destination. It is possible to load the sub processor 23 included in the information processing controller in the information processing apparatus and cause the information processing apparatus of the transmission destination to execute the sub processor program or the main memory program.

  When the program included in the received software cell is a sub processor program, the information processing controller in the transmission destination information processing apparatus loads the sub processor program to the designated sub processor. Then, the sub processor program or the main memory program included in the software cell is executed. Therefore, even if the user does not operate the transmission destination information processing apparatus, the sub processor program or the main memory program can be automatically executed by the information processing controller in the transmission destination information processing apparatus.

  In this way, when the information processing controller in its own device does not have a main memory program such as a sub processor program or a function program, the information processing device can receive information from other information processing devices connected to the network. Can be obtained. Furthermore, data is transferred between the sub-processors by the DMA method, and the above-described sandbox is used, so that even when it is necessary to process data in multiple stages within one information processing controller, high speed and high security are achieved. The process can be executed.

  As a result of distributed processing using software cells, a plurality of information processing apparatuses 1, 2, 3, 4 connected to the network 9 as shown in the upper part of FIG. It operates as a single information processing device 7. However, for this purpose, the following processing needs to be executed by the following configuration.

  FIG. 14 shows the configuration of software stored in the main memory 26 of each information processing controller. These software (programs) are recorded in the external recording unit 28 connected to the information processing controller before the information processing apparatus is turned on. Each program is categorized into a control program, a function program, and a device driver according to functions or features.

  The control program is the same for each information processing controller, and is executed by the main processor 21 of each information processing controller, and includes an MS (master / slave) manager and a capacity exchange program described later.

  The function program is executed by the main processor 21, and a function program corresponding to the information processing apparatus is provided for each information processing controller such as recording, reproduction, and material search.

  The device driver is for input / output (transmission / reception) of the information processing controller (information processing apparatus), such as broadcast reception, monitor output, bit stream input / output, network input / output, etc. Provided.

  When the information processing apparatus is physically connected to the network 9 and the main power is turned on, and the information processing apparatus is electrically and functionally connected to the network 9, the information processing apparatus The main processor 21 of the information processing controller loads each program belonging to the control program and each program belonging to the device driver into the main memory 26.

  As a loading procedure, the main processor 21 first reads a program from the external recording unit 28 by causing the DC 27 to execute a read command, and then causes the DMAC 25 to execute a write command to load the program into the main memory 26. Write to.

  As for each program belonging to the function program, it may be configured to load only the necessary program when necessary, or like the programs belonging to other categories, each program is loaded immediately after the main power is turned on. You may comprise as follows.

  Here, each program belonging to the function program does not need to be recorded in the external recording unit 28 of all information processing apparatuses connected to the network, and is recorded in the external recording unit 28 of any one information processing apparatus. If so, it can be loaded from another information processing apparatus by the above-described method. As a result, the function program is executed as one virtual information processing apparatus 7 as shown in the lower part of FIG. Can do.

  Further, as described above, the function program processed by the main processor 21 may cooperate with the sub processor program processed by the sub processor 23. Therefore, when the main processor 21 reads out the function program from the external recording unit 28 and writes it to the main memory 26, when there is a sub processor program that operates in cooperation with the target function program, the sub processor program also includes the same main program. It is assumed that data is written in the memory 26. In this case, there may be one or more sub-processor programs that operate in cooperation with each other. If there are a plurality of sub-processor programs, all the sub-processor programs operating in cooperation are written in the main memory 26. The sub processor program written in the main memory 26 is then written in the LS 24 in the sub processor 23 and operates in cooperation with the function program processed by the main processor 21.

  As shown in the software cell of FIG. 11, an identifier that can uniquely identify a program for each program is assigned to the function program as a function program ID. The function program ID is determined from the creation date and time, the information processing apparatus ID, and the like at the stage of creating the function program.

  A sub processor program ID is also assigned to the sub processor program, whereby the sub processor program can be uniquely identified. The assigned sub processor program ID is an identifier related to the function program ID of the function program that is the partner of the cooperative operation, for example, the function program ID as a parent number and a branch number added at the end. There may be an identifier that is not related to the function program ID of the function program that is the partner of the cooperative operation. In any case, when the function program and the sub processor program operate in cooperation, it is necessary to store the program ID which is the identifier of the other party in the own program. Even when the function program operates in cooperation with a plurality of sub processor programs, the function program stores the sub processor program IDs of all the sub processor programs.

  The main processor 21 secures an area for storing device information (information regarding the operation state) of the information processing device on which the main processor 21 operates in the main memory 26, and records the information as a device information table of the own device. The device information here is each piece of information below the information processing device ID shown in FIG.

  In the network system described above, when the main power supply to a certain information processing apparatus is turned on, the main processor 21 of the information processing controller of the information processing apparatus loads a master / slave manager (hereinafter referred to as MS manager) into the main memory 26 and executes it. To do.

  When the MS manager detects that the information processing apparatus on which it operates is connected to the network 9, it confirms the existence of another information processing apparatus connected to the same network 9. The “connection” or “existence” here means that the information processing apparatus is not only physically connected to the network 9 but also electrically and functionally connected to the network 9 as described above. Indicates. In addition, an information processing apparatus in which the device operates is referred to as a self device, and another information processing device is referred to as another device. The apparatus also indicates the information processing apparatus.

  A method in which the MS manager confirms the existence of another information processing apparatus connected to the same network 9 will be described below.

  The MS manager generates a software cell in which the DMA command is a status request command, the transmission source ID and the response destination ID are the information processing apparatus, and the transmission destination ID is not specified, and the network manager is connected to the information processing apparatus. To set a timer for network connection confirmation. The timeout time of the timer is, for example, 10 minutes.

  When another information processing apparatus is connected to the network system, the other apparatus receives the software cell of the status request command, and sends it to the information processing apparatus that has issued the status request command specified by the response destination ID. On the other hand, the DMA command is a status return command, and a software cell including device information of itself (other device) is transmitted as data. The software cell of the status reply command includes at least information for identifying the other device (information processing device ID, information on the main processor, information on the sub processor, etc.) and the MS status of the other device.

  The MS manager of the information processing apparatus that has issued the status request command monitors the reception of the software cell of the status reply command transmitted from another apparatus on the network until the timer for network connection confirmation times out. As a result, when the status reply command indicating the MS status = 0 (master device) is received, the MS status in the device information table of the own device is set to 1. Thus, the device becomes a slave device.

  On the other hand, if no status reply command is received before the network connection confirmation timer times out, or if no status reply command indicating MS status = 0 (master device) is received, The MS status in the device information table of the own device is set to 0. This makes the device a master device.

  That is, if no information processing apparatus is connected to the network 9 in a state where none of the apparatuses is connected to the network 9 or a master apparatus does not exist on the network 9, the apparatus automatically becomes the master apparatus. Set as On the other hand, when a new information processing apparatus is connected to the network 9 in a state where a master apparatus already exists on the network 9, the apparatus is automatically set as a slave apparatus.

  For both the master device and the slave device, the MS manager periodically monitors the status of the other device by sending a status request command to the other device on the network 9 and inquiring status information. As a result, the main power supply of the information processing apparatus connected to the network 9 is cut off or the information processing apparatus is disconnected from the network 9, so that the status from a specific other apparatus within a predetermined period set in advance for determination When there is a change in the connection state of the network 9, such as when a reply command is not returned or when a new information processing apparatus is connected to the network 9, the information is notified to the ability exchange program described later. .

  When the main processor 21 receives an inquiry from another manager on the network 9 and a notification of completion of setting the MS status of the own apparatus from the MS manager, the main processor 21 executes the capability exchange program.

  When the own device is a master device, the capability exchange program acquires device information of all other devices connected to the network 9, that is, device information of each slave device. As described above, the device information of another device is generated by generating a software cell in which the DMA command is a status request command and transmitting it to the other device. Thereafter, the DMA command is a status return command and data of the other device. This is possible by receiving a software cell containing device information from another device.

  Similar to the device information table of the own device that is the master device, the capability exchange program sets an area for storing device information of all other devices (each slave device) connected to the network 9 as the main memory of the own device. This information is recorded in a device information table of another device (slave device). That is, the device information of all information processing devices connected to the network 9 including the device itself is recorded in the main memory 26 of the master device as a device information table.

  On the other hand, when the own device is a slave device, the capability exchange program acquires device information of all other devices connected to the network 9, that is, device information of each slave device other than the master device and the own device. The information processing apparatus ID and the MS status included in the apparatus information are recorded in the main memory 26 of the own apparatus. That is, the device information of the own device is recorded as a device information table in the main memory 26 of the slave device, and the master device connected to the network 9 other than the own device and the information processing device ID for each slave device. And the MS status are recorded as another device information table.

  Further, in both the master device and the slave device, when the capability exchange program is notified from the MS manager that the information processing device is newly connected to the network 9 as described above, the device of the information processing device Information is acquired and recorded in the main memory 26 as described above.

  Note that the MS manager and the capability exchange program are not limited to being executed by the main processor 21, but may be executed by any of the sub processors 23. The MS manager and the capability exchange program are preferably resident programs that always operate while the main power supply of the information processing apparatus is turned on.

  For both the master device and the slave device, the capability exchange program causes the MS manager to cut off the main power supply of the information processing device connected to the network 9 or disconnect the information processing device from the network 9 as described above. When it is notified, the apparatus information table of the information processing apparatus is deleted from the main memory 26 of the own apparatus.

  Further, when the information processing apparatus disconnected from the network 9 is a master apparatus, a new master apparatus is determined by the following method.

  Specifically, for example, each of the information processing apparatuses that are not disconnected from the network 9 replaces the information processing apparatus ID of the own apparatus and the other apparatus with a numerical value, and sets the information processing apparatus ID of the own apparatus to the information processing of the other apparatus. If the information processing device ID of the own device is the smallest among the information processing devices not disconnected from the network 9 as compared with the device ID, the slave device moves to the master device and sets the MS status to 0. As described above, device information of all other devices (each slave device) connected to the network 9 is acquired and recorded in the main memory 26 as a master device.

  As shown in the lower part of FIG. 13, in order for a plurality of information processing apparatuses 1, 2, 3, 4 connected to the network 9 to operate as one virtual information processing apparatus 7, the master apparatus is a user It is necessary to grasp the operation of the slave device and the operating state of the slave device.

  FIG. 15 shows how four information processing apparatuses operate as one virtual information processing apparatus 7. It is assumed that the information processing device 1 is operating as a master device, and the information processing devices 2, 3, and 4 are operating as slave devices A, B, and C.

  When the user operates an information processing device connected to the network 9, if the operation target is the master device 1, the operation information is directly grasped by the master device 1, and if the operation target is a slave device, The operation information is transmitted from the operated slave device to the master device 1. That is, regardless of whether the user's operation target is the master device 1 or the slave device, the operation information is always grasped by the master device 1. The operation information is transmitted, for example, by a software cell whose DMA command is an operation information transmission command.

  Then, the main processor 21-1 included in the information processing controller 11 in the master device 1 selects a function program to be executed according to the operation information. At that time, if necessary, the main processor 21-1 included in the information processing controller 11 in the master device 1 may transfer the main memory 26-1 from the external recording units 28-1 and 28-2 of the own device by the above method. However, another information processing device (slave device) may transmit the function program to the master device 1.

  In the function program, information processing device type IDs represented as information shown in FIG. 12, processing capacity of the main processor or sub processor, main memory usage, and conditions related to the external recording unit are required for each execution unit. The required specifications regarding the device are defined.

  The main processor 21-1 included in the information processing controller 11 in the master device 1 reads out the required specifications necessary for each function program. Further, the device information table of each information processing device is read by referring to the device information table previously recorded in the main memory 26-1 by the capability exchange program. The device information here indicates each piece of information below the information processing device ID shown in FIG.

  The main processor 21-1 included in the information processing controller 11 in the master device 1 sequentially compares the device information of each information processing device connected on the network 9 with the required specifications necessary for executing the function program. To do.

  For example, when the function program requires a recording function, only the information processing apparatus having the recording function is specified and extracted based on the information processing apparatus type ID. Furthermore, a slave device that can secure the conditions regarding the processing capability of the main processor or sub processor, the amount of main memory used, and the external recording unit necessary for executing the function program is specified as an execution request candidate device. Here, when a plurality of execution request candidate devices are specified, one execution request candidate device is specified and selected from the candidate devices.

  When the slave device to be executed is specified, the main processor 21-1 included in the information processing controller 11 in the master device 1 sets the main memory included in the information processing controller 11 in the own device for the specified slave device. The device information table of the slave device recorded in 26-1 is updated.

  Further, the main processor 21-1 included in the information processing controller 11 in the master device 1 generates a software cell whose DMA command is a load command and a kick command, and the cell interface of the software cell needs a function program necessary. The sub processor information and the sandbox size (see FIG. 11) are set and transmitted to the slave device requested to execute.

  The slave device requested to execute the function program executes the function program and updates the device information table of the own device. At that time, if necessary, the main processor 21 included in the information processing controller in the slave device, from the external recording unit 28 of the own device to the main memory 26 by the above method, the function program and the sub-operation that operates in cooperation with the function program. Load the processor program.

  When the required function program or the sub processor program that operates in cooperation with the function program is not recorded in the external recording unit 28 of the slave device requested to execute the function program, the other information processing apparatus Alternatively, the system may be configured so that the sub processor program is transmitted to the function program execution request destination slave device.

  The sub-processor program can be executed by another information processing apparatus using the aforementioned load command and kick command.

  After the execution of the function program, the main processor 21 included in the information processing controller in the slave device that has executed the function program transmits an end notification to the main processor 21-1 included in the information processing controller 11 in the master device 1. At the same time, the device information table of the own device is updated. The main processor 21-1 included in the information processing controller 11 in the master device 1 receives the end notification and updates the device information table of the slave device that has executed the function program.

  The main processor 21-1 included in the information processing controller 11 in the master device 1 identifies itself as an information processing device that can execute the function program from the reference result of the device information table of the own device and the other device. There is also a case of selecting. In that case, the master device 1 executes the function program.

  In the example of FIG. 15, a case where the user operates the slave device A (information processing device 2) and another slave device B (information processing device 3) executes a function program corresponding to the operation is described with reference to FIG. An example of the distributed processing will be described.

  In the example of FIG. 16, when the user operates the slave device A, distributed processing of the entire network system including the slave device A starts. First, in step 81, the slave device A transmits the operation information to the master device. 1 to send.

  In step 72, the master device 1 receives the operation information, and further proceeds to step 73, where each information processing is performed from the device information table of the own device and other devices recorded in the main memory 26-1 of the own device. The operating state of the apparatus is checked, and an information processing apparatus that can execute a function program corresponding to the received operation information is selected. This example is a case where the slave device B is selected.

  Next, in step 74, the master device 1 requests the selected slave device B to execute the function program.

  In step 95, the slave device B receives the execution request, and further proceeds to step 96 to execute the function program requested to be executed.

  As described above, by operating only one information processing apparatus, the user operates a plurality of information processing apparatuses 1, 2, 3, and 4 without operating other information processing apparatuses. The information processing apparatus 7 can be operated.

  Next, an embodiment when the network system described above is applied to the present invention will be described. FIG. 17 is a diagram showing a configuration of a remote control system in the present embodiment. In the figure, the above-described remote controller 100 and the relay remote controller 100 ′ are applied to the information processing apparatus in FIG. 9, and the description of the parts having the same configurations as those in FIG. 1, FIG. 9, etc. is simplified or omitted. The explanation will focus on the different points.

  As shown in the figure, the remote controller 100 and the relay remote controller 100 ′ are connected via a network 9, and can perform communication using infrared rays, for example.

  The remote controller 100 functions as the information processing apparatus 1 in FIG. 1 and the like, and the relay remote controller 100 ′ functions as the information processing apparatus 2. Each of the remote controllers 100 ′ includes an information processing controller including the main processor and the sub processor described above. It is possible to execute software cells and exchange various data by, for example. Therefore, the information processing apparatus ID for identifying each is assigned to both remote controllers.

  In this system, after the user performs remote control of the device once by the remote controller 100, for example, when the user is present at a position where an infrared signal cannot be transmitted to the device due to movement of the position, Assume that the relay remote controller 100 'relays the infrared signal to control the device.

  FIG. 18 is a diagram illustrating an example of software cells transmitted from the remote controller 100 to the relay remote controller 100 ′ in the present embodiment. As shown in the figure, in this software cell, the transmission source ID is the information processing device ID of the remote control 100, and the transmission destination ID and the response destination ID are the information processing device ID of the relay remote control 100 ′. In addition, a remote command is transmitted as a DMA command, and as data, an infrared signal indicating the content of remote control for the device (for example, playback, pause, etc. for an audio player), the manufacturer name of the device to be remotely controlled, Send type name and type. Further, when the remote controller 100 has transmitted a software cell to the relay remote controller 100 'before the software cell, the global ID of the software cell at the previous transmission is used as the previous software cell ID in the cell interface. Send.

  Next, in the remote control system configured as described above, operations until a device is remotely controlled by the remote controller 100 and the relay remote controller 100 ′ will be described. FIG. 19 is a sequence diagram showing the flow of the operation. In this case, the remote controller 100 is the master device, and the relay remote controller 100 'is the slave device.

  As shown in the figure, first, the remote controller 100 has buttons set for remote control, such as the numeric buttons 204 and the Up / Down button 205 of the operation unit 105 in a state where the relay button is pressed by the user. When the button is pressed, an infrared signal having the control content is transmitted to the relay remote controller 100 'by the software cell (step 61). At this time, as described in the first embodiment, the user is present at a position where it is difficult to capture the image of the device. The device is determined and the operation unit 105 is operated.

  Next, when receiving the software cell (step 62), the relay remote controller 100 'analyzes the software cell and confirms that a remote command is included (step 63). When the remote command is confirmed, the manufacturer name, model name, and type data included in the remote command are extracted and compared with the own device information database 108 ′, so that the remote control target device can be selected. Specify (step 64). And the infrared signal which showed the control content contained in the said remote command with respect to the identified apparatus is transmitted via infrared output part 102 '(step 65). A series of processing of the relay remote controller is automatically performed.

  Then, when the device to be controlled receives an infrared signal (step 66), the remote control processing is completed by controlling itself according to the signal (step 67).

  Through the above operation, the remote controller 100 and the relay remote controller 100 ′ cooperate to function as a single virtual remote controller, so that the user can remotely control a desired device simply by operating the remote controller 100.

It is the block diagram which showed the structure of the remote control 100 in the 1st Embodiment of this invention. It is the figure which showed the external appearance of the remote control. 6 is a diagram showing data stored in a device information database 108. FIG. It is the figure which showed the detail of the setting information of each button. 6 is a diagram showing an example of a screen displayed on the liquid crystal display unit 104 when a device to be remotely controlled is specified. FIG. It is the flowchart which showed the flow of operation | movement until the remote control 100 remote-controls an apparatus. FIG. 6 is a diagram illustrating an example of a screen displayed on the liquid crystal display unit 104 when switching a remote control target device based on an image of a device that has already been captured. It is the figure which showed the mode in the case of making another remote control relay an infrared signal. It is a figure which shows an example of the network system used as the premise in the 2nd Embodiment of this invention. It is a figure with which it uses for description of the information processing controller with which an information processing apparatus is provided. It is a figure which shows an example of a software cell. It is a figure which shows the data area of a software cell when a DMA command is a status reply command. It is a figure which shows a mode that a some information processing apparatus operate | moves as one virtual information processing apparatus. It is a figure which shows an example of the software configuration of an information processing controller. It is a figure which shows a mode that four information processing apparatuses operate | move as one virtual information processing apparatus. It is a figure which shows the example of the distributed process in the system of FIG. It is a figure which shows the structure of the remote control system in the 2nd Embodiment of this invention. In 2nd Embodiment, it is the figure which showed the example of the software cell transmitted with respect to relay remote control 100 'from the remote control 100. FIG. In 2nd Embodiment, it is the sequence diagram which showed the flow of operation | movement until an apparatus is remotely controlled by remote control 100 and relay remote control 100 '.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 ... Remote control 100 '... Relay remote control 101 ... Camera part 102 ... Infrared output part 103 ... Infrared input part 104 ... Liquid crystal display part 105 ... Operation part 106 ... Operation part 107 ... Frame memory 108 ... Equipment information database 201 ... Image button 202 ... Relay button 203 ... Cross button 204 ... Numeric button

Claims (11)

An operation unit;
First storage means for storing device information related to a remote control target device;
Imaging means for imaging the device;
Extraction means for extracting character information from the image information of the imaged device;
First determining means for determining a device to be remotely controlled based on the extracted character information and device information stored by the storage means;
A remote control device comprising: a first transmission unit configured to transmit remote control information for remotely controlling the device to the determined device by an operation of the operation unit. The remote control device according to claim 1,
Second storage means for storing operation unit information indicating a relationship between the operation unit and the remote control information transmitted by operation of the operation unit in association with the device information;
Based on the stored operation unit information, further comprising setting means for setting the operation unit as an operation unit for remotely controlling the device determined by the first determination unit;
The first control means transmits the remote control information by operating the set operation unit. The remote control device according to claim 1,
The remote control device further comprising display means for displaying operation method information indicating an operation method of the operation unit corresponding to the device determined by the first determination means. The remote control device according to claim 3,
Third storage means for storing image information captured by the imaging means in association with the device information;
Means for extracting the stored image information,
The first control means determines a device for remote control based on the device information corresponding to the extracted image information. The remote control device according to claim 2,
The remote control device further comprising an updating unit for updating the device information and the operation unit information. The remote control device according to claim 1,
The device information includes a manufacturer name information, model name information, and type information of the device. The remote control device according to claim 4,
There are a plurality of the remote control devices,
The remote control device is
A remote control device further comprising a second transmission means for transmitting the remote control information to another remote control device in order to transfer the remote control information to the device. The remote control device according to claim 7,
Receiving means for receiving remote control information for remotely controlling the device transmitted from the other remote control device;
The remote control device further comprising transfer means for transferring the received remote control information to the device. The remote control device according to claim 8, comprising:
The remote control apparatus further comprising: a second determination unit that determines which of the first transmission unit and the second transmission unit transmits the remote control information. Storing device information related to the device to be remotely controlled;
Imaging the device;
Extracting character information from image information of the imaged device;
Determining a device to be remotely controlled based on the extracted character information and the stored device information;
A remote control method comprising: transmitting remote control information for remotely controlling the device to the determined device by operating an operation unit. Remote control device,
Storing device information related to the device to be remotely controlled;
Imaging the device;
Extracting character information from image information of the imaged device;
Determining a device to be remotely controlled based on the extracted character information and the stored device information;
A program that functions as a step of transmitting remote control information for remotely controlling the device to the determined device by operating an operation unit.

Images