JP2003061163A - System capable of utilizing the same user interface - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a user interface that can operate many kinds of electronic devices in a unified way and can easily be customized. SOLUTION: One embodiment of this invention provides the system comprising electronic devices, user terminals and an information processing apparatus. The electronic devices are in general household appliances such as television receivers, audio devices, and personal computers and the user terminals are mobile terminals such as mobile phones and personal digital assistants PDA. A home server and a network server are used for the information processing apparatus. In this system, by selecting a television receiver for the electronic device 1, an audio device for the electronic devices 2, a television receiver for a video output and an audio device for an audio output, the television receiver can reproduce a video signal of contents such as a movie and the audio device can reproduce the audio signal. The devices are controlled by using a local mobile phone or the like as the user terminal.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention generally relates to an input / output user interface between an electronic device and a human being, which is used for an electronic device including a home electric appliance such as a television, a radio, an audio device and a personal computer, and more particularly, , A user interface that can be used in a unified operation for a plurality of electronic devices coupled to the Internet or other communication networks.

[0002]

2. Description of the Related Art There are various home appliances. Televisions, radios, video devices, audio devices, game devices, mobile devices, etc. are home appliances. Although these products are often used in daily life, the user interface is different for each product, and it is often inconvenient to use.

For example, if there are several televisions of different models in the house, there is currently no controller that can operate those televisions in common. Each model has its own remote controller (hereinafter referred to as a remote controller), and if many products are to be used by remote control, many remote controllers will be flooded.

Further, since the operation method of each remote controller is peculiar to each model, the user has to learn a plurality of operation methods of a plurality of devices. Even if you remember it, you tend to forget it quickly. Furthermore, it is difficult to customize it for each user. It is convenient if there is a remote controller that can operate not only a television but also various electronic devices in common and can be easily customized.

At present, there is a remote controller which can control related products such as TV and video with a single controller, but the controllable function is limited to a specific combination of models and is not versatile. Other models cannot be controlled uniformly.

[0006]

SUMMARY OF THE INVENTION An object of the present invention is to provide a user interface capable of operating various electronic devices in a unified manner and easily customized.

[0007]

According to one embodiment of the present invention, there is provided a system including an electronic device, a user terminal, and an information processing device. Electronic devices are generally home electric appliances such as televisions, audios, and personal computers, and user terminals are mobile terminals such as mobile phones and PDAs (personal digital assistants). A home server or a network server is used as the information processing device. The electronic device and the user terminal are each provided with a unique identifier and can be individually identified. The information processing device includes an input / output device list, a registered device input / output function list, and a user interface creation program, and the user interface creation program includes a theme creation library. The electronic device, the user terminal, and the information processing device are mutually connected via a communication network such as the Internet or a communication line directly connected to a communication partner and capable of bidirectional or one-way communication. Connected.

[0008] First, the user of the system is
An electronic device such as a home electric appliance to be used for inputting / outputting information is determined, and an information processing device is requested to use the electronic device through a user terminal. The information processing apparatus registers the requested electronic device in the input / output device list, and
It is determined whether or not the information regarding the input / output function of this electronic device is registered in the registered device input / output function list. If not registered, the information processing device is sent from the user via the user terminal or the manufacturer's Web (web).
I / O function information is acquired from a site or the like via a communication network and registered in the registered device I / O function list.
The user can continue the registration request until all the electronic devices he / she wants to use have been registered.

When the registration is completed, the user interface creation program, based on the input / output function registered in the input / output device list and the registered device input / output function list, video input, video output, audio input, audio output, etc. A candidate list of available electronic devices is created for each input / output function of and displayed on the user terminal. The user selects a desired electronic device for each input / output function from the displayed candidate list, determines the combination of the electronic devices to be used, and returns the selection result to the user interface creation program of the information processing device. In the selection, the user interface creation program can allow the user to make a selection by presenting the user with a theme creation library that the user likes.

According to the system of the present invention, for example, a television is used as the electronic device 1 and an audio device is used as the electronic device 2, and the electronic device 1 (television) is used for video output and the electronic device 2 (audio device) is used for audio output. By selecting, the video signal of the content such as a movie sent via the communication network can be image-reproduced on the television, and the audio signal can be voice-reproduced on the audio device. These controls can be performed by using a mobile terminal such as a mobile phone at hand as a user terminal. Different electronic devices can be used for the electronic devices 1 and 2, and the same user interface can be used at that time.

According to this system, a mobile terminal such as a mobile phone can be used as a remote controller, and the remote controller can operate various electronic devices uniformly with the same user interface. The convenience of the user is improved.

Further, by dividing the use time, a plurality of users can share the same device such as a display device, and the mobile terminal user identifier, instead of the mobile terminal identifier, can be transmitted to the information processing device. Thus, it is possible for a plurality of users to divide the screen display and share one display device at the same time. At this time, each user can use the user interface according to his or her preference. When using the terminal identifier unique to the mobile terminal as the terminal user identifier, the user can set the mobile terminal to automatically transmit the terminal identifier to the information processing device when using the service of this system. It is possible to save the trouble of having to key in the terminal user identifier.

In this system, since it is possible to freely combine the input / output devices according to the environment in which the user is placed, for example, when the user is at home, the screen output of the mobile phone is reproduced on the television. , Voice output can be done with an audio device, voice input can be done with a mobile phone, etc.
Effective use of resources becomes possible.

Further, the programs installed in the user terminal are limited to those which are very simple and essentially necessary, such as control of input / output functions, and the application software part such as the user interface is installed in the network server or the like. This allows the user interface to be expanded later according to the user's preference. In addition, it is not necessary to collect user terminals for bugs and the like that occur due to the sophistication of applications. Even when changing terminals or when a software update occurs due to a bug correction or the addition of a new service, it is possible to deal with it by adding processing on the network side. Further, since the terminal having the minimum required basic functions can be used, the manufacturing cost of the terminal can be reduced.
In addition, the amount of software code required on the terminal side can be reduced, and the quality can be improved and the development period can be shortened.

[0015]

FIG. 1 is a diagram showing an embodiment of a system according to the present invention. This system is an electronic device 1
01, the electronic device 102, the user terminal 120, and the information processing device 130. The information processing device 130 includes an input / output device list 133, a registered device input / output function list 134,
A user interface creation program 135 is included, and the user interface creation program 135 includes a theme creation library 136. The electronic device 101, the electronic device 102, the user terminal 120, and the information processing device 130 are connected to each other via the communication network 10 or via a communication line directly connected to a communication partner.

The electronic devices 101, 102 are generally
Home appliances such as televisions, radios, video devices, audio devices, microwave ovens, refrigerators, personal computers, printers, displays, and car navigation systems that can input and output information to and from the outside.

The user terminal 120 is a mobile phone or PDA.
It is a mobile terminal such as a (personal digital assistant) that is usually carried by the user and is capable of personally identifying the user.

The electronic devices 101 and 102 and the user terminal 120 are each provided with a unique identifier so that they can be individually identified. Besides the IP address as the identifier,
It is also possible to use symbols, barcodes, and two-dimensional symbols.

The information processing device 130 is a server (network server) on the communication network 10, a home server, or the like, and realizes a unified interface between the electronic devices 101 and 102 and the user terminal 120. Execute the process. The information processing device 130 is a logical element, and can be physically incorporated as a part of the electronic devices 101 and 102 or the user terminal 120.

The input / output device list 133 is stored in the user terminal 1
20 is a list of electronic devices 101 and 102 and user terminals 120 registered via 20.

The registered device input / output function list 134 includes the electronic devices 101 registered via the user terminal 120.
102 is a list of input / output functions of the user terminal 120.

User interface creation program 1
Reference numeral 35 denotes an individual input / output processing program used by each user, which includes the electronic devices 101 and 102 and the user terminal 120.
Is executed by the information processing device 130 and returned as an output to the electronic devices 101 and 102 and the user terminal 120. The contents of the program are, for example, when the electronic device is a television, channel selection, etc.
In some cases, it may be the control program of 1, 102 itself,
It may be an application program (for example, a game program, a mail program, etc.) that is not intended to control the electronic devices 101 and 102 directly.

The theme creation library 136 is an interface creation library used by the user interface creation program 135 (for example, common routines for selection from a plurality of candidates, operation of a help agent, voice recognition, etc. are prepared as a library). Yes, multiple user interface creation programs 135
Common theme creation library 13 that suits users
With the configuration in which 6 is called, the user can use the plurality of user interface creation programs 135 with a uniform image.

The processing procedure according to the present invention will be described below with reference to FIGS. 2A and 2B. Here, it is assumed that the user selects a television as the electronic device 101 and an audio device as the electronic device 102 as electronic devices that are familiar to him / her and want to use for inputting / outputting information.

The user of this system first requests the information processing apparatus 130 to use the electronic apparatus 101 using the user terminal 120 (step 210). At this time, the user also transmits the identifiers of the user terminal 120 and the electronic device 101 or the manufacturer name and model name to the information processing device 130. The user may key-in the terminal user identifier instead of the identifier of the user terminal 120 to send. When the identifier is a barcode or the like, a reader such as a barcode reader, a digital camera, or an OCR can be used for inputting the identifier.

The information processing device 130 registers the electronic device 101 for which a use request has been made in the input / output device list 133 (step 232). This list is in a table format, and registration is performed by storing corresponding transmission data in each field such as the terminal identifier and electronic device identifier fields or the manufacturer name and model name fields. Next, the information processing device 130 is registered in the device input / output function list 134 of the electronic device 101 for which the use request is made.
Is registered in (step 23
4). If registered, the process proceeds to step 240. If not registered, the user is prompted to register the electronic device 101 through the screen display on the user terminal 120 (step 236).

The user obtains the necessary input / output function information from the manual of the electronic device 101 or the like, and the user terminal 12
The necessary information is input using the 0 key input device and sent to the information processing device 130 (step 214). The information processing device 130 registers the contents in the registered device input / output function list 134 (step 238). The registered device input / output function list 134 includes a list of input / output function information regarding the electronic device 101.

FIG. 3 shows an example of a screen display when keying in such input / output function information. Items of the input function and the output function of the electronic device 101 are input to the input function unit and the output function unit, respectively. The underlined parts are items keyed in by the user.In this example, video input, audio input, and remote control input can be used as input functions, and video output and audio output can be used as output functions. Indicates that it is available. The output destination part relates to the highlighted item among the items input to the output function part, and in FIG. 1, the video signal of the frequency f1 sent via the communication network 10 is sent to the electronic device. It is shown that image reproduction can be performed by using the video output of 101.

In the figure, each data in the identifier, maker name, and model name is automatically inserted by the information processing device 130 based on the data stored in the input / output device list 133. The registered device input / output function list 134 is in a table format, and the data of each item shown in FIG. 3 is stored in the corresponding item field in the table. The input / output function information of the electronic device 101 is infrared or Blue.
It is also possible to directly obtain from the electronic device 101 by the user terminal 120 using short-range wireless communication such as tooth (Bluetooth).

The information processing device 130 is connected to the maker's Web site via the communication network 10 such as the Internet.
It is also possible to obtain the input / output function information of the electronic device 101 from the (web) site or the electronic device 101 itself and register them in the registered device input / output function list 134.

The information processing apparatus 130 requests the user terminal 120 for the user interface creation program 135.
And the identifier of the electronic device 101 (step 240). Next, the information processing device 130 inquires of the user via the user terminal 120 whether or not there is a request for further use of the electronic device (step 242).

Here, the user relates to the electronic device 102,
Similarly to the above, a usage request is made to the information processing device 130 (steps 218 and 210). In this case, since the identifier of the user terminal 120 has been sent to the information processing device 130 before, there is no need to send it again. If the input / output function information regarding the electronic device 102 is not registered in the registered device input / output function list 134, the input / output function information is registered in the registered device input / output function list 134.

The user notifies the information processing device 130 via the user terminal 120 or directly that the selection of the combination of electronic devices to be used is completed (step 220).

User interface creation program 1
35 is based on the input / output function registered in the input / output device list 133 registered in step 232 and the registered device input / output function list 134 registered in step 238.
For each input / output function available in the user interface creation program 135, for example, for each input / output function such as voice input, voice output, video input, video output, text input / output, acceleration sensor input, position coordinate input, and printing. Then, a candidate list of available electronic devices is created and returned to the user terminal 120 (step 244).

If there are multiple selection candidates among the candidates returned in step 244, the user selects which electronic device to use and selects the user interface creation program 135 of the information processing device 130. The result is returned (step 222). For example, the electronic device 101 can be designated as video output and the electronic device 102 can be designated as audio output. Thus, if a high-quality audio device is used as the electronic device 102, the image displayed on the electronic device 101 can be heard with high-quality sound.

The user terminal 120 can store the combination of candidates selected in step 222 as needed. This can be done by giving a desired name to the table of the input / output device list 133. By performing this operation, the above steps can be omitted from the second time. Available electronic device combinations include, for example, in-home combinations and company combinations. By assigning a favorite name to each combination, you can use it in the environment where users are currently. The possible combinations of electronic devices can be easily selected.

User interface creation program 1
In step 222, when the user selects the desired electronic device from the candidate list in step 222, the theme creation library 136 is used to provide the user with a favorite theme, thereby prompting the user to make a selection. it can. The theme creation library 136 has contents selected based on the user identifier. The user selects his / her favorite theme as the information processing device 1
30 can be registered in advance. By using the theme creation library 136, the user can make selections and settings with his or her favorite settings and selection screen configuration.

Note that the user terminal 120 itself can be treated as an electronic device, and once the registration is completed, the interface of the user terminal 120 itself can be expanded by the user interface creation program 135. .

An application example of the system according to the present invention will be shown below. In any of the application examples described below, a mobile terminal such as a mobile phone or PDA can be used as a remote controller.

(Application 1) A TV channel is selected in advance by using the screen and buttons of the mobile phone, and the TV channel is changed after the selection is completed.
-You can watch the contents such as movies sent through the communication network on TV. Alternatively, the content viewed on the mobile phone can be changed so that it can be viewed on the television.

(Application 2) A cooking program is selected by using the screen and buttons of a mobile phone, and a cooking program for a microwave oven is controlled. A cooking program for adding or removing heat when cooking or warming rice. Can also be downloaded from a predetermined site via a communication network.

(Application 3) By using the screen and buttons of the mobile phone, the program viewed on the television at home can be continuously watched on the mobile phone when going out. Play the audio output downloaded by the mobile phone with high-performance audio.

[0043]

As described above, by using the present invention, various electronic devices can be operated in a unified manner. In addition, it is possible to provide a user interface that can be easily customized, improving user convenience, and enabling multiple users to share the same device,
Resources can be effectively used, for example, electronic devices having excellent functions can be used in combination.

[Brief description of drawings]

FIG. 1 is a diagram showing an embodiment of the present invention.

FIG. 2A is a diagram showing the processing steps according to the present invention.

FIG. 2B is a diagram showing the processing steps according to the present invention.

FIG. 3 is a diagram showing an example of a screen display that can be used to register in a registered device input / output function list.

[Explanation of symbols]

10: Communication network 101: Electronic device 102: Electronic device 120: User terminal 130: Information processing device 133: Input / output device list 134: List of registered device input / output functions 135: User interface creation program 136: Theme Creation Library

   ─────────────────────────────────────────────────── ─── Continued front page    F term (reference) 5C056 AA01 AA07 BA01 BA08 BA10                       CA06 CA08 CA19 CA20 DA06                       DA08 DA11                 5E501 AA02 AA19 BA05 CA03 CB02                       CC02 DA14 EA10 EA11 FA03                       FA04 FA14                 5K048 AA04 AA14 BA01 DA07 DC01                       EB06 EB14 EB15 FB10 FC01                       GC06 HA01

Claims (6)

[Claims] 1. A system capable of using the same user interface, comprising: an electronic device, a user terminal, and an information processing device connected to the electronic device and the user terminal via a communication line. The information processing device includes an input / output device list in which the electronic devices that can be used for input / output of information are registered, and a registered device input / output in which input / output functions for each electronic device in the input / output device list are registered. A user interface creation program for creating a candidate list of the electronic devices that can be used for each function based on a function list, the input / output device list, and the registered device input / output function list, and displaying the candidate list on the user terminal. And a system comprising. 2. A candidate list displayed on the user terminal,
2. The system according to claim 1, further comprising a theme creation library used by the user interface creation program to display based on a theme designated by a terminal user in advance. 3. The system according to claim 1, wherein the user terminal is a mobile terminal. 4. An electronic device, a user terminal, and an information processing device coupled to the electronic device and the user terminal via a communication line, the information processing device further comprising an input device. In a system including an output device list, a registered device input / output function list, and a user interface creation program, a usage request for the electronic device used for inputting / outputting information is requested by the user terminal from the information processing device. And a step of, in response to the usage request, determining whether or not the information processing device has data regarding the input / output function of the electronic device in the registered device input / output function list, Acquiring the input / output function data by the information processing device when the data does not exist, the input / output device list and the registered device input / output function Creating a candidate list of the electronic device that can be used for each input / output function based on the list by the user interface creating program; and displaying the created candidate list on the user terminal. How to be prepared. 5. The method further comprises the step of using a theme creation library by the user interface creation program to display a candidate list to be displayed on the user terminal based on a theme previously specified by the terminal user. The method according to claim 4. 6. The method according to claim 4, wherein the user terminal is a mobile terminal.