JPH07239929A - Interactive operation device - Google Patents

Abstract

(57) [Abstract] [Purpose] An operating device for operating electronic equipment composed of multiple sub-devices using screens and input means, presenting information paths to users in an easy-to-understand manner, and intuitive operation. Is possible. [Structure] An interconnection means 107 for managing the possibility and state of connection between sub-devices and a device information management means 108 for managing the state of a device are provided, and an icon is displayed by a graphic display means 105 on the basis of information provided from these. By creating a pictograph and deciding its placement, the connection status between subdevices is presented to the user, and this can be operated directly on the screen.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an operating device for operating an electronic apparatus composed of a plurality of sub-devices, and more particularly, by using a screen and an input means associated with the screen, the configuration of the sub-devices and the sub-devices It provides an operating device that presents the flow of information to users so that they can easily understand it and can operate it intuitively.

[0002]

2. Description of the Related Art As the functions of home electronic devices centering on AV devices have advanced, and as information devices enter the home, the problem that the functions cannot be used due to the poor usability has become apparent. It's starting. Several problems have been pointed out as the cause of this. For example, since buttons are the main operations, buttons are needed for each function, and the number of buttons becomes enormous. For the purpose of solving such a problem, a method of operating in a menu format has been proposed, and is disclosed in, for example, Japanese Patent Laid-Open No. 5-103376.
In this type of technology, operations are performed by tracing virtual buttons or hierarchical menus that display characters that display functions.

On the other hand, in the field of computers, research on a graphic user interface (GUI) based on a window system is progressing. In this field, a direct operation interface typified by selecting and moving an icon with a pointing device such as a mouse is already common.

[0004]

As an operation interface for household electronic equipment, a switch corresponding to the function of the equipment is mainly arranged on an operation panel or a remote controller. These are designs that started from the function of the equipment, and the operator is required to compare the purpose of operation with the function of the machine and disassemble it into individual operations. Therefore, various efforts have been made to improve usability, but the mental burden on the operator has not been sufficiently reduced.

Although a direct operation interface such as a desktop metaphor in a computer is effective for file operation on the computer, there are some points that are insufficient in the operation of home appliances. In other words, since it is necessary to execute various tasks including complex operations among several components, the icon not only realizes one function, but also expresses the relationship between the operation targets. Will be needed. In addition, the demands for ease of use for household appliances are more stringent than those for office and technical computers.

Further, in the case where the basic operation is based on the selection of the menu, the hierarchy of the menu becomes deeper as the number of selectable objects increases, and if these are sequentially followed, many operations will be performed until the purpose is reached. It takes time.

[0007]

In order to solve the above problems, in the operating device of the first invention of the present application, the setting items of the subdevice and the connection state between the subdevices are set in the form of virtual operating means. In the figure, a graphic display means for graphically displaying on the screen, a function simulating means for associating a change in the graphic display with a change in the internal state of the device, a graphic such as an icon and a pictograph displayed on the screen, and An operation input unit capable of directly operating a character is provided, and a virtual operation unit on the user screen is operated to perform an actual operation target operation.

In the operating device according to the second aspect of the invention, further, a connection information managing means for managing the connection possibility between the sub-devices and judging whether the information flow is possible or not is provided, and each sub-device is handled by an icon. It is configured to visually display the types of possible information and the possibility of mutual connection, and to change the flow of information between subdevices according to the arrangement and connection between icons.

In the operating device of the third invention, pictograph generating means for displaying the connection information provided by the connection information managing means is provided, the icon displays information about each sub-device, and the pictograph displays the sub information. It is configured to visually display connection information between devices and change the flow of information between subdevices according to the arrangement and connection of icons and pictographs.

[0010]

According to the first aspect of the present invention, since the configuration and connection state of the virtual device are presented on the display screen, it can be presented in a form that is easy for the user to understand even if the configuration is different from the actual one. It is possible to display on the screen a configuration that is easy to understand intuitively even if it differs from the actual configuration of the device. Also, by arranging virtual operating means simulating actual switches, volumes, valves, etc. on the screen, what can be operated among the displayed ones and what kind of change will occur Can be easily guessed. That is, it becomes easy to associate the operation with the operation of the device. Since the user's operation is immediately fed back on the screen, it is easy to understand the operation he is doing. In addition, grouping the functions according to the configuration also has the advantage that the functions can be understood and searched easily.

According to the second aspect of the invention, since the shape of the icon expresses the possibility of connecting the device by the function of the icon generating means, the possibility of connecting the sub-devices and the current state are displayed for easy understanding. It can be presented on the screen. Further, by directly connecting the operation of the icon on the screen and the connection state of the device, it becomes easy to connect the user operation and the operation state of the device.

According to the third aspect of the invention, the icon generating means generates the icon representing the sub-device, and the pictograph generating means displays the state of the connection between the sub-devices. In this case, the displayed content becomes clear and the signal path can be changed by a more intuitive operation.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A first embodiment of the present invention will be described below with reference to the drawings. The feature of this embodiment is that the setting items and operating states of each sub-device in the equipment and system consisting of a plurality of sub-devices, and the flow of information between sub-devices are presented on the display means, and this is directly input through the input means. It is about to be operated. Here, the sub device is a component part of a device or system having a certain functional unity. FIG. 1 is a diagram showing the configuration of this embodiment.

FIG. 1 is a diagram showing the configuration of this embodiment. The display means 101 and the input means 102 are in charge of direct interaction with the user. Although the display means is a general graphic display in this embodiment,
The display on the operation panel and the operating state of the device can be included in this. The input means is preferably a combination of a pointing device such as a mouse or a trackball and a button, but a combination of keys or the like can be used as long as the same input can be performed. Dialogue management means 1
Reference numeral 03 has a function of giving an input request to the user via the display means 101 and the input means 102, and reflecting the input from the user on the operation target. The dialogue management means 103 cooperates with a function simulation means and a graphic display means, which will be described later, to perform a display prompting an operation that is possible based on the configuration of the device and the state at that time, and passes a given input to the state management means. The function simulating means 104 is an operation target 106 that is an actual control target.
It has the ability to monitor the operating state of and simulate it. That is, the function simulating means 104 has the ability to predict what kind of operation will occur when a specific input is given to the operation target 106. Such a function simulating means 104 can be realized in the form of a logic circuit or a program of a microcomputer. The graphic display means 105 functions to generate a display screen to be given to the display means 101 based on the function of the operation target 106 given by the function simulating means 104.
This display screen not only visually displays internal states such as the setting items and operating states of the equipment, but also makes the display a form of virtual operating means such as switches and dials that can be operated directly, It can be directly operated by using it.

FIG. 2 shows an example of a display screen in which the present invention is applied to the operating means of a device in which a television and a video are integrated. Two tuners and VCRs which are subdevices depending on the displaying means. , A monitor is displayed and the connection path between them is illustrated. In this state, one tuner is recording a TV program while another tuner is listening to another program. Buttons for setting channels are displayed in the part showing the tuner.
On the monitor screen, there are functions for volume adjustment and voice switching. The switch on the left side of the monitor screen selects which signal path to monitor the signal from.

When the video display portion is selected on the screen shown in FIG. 2, the video-related portion of the overall configuration is enlarged as shown in FIG. 3, and the video-related operations and settings appear. Detailed setting items of each subdevice that cannot be included in the entire setting screen shown in FIG. 2 are thus grouped and displayed for each subdevice. Since the positional relationship of the entire device configuration is maintained, it is easy to grasp the position of the enlarged display part in the whole. Not only the video but also other parts can be set in detail similarly by selection.

The advantages obtained by configuring the display and the input in this way are as follows. First, since the virtual device configuration and connection state are presented on the display screen, it is possible to present in a form that is easy for the user to understand, even if the configuration is different from the actual one. If the actual device configuration is intuitive and easy to understand, the configuration can be displayed as it is on the screen. Another advantage is that not only the display but also the operation is performed through the same screen. By arranging virtual operating means simulating an actual switch, volume, valve, etc. on the screen, what is displayed can be operated and what kind of change will occur Easy to guess. That is, it becomes easy to associate the operation with the operation of the device. Since the user's operation is immediately fed back on the screen, it is easy to understand the operation he is doing. In addition, grouping the functions according to the configuration also has the advantage that the functions can be understood and searched easily.

FIG. 4 shows a flow chart of the operation of this embodiment. After confirming the system configuration in the initial setting of 401, the graphic display means creates or selects a diagram showing the overall configuration according to this configuration. The loop after 403 repeats display and input. The system status is confirmed at 403 and 404, and this is reflected on the screen. This is the function of the dialogue management means 103. When the input is accepted, in steps 406 and thereafter, it is determined whether the information flow is switched, the VTR is operated, or the setting item is changed, and necessary processing is performed correspondingly. At 406, it is determined whether the input provided by the user is a signal route change request, and if so, then at 407 a route change is performed. 408 if the input was not a route change request
It is determined whether or not the input is for the operation of the VTR portion, and if so, a predetermined operation for the VTR is performed at 409. Further, in 410, it is judged whether or not the change of the entire setting is requested, and if so, the change of the requested setting is performed in 411.

Next, a second embodiment of the present invention will be described. The basic configuration of this embodiment is as shown in FIG. Of the components shown in the figure, the display means 101,
Input means 102, dialogue management means 103, graphic display means 1
The description of 05 is omitted because it is common to the first embodiment. The present embodiment has an interconnection means 107 for connecting each of the target devices 106 constituting the sub-device of this embodiment and controlling the flow of signals. This has the function of transmitting information by interconnection between the target devices. The device information management unit 108 has a function of referring to and operating the function and operation state of each target device. The connection information management means 109 is an interconnection means 107.
The signal flow between each of the target devices is managed by referring to and operating the status of. Further, the above-mentioned schematic display means 105 is composed of two blocks, an icon generating means 110 and an icon arranging means 111. The icon generation means 110 generates an icon according to both the device information given by the device information management means 108 and the connection information given by the connection information management means 109. The icon is a picture or a character that can be displayed on the display means, and makes it easy to intuitively understand the existence or function of something by the content of the display. Each icon represents each sub-device, and has the feature of presenting the possibility of connection and the connection status to the user in an easy-to-understand manner by the shape and movement of each sub-device. That is, the components of the composite device or system are shown in the form of icons, and the possibility of information flow is shown in the form of the icons. In system components and video-integrated televisions, there is a flow of information between multiple devices, and switching between them has a functional meaning. Subdevices such as tuners and decks are represented by icons, and the shape of each device can indicate the type of signal that can be input / output by each device and the type of input / output. This shape and arrangement are not only automatically updated according to the configuration and state of the system, but also the user can change the connection route by moving the icon via the input means. FIG. 6 is an example of an operation screen of the AV system according to this embodiment. The top two icons in the figure represent the TV tuner, and the third icon represents the video recorder. The shape of the icon indicates that the TV tuner can only output an image and the video recorder can both input and output. The icon in the fourth row indicates the monitor and accepts only input. Below, the timer and the video disc player are lined up. The device is operated by operating and moving such an icon via the input means. As can be seen in this figure, the shape of the icon clearly indicates whether the subdevice can be input. For example, the TV tuner in the upper part of the figure can output only and has no input, so only the protrusion on the right side of the icon is projected. Similarly, the VTR can input and output, and
The V monitor indicates that only input is accepted. In this embodiment, the possibility of input / output is expressed by the shape of the outer shape of the icon, but other than this, a method using a moving image icon or the like is also possible.

An example of the operation on such a screen is shown in FIG. In this example, an operation is performed according to the purpose of watching TV while making a video recording reservation. The upper part shows one purpose of watching TV by connecting the output of the tuner icon to the input of the monitor. In the second stage, video recording reservation is specified by connecting another tuner to the VCR via a timer. That is, by arranging the input end of one icon in contact with the output end of another icon, the flow of information between two subdevices is represented. The timer time setting and the tuner channel setting can be performed by selecting each icon, as in the first embodiment.

FIG. 8 shows a flowchart of the main part of the operation of this embodiment. After confirming the system configuration as an initial setting in 801, the diagram display means creates or selects a diagram showing the overall configuration in 802 accordingly. In the subsequent loop, first, at 803, the operating state of the entire system is confirmed, and at 804, the result is displayed on the display screen by an icon. When the input is accepted, a predetermined operation is performed according to the user's request in steps 806 and thereafter.
At 806, it is determined whether or not the input is an appropriate icon movement request, and if it is an icon movement request, the icon is moved on the display screen at 807, and the corresponding signal path is changed at 808. Further, in 809, it is determined whether the request is to change the setting item of each sub device,
If it is a valid input, the requested setting change is made at 810.

Next, a third embodiment of the present invention will be described. The basic configuration of this embodiment is as shown in FIG. Of the constituent elements shown in the figure, description of constituent elements common to the first and second embodiments is omitted. The feature of this embodiment lies in the more detailed structure of the graphic display means 105. The graphic display means 105 includes an icon generation means 110, a pictograph generation means 112, and an arrangement means 1.
It consists of 11. The icon generation means 110 generates an icon according to the device information provided by the device information management means 108. Unlike the icon in the second embodiment, the icon in this embodiment does not display the possibility of connection and the connection status, but indicates the function / setting item and status of the subdevice represented by each icon. Is. The pictograph generating means 112 generates a pictograph displaying the connection state between the respective sub-devices according to both the device information given by the device information managing means 108 and the connection information given by the connection information managing means 109. Here, the pictograph is a picture or character that can be displayed on the display means like the icon, but unlike the icon, it does not represent a specific entity, but shows the state of the system by the displayed content. The name of the pictograph is used to distinguish this point. The arrangement unit 111 determines the arrangement of icons and pictographs on the screen according to both the device information given by the device information management unit 108 and the connection information given by the connection information management unit 109. That is, in the present embodiment, the components of the composite device or system are shown in the form of icons, the flow of information is shown in the form of pictographs, and the connection state is determined by the combination and arrangement of these icons and pictographs. Present.
This combination and arrangement is not only automatically updated according to the configuration and state of the system, but it is also possible for the user to change the connection route by directly operating the icon and pictograph.

FIG. 10 shows an example of the operation screen of this embodiment. In the lower part of the screen, among the selectable subdevices, the icons of those that are not currently operating are displayed. An icon 1001 representing a radio and an icon 1002 representing a laser disc player correspond to this. The state of the currently operating subdevice is displayed in the upper row. Explaining the group on the left side of the figure, an icon 1003 representing television broadcasting is linked to an icon 1005 representing video via a pictograph 1004 showing the flow of video and audio. The right group in the figure shows that dubbing from CD to cassette tape is being performed. For this group, there is only audio information and no image information flow, but it is displayed as a pictograph. Also,
The pictographs placed on the right side of both groups show that the TV image is displayed on the screen and the CD sound is being heard. That is,
The representation of the flow of information in this embodiment is performed by arranging two icons with one pictograph sandwiched therebetween. A pictograph inside represents the type of information flowing between the two subdevices.

In this way, by indicating the operating state of the system by arranging icons and pictographs on the screen,
It is possible to display without confusion even when there are multiple information flows. Even when multiple media such as images, voices, and text data are mixed, this method can present a screen that is easy to understand by preparing a pictograph representing each media.

Also, in operation, since the system state is displayed by a pictograph representing the flow of information itself, it is possible to introduce a method for changing the system state by moving the pictograph itself. It is possible and more intuitive operation is realized.

The configuration of the present invention showing the flow of information by a pictograph different from the icon representing the sub-device is the configuration of the second invention of the present application showing the possibility of information flow by the shape of the icon. It is possible to obtain a higher effect by using both of them at the same time.

[0027]

As described above, according to the present invention, since an operation instruction is given by moving or combining icons, the number of combinations is smaller than that of a combination of switch operations and a hierarchy of menus when performing complex operations. It can be executed by the number of operations and it is easy to intuitively understand the operating status of the device. By presenting to the user a configuration that is different from the actual configuration and is logically easy to understand, it is possible to provide an operating device that can be easily understood.

Further, by using the shape, positional relationship and connection status of the icons for displaying / manipulating the connection status of the sub-device, it is possible to express on the screen a complex function that cannot be expressed by the icon alone, and the user can understand. Can help Compared with the conventional method of setting the signal path by switching the switch, when the system is in a complicated state such as when multiple paths are set separately, a more intuitive display should be provided. Can be done.

Further, by using the method of indicating the information flow by the pictograph, it is possible to introduce an operation method for directly manipulating the information flow, and at the same time, it is easy to deal with the increase in the types of media. The characteristic that is obtained.

[Brief description of drawings]

FIG. 1 is a schematic configuration diagram of a first embodiment of the present invention.

FIG. 2 is an initial screen according to the first embodiment of this invention.

FIG. 3 is a detailed setting screen according to the first embodiment of this invention.

FIG. 4 is a flow chart showing main operations of the first embodiment of the present invention.

FIG. 5 is a schematic configuration diagram of a second embodiment of the present invention.

FIG. 6 is an initial operation screen according to the second embodiment of the present invention.

FIG. 7 is another operation screen according to the second embodiment of the present invention.

FIG. 8 is a flow chart showing the main operation of the second embodiment of the present invention.

FIG. 9 is a schematic configuration diagram of a third embodiment of the present invention.

FIG. 10 is an operation screen according to the third embodiment of the present invention.

[Explanation of symbols]

 101 Display Means 102 Input Means 103 Dialog Management Means 105 Graphical Display Means 106 Target Equipment 107 Interconnection Means 108 Equipment Information Management Means 109 Connection Information Management Means 110 Icon Generation Means 111 Icon Arrangement Means

 ─────────────────────────────────────────────────── ─── Continuation of the front page (72) Inventor Atsushi Tanaka 1006 Kadoma, Kadoma City, Osaka Prefecture Matsushita Electric Industrial Co., Ltd.

Claims (3)

[Claims] 1. An operating device for an electronic apparatus comprising a plurality of sub-devices, comprising: display means for presenting a screen for providing operation information to a user; input means for receiving an operation input from the user; and these displays. A dialogue management means for controlling the flow of the dialogue between the user and the electronic device via the means and the input means is provided, and the setting items of the subdevices and the connection state between the subdevices are schematically shown in the form of virtual operation means. The graphic display means for displaying on the screen, the function simulating means for associating the change in the graphic display with the change in the internal state of the device, and the figures and characters such as icons and pictographs displayed on the screen directly. An operation device comprising an operable operation input means, and operating an actual operation target by operating a virtual operation means on a user screen. 2. An operation of an electronic device having a display means configured of a plurality of sub-devices for presenting a screen and an input means capable of directly operating graphics and characters such as icons and pictographs displayed on the screen. A device, which is a graphic display means for displaying each subdevice as an icon on the display means, and a connection information management means for managing the possibility of connection between the subdevices and determining whether or not information flow is possible. The display means is provided with an input means for performing an operation for connecting between the icons according to the connection information, and the icons visually indicate the types of information that can be handled by each subdevice and the possibility of mutual connection. An operating device characterized by displaying and changing the flow of information between subdevices according to the arrangement and connection between icons. 3. A display means for presenting a screen, comprising a plurality of subdevices and an interconnecting means for interconnecting the subdevices, and a graphic and a character such as an icon and a pictograph displayed on the screen. An operation device of an electronic device having an input device that can be directly operated, and a device information management device that manages the functions and states of each sub device, and a connection possibility between sub devices that manages the information flow. Connection information management means for determining whether or not it is possible, icon generation means for displaying information about each sub-device given by the device information management means, and pictograph for displaying connection information given by the connection information management means Generating means and arranging means for arranging the icon and pictograph on the screen according to the device information and the connection information. The icon displays information about each sub-device, the pictograph visually displays connection information between the sub-devices, and the pictograph displays the connection information between the sub-devices corresponding to the arrangement and connection of the icon and the pictograph. An operating device for changing the flow of information.