JP2001092575A - System and method for visually controlling connection of equipment - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a system which enables a user to easily recognize the connection state, current state, etc., of connected equipment from a more user- friendly display on a screen through a GUI of a personal computer(PC), is easily operated at high operability and enables the user to recognize the current state and a processing/progress state by displaying an operation state in accordance with an applied instruction and enables the user to easily assemble a succeeding operation schedule. SOLUTION: In the system for visually controlling the connection of equipment which system has a function for displaying icons corresponding to plural pieces of equipment connected to the PC on a monitor and enabling the user to easily and visually control these icons, the PC connecting plural pieces of equipment is provided with a changing means capable of dynamically changing the display format of the icons so that the user can understand the state of the equipment by these icons.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to a graphic user interface (GUI: Gr) for a computer.
The present invention relates to a visual connection device control method and a control method for controlling a display device or the like by operating via pictograms by an aphical user interface.

[0002]

2. Description of the Related Art Conventionally, in operation of a computer, a user interface that displays pictures and icons (pictograms) on a display screen so that the user can intuitively operate the computer is called a GUI.
In the case of personal computer OSs such as Mac OS and OS / 2, the use of a GUI has become commonplace. In the GUI environment, mouse operation is basically performed, and most operations other than character input can be performed by moving a mouse cursor on the screen with a mouse and pressing a mouse button. For example, when copying a file, the user can specify the icon of the file on the screen with the mouse and move to the copy destination. Also, move the mouse cursor to the menu bar at the top of the window and press the mouse button to open a pull-down menu and call various functions.

However, the conventional computer GU
In the connection method using the icon display using I, not all devices connected to a personal computer (hereinafter, referred to as a PC) are displayed. Just by making connections to the device or looking at the icons, it was not possible to reduce mistakes, setting mistakes, and malfunctions when using the device.

The icons are abstract, so that the user can visually understand what devices are connected,
There is no function that changes the state of the icon in conjunction with the state of the device on the GUI, and the state of the device cannot be understood only by looking at the icon. In addition, since data transfer between one device and one device is considered, data transfer between one device and one device with a plurality of devices connected cannot be performed by connecting icons.

For example, in Japanese Patent Application Laid-Open No. Hei 10-143347, a pair of connector-shaped or concave-convex sub-icons are additionally displayed on icons representing the source and destination of data transfer, respectively, and are controlled by a pointing device such as a mouse. It describes that the data transfer is performed by instructing the connection between the transmission source and the transmission destination by the instruction icon on the screen. However, a plurality of connected devices can be connected to another device, or the state of the icon can be changed using the guide function, and the user can visually understand the connectable devices and set a suitable connection. Such a function is not described.

[0006] Japanese Patent Application Laid-Open No. Hei 3-253961 discloses that in a network system including a computer and an electronic device operable by an operation panel, each of the devices is opened by a device operation icon, It is described that the apparatus includes a device operation input unit that is a window having an operation input function corresponding to the operation input function, and a communication unit that communicates device operation input information input through the window to the device. ing.
However, the document does not describe dynamically changing the shape of an icon in device information or device connection externally connected to a plurality of icons displayed on the GUI.

Japanese Patent Application Laid-Open No. Hei 10-224875 discloses that first to I-th icons corresponding to a plurality of operation function units are graphically displayed on a screen, and data is obtained by an icon operation using a specific pointing device. This document describes a function control method for starting, suspending, resuming, and terminating the processing operation. However, the icons are fixed icons, and information on receiving information via the interface and changing the shape of the icons according to changes in the state of the device, and connecting icons and controlling externally connected devices by connecting the icons are described. It has not been.

Japanese Patent Application Laid-Open No. 10-320344 discloses a layout image showing the layout of input / output devices on a display means in a network connecting a computer and input / output devices, and an icon for displaying the input / output devices. Is displayed at a position corresponding to an actual arrangement position of the input / output device on the layout image, and the input / output device corresponding to the icon is specified as an input / output destination by specifying the icon. ing. However, the icon is a fixed icon, and is displayed in characters when the state of the device changes, and the shape of the icon is not dynamically changed.

Japanese Patent Application Laid-Open No. H11-032154 discloses a technique of searching and reading recognition data of an external input / output device, displaying display data of the external input / output device, and inputting control data of the external input / output device. And performs processing of image data input / output to / from an external input / output device based on the input control data, thereby visually recognizing and grasping the external input / output device. A digital image forming apparatus that performs operations easily and quickly is described. However, when an external input / output device that is not stored in the PC is connected, it cannot be handled as an icon, and there is no description that the icon itself is dynamically changed.

[0010]

The above publications include GU
Various user-friendly images are displayed using the icon of I as an index, but icon information can be transferred from the connected device to display an icon that allows the device to be properly imaged, and device status changes. Since there is no function to change the device in real time and specify it, the user cannot visually identify the device or the state of the device.

In addition, since there is no function of displaying all the connected devices by icons, there is no function of simulating the actual connection of the devices on the GUI, and the devices to be additionally connected can be displayed by the GUI.
It was not possible to perform the joining control on I.

Here, for example, FIG. 5 shows a conceptual diagram of icons and the like displayed on a conventional screen, which will be described. In FIG. 5, text data 51 and video file data 52 are stored in storage means (not shown) on a display surface 50 of a display, and a video playback device 53 and a printer 54 are displayed as external devices connected to a PC. Have been.

Here, when the video file data 52 is sent to the external device 53, the external device 53 starts image reproduction. However, the icon of the external device 53 does not change even if the image is being reproduced, and it is not clear whether the image is actually being reproduced. In particular, when the external device 53 is located far away by remote control, it is not possible to confirm that the device is operating unless the user goes to that place. For example, when other similar devices are connected, it is not known which device is operating and playing on the display screen.

Further, when the external device 53 is in the suspend state,
Even when the image cannot be displayed, the icon does not change. Therefore, when the user cannot drag and play the video file data 52 but cannot play it, it is difficult to understand why the playback is not possible. In addition, instructions such as connection and operation start using a mouse on the display screen are only for transfer between devices and files, but not for connection and data transfer between devices.

Recently, HAVi (Home Audio / Video i)
There are basic specifications for IEEE 1394 compatible AV devices that are compatible with home networks called “interoperability”. Among them, detailed icons that can be used to see which device is shown by looking at the icons, The display form is changed in real time in accordance with the change in the state of the device, and there is no function that allows the user to visually understand the state by looking at the change or to retain the corresponding data format and function of the device in the table.

Accordingly, the present invention provides a more user-friendly, easy-to-use, easy-to-use GUI for a PC, which can easily recognize the connection status and current status of the connected device from the display on the screen. To provide a visual connection device control method and control method that can display the operation status according to the instruction, recognize the current status, processing / progress status, and easily assemble the next operation schedule. As an issue.

[0017]

According to the present invention, an icon corresponding to a plurality of devices is displayed on a monitor by a personal computer (PC) to which a plurality of devices are connected, so that the user can easily and visually recognize the icons. In a visual connection device control method having a function that can be controlled in a personal computer (PC) to which the plurality of devices are connected, a display form of the icons is provided so that a user can understand the state of the devices by the icons. Is dynamically provided.

The present invention also relates to a method for controlling a visually connected device, wherein a personal computer (PC) to which a plurality of devices A, B and C are connected is controlled by an icon for displaying the plurality of devices on a monitor. When acquiring the acquired data of the device A, transferring the data to the device B, and recording the transferred data in the device C,
The connection of the personal computer (PC) is indicated by an icon representing the devices A, B, and C on the monitor by a plug-and-play function, and a start instruction for operating the device A is displayed on the monitor. Click on the icon, drag the icon of the device A and the icon of the device B, and change the icon of the device A and the icon of the device B to an operation icon for transferring the acquired data of the device A. Is displayed, and the icon of the device B and the icon of the device C are dragged to transfer the transfer data of the device B.
And the icon of the device C are displayed as changing icons, and when the acquired data of the device A can be transferred to the device C, the icons of the devices A, B, and C are changed to an operation end icon. It is characterized by changing to display.

In the visual connection device control system according to the present invention, all devices connected to a personal computer (hereinafter, referred to as a PC) are displayed as icons, and function information possessed by the devices is obtained from the devices. It has a function of creating a function table and enabling control using the information.

By using this function, the user can visually connect and disconnect the device to transfer, reproduce, or edit data. Also, control of the connected device of the PC is simplified, and whether the connected device is available or whether the data is compatible is displayed. As a result, it is possible to reduce a user's error in using the device, a setting error, and a malfunction. The user can easily recognize the state of the connected device by dynamically changing the icon of the connected device.

Further, according to the present invention, referring to FIG. 1, when the device A6, the device B7, and the device C8 are connected to the PC 1, the display of a graphical user interface (hereinafter referred to as a GUI) such as Windows is performed. An icon A3, an icon B4, and an icon C5 are displayed on the monitor 2 connected to the PC 1 on which the adapted operation system is mounted. The data of these icons is already registered on the operation system, or is automatically transferred from the connected device upon connection.

At the same time, the functions (such as the format of the received / transmitted data) possessed by each of the devices 6 to 8 are transferred, and are tabulated by the guide function 9 as a function table 10. When the icon of each device is displayed, the icon reflects the image of the connected device,
The user can visually understand what device is connected to the PC 1. By clicking on the icon, the guide function 9 refers to the device table, flashes the icon of the device to which the device represented by the clicked icon is connectable, and specifies the icon to the user.

Next, the user connects to the connectable icon using a user I / O interface device such as a mouse. By this operation, the icons are connected by a line, and perform data transfer and other processing according to the control desired by the user.

[0024]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments according to the present invention will be described.
This will be described in detail with reference to the drawings.

First Embodiment (1) Description of Configuration Referring to FIG. 1, as a connected device control system using icons, a device A6, an external device such as a device B7, a device C8, and the like are connected. A personal computer PC1 for controlling the external device, and a display monitor 2 for displaying a data processing instruction operation by the PC1, a state related to the operation, and a state of connection of the device.

Here, it is assumed that the PC 1 is equipped with an operation system such as Windows, iMAC, OS2, etc., adapted to display a graphical user interface (GUI) such as Windows. When the external devices 6 to 8 are connected, the icons A3, B4, and C5 corresponding to the devices connected to the PC 1 are displayed on the monitor 2. The external devices 6 to 8 include a printer, a hard disk driver, a floppy disk driver, a CD-ROM driver, a DVD driver,
Drivers, scanners, digital cameras, modems, terminal adapters for communication lines, XY plotters, etc. can be used. Even when the external devices 6 to 8 are connected to the PC 1 even after the power of the PC 1 is turned on, icons corresponding to the connected devices can be displayed by the plug and play function. The icon information is already registered in the GUI or transferred from a connected device in the operation system of the storage unit in the PC 1.

At the time of connection, the external devices 6 to 8 transfer functions possessed by the devices and data format information which can be supported to the PC 1, and the information is stored as a device table 10 by the guide function 9 of the PC 1. And saved. Connected devices are, for example, digital video cameras and digital video decks,
Connection is made by a high-speed interface such as EEE1394 or USB (Universal Serial Bus: peripheral device serial interface). When the digital video camera and the digital video deck are connected, icons similar in shape and state to those are displayed on the monitor 2 on the PC 1.

When the power of the digital video camera is turned off, the icon is displayed so that the user can visually understand the state (for example, the color is lightly displayed).

Referring to FIG. 2, as shown in FIG. 2A, the cursor 23 is used as an index to operate the mouse.
When the icon 21 is clicked, the guide function 9 refers to the function table 10 and blinks the icon 22 when confirming that the icon 22 can be connected to the external device indicated by the icon 21. The icon 2
It can be seen that 1 and the icon 22 can be connected. Next, as shown in FIG. 2B, the icon 21 and the icon 22 are connected by moving a mouse cursor 23 using a mouse. Then, as shown in FIG. 2C, the icons are connected by the line 24 when the connection is established. When connected, the icons 21 and 22 change to icons representing the connected state.

(2) Description of Operation Next, the operation of the GUI of the PC 1 shown in FIGS. 1 and 2 will be described. Device A3, Device B4 and Device C5 are I
When connected to an interface such as EEE1394,
As shown in the image of the monitor 2 in FIG. 1, an icon representing each device registered in the PC 1 in which an operation system having a GUI such as Windows is installed is called. Alternatively, when an external device is connected to the interface of the PC 1, the connected device transfers the icon information to the operation system in a format that can be understood by the operation system.

The operating system OS of the PC 1 having received the icon displays the icon on the GUI. At the same time, the external device transfers the functions possessed by the device and data format information that can be transmitted and received to the PC 1, and the PC 1
Creates a function table 10 with the guide function 9 and stores the information in a table. For example, when a video camera is connected and the video camera is in a camera mode in which an image of a subject is captured, the state is reflected on an icon, or in a video mode in which an image signal of a recorded recording medium is displayed and output, the state is displayed. PC1
Is displayed so that the user who operates can easily understand the state of the video camera.

For example, as shown in FIG. 2A, on the screen displayed on the monitor 2, the device of the icon 21 and the icon 2
When connecting and using two devices (for example, device A3
When the icon 21 is clicked with the mouse cursor 23, the guide function 9 refers to the device table 10 and the icon 22 is connected.
When it is determined that the device represented by is connectable, the icon 22
Flashes to indicate that connection is possible. Cursor 23
Is used to drag the mouse to draw a line from the icon 21 and bring it to the icon 22 (FIG. 2B).
In order for the connected icon 22 to indicate connection success and availability, the state of the icon 21 and the icon 22 change to a connected state according to the path along which the cursor 23 has moved, and between them, a line 24 representing the connection indicates a mutual connection. Connected (Fig. 2
(C)).

The connected devices A3 and B4 can perform data transfer or dubbing control between the devices by clicking the connection line 24 with a mouse. Also, reflect the function of the connected device to the icon,
That effect can also be represented by the display form of the icon. For example, when the connected device is in the standby state, the icon is grayed, so that it can be visually understood that the device is in an unusable state. When data is being transferred, one icon changes to an icon indicating data transmission, and the other icon changes to a state in which data is being received and data is being recorded.

At this time, when the device indicated by the icon 21 is a video camera and the device indicated by the icon 22 is a hard disk device, an arrow is displayed on the line 24 from the video camera to the hard disk device as a status display after connection. The upper right side of FIG. 2 indicates that the signal is transmitted. When the video signal has not been transmitted yet, the display of the line 24 blinks. When the video signal is transmitted, the display of the line 24 changes from left to right. It is also possible to perform a display for moving the moving blinking point.

By right-clicking the icon with the mouse, it is also possible to display the functions possessed by the device by referring to the device table 10 from the guide function 9. In addition, a receivable data format and a transmittable data format can be displayed.

[Second Embodiment] Next, a second embodiment of the present invention will be described in detail with reference to the drawings. A digital video camera icon 31 and a digital video camera icon 32 displayed on the monitor 2 of FIG.
The digital video deck icon 33 is connected on the GUI of the operation system.

A digital video camera represented by a digital video camera icon 31 includes a digital video deck represented by a digital video deck icon 33 and a digital video camera represented by a digital video camera icon 32. The video data is transferred to the camera. The digital VCR represented by the digital VCR icon 33 is set by the user to record the transferred video data, and the icon is in a state in which the icon is in a recording state so that it can be visually recognized. With reference to the guide function, the display changes to, for example, a blue blinking display.

The digital video camera representing the digital video camera icon 32 is a digital video deck
The video data transferred from the digital video deck represented by the icon 33 is displayed on the monitor 2 of the digital video camera represented by the digital video camera icon 32.
To display video. At this time, the digital video camera icon 32 displays the monitor image frame by referring to the guide function 9 in a state where the user can visually recognize that monitoring is being performed, and changes the display state.

In the above-described embodiment, an example in which data is transferred from the device A to the device B and the device C has been described, but the data transfer from the device A to the devices B and C in a one-to-many manner is also performed.
This can be achieved by displaying the icon at that time. That is, the icons of the three devices on the monitor shown in FIG.
Next, by dragging the icon of the device A from the icon of the device A to the icon of the device C with a mouse, the connection relationship is clearly indicated by a connection line on the icon. While the pan is away from the circle, an icon indicating that the switch has been released is displayed, and an operation of pressing down the pan with a cursor using a mouse is performed to change the device A to an operating icon. Next, data is transferred in real time by an icon indicating that data is being transferred by blinking of a connection line from the device A to the devices B and C, and when the data transfer is completed, the transmission line blinking display of the connection line is terminated. A color is displayed to indicate the end of data transfer. Dynamically change the display of the above icons to display more friendly operations and signal processing.
It can be confirmed and recognized.

The physical operation in the one-to-many case is as follows.
Similarly to the display of the icons, when the operation is started from the one-to-many connection state, the data transfer line of the device A is used as one bus line, and the devices B and C sequentially input data from the data reception line. By recording,
Can be achieved.

Next, referring to FIG. 4, the device A4 is connected via two physical connectors using an IEEE1394 interface 49 suitable for connection of AV devices and the like.
5 and the device B46 are connected. Interface 49
When the devices 45 and 46 are connected to the PC 4, the PC 41
5 and 46 are obtained, and a table 48 of the corresponding data format information of the device is obtained based on the type method.
Save. When the control application 47 is activated, the icons A43 and B44 of each device are displayed on the application screen.

Next, when the device A45 and the device B46 are connected on the application and data transfer is to be performed, the icon A43 is clicked with the left mouse button, and the control application 47 refers to the table 48, and the device A45 and the device A45 are connected. B46 processable data format, for example, DV format or MPEG2
If the format of the transport stream is the same, the icon B44 is blinked, and connection with the icon B44 is permitted.

Next, the icon A43 and the icon B44 are connected by drawing a line by dragging a mouse to establish a connection between the device A45 and the device B46, thereby enabling data transfer. During the data transfer, an icon A43 indicating that the data is being transferred is displayed. If the data transfer is completed and you want to disconnect the connection between device A45 and PC41,
By disconnecting the connected cable, the icon A43
Disappears, and the information of the device A45 stored in the table 48 is deleted.

In this respect, if the PC 41 is provided with an operational system of a plug and play mechanism,
The display of the icon A43 on the monitor 42 can be extinguished almost in real time. Plug-and-play works just by attaching peripheral devices to a PC (Plug).
ay) is a function to do so. This plug and play feature automates the cumbersome configuration of system resources such as interrupts (IRQs) on the expansion board, DMA channels, and I / O addresses, or attaches and detaches peripherals while the PC is running. When the device
A function of automatically loading / unloading a driver is provided. In the present embodiment, the latter function is used.

[0045]

According to the present invention, when connecting a plurality of connected devices to another device, the state of the icons is changed using the guide function, so that the user can visually connect the devices that can be visually connected. You can check and set up a connection,
A connection can be made from a plurality of connected devices to another device, and a suitable use form can be constructed.

Further, since the icon information which clearly indicates the connected device is transferred from the connected device and displayed, the user can identify the device visually, so that the user can determine which device is connected. Can be visually understood at a glance.

Further, all the connected devices are displayed as icons,
Since the actual device is simulated on the GUI, the actual connection operation can be performed by connecting the devices to be connected on the GUI. Can be done.

Since the guide function monitors the status of the device, if the status of the device changes, the status is reflected on the icon on the GUI, and the display of the icon changes. Therefore, the status of the device on the GUI is changed. Can be directly understood, and the next operation can be easily recognized and executed.

[Brief description of the drawings]

FIG. 1 is a conceptual configuration diagram showing an example of a GUI of a personal computer according to a visual connection device control method of the present invention.

FIG. 2 is a conceptual explanatory diagram showing an example on a GUI of a personal computer according to the visual connection device control method of the present invention.

FIG. 3 is a diagram illustrating an example of a one-to-many display of icons according to the visual connection device control method of the present invention.

FIG. 4 is a conceptual configuration diagram showing an example of a GUI of a personal computer according to the visual connection device control method of the present invention.

FIG. 5 is a conceptual explanatory diagram showing an example on a GUI of a personal computer according to a conventional visual connection device control method.

[Explanation of symbols]

 1,41 Personal computer (PC) 2,42,50 Monitor 3,4,5,43,44 Icon A, B, C 6,7,8,45,46 External device A, B, C 9 Guide function 10, 48 Function table 21, 22 Icon 23 Cursor 24 Connection line 31, 32 Video camera 33 VCR 47 Control application program 51, 52, 53, 54 Icon

Claims (6)

[Claims] 1. A personal computer (PC) to which a plurality of devices including a monitor are connected, an icon corresponding to the plurality of devices is displayed on the monitor, and the user can control the icons simply and visually. In a visual connection device control method having a function, a personal computer (P
In response to a connection or instruction to C), the icon
A visual connection device control system, comprising: a change unit for dynamically changing a display mode of the icon so that a user can understand a state of the device. 2. The visual connection device control method according to claim 1, wherein the interface according to the IEEE 1394 standard is connected to the plurality of devices by using the interface, and information of the plurality of devices is transmitted via the interface. Obtain the personal computer (P
C) a function table to be stored in the device, and a graphic user interface (GUI) having a drawing function of the personal computer based on the information of the device, wherein the icon on the graphic user interface (GUI) is provided. Controlling the plurality of devices by a visual connection device control method. 3. The visual connection device control system according to claim 1, wherein, when the plurality of devices are connected to the personal computer (PC), the type information of the plurality of devices is displayed on the personal computer (PC). A visual connection device control method for determining whether connection is possible or not based on the type information of the plurality of devices. 4. The visual connection device control method according to claim 1, wherein when the plurality of devices are connected to the personal computer (PC), one of the plurality of devices changes to another device. A data transfer state of the personal computer (PC) is displayed by the icon on a graphic user interface (GUI) of the personal computer (PC). 5. A visually connected device control method for controlling a personal computer (PC) to which a plurality of devices A, B, and C are connected by using an icon for displaying the plurality of devices on a monitor of the personal computer (PC). In the device, the obtained data of the device A is obtained, the data is transferred to the device B, and the transferred data is transferred to the device C.
When the personal computer (PC) is connected, icons indicating the devices A, B, and C are displayed on the monitor by a plug and play function, and a start instruction for operating the device A is displayed. Click the icon to display the device A, drag the icon of the device A and the icon of the device B, and transfer the acquired data of the device A to the operation icon for transferring the acquired data of the device A. Is displayed, and the icon of the device B and the icon of the device C are dragged to display an operation icon for transferring the transfer data of the device B.
And the icon of the device C are displayed as changing icons, and when the acquired data of the device A can be transferred to the device C, the icons of the devices A, B, and C are changed to an operation end icon. A visual connection device control method characterized by changing to a display. 6. The visual connection device control method according to claim 5, wherein the device A is a digital video camera, the device B is a digital video deck, and the device C is a digital video camera. Connection device control method.