JP2757828B2 - Input/Output Interface Device - Google Patents

Description

Detailed Description of the Invention

[0001]

FIELD OF THEINVENTION The present invention relates to an input/output interface device for a computer system, and more particularly to an input/output interface device having a function for easily changing the input/output interface based on the characteristics and available devices of various users.

[0002]

2. Description of the Related Art Conventionally, in information processing devices,
Interfaces that accommodate users with various characteristics, such as the elderly, have traditionally been provided with functions tailored to the characteristics of each individual user, but with these interfaces it has been difficult to easily adapt them to users with multiple characteristics, to accommodate users whose characteristics change over time, such as the elderly, or to change settings every time a new user changes when users with different characteristics use the same device to work together. Currently, there are more opportunities to use information devices in a variety of situations, and there is a need to develop new interfaces that can accommodate the multiple characteristics of a variety of users.

In view of the above, a conventional technique that changes the input/output method in accordance with the device that the user wishes to use is disclosed in Japanese Patent Laid-Open Publication No. 6-51970 entitled "Interface Device."
The "Interface Device" of Publication No. 1970 realizes an input/output interface corresponding to an application and a user interface suited to information on the user's input/output usage situation.

[0004]

However, the interface device disclosed in the above-mentioned Japanese Patent Laid-Open Publication No. 6-51970 is not suitable for users with various characteristics such as the handicapped and the elderly.
In order to present information by making maximum use of available devices, the methods of selecting and presenting information differ even when using the same device, and furthermore, each interface function needs to work in conjunction with each other.

Furthermore, in the prior art, interface devices for users with various characteristics, such as the disabled and the elderly, were made with functions corresponding to the characteristics of each individual user, so it was necessary to develop a new interface device for users with multiple characteristics. These interface devices did not have a linking mechanism for linking with other interface functions, and did not have a control mechanism for maintaining the consistency of the linking of multiple interfaces.

In view of the above, an object of the present invention is to provide a consistent interface adapted to users with multiple characteristics by linking user interface functions for adjusting the operation of each device, user interface functions for selection operations, user interface functions for input operations, and user interface functions for information output while maintaining consistency, based on user characteristics and information on available devices.

[0007]

[0013] The present invention, the first invention,
an input/output interface device which changes an interface between the input and output devices and the application and the operating system to suit a user, the input/output interface device comprising: an application; an operating system which controls the application; one or more input devices such as a keyboard, a mouse, a touch panel, a pen, a push switch, a sensor switch, a joystick, etc.; and one or more output devices such as a display, a Braille display, a tactile pin display, a speaker, etc.; the input/output interface device comprising: a device information storage unit which stores information regarding the connection relationship and usability status of the input and output devices; a user information storage unit which stores user information such as user characteristics and system usage status; and an input interface library which is a collection of functions for performing input suitable for a user; The system is characterized in that it is composed of an output interface library which is a collection of functions that provide output adapted to the user; a library control information storage unit which holds library control information which is a combination of each function of the input interface library and the output interface library and default parameters for each function; an interface control unit which selects a function to be launched from the input interface library and the output interface library based on the device information, the user information and the library control information and determines the parameters to be passed on; an information structure extraction unit which extracts information on the status and screen of the application and the operating system; and an information structure conversion unit which converts the structure of the information extracted by the information structure extraction unit in accordance with the function to be launched selected by the interface control unit.

A second aspect of the present invention is a computer system including an application, an operating system for controlling the application, a keyboard, a mouse, a touch panel,
The device includes one or more input devices such as a pen, a push switch, a sensor switch, a joystick, etc., and one or more output devices such as a display, a Braille display, a tactile pin display, a speaker, etc.
an input/output interface device for changing an interface between the input device and the output device and the application and the operating system to suit a user, the input/output interface device including a device information storage unit for storing information regarding connection relationships and availability status of the input device and the output device, a user information storage unit for storing user information such as user characteristics and system usage status, an input interface library which is a set of functions for performing input adapted to the user, an output interface library which is a set of functions for performing output adapted to the user, a library control information storage unit for storing library control information which is a combination of each function of the input interface library and the output interface library and default parameters of each function, the set of functions of the input interface library being composed of a library group consisting of an input adjustment library having adjustment functions and setting functions for the user to use the input device, a selection mode library which provides a method for the user to select and indicate an object, and an input mode library which provides an input method for the user to input content information of a document such as text, and the set of functions of the output interface library being composed of a library group consisting of an output adjustment library having adjustment functions and setting functions for the user to use the output device, and an output mode library which provides an output method by visual, auditory, or tactile senses according to the user,
The system is characterized in that it is composed of an interface control unit which selects a library to be launched from the input interface library and the output interface library based on the device information, the user information, and the library control information and determines parameters to be passed on; each of the input interface library and the output interface library is equipped with a single or multiple programs that can be launched to provide the respective functions, and a selector which receives output from the interface control unit and provides parameters to the appropriate program to selectively launch it; an information structure extraction unit which extracts information on the status and screen of the application and the operating system; and an information structure conversion unit which converts the structure of the information extracted by the information structure extraction unit in accordance with the library to be launched selected by the interface control unit.

[0009] Furthermore, the third invention of the present invention is characterized in that, in the second invention, when the interface control means obtains the device information, the user information, and the library control information to select a library to be started, it determines whether the device to be used is usable or unusable, and if the device to be used is unusable, it determines whether an alternative device is available, and if an alternative is possible, it performs control to use the alternative device.

[0010]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Next, an embodiment of the present invention will be described with reference to the drawings.

FIG. 1 is a block diagram showing an embodiment of the configuration of an input/output interface device according to the present invention.

In FIG. 1, reference numeral 101 denotes an operating system, 102 denotes an application, 103 denotes an output device including a display, a Braille display, a tactile pin display, a speaker, etc., 104 denotes a keyboard, a mouse, a touch panel, a pen, a push switch,
An input device 110 is a sensor switch, a joystick, or the like, and an input interface library 111 is a set of functions for performing input suited to the user.
112 is a selection mode library included in the input interface library, which provides a suitable method for a user to select and indicate an object; 113 is an input mode library included in the input interface library, which provides an input method for inputting content information of a document such as a text by a user; and 114 is an output interface library, which is a set of functions for performing output adapted to a user; and 115 is an output interface library, which is a set of functions for performing output adapted to a user.
The output interface library includes an output adjustment library having an adjustment function for a user to use a certain device. 116 includes a visual, auditory, or other input interface adapted to the user.
An output mode library that provides an output method using touch, etc.; 120 is a device information storage unit that stores information on device connections and usable status; 121 is a user information storage unit that stores user characteristic parameters and customization information, etc.; 122 is the input interface library;
A library control information storage unit 123 stores information for controlling the output interface library, and an interface control unit 124 selects a library to be started from the input interface library and the output interface library based on the device information, the user information, and the library control information, determines transfer parameters, and performs exclusive control. A selector 124 selects an appropriate library from the output adjustment library by giving parameters to the appropriate library and starting it. A selector 125 selects an appropriate library from the output mode library by giving parameters to the appropriate library and starting it. A selector 126 selects an appropriate library from the selection mode library by giving parameters to the appropriate library and starting it.
Reference numeral 7 denotes a selector which gives parameters to an appropriate library from among the input mode libraries and selectively launches it; 128 denotes a selector which gives parameters to an appropriate library from among the input adjustment libraries and selectively launches it; 130 denotes an information structure extraction unit which extracts information on the operating system and application; and 131 denotes an information structure conversion unit which converts the structure of the information extracted by the information structure extraction unit in accordance with the launch library determined by the interface control unit.

The output interface library 114 includes:
Output adjustment library 115, output mode library 11
It consists of 6.

The output adjustment library 115 is made up of a group of libraries that adjust device drivers and output information that the selector 124 selects and activates to enable each device in the output device 103 based on output mode information and parameters sent from the selector 125 in accordance with the output method to the user determined by the output mode library 116. An example is shown in Figure 2. The selector 124 activates the libraries shown in Figure 2, transfers data between these libraries, and controls the output mode library 116.
It controls the reception of data from.

The output mode library 116 is made up of a group of libraries that are selected and activated by the selector 125 according to output mode information sent from the interface control unit 123 in order to change the output method for the user and output to the output device 103 via the output adjustment library 114. An example is shown in Fig. 3. The selector 125 controls the activation of libraries such as those shown in Fig. 3, data transfer between these libraries, and data transfer to the output adjustment library 115.

The input interface library 110 includes:
Input adjustment library 111, selection mode library 11
2. Input mode library 113.

The input adjustment library 111 includes a selector 1
26, via the selector 127, select mode library 1
The selector 128 is composed of a device driver that is activated to enable input from each device of the input device 104 and a library group that adjusts input information according to the user's selection operation or input operation method determined by the selection mode library 112 and input mode library 113. An example is shown in Fig. 4. The selector 128 activates the libraries shown in Fig. 4, transfers data between these libraries, and controls the selection mode library 112, input mode library 113, and input mode library 114.
It controls the passing of data to the

The selection mode library 112 changes the method of selecting a menu or document presented by the application 102 or the operating system 101 when the selector 126 is activated based on the selection mode information from the interface control unit 123, and the input adjustment library 111
The selector 126 is a group of libraries for passing information on selection operations obtained from the input device 104 to the operating system 101 and the application 102 through the input mode library 113, and for passing selection information for inputting text or the like to the input mode library 113. An example is shown in FIG. 5.
10 and controls the initiation of libraries as shown in FIG. 10, data transfer between these libraries, reception of data from the input adjustment library 111, data transfer with the input mode library 113, and data transfer to the output mode library 116.

The input mode library 113 is a group of libraries that change the input method of the user's text, figures, etc., which is activated by the selector 127 in response to input mode information from the interface control unit 123, obtains input information from the input device 104 via the selection mode library 112 and input adjustment library 111, and passes it to the operating system 101 and application 102. An example is shown in Fig. 6. The selector 127 controls the activation of libraries such as those shown in Fig. 6, the transfer of data between these libraries, the reception of data from the input adjustment library 111, and the transfer of data with the selection mode library 112.

An example of the relationship between the libraries in a screen reading interface for the visually impaired is shown in Fig. 7, and an example of the relationship between the libraries in a scanning input interface for the upper limb impaired is shown in Fig. 8. The selector of each library starts the appropriate library group and controls the data transfer between the libraries.

9, 10 and 11 show flow charts of the processing in this embodiment.

There are three phases: an adaptation phase in which an adapted interface is determined from user information and device information; a setting phase in which the current adapted interface is changed and customized; and an operation phase in which the determined adapted interface is used to perform an operation.

FIG. 9 is a flow chart of the adaptation phase.

In the adaptation phase, the user information storage unit 12
Using the user information in the user information storage unit 111 and the device information in the device information storage unit 120 , the interface control unit 123 determines the activation library from the selection mode library 112 in the input interface library 110 , the input mode library 113 , and the output mode library 116 in the output interface library 114 .

First, device information is obtained (600) from the device information storage unit 120. The device information includes information on the usable/unusable state of currently connected devices.

Next, the name of the interface set adapted to the user is obtained from the user information in the user information storage unit 121 (601). The user information consists of an interface set, user characteristic parameters, and user customization parameters. The interface set is a combination of interfaces used by the user, and the user characteristic parameters consist of the media available to the user and the number of switches (keys) available to the user. The user customization parameters hold parameters customized by the user himself among the adapted interfaces that the user has used up to now.

Next, library control information is obtained from the library control information storage unit 122 (602). The library control information consists of a combination of a start library for an interface set name, and a default parameter set. An example of library control information when the interface set name is "Screen reading for visually impaired people" is shown in FIG.
As shown in.

Whether the device required to use the interface set acquired in 601 is connected and available, the device information acquired in 600, and
The determination is made based on the library control information acquired in 60
3) An example of device information is shown in Figure 13.

If a device required to use the interface set is unavailable, a user characteristic parameter is obtained from the user information in the user information storage unit 121. From the user characteristic parameter, the current interface set, and the library control information, another device,
If the library can be substituted, an alternative device and an alternative library are selected (611).
User customized parameters are obtained (612) from the user information in the user information storage unit 121, and modified (613) in accordance with the alternative device, after which the library is activated (604) from the interface control unit 123 via the selectors 124 to 128. An example is shown in Fig. 14. In this example, since the speaker is not available in the device information in Fig. 13, a braille display is used as the alternative device.

If the device required to use the interface set is available, the user customize parameters are obtained (620) from the user information in the user information storage unit 121, and the interface control unit 1
23 starts each library via each of the selectors 124 to 128 (604).

Next, an embodiment of the operation in the setting phase will be described with reference to the flowchart of FIG.

In the configuration phase, the user can change the currently used interface set, libraries and their parameters.

Obtaining information about running libraries (6
40) device information in the device information storage unit 120,
User characteristic parameters are acquired from the user information in the user information storage unit 121 (641, 642). Also, setting panel information is acquired from each library (643) and a setting panel is generated (644). The setting panel information consists of items to be set for the library function, current values, value ranges, options, etc. Furthermore, library control information is acquired from the library control information storage unit 122.

When changing the interface set (6
50), the interface control unit 123 presents a changeable interface set based on the device information acquired in 641, the user characteristic parameters acquired in 642, and the library control information acquired in 645 (655).
When the interface set to be changed is input (656), user customization parameters are acquired (657) from the user information in the user information storage unit 121.
After the user customization parameters are modified (658) in accordance with the interface set changed in step 2, each library is started from the interface control unit 123 via each of the selectors 124 to 128 (646).

When the setting is completed (647), the changed setting is registered and the new interface set is saved in the user information storage unit 121 (648).

When changing a library (650), the interface control unit presents libraries that can be changed (653) based on the device information acquired in 641, the user characteristic parameters acquired in 642, and the library control information acquired in 645. When the library to be changed is input (654), user customization parameters are acquired from the user information in the user information storage unit 121 (655).
57), and after modifying the user customization parameters in accordance with the library changed in 656 (658), the interface control unit 123 transmits the user customization parameters to each of the selectors 124 to 126.
Each library is started via the program 8 (646).

When the setting is completed (647), the changed setting is registered and the new interface set is saved in the user information storage unit 121 (648).

When changing parameters (650), the interface control unit 123 presents changeable parameters (651) based on the device information acquired in 641, the user characteristic parameters acquired in 642, and the library control information acquired in 645. When the parameters to be changed are input (652), the interface control unit 12
3 to activate each library via each of the selectors 124 to 128 (646).

When the setting is completed (647), the changed setting is registered and the new interface set is saved in the user information storage unit 121 (648).

[0040] Examples of library changes are shown in Fig. 15 and Fig. 16. In the scan input method interface set for the upper limb disabled in Fig. 15, the panel scan library, filtering library, and screen scan library can be selected from the selection mode library. When the screen scan library is selected from the state of the scan input interface for the upper limb disabled in Fig. 8, the interface becomes as shown in Fig. 16.
It is.

Next, an embodiment of the operation in the operation phase will be described with reference to the flowchart of FIG.

In the operation phase, the state and screen information of the application and the operating system that change in response to the user's operation are extracted, and the structure of the extracted information is converted in accordance with the interface set adapted to the user.
It allows users to easily search for and operate information.

When a user makes an input or selection from the input device 104, the input interface library 110
Through this, the operating system 101 and the application 102 receive information and perform corresponding operations.
At this time, the information extraction unit 130 extracts the application 102 and the operating system 102 that have changed in response to the input.
The interface control unit 123 provides the information of the currently active library to the information structure conversion unit 131, which converts the structure of the information extracted by the information extraction unit 130 to match it with the currently active library (671).
72), and passes it to each of the selection mode library 112 or the output mode library 116, and each library performs its own operation (673).

As a result of the above, an input/output interface using an information format and media suited to various user characteristics can be provided, and the interface can be easily changed.

[0045]

As a result of the above, the present invention can respond to multiple characteristics of a user, not just individual characteristics of the user.
The present invention provides an interface that is optimal for a user, combining input/output methods of various media and input/output devices according to the situation at the time, and allows the user to acquire and create information efficiently and effectively. Therefore, by using an interface that is adaptive to the multiple characteristics of the user of the present invention, the input/output method and media can be optimally selected according to the situation, allowing the user to acquire and create information effectively and efficiently.

[Brief description of the drawings]

FIG. 1 is a configuration diagram of an input/output interface device according to an embodiment of the present invention.

FIG. 2 is an example of an output adjustment library of an input/output interface device according to an embodiment of the present invention.

FIG. 3 is an example of an output mode library of an input/output interface device according to an embodiment of the present invention.

FIG. 4 is an example of an input adjustment library of an input/output interface device according to an embodiment of the present invention.

FIG. 5 is an example of a selection mode library of an input/output interface device according to an embodiment of the present invention.

FIG. 6 is an example of an input mode library of an input/output interface device according to an embodiment of the present invention.

FIG. 7 is an example of the relationship between libraries in a screen reading interface for visually impaired people according to the present invention.

FIG. 8 is a diagram showing an example of the relationship between libraries in a scan input interface for persons with upper limb disabilities according to the present invention.

FIG. 9 is a flowchart showing an adaptation phase of processing of the input/output interface device according to an embodiment of the present invention.

FIG. 10 is a flowchart showing a setting phase of processing of the input/output interface device according to an embodiment of the present invention.

FIG. 11 is a flowchart showing an operation phase of the processing of the input/output interface device according to an embodiment of the present invention.

FIG. 12 is an example of library control information in the present invention.

FIG. 13 is an example of device information in the present invention.

FIG. 14 is an example of selection of an alternative device in the present invention.

FIG. 15 is an example of a scan input method interface set for people with upper limb disabilities according to the present invention.

FIG. 16 shows an example of a modified library according to the present invention.

[Explanation of symbols] 101 Operating system 102 Application 103 Output device 104 Input device 110 Input interface library 111 Input adjustment library 112 Selection mode library 113 Input mode library 114 Output interface library 115 Output adjustment library 116 Output mode library 120 Device information storage unit 121 User information storage unit 122 Library control information storage unit 123 Interface control unit 124 Selector 125 Selector 126 Selector 127 Selector 128 Selector 130 Information structure extraction unit 131 Information structure conversion unit

Claims (3)

(57) [Claims] [Claim 1] An application, an operating system that controls the application, a keyboard, a mouse, a touch panel, a pen, a push switch,
An input/output interface device is provided with one or more input devices such as a sensor switch, a joystick, etc., and one or more output devices such as a display, a Braille display, a tactile pin display, a speaker, etc., and changes an interface between the input device and the output device and the application and the operating system to suit a user. The input/output interface device has a device information storage section that stores information regarding a connection relationship and an available status of the input device and the output device, a user information storage section that stores user information such as user characteristics and a system usage status, an input interface library which is a set of functions for performing inputs suitable for a user, an output interface library which is a set of functions for performing outputs suitable for a user, and a function for storing information regarding the input device, the output device, the user information storage section that stores information regarding the connection relationship and the available status of the input device, the user information storage section that stores user information such as user characteristics and a system usage status, an input interface library which is a set of functions for performing inputs suitable for a user, and an output interface library which is a set of functions for performing outputs suitable for a user. an interface control unit that selects a function to be started from said input interface library and said output interface library based on said device information, said user information and said library control information and determines parameters to be passed on; an information structure extraction unit that extracts information on states and screens of said application and said operating system; and an information structure conversion unit that converts the structure of the information extracted by said information structure extraction unit in accordance with the function to be started selected by said interface control unit. 2. An application, an operating system that controls the application, a keyboard, a mouse, a touch panel, a pen, a push switch,
An input/output interface device is provided with one or more input devices such as a sensor switch, a joystick, etc., and one or more output devices such as a display, a Braille display, a tactile pin display, a speaker, etc., and changes an interface between the input device and the output device and the application and the operating system to suit a user. The input/output interface device has a device information storage section that stores information regarding connection relationships and availability status of the input device and the output device, a user information storage section that stores user information such as user characteristics and system usage status, an input interface library which is a collection of functions for performing inputs suitable for a user, an output interface library which is a collection of functions for performing output suitable for a user, and library control information which stores combinations of each function of the input interface library and the output interface library and default parameters for each function. a library control information storage unit for storing information on the input and output interface libraries, the set of functions of the input interface library being composed of a library group consisting of an input adjustment library having adjustment and setting functions for a user to use the input device, a selection mode library providing a method for a user to select and indicate an object, and an input mode library providing an input method for inputting content information of a document such as a user's text, the set of functions of the output interface library being composed of a library group consisting of an output adjustment library having adjustment and setting functions for a user to use the output device, and an output mode library providing an output method using vision, hearing, and touch according to the user, an interface control unit for selecting a library to be started from the input interface library and the output interface library and determining parameters to be passed on based on the device information, the user information, and the library control information,
an information structure extraction unit that extracts information on the status and screen of the application and the operating system, and an information structure conversion unit that converts the structure of the information extracted by the information structure extraction unit in accordance with the library to be launched selected by the interface control unit. [Claim 3] The input/output interface device described in claim 2, characterized in that when the interface control means obtains the device information, the user information, and the library control information to select the library to be started, it determines whether the device to be used is usable or unusable, and if the device to be used is unusable, it determines whether an alternative device is available, and if an alternative is available, it performs control to use the alternative device.