AU2021302559A1

AU2021302559A1 - Operating system multiplexing device

Info

Publication number: AU2021302559A1
Application number: AU2021302559A
Authority: AU
Inventors: Eigo Fukai; Motohiko Okabe; Yoichi Takayanagi; Genki TATENO
Original assignee: Toshiba Corp; Toshiba Infrastructure Systems and Solutions Corp
Current assignee: Toshiba Corp
Priority date: 2020-07-03
Filing date: 2021-06-08
Publication date: 2023-01-19
Anticipated expiration: 2041-06-08
Also published as: WO2022004309A1; JP2022013426A; AU2024202441A1; JP7341955B2; AU2021302559B2; AU2024202441B2; CN115715384A

Abstract

An operating system multiplexing device according to an embodiment comprises: an image signal acquisition unit of an information processing device having a GUI output unit that outputs a GUI image combined with state information of a to-be-controlled device, a GUI operating unit that receives operating input pertaining to the GUI image, and a communication terminal that is compatible with the EIA-232 standard, the image signal acquisition unit being provided so as to be connectable to the GUI output unit, and receiving input of the GUI image; an image state recognition unit that acquires numerical value information of a control element of the to-be-controlled device expressed in the GUI image acquired by the image signal acquisition unit, converts the numerical value information to a numerical value, and associates the same with the control element; and a state information output terminal that outputs the numerical value and the GUI image using the TCP/IP protocol.

Description

DESCRIPTION OPERATION SYSTEM MULTIPLEXING DEVICE TECHNICAL FIELD

[0001] Embodiments of the present invention relate to an

operation system multiplexing device.

BACKGROUND ART

[0002] Controllers for controlling input/output (I/0)

devices and the like have been used in control systems of

industrial plants (hereinafter, also simply referred to as "plants"), for example. Furthermore, a plant monitoring

device such as a human machine interface (HMI) is used in

order for a worker to monitor a situation and the like of

processing in such a controller and give an instruction to

a control systemas necessary.

[0003] For example, the plant monitoring device displays

a situation in the plant on a display screen, and the

worker looks at the display screen and performs operation

input with an input device (e.g., keyboard) as necessary.

Furthermore, the content (e.g., alarm occurrence) of the

display screen and the content (e.g., device stop

instruction) of operation input of the worker often have

correspondence relation. Thus, the plant monitoring device

may be modified for automating (at least a part of (the

same applies hereinafter)) operation thereof such that,

when a predetermined display screen is generated, the plant

monitoring device automatically acquires the content of the

corresponding operation input.

CITATION LIST

Patent Literature

[0004] Patent Literature 1: Japanese Patent No. 5740634 Patent Literature 2: Japanese Patent No. 6591937 Patent Literature 3: Japanese Patent No. 6679247 Patent Literature 4: Japanese Patent Application Laid open No. 2002-244702 Patent Literature 5: Japanese Patent Application Laid open No. H11-327627

SUMMARY OF INVENTION PROBLEM TO BE SOLVED BY THE INVENTION

[0005] However, in conventional technology, automation cannot be achieved when a plant monitoring device is old and cannot be modified for automation, or when a user does not desire to modify the plant monitoring device due to various circumstances.

[0006] Therefore, an object of embodiments of the present invention is to provide an operation system multiplexing device capable of multiplexing an operation system including automation without modifying a target device such as the plant monitoring device.

MEANS FOR SOLVING PROBLEM

[0007] An operation system multiplexing device according to embodiments includes: an image signal acquisition unit configured to receive a graphical user interface (GUI) image combined with state information on a control target device, the image signal acquisition unit being able to be connected to a GUI output unit of an information processing device, and the information processing device including: the GUI output unit that outputs the GUI image; a GUI operating unit that receives operation input to the GUI image; and a communication terminal compatible with an electronic industries alliance (EIA)-232 standard; an image state recognition unit configured to convert into a numerical value numerical information of a control element of the control target device to acquire the numerical value in association with the control element, the numerical information being expressed in the GUI image acquired by the image signal acquisition unit; and a state information output terminal configured to output the numerical value in accordance with a TCP/IP protocol.

BRIEF DESCRIPTION OF DRAWINGS

[00081 FIG. 1 is an overall configuration diagram of a

control system according to a first embodiment.

FIG. 2 is a configuration diagram of an operation

system multiplexing device and a plant monitoring device

according to the first embodiment.

FIG. 3A illustrates an example of a display screen of

a display device according to the first embodiment.

FIG. 3B illustrates an example of the display screen

of the display device according to the first embodiment.

FIG. 4 illustrates an example of the display screen of

the display device according to the first embodiment.

FIG. 5 is a flowchart illustrating the overall

processing of the operation system multiplexing device

according to the first embodiment.

FIG. 6 is a flowchart illustrating details of

processing in Step S1 in FIG. 5.

FIG. 7 is a flowchart illustrating details of

processing in Step S2 in FIG. 5.

FIG. 8 is an overall configuration diagram of a

control system according to a second embodiment.

FIG. 9 is an overall configuration diagram of a

control system according to a third embodiment.

FIG. 10 is an overall configuration diagram of a control system according to a fourth embodiment. FIG. 11 is an overall configuration diagram of a control system according to a fifth embodiment. FIG. 12 is an overall configuration diagram of a control system according to a seventh embodiment. FIG. 13 is an overall configuration diagram of a control system according to an eighth embodiment. FIG. 14 illustrates an example of a notification destination information table according to the eighth embodiment. FIG. 15 is an overall configuration diagram of a control system according to a ninth embodiment. FIG. 16 illustrates an example of an authority information table according to the ninth embodiment.

DESCRIPTION OF EMBODIMENTS

[00091 Embodiments of an operation system multiplexing device of the present invention will be described with reference to the drawings. In the following embodiments, an example of a case where the operation system multiplexing device is applied to a control system of an industrial plant will be described.

[0010] (First Embodiment) FIG. 1 is an overall configuration diagram of a control system S according to a first embodiment. FIG. 2 is a configuration diagram of an operation system multiplexing device 1 and a plant monitoring device 2 according to the first embodiment. The control system S includes the operation system multiplexing device 1 and the plant monitoring device 2. The plant monitoring device 2 includes an information processing device 21, a display device 22, and a keyboard 23 (graphical user interface (GUI) operating unit). Note that, in FIG. 2, lines connecting configurations indicate main connection relations, and configurations that are not connected by a line may be actually connected.

[0011] The information processing device 21 is connected to a controller, and transmits and receives information to and from the controller. The controller controls an I/O device and a sensor, an actuator, and the like (hereinafter, also referred to as control target device) connected to the I/O device. Furthermore, the information processing device 21 displays a situation of a plant on the display device 22 based on information collected from the controller and the like.

[0012] The information processing device 21 includes a GUI output unit P23, a port P21, and a communication terminal (port P22) for control signals. The GUI output unit P23 outputs a VGA image of a GUI combined with state information (e.g., information illustrated in water level display region A2 in FIGS. 3A and 3B) on a control target device. A man-machine interface such as a keyboard, a mouse, and a touch panel for operating the GUI is connected to the port P21. The port P22 is compatible with an electronic industries alliance (EIA)-232 standard.

[0013] The port P23 of the information processing device 21 is connected to a port P12 of the operation system multiplexing device 1 via a cable (reference sign R2) such as a video graphics array (VGA) and a digital visual interface (DVI). This configuration allows the information processing device 21 to transmit image information to a signal distribution unit 11 of the operation system multiplexing device 1. Furthermore, a port P13 of the operation system multiplexing device 1 is connected to the display device 22 via a cable (reference sign R3) such as a VGA and a DVI. This configuration causes the signal distribution unit 11 of the operation system multiplexing device 1 to serve as an image relay unit having a function of distributing image signals and relay image information output from the information processing device 21 to output the image information to the display device 22. Therefore, the display device 22 displays the same image as a conventional image.

[0014] The operation system multiplexing device 1 converts numerical information expressed in an image input from the port P23 into a numerical value capable of being computed by a CPU. The numerical value is subjected to computation processing or accumulated. The result is output from a LAN port P14 serving as a state information output terminal in accordance with a transmission control protocol/internet protocol (TCP/IP) at predetermined timing or in response to a request from the outside.

[0015] Hardware of the information processing device 21 is not assumed to be modified, so that the original operation system is maintained. The information processing device 21 may be connected to the keyboard 23 via a cable such as a personal system/2 (PS/2) (registered trademark) through the port P21, and wait for input. Furthermore, for example, UNIX (registered trademark) and an operation systems (OSs) whose manufacturer support (e.g., security measure) has been ended are assumed as an OS of the information processing device 21, the OS is not limited thereto.

[0016] Note, however, that, in a sequence of control operation of the information processing device 21, it may be necessary to wait for a control signal input from the communication terminal, and, when a specific control signal is input, perform setup for performing internal processing in accordance with the control signal or software implementation.

[0017] A worker looks at a display screen of the display device 22, operates the keyboard 23 that receives operation input to the GUI image, and inputs information to the information processing device 21. For example, the worker can operate the keyboard 23 and instruct the information processing device 21 to stop the device by looking at a screen, indicating alarm occurrence, displayed on the display device 22.

[0018] FIG. 3A illustrates an example of a display screen of the display device 22 according to the first embodiment. In the screen example, a GUI screen includes a screen selection region Al and a screen region based on a control element input from the controller. Then, the screen region based on a control element input from the controller includes, for example, a tank T, pipes El and E2, a first solenoid valve Bl, a second solenoid valve B2, a water level sensor W, the screen selection region Al, and the water level display region A2. In FIG. 3A, the tank T, the pipes El and E2, the first solenoid valve Bl, and the second solenoid valve B2 serve as examples of the control element.

[0019] The screen selection region Al is provided in an upper left portion of the screen. The screen selection region Al performs display for a user to select a screen such as a state monitoring screen (screen in FIG. 3A), an operating screen (screen in FIG. 4), a parameter setup screen, a trend graph display screen, and the like.

[0020] The tank T schematically illustrates a tank, which is a liquid storage facility in the plant. The pipes El and E2 schematically illustrate pipes, which are liquid flow paths. The first solenoid valve Bl and the second solenoid valve B2 schematically illustrate solenoid valves for allowing and blocking a flow of liquid in the pipes El and E2. The water level sensor W schematically illustrates a sensor that measures a water level of liquid in the tank

T.

[0021] The water level display region A2 is provided in

a lower right portion of the screen. A numerical value of

a water level in the tank T measured by the water level

sensor W and the like are displayed on the water level

display region A2. As described above, in the present

embodiment, an image related to a water level of a control

element (e.g., tank T) of the controller is displayed.

[0022] The worker can grasp the situation of the water

level of the tank T in the plant and the like by looking at

such a screen. Furthermore, in the screen example, at the

time of alarm occurrence, a predetermined region (e.g.,

water level display region A2) in the screen is blinked in

red, for example.

[0023] Furthermore, in the screen example, at the time

of alarm occurrence due to an excessively increased water

level, as illustrated in FIG. 3B, "water level OVER" may be

displayed in the water level display region A2, for

example.

[0024] Furthermore, FIG. 4 illustrates an example of a

display screen of the display device 22 according to the

first embodiment. In the screen example, the screen

selection region Al and operating regions A3 to A5 are

illustrated.

[0025] The screen selection region Al is similar to that

in FIG. 3A. The operating regions A3 to A5 are provided in

a central portion of the screen. In the operating regions

A3 to A5, for example, a plurality of controls that can be

executed by control elements is displayed in a selectable

manner for each control element of the controller. For example, in the operating region A3, display is performed for operating start, stop, and the like of operation of the tank T and a facility related thereto. Furthermore, for example, in the operating regions A4 and A5, display is performed for operating start, stop, and the like of operation of other facilities in the plant.

[0026] The worker can perform various operations (e.g.,

instruction to start or stop operation of predetermined

facility) in the operating regions A3 to A5 by using such a

screen.

[0027] Returning to FIGS. 1 and 2, the operation system

multiplexing device 1 is a computer device, and includes

the signal distribution unit 11, an acquisition unit 12

(image signal acquisition unit), a computation unit 13, and

a storage unit 14 as main configurations. A port P11

(operation information output terminal) can be connected to

the port P22 of the information processing device 21, and

outputs operation information in response to an instruction

from the computation unit 13. The computation unit 13

(operation information generation unit) is connected to the

information processing device 21 via the port P11

(operation information output terminal) and a cable

(reference sign R1). In this case, the information

processing device 21 uses an existing interface, which

eliminates the need for modification.

[0028] The signal distribution unit 11 receives an image

signal from the information processing device 21, and

outputs the image signal to the display device 22 and the

acquisition unit 12. The acquisition unit 12 acquires the

image signal from the signal distribution unit 11.

[0029] The storage unit 14 includes, for example, a

random access memory (RAM), a read only memory (ROM), and a

hard disk drive (HDD), and stores various pieces of information. The storage unit 14 includes an operation information table storage unit 14a that stores operation information in accordance with an image state of a GUI image. The operation information table storage unit 14a stores the correspondence relation between the content of the display screen configured by an image signal output by the information processing device 21 and an operation signal output from the keyboard 23 to the information processing device 21 by operation of the worker, for example. Furthermore, the storage unit 14 stores an engineering tool as software. The engineering tool has, for example, an engineering function of recording and setting operation of the worker and an operation reproducing function of reproducing the set operation.

[00301 The computation unit 13 includes, for example, a

central processing unit (CPU), and implements various

pieces of computation processing by executing an

application program. For example, the computation unit 13

recognizes the content of the display screen by performing

image processing based on the image signal acquired by the

acquisition unit 12. In that case, for example, the

computation unit 13 recognizes that a predetermined region

in the screen blinks in red on the screen of FIG. 3A.

Furthermore, in the image processing of the computation

unit 13, characters (including numerical value) are

recognized by using character recognition technology used

for optical character recognition (OCR), converted into

character information, and held.

[0031] Specifically, for example, the computation unit

13 functions as an image state recognition unit that

recognizes the image state of the GUI image acquired by the

acquisition unit 12 and acquires numerical information

expressed in the GUI image as a numerical value. For example, in the GUI screen in FIG. 3A, numerical information indicating a water level is displayed as an image in the water level display region A2. Then, the computation unit 13 acquires, as the image state recognition unit, numerical information represented as an image in the water level display region A2 as a numerical value. That is, for example, the computation unit 13 can recognize the image state indicated in the water level display region A2 by recognizing a water level as a numerical value. Furthermore, for example, the computation unit 13 can recognize the image state indicated in the water level display region A2 by recognizing an image related to a water level.

[0032] The computation unit 13 refers to the operation

information table storage unit 14a of the storage unit 14

in accordance with the recognized image state, and acquires

corresponding operation information. Then, the computation

unit 13 outputs the operation information to the

information processing device 21. For example, the

operation information table storage unit 14a stores an

image related to a water level (e.g., image including

characters "water level OVER" in water level display region

A2 in FIG. 3B) as an image state of the GUI image and the

corresponding operation information in association with

each other. This causes the computation unit 13 to acquire

operation information associated with the recognized image

related to a water level.

[0033] As a specific example, for example, a case in

which the content of the display screen relates to alarm

occurrence and an operation signal gives an instruction to

stop a device is conceivable. In addition, for example, a

case in which the content of the display screen relates to

a predetermined parameter value and the operation signal changes a setting value of a controller (e.g., indicates numerical value) is conceivable.

[0034] Furthermore, for example, the computation unit 13 functions as a notification unit that outputs, from the port P13, an image signal for a notification screen notification screen indicating that the worker should respond when a recognized image state is not stored in the operation information table storage unit 14a. As a specific example of a case where notification is given, for example, a case where the content of the display screen indicates the state of unexpected changes in water level in a tank for storing liquid in a plant is conceivable.

[0035] Furthermore, for example, in the content of the display screen, a predetermined region in the screen is colored in any of green, red, and yellow as state display related to the water level in the tank for storing liquid in the plant. In that case, for example, in a case of green, it is determined that there is no problem and no response is required to be made. In a case of red, it is determined that there is a problem, and a predetermined operation signal is required to be generated to be transmitted to the information processing device 21. In a case of yellow, notification is required to be given.

[0036] Next, overall processing of the operation system multiplexing device 1 according to the first embodiment will be described with reference to FIG. 5. FIG. 5 is a flowchart illustrating the overall processing of the operation system multiplexing device 1 according to the first embodiment.

[0037] In Step S1, the operation system multiplexing device 1 performs setting processing. FIG. 6 is a flowchart illustrating details of the processing in Step S1 in FIG. 5. In Step Sli, the computation unit 13 stores an operation execution image in the storage unit 14. That is, for this setting processing, the worker performs a series of operations, and captures an image (moving image) at the time (stores the image in the storage unit 14). For example, in the screen of FIG. 3B associated with a case where the water level of the tank excessively increases, the worker designates the water level display region A2, and the computation unit 13 captures an image including the characters of "water level OVER" in the water level display region A2 (stores the image in the storage unit 14).

[00381 Next, in Step S12, the computation unit 13 sets

an operation desired to be reproduced by using a recorded

image. Specifically, a moving image is stopped by a user

operation at the timing when an operation is desired to be

reproduced in the middle of the image, and an operation

signal associated with an image of a specific region of the

still image is set in accordance with the user operation.

For example, the computation unit 13 sets an operation

signal related to closing of the first solenoid valve B1 as

an operation signal associated with the screen of FIG. 3B.

[00391 The teaching operation is repeated, and the

operation content associated with the state of a specific

region image is tabulated and accumulated in the storage

unit 14 to generate the operation information table storage

unit 14a. Note that Step S1 is performed offline.

[0040] Returning to FIG. 5, after Step 51, in Step S2,

the operation system multiplexing device 1 performs

operation reproduction processing. FIG. 7 is a flowchart

illustrating details of processing in Step S2 in FIG. 5.

In Step S21, the acquisition unit 12 acquires an image

signal from the information processing device 21 via the

signal distribution unit 11.

[0041] Next, in Step S22, the computation unit 13 recognizes the content of the display screen based on the image signal acquired in Step S21.

[0042] Next, in Step S23, the computation unit 13 determines whether or not the content of the display screen recognized in Step S22 is in the correspondence relation stored in the storage unit 14. If Yes, the processing proceeds to Step S24. If No, the processing proceeds to Step S26.

[0043] Here, specific examples of Steps S22 and S23 will be described. For example, when an image in the water level display region A2 includes the characters of "water level OVER" as illustrated in the screen of FIG. 3B, the computation unit 13 makes a determination of Yes in Step S23 based on the image signal acquired in Step S21.

[0044] In Step S24, the computation unit 13 generates an operation signal associated with the content of the display screen based on the content of the display screen recognized in Step S22 and the correspondence relation stored in the operation information table storage unit 14a of the storage unit 14. In Step S25, the computation unit 13 outputs the operation signal to the information processing device 21. This enables the information processing device 21 to perform processing based on the input operation signal.

[0045] In Step S26, the computation unit 13 notifies the worker to respond. This causes the worker to know that the worker should respond, and the worker can appropriately respond. Note that Step S2 is performed online.

[0046] Returning to FIG. 5, after Step S2, in Step S3, the operation system multiplexing device 1 determines whether or not to perform resetting. If Yes, the processing returns to Step S1. If No, the processing returns to Step S2. Note that, when the user performs an operation of resetting start with the keyboard 23, a determination of Yes is made in Step S3.

[0047] As described above, according to the operation system multiplexing device 1 of the first embodiment, an operation system can be multiplexed including automation without modifying the plant monitoring device 2 by generating an operation signal associated with the content of the recognized display screen based on an image signal output by the information processing device 21 and outputting the operation signal to the information processing device 21.

[0048] That is, even when the plant monitoring device 2 is too old to be modified for automation, or when a user does not desire to modify the plant monitoring device 2 due to various circumstances, the plant monitoring device 2 can be automated, and labor saving and telework can be easily achieved.

[0049] In contrast, in such a case, in order to achieve labor saving and telework by a conventional technique, the plant monitoring device 2 needs to be replaced with the latest device to use techniques such as robotic process automation (RPA) and a remote desktop. This places a great burden in terms of cost and labor.

[0050] According to the present embodiment, only a small burden is placed in terms of cost and labor. That is, it is only required to produce the operation system multiplexing device 1 mounted with software (created by engineering tool) capable of generating an operation signal in accordance with a change in the content of the display screen and operate the operation system multiplexing device 1 by connecting the operation system multiplexing device 1 to the plant monitoring device 2 with a cable having an existing specification.

[0051] Then, since the operation system multiplexing device 1 can perform operation of the worker instead, labor can be saved. Labor saving and manpower saving are important in a site in an age of manpower shortage due to aging population with fewer children. It is meaningful that operations of conventional facilities can be automated.

[0052] (Second Embodiment) Next, a second embodiment will be described. Description and illustration of matters similar to the matters described so far will be appropriately omitted (the same applies to the third and subsequent embodiments). In the second embodiment, a case where work originally performed by a plurality of workers is performed by one worker will be described. FIG. 8 is an overall configuration diagram of a control system S according to the second embodiment.

[0053] In a plant P, an I/O device 10 connected to various sensors (not illustrated) and the like is connected to a controller C. An information processing device 21 is connected to the controller C. An operation system multiplexing device 1 is connected to a plant monitoring device 2 via a cable. A display device D with high resolution is connected to the operation system multiplexing device 1, and aggregates and displays display screens of four display devices 22. At that time, information for identifying each display screen is assigned to each display screen. Furthermore, a storage unit 14 (FIG. 2) of the operation system multiplexing device 1 stores correspondence relations related to a plurality of workers.

[0054] Furthermore, operations of a worker includes routine work and non-routine work (e.g., alarm processing that needs complicated determination). The operation system multiplexing device 1 automates the former work. The worker performs the latter work.

[00551 A worker M can concentrate on non-routine work by automating the routine work with the operation system multiplexing device 1. That is, the number of workers can be reduced.

[00561 As described above, according to the operation system multiplexing device 1 of the second embodiment, the number of workers can be reduced by automating the routine work with the operation system multiplexing device 1.

[0057] (Third Embodiment) Next, a third embodiment will be described. In the third embodiment, a case where work originally performed by a plurality of workers is performed by one worker and the worker performs telework will be described. FIG. 9 is an overall configuration diagram of a control system S according to a third embodiment. An operation system multiplexing device 1 is connected to a display device D via a cloud CL (e.g., cloud server).

[00581 A worker M can monitor a state by telework by looking at a display screen of the display device D in a facility H outside a plant P. When a non-routine work is needed, the operation system multiplexing device 1 notifies the worker of the fact with the display device D and the like. Then, the worker M responds.

[00591 As described above, according to the operation system multiplexing device 1 of the third embodiment, the worker can monitor a state and perform non-routine work at a remote place outside the plant P.

[00601 (Fourth Embodiment) Next, a fourth embodiment will be described. For a fail-safe purpose, an operation system multiplexing device

1 can be duplicated. FIG. 10 is an overall configuration

diagram of a control system S according to the fourth

embodiment. Note that, in FIG. 10, illustration of a

configuration not changed from FIG. 2 is appropriately

omitted (the same applies to FIG. 11 and subsequent

drawings). The control system S in FIG. 10 includes a

first operation system multiplexing device la and a second

operation system multiplexing device lb as a duplexed

configuration of the operation system multiplexing device

1.

[0061] States of connection of the first operation

system multiplexing device la and the second operation

system multiplexing device lb to the plant monitoring

device 2 and data flows are as follows. Data of RS-232C

from the first operation system multiplexing device la and

the second operation system multiplexing device lb is input

to the information processing device 21 of the plant

monitoring device 2 by a bifurcated cable (reference sign

R1).

[0062] Furthermore, image signals from the information

processing device 21 of the plant monitoring device 2 are

input to the first operation system multiplexing device la

and the second operation system multiplexing device lb by a

bifurcated cable (reference sign R2).

[0063] Furthermore, image signals from the first

operation system multiplexing device la and the second

operation system multiplexing device lb are input to the

display device 22 of the plant monitoring device 2 by a

bifurcated cable (reference sign R3).

[0064] Note that, since the first operation system

multiplexing device la and the second operation system

multiplexing device lb do not simultaneously output data

and image signals to the plant monitoring device 2, a problem such as simultaneous transmission of data and image signals does not occur even when the above-described bifurcated cable is used.

[00651 Then, when the first operation system

multiplexing device la is in an operating state and the

second operation system multiplexing device is in a standby

state, a periodic signal transmitting unit 16 of the first

operation system multiplexing device la transmits a

periodic signal (e.g., heartbeat signal) to the second

operation system multiplexing device lb via a twisted pair

cable R4 that couples local area network (LAN) ports with

each other. A monitoring unit 17 of the second operation

system multiplexing device lb switches the state of the

second operation system multiplexing device lb from the

standby state to the operating state when the monitoring

unit 17 has not received the periodic signal for a

predetermined period of time or more since the previous

reception time.

[00661 In this way, according to the operation system

multiplexing device 1 of the fourth embodiment, the

operation system multiplexing device 1 is duplexed, so

that, even when the first operation system multiplexing

device la fails, processing can be continued by switching

the state of the second operation system multiplexing

device lb from the standby state to the operating state.

[0067] (Fifth Embodiment)

Next, a fifth embodiment will be described. FIG. 11

is an overall configuration diagram of a control system S

according to the fifth embodiment. A computation unit 13

of an operation system multiplexing device 1 is connected

to an external device 102 (e.g., mechanical switch (e.g.,

emergency button), graphic panel, emergency light, and

speaker of another system) connected to an information processing device 21 via an input/output card 101. The input/output card 101 is mounted in an extension slot 18 (e.g., peripheral component interconnect (PCI) express slot) of the operation system multiplexing device 1 and includes a contact output terminal that simulates on/off of a switch. The computation unit 13 performs input/output of information with the external device 102.

[00681 For example, when the external device 102 is an emergency button having a mechanical switch, the computation unit 13 recognizes that the emergency button has been pressed by receiving a contact signal via the input/output card 101. Furthermore, for example, when the external device 102 is a speaker that outputs a warning sound by input of a contact signal, the computation unit 13 can cause the speaker to output the warning sound by transmitting the contact signal to the speaker via the input/output card 101.

[00691 In this way, according to the operation system multiplexing device 1 of the fourth embodiment, the existing external device 102 can be effectively used.

[0070] (Sixth Embodiment) Next, a sixth embodiment will be described. In an operation system multiplexing device 1 in FIG. 2, a computation unit 13 functions as a storage control unit that causes a storage unit 14 (semiconductor storage device) to store data including a log related to an information processing device 21. Here, the data including a log includes, for example, an operation log and trend data, may include the content of a display screen recognized by an image signal acquired by an acquisition unit 12 or by performing image processing based on the acquired image signal, and includes, for example, data indicating that a predetermined region in a screen in the screen of FIG. 3A blinks in red and character information and numerical information acquired by the computation unit 13 by using OCR.

[0071] The old information processing device 21 has a small storage capacity so that only data for three days can be stored. The data needs to be transferred to another storage medium every three days. In contrast, according to the operation system multiplexing device 1 of the sixth embodiment, if data for one month can be stored by the computation unit 13 causing the storage unit 14 to store the data by using the storage unit 14 having large storage capacity, the frequency of such data migration work can be beneficially reduced.

[0072] (Seventh Embodiment) Next, a seventh embodiment will be described. FIG. 12 is an overall configuration diagram of a control system S according to the seventh embodiment. An operation system multiplexing device 1 includes a permission information table storage unit 14b (part of storage unit 14) and an ID reader 19. The permission information table storage unit 14b stores permission information that permits use of a plant monitoring device 2. The ID reader reads a worker ID. The ID reader 19 is, for example, a card reader that reads information of a security card possessed by a worker. The ID reader 19 is connected to the operation system multiplexing device 1 via a universal serial bus (USB) port P14.

[0073] Then, for example, the computation unit 13 refers to the permission information table storage unit 14b, and, when there is permission information associated with the worker ID read by the ID reader 19, functions as a permission unit that permits use of the plant monitoring device 2.

[0074] In this way, according to the operation system multiplexing device 1 of the seventh embodiment, security in the control system S can be enhanced.

[0075] (Eighth Embodiment) Next, an eighth embodiment will be described. FIG. 13 is an overall configuration diagram of a control system S according to the eighth embodiment. FIG. 14 illustrates an example of a notification destination information table according to the eighth embodiment.

[0076] The storage unit 14 includes a notification destination information table storage unit 14c that stores a notification destination information table (FIG. 14) in which the content of a display screen and notification destination information are associated with each other. As illustrated in FIG. 14, in the notification destination information table, information indicating a notification destination A is associated with a screen indicating an abnormality A, information indicating a notification destination B is associated with a screen indicating an abnormality B, and information indicating a notification destination C is associated with a screen indicating an abnormality C. When an image matching a specific image corresponding to not only an abnormal state but a state of a control target device is input, notification processing for the content in accordance with the state can be performed. Assumed notification processing includes e-mail transmission from a LAN port, activation of a power output device for driving alarm activation of an alarm device, and the like.

[0077] For example, when the content of the recognized display screen is in the notification destination information table stored in the notification destination information table storage unit 14c, the computation unit 13 of the operation system multiplexing device 1 outputs the content of the display screen to a notification destination associated with the display screen. In the embodiment, the notification destination is a display device 3.

[0078] The display device 3 includes a reception unit 31 and a display unit 32. The reception unit 31 receives information transmitted from the computation unit 13 of the operation system multiplexing device 1, and outputs the information to the display unit 32. The display unit 32 displays the information from the reception unit 31. The display device 3 may be any device such as a tablet terminal and a PC as long as the device can display information transmitted from the computation unit 13. Examples of a screen to be displayed on the display device 3 of a notification destination in a case where the recognized display screen indicates the abnormality A include a screen in FIG. 3B.

[0079] In this way, according to the control system S of the eighth embodiment, a function of notifying an observer and the like of an abnormality of a conventional facility can be safely and easily added by externally attaching the operation system multiplexing device 1 to the existing plant monitoring device 2.

[0080] (Ninth Embodiment) Next, a ninth embodiment will be described. FIG. 15 is an overall configuration diagram of a control system S according to the ninth embodiment. FIG. 16 illustrates an example of an authority information table according to the ninth embodiment.

[0081] The storage unit 14 includes an authority information table storage unit 14d that stores a plurality of pieces of data in which operator identification information and authority information are associated with each other. As illustrated in FIG. 16, in this data, an operator A is associated with authority of confirmation processing at the time of abnormality and restoration processing at the time of abnormality, and an operator B is associated with authority of confirmation processing at the time of abnormality, restoration processing at the time of abnormality, and shutdown.

[0082] An operator device 4 includes a reception unit 41, a display unit 42, an external input unit 43, and an information output unit 44. The external input unit 43 receives input of operator identification information. The external input unit 43 is only required to be capable of inputting the operator identification information, and includes, but not limited to, a keyboard, a mouse, a card reader, and the like. The operator identification information includes a login ID and ID information associated with a card read by a reader. The information output unit 44 outputs operation information input by the external input unit 43 to a computation unit 13 of an operation system multiplexing device 1.

[0083] The computation unit 13 of the operation system multiplexing device 1 acquires authority information from the authority information table storage unit 14d based on the operator identification information received from the information output unit 44, and outputs the acquired authority information to the operator device 4. Furthermore, the computation unit 13 outputs the operation information received from the information output unit 44 to the information processing device 21.

[0084] The reception unit 41 transmits display screen information to the display unit 42 based on the received authority information. For example, in the example of FIG. 16, when the operator A has logged in, a button, a menu, and the like are displayed on the display unit 42 so that the operator A can perform the confirmation processing at the time of abnormality and the restoration processing at the time of abnormality. Furthermore, when the operator B has logged in, a button, a menu, and the like are displayed on the display unit 42 so that the operator B can further perform shutdown in addition to the confirmation processing at the time of abnormality and the restoration processing at the time of abnormality.

[00851 In this way, according to the control system S of the ninth embodiment, the content that can be operated by the operator can be changed in accordance with user authority setting by externally attaching the operation system multiplexing device 1 to the existing plant monitoring device 2.

[00861 Note that the ninth embodiment can be combined with the eighth embodiment. When the operator receives a notification of an abnormality and the operator logs in to the operator device 4, for example, authority to respond is limited, and the operator can respond to the abnormality within the scope of the authority. This prevents processing from being performed beyond the authority, and allows safe operation. In particular, when it is desired to divide the authority between an administrator and other general responders, such an access limiting function can be easily added by externally attaching the operation system multiplexing device 1 to the existing plant monitoring device 2.

[0087] Note that a program executed by the operation system multiplexing device 1 of each of the above-described embodiments is provided by being stored in a computer readable storage medium such as a CD-ROM, a flexible disk (FD), a CD-R, and a digital versatile disk (DVD) in a file in an installable format or an executable format.

[00881 Furthermore, the program may be stored on a computer connected to a network such as the Internet, and provided by being downloaded via the network. Furthermore, the program may be provided or distributed via a network such as the Internet. Furthermore, the program may be provided by being preliminarily incorporated in a ROM or the like.

[00891 The program executed by the operation system multiplexing device 1 of each embodiment has a module configuration including each of the above-described units (acquisition unit 12 and computation unit 13). As actual hardware, each of the above-described units is loaded on a main storage device by a CPU (processor) reading the program from the storage medium and executing the program, and generated on the main storage device.

[00901 Although some embodiments of the present invention have been described, these embodiments have been presented as examples, and are not intended to limit the scope of the invention. These novel embodiments can be performed in various other forms, and various omissions, substitutions, and changes can be made without departing from the gist of the invention. These embodiments and variations thereof are included in the scope and gist of the invention, and included in the invention set forth in the claims and the equivalent scope thereof.

[0091] For example, although, in the above-described embodiments, an example of a case where an operation system multiplexing device is applied to a control system of an industrial plant has been described, this is not a limitation. The operation system multiplexing device of the present invention can be applied to all target devices having correspondence relation between the content of a display screen and the content of operation input from a worker who has looked at the content of the display screen.

[0092] Furthermore, although the keyboard 23 has been described as an example of an input device, the input device is not limited to the keyboard 23. Other input devices such as a mouse and a touch panel may be used.

[0093] Furthermore, the operation system multiplexing device 1 may acquire information on operation content from a higher-level device (cloud controller) to transmit the information to the information processing device 21. Furthermore, the operation system multiplexing device 1 may accumulate and analyze operational data, and transmit a parameter adjusted based on the analysis result to the information processing device 21.

Claims

CLAIMS 1. An operation system multiplexing device comprising: an image signal acquisition unit configured to receive a graphical user interface (GUI) image combined with state information on a control target device, the image signal acquisition unit being able to be connected to a GUI output unit of an information processing device, and the information processing device including: the GUI output unit that outputs the GUI image; a GUI operating unit that receives operation input to the GUI image; and a communication terminal compatible with an electronic industries alliance (EIA)-232 standard; an image state recognition unit configured to convert into a numerical value numerical information of a control element of the control target device to acquire the numerical value in association with the control element, the numerical information being expressed in the GUI image acquired by the image signalacquisition unit; and a state information output terminal configured to output the numerical value in accordance with a TCP/IP protocol.
2. An operation system multiplexing device comprising: an image signal acquisition unit configured to receive a GUI image combined with state information on a control target device, the image signal acquisition unit being able to be connected to a GUI output unit of an information processing device, and the information processing device including: the GUI output unit that outputs the GUI image; a GUI operating unit that receives operation input to the GUI image; and a communication terminal compatible with an EIA-232 standard; an operation information table storage unit configured to store operation information in accordance with an image state of the GUI image; an image state recognition unit configured to recognize the image state of the GUI image acquired by the image signal acquisition unit, and acquire numerical information expressed in the GUI image as a numerical value; an operation information generation unit configured to refer to the operation information table storage unit in accordance with the image state recognized by the image state recognition unit, and acquire corresponding operation information; an operation information output terminal configured to output the operation information, the operation information output terminal being able to be connected to the communication terminal; and a state information output terminal configured to output the numerical value in accordance with a TCP/IP protocol.
3. The operation system multiplexing device according to claim 2, further comprising a notification unit configured to output from the state information output terminal an image signal for a notification screen indicating that a worker is required to respond when the operation information table storage unit does not store the image state recognized by the image state recognition unit.
4. The operation system multiplexing device according to claim 2, further comprising a first operation system multiplexing device and a second operation system multiplexing device as a duplexed configuration of the operation system multiplexing device, wherein each of the first operation system multiplexing device and the second operation system multiplexing device is connected to the information processing device, and the second operation system multiplexing device includes a monitoring unit configured to switch, in a case where the first operation system multiplexing device is in an operating state and the second operation system multiplexing device is in a standby state, a state of the second operation system multiplexing device from the standby state to the operating state when a periodic signal to be transmitted by the first operation system multiplexing device has not been received for a predetermined period of time or more since previous reception time.
5. The operation system multiplexing device according to

claim 2, wherein the unit is connected to an external

device connected to the information processing device via

an input/output card and performs input/output of

information with the external device, the input/output card

being mounted in an extension slot of the operation system

multiplexing device andincluding a contact output terminal

that simulates on/off of a switch.
6. The operation system multiplexing device according to

claim 2, further comprising a storage control unit

configured to cause a semiconductor storage device to store

data including a log related to the information processing

device.
7. The operation system multiplexing device according to

claim 2, further comprising:

a permission information table storage unit configured to store permission information permitting use of the information processing device; an ID reader configured to read a worker ID; and a permission unit configured to refer to the permission information table storage unit and, when there is permission information corresponding to the worker ID read by the ID reader, to permit use of the information processing device.