JP2011139395A - Work recording device, work recording system, work recording method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a work recording system capable of concretely recording a work content in an image pickup range. <P>SOLUTION: A work recording system 1 includes an image pickup device 20, a work detection device 30, and a work recording device 50. The image pickup device 20 includes an image pickup means installed at a work job site and an image data transmission means for transmitting a static image picked up at each fixed time by the image pickup means to the work recording device 50. The work detection device 30 is constituted to detect an input operation by an operator at the work job site. The work recording device 50 includes an association means for making the static images picked up by the image pickup device 20 associated with the detection timing of the input operation based on image pickup timing when each of those static images has been picked up by the image pickup device 20 and detection timing when the input operation has been detected by the work detection device 30, and a display means for displaying the static image picked up by the image pickup device 20 according to the detection timing associated with the static image by the association means. <P>COPYRIGHT: (C)2011,JPO&INPIT

Description

  The present invention relates to a work recording system.

  For example, Patent Document 1 discloses at least one web camera, at least one sensor for detecting a sensor reaction within an imaging range of the web camera, and a sensor reaction receiver that stores the presence or absence of a sensor reaction by the sensor. And temporarily store the images captured by the webcam, check for sensor responses stored in the sensor response receiver regularly or irregularly, and temporarily store them when there is a sensor response. A remote monitoring system is disclosed that includes a base management device that extracts a single image and / or continuous image from existing images and transmits the extracted single image and / or continuous image to an image storage server via a network.

JP 2004-64276 A

  The present invention provides a work recording system capable of specifically recording work contents in an imaging range.

  A work recording system according to the present invention is a work recording system including an imaging device, a work detection device, and a work recording device. The imaging device includes an imaging means installed at a work site, and the imaging means. Image data transmitting means for transmitting still images captured at regular intervals to the work recording device, the work detection device detecting an input operation by an operator at the work site, and the work recording device Is based on the imaging timing when each still image is captured by the imaging device and the detection timing when the input operation is detected by the work detection device. Associating means for associating with the detection timing, and associating the still image captured by the imaging device with the still image by the associating means. And a display means for displaying in accordance with the detection timing is.

Preferably, the work detection device transmits input information input by an input operation by an operator to the work recording device, and in the work recording device, the association unit inputs each captured still image as an input. The display means associates the still image captured by the imaging device with the operation detection timing and the input information, the input operation identification information at the detection timing, and the input information associated with the still image by the association means. Display in association with.
Preferably, the work recording apparatus further includes an extracting unit that extracts a still image associated with a detection timing of a predetermined input operation. In the work recording apparatus, the display unit is extracted by the extracting unit. The list of still images is displayed in a manner different from the list of still images that have not been extracted by the extraction unit, according to the detection timing associated with the still image by the association unit.
Preferably, the apparatus further includes a work time calculating unit that calculates a work time based on a still image selected by the user from the list of still images displayed by the display unit.
Preferably, the work recording device is configured based on a still image captured by the imaging device, and input operation identification information and input information associated with the still image by the association unit at a detection timing. It further has manual generation means for generating.

  In addition, the work recording apparatus according to the present invention is captured by the imaging device based on the imaging timing at which each still image is captured by the imaging device and the detection timing at which the input operation is detected by the work detection device. Association means for associating each still image with the detection timing of the input operation; and display means for displaying the still image captured by the imaging device according to the detection timing associated with the still image by the association means.

  Further, the program according to the present invention is based on the imaging timing when each still image is captured by the imaging device and the detection timing when the input operation is detected by the work detection device, and the still image captured by the imaging device. The computer realizes an association function that associates each with the detection timing of the input operation and a display function that displays the still image captured by the imaging device according to the detection timing associated with the still image by the association function.

  The work recording method according to the present invention is a work recording method using an imaging device, a work detection device, and a work recording device, wherein the imaging device images a work site at regular intervals. And an image data transmission step in which the imaging device transmits the still image captured in the imaging step to the work recording device, and the work detection device detects an input operation by an operator at the work site. The work recording device is imaged by the imaging device based on an imaging timing at which each still image is captured by the imaging device and a detection timing at which an input operation is detected by the work detection device. An associating step for associating each still image with a detection timing of an input operation; The still image, and a display step of displaying in accordance with the detection timing associated with the still image by the associating step.

  According to the present invention, the work content in the imaging range can be specifically recorded.

1 is a diagram illustrating an overall configuration of a work recording system 1. FIG. 3 is a diagram illustrating functional configurations of an imaging program 100, a work detection program 200, and a work recording program 300. FIG. It is a figure which illustrates work record DB306. 5 is a diagram illustrating a work confirmation screen 400. FIG. It is a figure which illustrates the function structure of the imaging program 100 in the modification 1, the work detection program 200, and the work recording program 500. It is a figure which illustrates the function structure of the imaging program 100 in the modification 2, the work detection program 200, and the work recording program 600. 3 is a diagram illustrating a manual document 700. FIG. 10 is a diagram illustrating a functional configuration of an imaging program 100, a work detection program 200, and a work recording program 800 in Modification 3. FIG. 6 is a diagram illustrating a work image list screen 900. FIG.

FIG. 1 is a diagram illustrating the overall configuration of the work recording system 1.
As illustrated in FIG. 1, the work recording system 1 includes an imaging device 20, a work detection device 30, and a work recording device 50. The imaging device 20 and the work detection device 30 are connected to the work recording device 50 via the communication network 40. In addition, the work detection device 30 is connected from the input device 10 by wireless communication or wired communication. In the present embodiment, the work detection device 30 is connected from the input device 10 by wireless communication using infrared rays or radio waves.
The communication network 40 is not particularly limited, and is configured by, for example, the Internet, a mobile phone communication network, or a LAN (Local Area Network). In this figure, communication devices (such as a modem) for connecting to the communication network 40 are omitted.

The input device 10 receives data input. For example, the input device 10 is an electronic caliper, a barcode reader, or a computer. The input device 10 transmits the input data (hereinafter referred to as “input data”) to the work detection device 30.
In this embodiment, the input device 10 is an electronic caliper, and transmits data measured and input to the work detection device 30.

The imaging device 20 captures a still image in a predetermined imaging range from an arbitrary angle and distance. The imaging device 20 includes at least data (hereinafter referred to as “image data”) representing still images captured at regular intervals and the time (hereinafter referred to as “imaging time”) when the still images were captured. To the work recording device 50.
Note that a plurality of imaging devices 20 may be provided for one imaging range.

The work detection device 30 detects the start or end of an input operation by an operator in the imaging range. The means for the work detection device 30 to detect the start or end of the input operation in the imaging range is not particularly limited. For example, the work detection device 30 may detect by receiving a notification notifying the start or end of the input operation from the input device 10, and whether or not there is a worker at a specific place using a human sensor or the like. Thus, the start or end of the input operation may be detected, or the start or end of the input operation is detected based on whether or not the input device 10 is placed at a specific location using a weight sensor or the like. May be. The work detection device 30 includes at least data indicating the start or end flag of the detected input operation and the time (hereinafter referred to as “input detection time”) when the start or end of the input operation is detected. Input detection data ”) is transmitted to the work recording device 50.
Further, the work detection device 30 receives input data from the input device 10. The work detection device 30 uses the work recording device to represent the received input data and data (hereinafter referred to as “input reception data”) indicating the time when the input data was received (hereinafter referred to as “input reception time”). 50.
In this example, a mode in which the input device 10 and the work detection device 30 are separate devices will be described as a specific example, but the input device 10 itself may have a function of the work detection device.

  The work recording device 50 receives image data from the imaging device 20 and receives input detection data and input reception data from the work detection device 30. The work recording device 50 associates the input detection data and the input reception data received from the work detection device 30 with the image data received from the imaging device 20 and stores them in the storage medium. The work recording apparatus 50 displays the image data stored in the storage medium, the input detection data, and the input reception data in association with each other.

  According to the configuration described above, the work recording system 1 does not require the worker in the imaging range to perform a special work for the work recording, and can display the still image of the worker in the imaging range at regular intervals. Recording can be performed on the recording device 50. Further, the still image recorded in the work recording device 50 is associated with the flag of the start or end of the input operation by the worker or the data input by the worker when the still image is captured.

FIG. 2 is a diagram illustrating functional configurations of the imaging program 100, the work detection program 200, and the work recording program 300.
As illustrated in FIG. 2, the imaging program 100 includes an imaging unit 102 and an image data transmission unit 104. In addition, the work detection program 200 includes an input data receiving unit 202, an input operation detection unit 204, and an input information transmission unit 206. The work recording program 300 includes a data receiving unit 302, an associating unit 304, and a display unit 308. A work record database (work record DB) 306 is stored in a storage medium of the work recording device 50.
Note that the imaging program 100 is installed in the imaging apparatus 20 and is executed using hardware resources (a CPU, a storage medium, and the like) of the imaging apparatus 20. The work detection program 200 is installed in the work detection device 30 and is executed using the hardware resources of the work detection device 30. The work recording program 300 is installed in the work recording apparatus 50 and is executed using the hardware resources of the work recording apparatus 50.

  The imaging unit 102 captures a still image in a predetermined imaging range at regular time intervals. In addition, the fixed time interval which the imaging part 102 images should just be set arbitrarily by the user.

The image data transmission unit 104 transmits image data representing the still image captured by the imaging unit 102 and the time (imaging time) when the still image was captured to the data reception unit 302 in the work recording program 300.
In this embodiment, the image data transmission unit 104 specifies a still image captured by the imaging unit 102, a time (imaging time) when the still image was captured, and an imaging range captured by the imaging unit 102. Image data representing the imaging range ID and the imaging device ID that identifies the imaging device 20 in which the imaging program 100 is executed is transmitted to the data receiving unit 302 in the work recording program 300.

The input data receiving unit 202 receives input data from the input device 10.
In this embodiment, input data is received from the input device 10 by wireless communication using radio waves.

The input operation detection unit 204 detects the start or end of an input operation by an operator in the imaging range.
In this embodiment, the input operation detection unit 204 receives a notification notifying the start or end of the input operation from the input device 10 by wireless communication using radio waves, and detects the start or end of the input operation based on the received notification. To do. In addition, the timing of the notification informing the start or end of the input operation is not particularly limited. For example, the input device 10 may notify the input operation detection unit 204 of the start or end of the input operation in conjunction with power ON / OFF of the input device 10.

The input information transmitting unit 206 receives the input data received by the input data receiving unit 202 and the input reception data representing the time (input reception time) at which the input data receiving unit 202 received the input data. To the data receiving unit 302.
In this embodiment, the input information transmitting unit 206 receives the input data received by the input data receiving unit 202, the time when the input data receiving unit 202 received the input data (input reception time), and the input data. The input reception data representing the imaging range ID for specifying the imaging range in which the input device 10 that has transmitted is present is transmitted to the data receiving unit 302 in the work recording program 300.
The input information transmission unit 206 also includes input detection data indicating a start or end flag of the input operation detected by the input operation detection unit 204 and a time (input detection time) when the start or end of the input operation is detected. Is transmitted to the data receiving unit 302 in the business record program 300.
In the present embodiment, the input information transmission unit 206 includes a flag indicating the start or end of the input operation detected by the input operation detection unit 204, a time when the start or end of the input operation is detected (input detection time), Then, input detection data representing the imaging range ID for specifying the imaging range in which the start or end of the input operation is detected is transmitted to the data receiving unit 302 in the business record program 300.

  The data receiving unit 302 receives image data from the imaging device 20 and receives input detection data and input reception data from the work detection device 30.

The associating unit 304 associates the input detection data and the input reception data received by the data receiving unit 302 with the image data received by the data receiving unit 302 and stores them in the storage medium. At this time, the associating unit 304 obtains the image data based on the imaging time (imaging timing) represented by the image data, the input detection time (detection timing) represented by the input detection data, and the input reception time represented by the input reception data. The represented still image is associated with the input data represented by the input reception data and the input operation start or end flag represented by the input detection data.
In this embodiment, the associating unit 304 associates the imaging range ID represented by the image data received by the data receiving unit 302, the imaging device ID, the imaging time, and the still image with each other and stores them in the work record DB 306. At this time, the still images are arranged in time series based on the imaging time.
In addition, the associating unit 304 associates and receives the flag of the start or end of the input operation represented by the input detection data received by the data receiving unit 302 with the imaging range ID represented by the received input detection data. It is stored in the work record DB 306 in association with a still image associated with an imaging time that matches the input detection time represented by the input detection data.
The associating unit 304 associates the input data represented by the input received data received by the data receiving unit 302 with the imaging range ID represented by the received input received data, and also represents the received input received data. The data is stored in the work record DB 306 in association with a still image associated with an imaging time within a predetermined range from the input reception time. Note that “within a predetermined range from the input reception time” represents the time before and after the input reception time.

The display unit 308 associates and displays image data stored in the storage medium, input detection data, and input reception data.
In this embodiment, the display unit 308 displays the image data stored in the work record DB 306 by the association unit 304, the input detection data, and the input reception data based on the data association in the work record DB 306. (Described later with reference to FIG. 4).

FIG. 3 is a diagram illustrating the work record DB 306.
As illustrated in FIG. 3, the work record DB 306 includes an imaging range ID, an imaging device ID, an imaging time, a still image, a detection timing, and input data as data items. Note that the data items of the work record DB 306 are not limited to these, but at least what represents the still image obtained by imaging the imaging range, and what is the input operation in the imaging range when the still image is captured. And data that is input to the input device 10 when this still image is captured.

  The imaging range ID is information for specifying the imaging range captured by the imaging device 20. The imaging range ID is expressed by combining numbers, symbols, characters, and the like.

  The imaging device ID is information for specifying the imaging device 20. The imaging device ID is represented by combining numbers, symbols, characters, and the like.

  The imaging time represents the time when a still image is captured by the imaging device 20.

  The still image represents a storage location (storage path) of the still image in the storage medium.

  The detection timing represents the start or end of the input operation. In the work record DB 306, the input operation is started from the imaging time associated with the input operation start flag (AS and BS shown in the figure), and the input operation end flag (AE and BE shown in the figure). The input operation ends at the imaging time associated with. In addition, the input operation start or end flag stored at the detection timing represents what input operation has been performed (type of input operation).

  The input data represents a storage location (storage path) of the input data in the storage medium. A plurality of input data may be associated with one still image.

FIG. 4 is a diagram illustrating a work confirmation screen 400.
As illustrated in FIG. 4, the work confirmation screen 400 continuously displays a selection area 410 for selecting an imaging range, a selection area 420 for selecting an imaging device, a display area 430 for displaying an imaging time, and a still image. The display area 440 includes a display area 450 that displays input operations, a display area 460 that displays input data, and an operation area 470 that operates the display area 440.

  First, the user selects an imaging range (work place range) of the work site. Next, the user selects an imaging device that captured the selected imaging range. Then, in the work area DB 306, still images associated with the selected imaging range and imaging device are continuously displayed in the display area 440 as the imaging time elapses. In the display area 430, the imaging time associated with the still image displayed in the display area 440 in the work record DB 306 is displayed. The display area 450 displays the type of input operation indicated by the input operation start or end flag associated with the still image displayed in the display area 440 in the work record DB 306. In the display area 460, input data associated with the still image displayed in the display area 440 in the work record DB 306 is displayed. In addition, by operating the operation area 470, the user can pause, fast forward, or fast reverse the still images continuously displayed in the display area 440.

According to the configuration described above, the work recording system 1 not only records a still image for every fixed time when the imaging range is imaged, but also describes the contents of the input operation performed on the still image in the imaging range (input operation By associating the type and input data), the work content in the imaging range can be specifically recorded. In addition, the work recording system 1 shows the work contents (the still images at regular time intervals and the contents of the input operation associated with the still images) in the recorded imaging range to the user in the imaging range. You can learn how to work.
For example, when the input device 10 is an electronic caliper and the imaging range is an inspection site using an electronic caliper, the user can learn an inspection method using the electronic caliper using the work recording system 1.
Further, for example, when the input device 10 is a computer and the imaging range is an office provided with a computer (preferably, the imaging range includes a screen displayed on the computer display), the user can record the work. The system 1 can be used to learn office work methods using a computer.

[Modification 1]
FIG. 5 is a diagram illustrating functional configurations of the imaging program 100, the work detection program 200, and the work recording program 500 in the first modification.
As illustrated in FIG. 5, the work recording program 500 has a configuration in which an extraction unit 510 is added to the work recording program 300 in FIG. 2.

The extraction unit 510 extracts a still image at a time when a predetermined input operation is performed from the storage medium. The predetermined input operation may be arbitrarily designated by the user.
In the present modification, the extraction unit 510 uses the work record DB 306 to end the input operation representing the predetermined input operation type based on the imaging time associated with the input operation start flag representing the predetermined input operation type. A still image associated with an imaging time between the imaging time associated with the flag is extracted. Then, the extraction unit 510 displays the extracted still image in association with the type of input operation and input data via the display unit 308.

  According to the configuration described above, the work recording system 1 can display only a still image representing that a predetermined input operation has been performed to the user in association with the type of input operation and input data. .

[Modification 2]
FIG. 6 is a diagram illustrating a functional configuration of the imaging program 100, the work detection program 200, and the work recording program 600 in the second modification.
As illustrated in FIG. 6, the work recording program 600 has a configuration in which a manual generation unit 612 is added to the work recording program 500 of FIG. 5.

The manual generation unit 612 generates a manual based on the image data stored in the storage medium, the input detection data, and the input reception data.
In the present modification, the manual generation unit 612 extracts, from the work record DB 306, a still image associated with input data and an input operation start or end flag indicating the type of input operation in the still image, and extracts As shown in FIG. 7, the still image, the type of the input operation indicated by the extracted input operation start or end flag, and the input data associated with the extracted still image are embedded in a standard sentence of the manual. A manual document 700 is generated. Then, the manual generation unit 612 outputs the generated manual document in a known document format such as PDF (Portable Document Format).

FIG. 7 is a diagram illustrating a manual document 700.
As illustrated in FIG. 7, the manual document 700 includes a section 710 in which the type of input operation represented by the detection timing is embedded, FIG. 720 in which a still image is embedded, and the type and input data of the input operation represented by the detection timing. Is composed of a sentence 730 in which is embedded and a fixed sentence 740.

  According to the configuration described above, the work recording system 1 can automatically generate a manual based on the work content in the recorded imaging range.

[Modification 3]
FIG. 8 is a diagram illustrating a functional configuration of the imaging program 100, the work detection program 200, and the work recording program 800 in the third modification.
As illustrated in FIG. 8, the work recording program 800 has a configuration in which a work time calculation unit 814 is added to the work recording program 600 of FIG. 6.

The work time calculation unit 814 calculates the work time based on the image data stored in the storage medium.
In the present modification, the work time calculation unit 814 calculates a difference in imaging time associated with any two still images selected from the work record DB 306, and outputs the calculated difference in imaging time as the work time. . Then, the work time calculation unit 814 displays the output work time on the work image list screen 800 (described later with reference to FIG. 9) via the display unit 308.

FIG. 9 is a diagram illustrating a work image list screen 900.
As illustrated in FIG. 9, the work image list screen 900 includes a list of still images 910, a list of still images 920 highlighted in a different manner from the still image 910, selected still images 930 and 940, It comprises a display area 950 for displaying the work time. Note that the still image 920 is associated with an imaging time between the imaging time associated with the input operation start flag and the imaging operation time associated with the input operation end flag in the work record DB 308. . That is, the list of still images 920 indicates that a certain input operation has been performed here.

  The user selects any two still images 910 or 920 from the list of still images 910 and 920. Then, the work time calculation unit 814 calculates the time (work time) required for the work represented from the selected still image 930 to the still image 940 and displays the calculated work time in the display area 950.

  According to the configuration described above, the work recording system 1 can calculate the work time based on the work content in the recorded imaging range.

[Modification 4]
In the above embodiment, the time zone in which the predetermined input operation is performed is represented by the start and end flags of the input operation, but this may be represented by an arbitrary reference time. That is, it may indicate that a predetermined input operation has been performed within a certain time from an arbitrary reference time.
In this case, the input detection data represents at least the type of input operation and the reference operation reference time. The associating unit 304 in the work recording program 300 indicates the type of the input operation represented by the input detection data received by the data receiving unit 302 from the input operation reference time represented by the input detection data similarly received by the data receiving unit 302. Associate with a still image captured within a certain time.

[Other variations]
In the above embodiment, the work recording system 1 includes the imaging device 20 and the work detection device 30 separately. However, these functions are integrated into the functions of the imaging device 20 and the work detection device 30. It may be replaced with a device having the same.

DESCRIPTION OF SYMBOLS 1 Work recording system 10 Input device 20 Imaging device 30 Work detection device 40 Communication network 50 Work recording device 100 Imaging program 102 Imaging part 104 Image data transmission part 200 Work detection program 202 Input data reception part 204 Input operation detection part 206 Input information transmission Unit 300 work record program 302 data receiving unit 304 association unit 306 work record DB
308 Display unit 400 Work confirmation screen 410 Imaging range selection area 420 Imaging apparatus selection area 430 Imaging time display area 440 Still image display area 450 Input operation display area 460 Input data display area 500 Work recording program (modified example) 1)
510 Extraction Unit 600 Work Record Program (Modification 2)
612 Manual Generation Unit 700 Manual Document 800 Work Record Program (Modification 3)
814 Work time calculation unit 900 Work image list screen

Claims (8)

A work recording system including an imaging device, a work detection device, and a work recording device,
The imaging device
Imaging means installed at the work site;
Image data transmitting means for transmitting still images captured by the imaging means at regular intervals to the work recording device;
The work detection device detects an input operation by an operator at the work site,
The work recording device includes:
Based on the imaging timing at which each still image is captured by the imaging device and the detection timing at which an input operation is detected by the work detection device, each of the still images captured by the imaging device is detected as an input operation. An association means to associate with the
A work recording system, comprising: a display unit configured to display a still image captured by the imaging device according to a detection timing associated with the still image by the association unit. The work detection device transmits input information input by an input operation by an operator to the work recording device,
In the work recording apparatus,
The association means associates each captured still image with the input operation detection timing and input information,
The display unit displays the still image captured by the imaging apparatus in association with the input operation identification information at the detection timing and the input information associated with the still image by the association unit. Work recording system. The work recording device includes:
Extraction means for extracting a still image associated with a predetermined input operation detection timing;
In the work recording apparatus,
The display unit differs from the list of still images extracted by the extracting unit according to the detection timing associated with the still image by the associating unit. The work recording system according to claim 1, wherein the work recording system is displayed in a form. The work recording system according to claim 3, further comprising: a work time calculation unit that calculates a work time based on a still image selected by a user from the list of still images displayed by the display unit. The work recording device includes:
Manual generation means for generating a manual based on the still image captured by the imaging device and the identification information and input information of the input operation at the detection timing associated with the still image by the association means. Item 3. The work recording system according to Item 2. Based on the imaging timing at which each still image is captured by the imaging device and the detection timing at which the input operation is detected by the work detection device, each still image captured by the imaging device is associated with the detection timing of the input operation. An association means;
A work recording apparatus comprising: a display unit configured to display a still image captured by the imaging device in accordance with a detection timing associated with the still image by the association unit. Based on the imaging timing at which each still image is captured by the imaging device and the detection timing at which the input operation is detected by the work detection device, each still image captured by the imaging device is associated with the detection timing of the input operation. An association function;
A program for causing a computer to realize a display function for displaying a still image captured by an imaging device according to a detection timing associated with the still image by the association function. A work recording method using an imaging device, a work detection device, and a work recording device,
An imaging step in which the imaging device images a work site at regular intervals;
An image data transmitting step in which the imaging device transmits the still image captured in the imaging step to the work recording device;
The work detection device detecting an input operation by an operator at the work site; and
Each of the still images captured by the imaging device based on an imaging timing at which each of the still images is captured by the imaging device and a detection timing at which an input operation is detected by the work detection device. Associating with the input operation detection timing,
A work recording method comprising: a display step in which the work recording device displays a still image captured by the imaging device in accordance with a detection timing associated with the still image by the association step.

Images