JP2018113013A - Imaging device, imaging system, imaging method, imaging program, and display device for imaging - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an imaging device for acquiring composite image data which can be properly displayed without losing operability in the case of displaying a composite image of an acquired image and a corresponding associated information image.SOLUTION: The imaging device comprises: an imaging part 13 for generating and outputting image data by receiving an optical image of an object; a display part 17 for displaying an image based on the image data output from the imaging part and various information; a communication part 19 for acquiring associated information related to the object by communicating with terminal equipment 40; and a display control part 24 for causing the display part to superimpose and display the image based on the corresponding associated information in the image being displayed thereby. The display control part performs display control to cause the display part to display the image based on the associated information at a preliminarily designated position in a display screen thereof.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging device, an imaging system, an imaging method, an imaging program, and an imaging display device that can record accompanying information related to the object as tag data when acquiring an image of the object.

  Conventionally, an optical image formed by an imaging optical system is sequentially photoelectrically converted using a photoelectric conversion element or the like (hereinafter referred to as an imaging element), and an image signal obtained thereby is stored as digital image data in a predetermined form. In general, an image pickup device configured to include an image display device that displays a still image or a moving image based on the digital image data is put into practical use and widely used.

  This type of imaging device, for example, records a series of actions, progress, or processes in various events (events) or operations, etc., to record events or constructions (hereinafter referred to as “recording target constructions, etc.”). In various cases, it is used for the purpose of sequentially recording various scenes and changes in specific objects as images (photographs) sequentially with time.

  In this case, specific examples of constructions to be recorded include various events such as ceremonial occasions, construction progress records such as civil engineering and construction, etc., as well as various products and structures, etc. It is a process record of manufacturing production work.

  Conventionally, for example, when a construction status progress record such as a civil engineering work or a building work is performed, an image is acquired for each stage of the work to be recorded. In such a case, information related to the image, that is, incidental information such as status explanation information about the construction to be recorded is recorded in association with the image.

  Here, as the above-mentioned status explanation information on the construction subject to recording, for example, basic information such as date and place, and specific information on construction subject to recording (construction name, work name, target name, company name, other memos, etc.) ) Etc.

  Conventionally, when imaging a desired object, a blackboard image created based on an actual blackboard or electronic data in which such information is described is copied on the same screen as the object. It is done to image.

  The large amount of image data obtained in this way is appropriately organized and used for a progress report during the construction of the recording target construction, etc., and a result report at the end or completion of the construction subject to recording. Will be.

  2. Description of the Related Art In recent years, for example, small personal information terminal devices (so-called personal computers; hereinafter abbreviated as “PC”) and the like are widely used when handling a large amount of image data acquired by the imaging apparatus.

  However, a series of operations from recording a plurality of required image data without omission (operation by an imaging device) and sorting and organizing a large amount of acquired image data (operation by a PC) are very complicated. It is.

  Therefore, a large amount of image data (for example, image data of a construction site) is captured (recorded), sorted, and organized by organizing a large amount of image data by automating a part of various processes in a series of operations. For example, Japanese Patent Application Laid-Open No. 2014-157596 discloses various imaging methods that are performed using an imaging system including an imaging device and a PC that are devised for simplification, and imaging programs that are applied to the imaging system. Proposals have been made.

  The means disclosed in Japanese Patent Application Laid-Open No. 2014-157596 is a program for automatically organizing a large amount of image data in which construction work steps are recorded. The program disclosed in the publication stores various types of information (referred to as blackboard information) in advance as electronic information data (referred to as blackboard information data), and generates a predetermined blackboard image based on the blackboard information data. When the blackboard image is superimposed on the live view image and the image data is acquired when the shutter button is pressed, the blackboard composite image data on which the corresponding blackboard image is superimposed is created and the above-mentioned acquisition is performed. Blackboard information data corresponding to the image data is recorded in association with the image data. Further, the program classifies and stores a plurality of blackboard composite image data generated as described above into corresponding folders based on the blackboard information data.

JP 2014-157596 A

  However, the means disclosed in Japanese Unexamined Patent Application Publication No. 2014-157596 and the like is configured to perform processing for generating blackboard composite image data by combining the acquired image data and the blackboard image in the imaging apparatus. In the case of this configuration, adjustment operations such as the arrangement of the blackboard image within the desired image are performed on the screen of a small display device of the imaging device. Therefore, there is a problem that good operability cannot be obtained.

  Furthermore, as an imaging device to which the technology described in the above publication is applied, a so-called smartphone or the like is assumed. However, general smartphones and the like are not assumed to be used in harsh environments such as construction sites, and there is a possibility that problems such as equipment failure may occur when used in such harsh environments.

  In addition to this, there is a limit to the performance of image sensors and imaging optical systems that are applied to general smartphones, so image acquisition performance (for example, high sensitivity resistance, high magnification zoom function, etc.) There are inferior aspects to imaging devices. For example, a clear image may not be obtained when used in a low illumination environment such as a building or a tunnel. That is, in a severe environment such as a construction site, it can be said that there are many problems in using a general smartphone or the like as a construction recording imaging device.

  Further, when adjusting the size of the blackboard image to be combined in the imaging device, if the size of the blackboard image is set smaller than the screen size, depending on the recording image size set in the imaging device, the blackboard image May not be displayed clearly.

  In addition to this, even when a report including the image is created and printed, the printing resolution is insufficient and various information described in the blackboard image on the printed matter cannot be read. Etc. arise.

  Furthermore, since the image data recorded about the construction status can be easily processed by a computer or the like, it has a configuration for verifying the alteration of the image file in order to ensure the reliability of the image data as a trail. Is desired.

  The present invention has been made in view of the above-described points, and an object of the present invention is to acquire incidental information related to an object when the image of the desired object is captured and image data is acquired. In an imaging apparatus, an imaging system, an imaging method, and an imaging program that can be recorded in association with image data, a composite image obtained by synthesizing an image based on the acquired image data and an image representing accompanying information corresponding to the image data is displayed. An image pickup apparatus capable of verifying whether or not there is any falsification in the composite image data without impairing the operability and displaying the composite image data that can always be displayed properly, A system, an imaging method, an imaging program, and an imaging display device are provided.

  In order to achieve the above object, an imaging device of one embodiment of the present invention includes an imaging unit that receives an optical image of an object and generates and outputs image data, and an image based on the image data output from the imaging unit. And a display unit that displays various information, a communication unit that communicates with the terminal device to acquire accompanying information regarding the object, and the image corresponding to the image in the image being displayed on the display unit A display control unit that superimposes and displays an image based on the accompanying information, and the display control unit displays the image based on the accompanying information at a predetermined position in the display screen of the display unit. Take control.

  The imaging system of one embodiment of the present invention displays an image based on the image data output from the imaging unit and various types of information, an imaging unit that receives and outputs an optical data of an object. An image based on the accompanying information corresponding to the image in the image being displayed on the display unit, and a body side communication unit that communicates between the display unit and the terminal device to acquire the accompanying information about the object A display control unit that superimposes and displays the image at a predetermined position, a terminal-side communication unit that communicates with the imaging device via the body-side communication unit, and a plurality of imaging objects A recording unit for recording an information data group related to a recording target event including a plurality of incidental information on the recording unit, and additional information about each of the individual imaging objects based on the information data group recorded in the recording unit It is configured by including Ku and a terminal device having an image processing unit for creating attendant information image.

  The imaging method of one embodiment of the present invention creates a plurality of accompanying information images corresponding to each of the imaging objects based on an information data group related to a recording target event including a plurality of accompanying information about a plurality of imaging objects. Transferring the plurality of accompanying information images between the terminal device and the imaging device, receiving an optical image of the imaging object, generating image data, displaying an image based on the image data, and displaying the plurality of images A specific accompanying information image corresponding to the currently displayed image is superimposed and displayed at a predetermined position on the display screen, and image data representing the currently displayed image is associated with this image data. The data representing the accompanying information image is recorded in association with each other.

  The imaging program of one embodiment of the present invention creates a plurality of accompanying information images corresponding to each of the imaging objects based on an information data group related to a recording target event including a plurality of accompanying information related to a plurality of imaging objects. Receiving the optical image of the imaging object, generating image data, displaying an image based on the image data, and displaying a specific accompanying information image corresponding to the image being displayed among the plurality of accompanying information images. The image data representing the image being displayed and the data representing the accompanying information image corresponding to the image data are recorded in association with each other by being superimposed and displayed at a predetermined position in the display screen.

  An imaging display device of one embodiment of the present invention includes a display unit that displays an image based on image data from an imaging unit that receives an optical image of an object and generates and outputs image data, and a terminal device. A communication unit that communicates with each other to acquire accompanying information about the object, and a display control unit that superimposes and displays an image based on the accompanying information corresponding to the image in an image being displayed on the display unit, The display control unit performs display control to display an image based on the accompanying information at a position specified in advance in the display screen of the display unit.

  According to the present invention, when a desired object is imaged and image data is acquired, accompanying information related to the object can be recorded in association with the image data, an imaging system, an imaging method, and imaging In a program, when a composite image obtained by combining an image based on acquired image data and an image representing accompanying information corresponding to the image data is displayed using a display device, the composite image data is not impaired. It is possible to provide an imaging device, an imaging system, an imaging method, an imaging program, and an imaging display device that can acquire composite image data that can verify whether or not tampering exists in the image and can always perform appropriate display. .

The system block block diagram which shows schematically the structure of the imaging device of one Embodiment of this invention, and the imaging system to which this imaging device is applied The conceptual diagram which shows simply the structure of the whole imaging system of FIG. FIG. 1 is a conceptual diagram showing a state when a recording operation such as a target recording work is performed using the imaging system of FIG. The figure which shows an example of the display form of the blackboard specification data produced with the terminal device in the imaging system of FIG. The figure which shows an example of the display form of the simple blackboard image based on the blackboard specification data superimposed and displayed on a live view image with the imaging device in the imaging system of FIG. 1 is an example of a display form of blackboard specification data superimposed on a live view image by the imaging apparatus in the imaging system of FIG. 1, and a warning display that appears when the blackboard image size setting by the blackboard specification data is too small Figure showing an example The figure which shows an example of the display form of the synthetic | combination image with a blackboard image displayed on a terminal device based on the blackboard specification data corresponding to the image data acquired with the imaging device in the imaging system of FIG. The figure which shows an example of the recording report produced using the imaging system of FIG. FIG. 1 is a conceptual diagram in the case of calculating a dimension value of an object from acquired image data in the imaging apparatus of FIG. Flowchart of a material creation sequence performed in the imaging system of FIG. The flowchart which shows the effect | action of the imaging device in the imaging system of FIG. The flowchart which shows the effect | action of the terminal device in the imaging system of FIG. Flowchart after branching in step S52 of FIG. Flowchart after branching in step S58 of FIG.

  The present invention will be described below with reference to the illustrated embodiments. Each drawing used in the following description is schematically shown. In order to show each component in a size that can be recognized on the drawing, the dimensional relationship and scale of each member are different for each component. May be shown. Therefore, the present invention is only in the illustrated form with respect to the quantity of each component described in each drawing, the shape of each component, the ratio of the size of each component, the relative positional relationship of each component, and the like. It is not limited.

  An imaging apparatus according to an embodiment of the present invention, for example, converts an optical image formed by an imaging optical system, for example, a CCD (Charge Coupled Device) image sensor or a CMOS (Complementary Metal Oxide Semiconductor). A photoelectric conversion element such as a semiconductor) type image sensor (hereinafter referred to as an imaging element) is used for sequential photoelectric conversion, and image signals obtained thereby are converted into image data in a predetermined form (for example, digital representing a still image or a moving image). An image display device, such as a liquid crystal display (LCD) or an organic display, which reproduces and displays a still image or a moving image based on the digital image data recorded on the storage medium. It is equipped with an electroluminescence (Organic Electro-Luminescence: OEL) display. And an imaging apparatus, specifically illustrating the example digital camera or the like.

  An imaging system according to an embodiment of the present invention is a small personal information terminal device that is used in cooperation with the imaging device, and performs wireless communication with other electronic devices. A terminal device capable of transmitting and receiving various data, such as a personal computer (a desktop computer, a notebook PC, a tablet PC, a smartphone, or the like) is exemplified.

  This imaging system is configured to transmit and receive various data between the imaging device and the terminal device using a network connected by wireless communication or wired communication, for example, the Internet or a local area network. It is what has been.

  The image pickup apparatus and image pickup system according to an embodiment of the present invention specifically records, for example, various various scenes in a construction site such as civil engineering work and building work, and changes over time depending on the work stage of a specific object. A construction photograph imaging apparatus and a construction photograph imaging system suitable for recording the progress of construction and the like are illustrated.

[One Embodiment]
First, the configuration of an imaging apparatus according to an embodiment of the present invention and an imaging system to which the imaging apparatus is applied will be described below with reference to FIGS. FIG. 1 is a system block configuration diagram schematically showing the configuration of an imaging apparatus according to an embodiment of the present invention and an imaging system to which the imaging apparatus is applied. FIG. 2 is a conceptual diagram schematically showing the overall configuration of the imaging system of the present embodiment.

  An imaging system 1 to which an imaging apparatus 10 according to an embodiment of the present invention is applied includes an imaging apparatus 10, a terminal device 40, and an external server 60 as shown in FIG.

  The imaging device 10 and the terminal device 40 are configured to be able to transmit and receive data between each other using an existing communication means 71 (detailed later) such as short-range wireless communication or wired communication (detailed later). ). Further, the terminal device 40 and the external server 60 are configured to transmit and receive data to and from each other by wireless communication or wired communication via the existing network 70. The network 70 illustrated in FIGS. 1 and 2 is illustrated assuming a wireless network such as the Internet configured to perform wireless communication.

  The imaging device 10 includes a body unit 11 and a lens unit 31. The body unit 11 and the lens unit 31 are configured separately or integrally. That is, the imaging apparatus 10 of the present embodiment is configured such that the lens unit 31 is configured to be detachable from the body unit 11, or the body unit 11 and the lens unit 31 are integrally configured. Any form of the fixed lens type imaging device can be applied.

  The imaging apparatus 10 of the present embodiment can be used in various waterproofing, dustproofing, shockproofing, loadproofing, low temperature resistance, and the like so that it can be used even in harsh environments such as construction sites such as civil engineering and building construction. It is configured with performance. Note that the specific configuration for realizing these various performances is not directly related to the present invention, and therefore the same configuration as that applied to electronic devices such as imaging devices that have been widely used in the past. The detailed description of these configurations is omitted.

  The body unit 11 includes an image processing unit 12, an imaging unit 13, a lens control unit 14, a body-side first communication unit 15 (abbreviated as “B1 communication unit” in FIG. 1), a sensor unit 16, The imaging device side display unit 17 (“imaging device side” in FIG. 1 is omitted. Hereinafter, the imaging device side is referred to accordingly) and the imaging device side operation unit 18 (“imaging device side” is omitted in FIG. 1). Hereinafter, the body side second communication unit 19 (abbreviated as “B2 communication unit” in FIG. 1) and the imaging device side recording unit 20 (in FIG. 1, “imaging”). The “device side” is omitted. Hereinafter, it will be referred to accordingly) and the display control unit 24 and the like are included.

  The image processing unit 12 is a processing circuit that performs various signal processing in response to image data output from the imaging unit 13, blackboard information data transferred from the terminal device 40, and the like. The image processing unit 12 includes a composite image creation unit 21, a file creation unit 22, a resolution determination unit 23, and the like.

  The composite image creation unit 21 is a processing circuit that performs processing for associating the image data output from the imaging unit 13 with the blackboard information data that is accompanying information of the object included in the image data. When the composite image creation unit 21 associates the image data with the blackboard information data, when the data is transferred to the terminal device 40, the terminal device 40 side (the image processing unit 45) determines a predetermined value. Thus, composite image data with a blackboard image (accompanying information image) is created. Since the blackboard information data is data for determining the specifications of the blackboard image, it is hereinafter referred to as blackboard specification data.

  The file creation unit 22 is a circuit unit for filing image data and associated blackboard specification data as a single image file.

  The resolution determination unit 23 is a circuit unit that determines whether or not the blackboard image size is appropriate based on the recorded image size information set in the imaging apparatus 10 and the set blackboard image size information. is there. In other words, the determination performed by the resolution determination unit 23 is specifically performed when, for example, a blackboard image corresponding to predetermined image data is combined, the resolution of the blackboard image combined in the image data (Optical resolution). ), That is, determination of blackboard information (character information) identification capability (whether it can be read reliably) or the like described in the blackboard image.

  The collation information creation unit 25 creates collation information for preventing falsification of the composite image data. As the collation information, for example, a hash value based on the composite image data is created. The hash value (hash code) is a value obtained by performing a predetermined calculation process called a hash function on the original data. SHA-1, SHA-2, MD5, etc. are known as typical hash functions. The hash value is sometimes called a message digest or a fingerprint print.

  The imaging unit 13 receives an optical image of an object to be imaged via the lens unit 31 and performs photoelectric conversion to generate an image signal, and the like, and the imaging element. A driving circuit for driving and various electronic circuits such as an analog-to-digital conversion circuit that receives an image signal (analog signal) output from the image sensor and generates image data (digital signal) in a predetermined form are configured. . As the imaging unit 13 itself, one having the same configuration as that of an imaging device that has been widely used in the past is applied.

  The lens control unit 14 is a control circuit that controls the lens unit 31. The lens control unit 14 controls an AF unit 32, a zoom unit 33, and the like, which will be described later, of the lens unit 31 through the body-side first communication unit 15 and the lens-side communication unit 34 to automatically adjust the focus of the lens unit 31. In addition to the operation and zoom operation, aperture control or shutter control (not shown) is performed.

  The body side first communication unit (B1 communication unit) 15 is a first communication unit provided on the body unit 11 side. The first body-side communication unit 15 is a circuit unit for transmitting and receiving control signals, data, and the like between the body unit 11 and the lens unit 31 (the lens-side communication unit 34).

  The sensor unit 16 includes an acceleration sensor that detects the state (horizontal and vertical posture, etc.) of the imaging device 10 and a detection circuit thereof, as well as a gyro sensor for detecting fine vibration applied to the imaging device 10 and performing shake correction control. In addition, the display unit 17 is a circuit unit configured to include various necessary sensors and corresponding detection circuits and the like as appropriate, such as an eye sensor for switching between a rear monitor and an electronic viewfinder in the display unit 17 described later.

  The display unit 17 receives an output signal from the imaging unit 13 and sequentially displays captured images (live view images), or displays an image based on image data recorded on the storage medium of the recording unit 20. This is a display unit for switching and displaying menu images and the like for setting in the imaging apparatus 10 as appropriate. Examples of the display unit 17 include a rear monitor and an electronic view finder (EVF) provided on the rear surface of the imaging device 10.

  The operation unit 18 includes a plurality of operation members that perform various operations on the imaging device side, a plurality of switch members as electrical components that receive the action of the plurality of operation members, and an electric circuit unit that includes the plurality of switch members and the like. It is configured. The operation unit 18 includes various types of mechanical switch parts such as a push button type, a slide type, and a rotary type, and a touch panel provided on the display surface of the display unit 17.

  The body side second communication unit (B2 communication unit) 19 is a second communication unit provided on the body unit 11 side. The body-side second communication unit 19 transmits and receives various data such as image data and blackboard specification data between the body unit 11 and the terminal device 40 (terminal-side first communication unit 41; details will be described later). It is a circuit part.

  The recording unit 20 includes a storage medium (not shown) that stores recording image data acquired by the imaging unit 13 and subjected to predetermined signal processing in the image processing unit 12, and a drive circuit that drives the storage medium. It is a constituent unit.

  The display control unit 24 is a circuit unit that controls driving of the display unit 17. The display control unit 24 performs, for example, switching control of display contents displayed on the display unit 17 in response to an operation signal from the operation unit 18, switching control between the rear monitor and the electronic viewfinder, and the like. The display control unit 24 also controls live view images. For example, when an output from the imaging unit 13 is received and a live view image is displayed on the display unit 17, display control is performed such that a predetermined blackboard image is superimposed on the live view image display screen. In this case, display control of the position and size for displaying the blackboard image is also performed by the display control unit 24 based on data designated in advance.

  Furthermore, the display control unit 24 performs display control for changing the display position and display size in the display screen of the blackboard image in response to an operation input from the operation unit 18. Specifically, for example, when the user taps an arbitrary position on the touch panel included in the operation unit 18 with the blackboard image superimposed on the live view image, the position of the blackboard image is displayed. Display control is performed so as to move from the middle position to the designated position. Further, when a blackboard image being displayed is tapped, display control is performed such that the size of the blackboard image changes. In addition, when setting of the position and size of the blackboard image is changed by performing such an operation, the setting information such as the changed position and size is placed in the image processing unit 12 or the like. After the update, the blackboard specification data 52 of the recording unit 44 described later may be updated by being transmitted to the terminal device 40 side via the B2 communication unit 19.

  The lens unit 31 is a configuration unit for generating an optical image of a subject. The lens unit 31 includes an imaging optical system (not shown) including a plurality of optical lenses, a plurality of holding members (not shown) that hold the optical lenses of the imaging optical system, and a part of the plurality of holding members. A drive mechanism (not shown) for driving the lens back and forth or rotating, a circuit unit (AF unit 32, zoom unit 33, etc.) for driving and controlling the drive mechanism, and a lens side communication unit 34 (in FIG. (Abbreviated as “L communication unit”) and the like. Although not shown, the lens unit 31 includes a lens shutter mechanism unit and the like as necessary in addition to the aperture mechanism unit. Since these unillustrated mechanism portions are not directly related to the present invention, the same configuration as that applied to the lens unit of an imaging device that has been widely used in the past has been adopted. Detailed description is omitted.

  Among them, the AF unit 32 receives a control signal from the lens control unit 14 on the body unit side and drives the drive mechanism (not shown) to realize an automatic focus adjustment (AF) operation. It is.

  The zoom unit 33 is a circuit unit that realizes a zooming operation by driving a driving mechanism (not shown) in response to a control signal from the lens control unit 14 on the body unit side.

  The lens side communication unit (L communication unit) 34 is a communication unit provided on the lens unit 31 side. The lens side communication unit 34 is a circuit unit for transmitting and receiving control signals and data between the body unit 11 (the body side first communication unit 15) and the lens unit 31.

  On the other hand, in the present imaging system 1, the terminal device 40 communicates with the imaging device 10 via the communication means 71 (details will be described later), so that small personal information is used in cooperation with each other. It is a terminal device. The terminal device 40 uses, for example, an electronic device that has been widely spread and put into practical use, such as a personal computer (desktop type PC, notebook type PC, tablet type PC) or a smartphone. By applying the imaging program of the embodiment of the present invention to the terminal device 40 of these general forms, the imaging system 1 of the embodiment of the present invention is configured.

  The imaging apparatus 10 includes a control unit (not shown) that controls the entire imaging apparatus 10 and controls each of the internal configuration units of the imaging apparatus 10 individually.

  The terminal device 40 omits the terminal-side first communication unit 41 (abbreviated as “D1 communication unit” in FIG. 1) and the terminal-side display unit 42 (“terminal side” in FIG. 1). 1), the terminal side operation unit 43 (in FIG. 1, “terminal side” is omitted. Hereinafter, it is referred to in accordance with this) and the terminal side recording unit 44 (in FIG. 1, “ "Terminal side" is omitted. In the following, it will be referred to in accordance with this) and terminal side image processing unit 45 ("Terminal side" in FIG. 1 is omitted. In the following, it will be referred to in accordance with this). The terminal-side second communication unit 46 (abbreviated as “D2 communication unit” in FIG. 1), the position information clock information unit 47, and the like.

  The terminal side first communication unit (D1 communication unit) 41 is a first communication unit provided on the terminal device 40 side. The terminal side first communication unit 41 is a circuit unit for transmitting and receiving various data such as image data and blackboard specification data between the terminal device 40 and the body unit 11 (the body side second communication unit 19). It is.

  The display unit 42 is a general form of display device applied to a PC or the like that displays various information using characters, images, and the like in the terminal device 40.

  The operation unit 43 is an input operation device that accepts a user operation in the terminal device 40. Specific examples of the operation unit 43 include an input device such as a keyboard, a pointing device such as a mouse, a trackball, a joystick, a touch panel (touch screen), a pen tablet, a touch pad, a track pad, and a joy pad. is there. These operation units 43 are input operation devices in a general form applied in a PC or the like.

  The recording unit 44 is a storage device that stores various types of information as electronic data in the terminal device 40. Specific forms of the recording unit 44 include, for example, a storage device using a semiconductor, a magnetic storage device such as a hard disk device, and a semiconductor memory that performs temporary storage. The recording unit 44 is also a general type storage device applied in a PC or the like.

  The recording unit 44 has a recording area in which various data such as construction design drawing data 51, blackboard specification data 52, and imaging device specification data 53 are stored.

  Here, the construction design drawing data 51 is an information data group composed of unique data including various drawings relating to the recording target construction and the like in addition to the design drawings and design specifications of the recording target construction (recording target event) and the like. The construction design drawing data 51 is data that has been downloaded via the network 70, in addition to data created by the terminal device 40, data created by other terminal devices and stored in the external server 60 or the like.

  The blackboard specification data 52 is information data for a blackboard image created in the terminal device 40. The blackboard specification data 52 is created by using the terminal device 40 based on information (construction design drawing data 51) regarding the construction to be recorded and the like. This blackboard specification data 52 is a template image of a blackboard image, information written in the blackboard image (status explanation information such as construction to be recorded; for example, basic information such as date and place, construction name, work, etc. Name, target name, company name, other information such as memos), etc., and the display position when the blackboard image is superimposed (composited) in the image displayed based on the image data including the target Various information for designating (compositing position), size, and the like are included. The blackboard specification data 52 is created as a result of processing performed by the image processing unit 45 or the like in response to an operation input from the operation unit 43 by the user, for example.

  The imaging device specification data 53 is unique data related to a specific imaging device 10 corresponding to the imaging system 1, for example, unique data such as a serial number of the imaging device 10 and various specification data, in particular, an imaging optical system included in the lens unit 31. Focal length information (not shown), light receiving surface size information of an imaging device (not shown) included in the imaging unit 13, (view angle information calculated from the lens focal length and the element size), information on the recorded image size, etc. It is.

  The image processing unit 45 performs various data processing relating to image data in the terminal device 40, for example, processing for creating the blackboard specification data 52, and display control processing for appropriately displaying various information on the display unit 42. It is a circuit part. Note that the image processing unit 45 has the same function as the image processing unit 12 of the body unit 11. That is, the image processing unit 45 has a function of performing resolution determination processing and the like in addition to various types of image editing processing (such as composite image creation processing and file creation processing).

  The terminal-side second communication unit (D2 communication unit) 46 is a second communication unit provided on the terminal device 40 side. The terminal-side second communication unit 46 is a circuit unit for transmitting and receiving various data between the terminal device 40 and the external server 60 via the network 70.

  The position information clock information unit 47 is a circuit unit that acquires or generates the position information of the terminal device 40 and information on the current time.

  The terminal device 40 has a control unit (not shown) that controls the entire terminal device 40 and controls each of the internal components of the terminal device 40 individually.

  The external server 60 is a storage device having a storage area for storing various kinds of information such as construction design drawing data 61, blackboard specification data 62, and image data 63 as electronic data. The external server 60 is electrically connected to the imaging system 1 by wireless communication means or wired communication means via an existing network (Computer network) 70 such as the Internet or a local area network.

  The construction design drawing data 61 is the same as the construction design drawing data 51 of the terminal device 40. Similarly, the blackboard specification data 62 is the same as the blackboard specification data 52 of the terminal device 40. The image data 63 is image data acquired by the imaging device 10, image data in a form in which various types of processing (blackboard image synthesis processing or the like) is performed on the image data, and the like. The construction design drawing data 61, the blackboard specification data 62, the image data 63, and the like are data uploaded via the network 70 from the terminal device 40 or other terminal devices.

  Note that, as described above, data is transmitted and received between the imaging device 10 and the terminal device 40 by the predetermined communication means 71. As the communication means 71, wireless communication means (for example, near field radio communication (NFC), wireless local area wireless communication (NFC)) using the body side second communication unit 19 and the terminal side first communication unit 41 is used. In addition to (Area Network), Bluetooth (registered trademark) (Bluetooth), and the like), a wired cable communication means (for example, a universal serial bus (USB)) can be applied as shown in FIG.

  Other configurations in the imaging apparatus 10 of the present embodiment and the imaging system 1 to which the imaging apparatus 10 is applied have the same configuration as that of individual electronic devices such as a conventional general imaging apparatus, a terminal device, and an external server. The description is omitted.

  An outline of operations performed using the imaging apparatus 10 of the present embodiment configured as described above and the imaging system 1 to which the imaging apparatus 10 is applied will be described below.

  FIG. 3 is a conceptual diagram showing how recording operation such as target recording work is performed using the imaging system of the present embodiment.

  FIG. 4 is a diagram illustrating an example of a display form of blackboard specification data created by the terminal device in the imaging system of the present embodiment.

  FIG. 5 is a diagram illustrating an example of a display form of a simple blackboard image based on the blackboard specification data superimposed on the live view image by the imaging device in the imaging system of the present embodiment.

  FIG. 6 is an example of a display form of blackboard specification data superimposed on the live view image by the imaging device in the imaging system of the present embodiment, and the blackboard image size setting by the blackboard specification data is too small. It is a figure which shows an example of the warning display which appears.

  FIG. 7 is a diagram illustrating an example of a display form of a composite image with a blackboard image displayed on the terminal device based on the blackboard specification data corresponding to the image data acquired by the imaging device in the imaging system of the present embodiment. .

  FIG. 8 is a diagram illustrating an example of a recording report created using the imaging system of the present embodiment.

  As the usage pattern of the imaging system 1 of the present embodiment, the following two usage patterns are generally considered.

  First, the terminal device 40 is used in an indoor facility (hereinafter abbreviated as “office”) located at a location different from the site (hereinafter simply abbreviated as “work site”) for recording work, etc. Thus, a plurality of blackboard specification data 52 corresponding to each of the plurality of objects is created and stored in the recording unit 44 of the terminal device 40 (see FIG. 2).

  Here, how to create the desired blackboard specification data 52 using the terminal device 40 is as shown in FIG.

  First, a blackboard image template image 201 is displayed on the display unit 42 of the terminal device 40. Here, the user can place predetermined information (situation explanation information such as construction to be recorded; basic information such as date and place, construction name, work name, object name, etc.) at a predetermined position in the template image 201. Write company name, other information such as other memos).

  This information input operation is performed using the operation unit 43 of the terminal device 40 or the like. When performing this information input operation, the template image 201 can be enlarged on the display screen and displayed slightly larger so that the blackboard image can be easily input into the template image.

  Note that the information input work can be the following automatic input work as well as the manual input work by the user. The predetermined information is normally stored in advance in the external server 60 as construction design drawing data 61 or the like. Therefore, the terminal device 40 can access the external server 60 and download and use the predetermined information. The predetermined information downloaded to the terminal device 40 may be automatically input to the corresponding item column in the template image 201 of the blackboard image for each predetermined item.

  Further, when the blackboard specification data 52 is created, the position and size at which the blackboard image is displayed can be designated in the display screen of the image data including the corresponding recording object. Also, depending on the object to be recorded, whether the image is a vertically long image or a horizontally long image can be assumed in advance. Therefore, it is possible to specify the vertical position setting or the horizontal position setting when acquiring image data. .

  The blackboard specification data 52 thus created is first stored in the recording unit 44 of the terminal device 40. In addition, the blackboard specification data 52 may be transferred to the imaging device 10 in advance and stored in the recording unit 20 of the imaging device 10. At the same time, the blackboard specification data 52 may be uploaded to the external server 60.

  The work up to this point, that is, the creation and storage work of the blackboard specification data 52 is a work common to any of the two types of usage.

  Thereafter, in the first usage pattern, both the imaging device 10 and the terminal device 40 are taken out to a site such as a construction to be recorded (hereinafter simply referred to as a site), and the imaging device 10 and the terminal device 40 at the site. Used in conjunction with.

  In this case, the blackboard specification data 52 is stored in the terminal device 40 as described above. Further, when the blackboard specification data has been transferred to the imaging device 10 in advance, the same blackboard specification data is also stored in the imaging device 10. Further, the blackboard specification data may be stored in the external server 60 in some cases.

  In the first usage pattern, the blackboard specification data only needs to be stored in at least the terminal device 40.

  However, if either or both of the imaging device 10 and the terminal device 40 can communicate with the external server 60 via the network 70 (in this case, the Internet), the blackboard specification data is stored in the imaging device. 10, it may be stored in one of the terminal device 40 and the external server 60 in one place.

  In other words, when the blackboard specification data is only in the imaging device 10, it is used as it is in the imaging device 10, transferred to the terminal device 40 each time, and used in cooperation with both.

  Further, when the blackboard specification data is only in the terminal device 40, the blackboard specification data is transferred from the terminal device 40 to the imaging device 10 as necessary, and the work is performed while the two devices cooperate with each other.

  When the blackboard specification data is only in the external server 60, one of the imaging device 10 or the terminal device 40 downloads from the external server 60, transfers this to the other of the imaging device 10 or the terminal device 40, and both It will be a form to work while cooperating between.

  On the other hand, after the blackboard specification data 52 is created, the second usage pattern is a mode in which only the imaging device 10 to which the blackboard specification data has been transferred and stored is taken out and used while the terminal device 40 is placed in the office. .

  In this case, the blackboard specification data 52 needs to be created in the office, transferred to the imaging apparatus 10 in advance, and recorded in the recording unit 20 of the imaging apparatus 10.

  However, in the second usage pattern, if the imaging device 10 can communicate with the external server 60 via the network 70 (Internet), the blackboard specification data does not necessarily have to be transferred to the imaging device 10. For example, even if the blackboard specification data goes to the site without being transferred to the imaging device 10, the blackboard specification data can be downloaded from the external server 60 using the imaging device 10 at the site. In this case, it may be downloaded every time an imaging operation is performed, or a plurality of required blackboard specification data may be downloaded in a batch.

  In order to avoid complication of explanation, it is assumed that the settings of the imaging device 10 and the terminal device 40 are under the following conditions.

  First, in the case of the first usage pattern, it is assumed that the blackboard specification data is stored in the terminal device 40. In the case of the second usage pattern, it is assumed that the blackboard specification data is stored in the imaging device 10. Therefore, in the following description, in either case of the first usage pattern or the second usage pattern, the connection operation to the external server 60 using the imaging device 10 or the terminal device 40 is not performed in the field. To do.

  Here, the situation at the site is assumed as shown in FIG. That is, when the recording target object 300 is present at a site such as target recording work, the first user 101 holds the imaging device 10 and performs an imaging operation of the recording target object 300. The second user 102 holds the terminal device 40 and assists the imaging operation of the first user 101.

  In this case, in the first usage pattern, the first user 101 (imaging device 10) and the second user 102 (terminal device 40) are present on site (reference A in FIG. 3). On the other hand, in the second usage pattern, only the first user 101 (imaging device 10) exists in the field (reference numeral B in FIG. 3).

  FIG. 3 shows a situation where two users (101, 102) hold and use the imaging device 10 and the terminal device 40, respectively, in the case of the first usage pattern. There is no limit. For example, even in the case of the first usage pattern, it may be considered as a mode in which only one user is used and the one user uses the imaging device 10 and the terminal device 40 alternately.

  In the field, in the case of the first usage pattern, first, the first user 101 activates the imaging device 10 and directs it toward the recording object 300. Then, a normal live view image is displayed on the display unit 17 of the imaging apparatus 10.

  At the same time, the second user 102 operates the terminal device 40 to display the blackboard specification data corresponding to the recording object 300 on the display unit 42, and the blackboard specification data from the terminal device 40 to the imaging device. The operation to transfer to 10 is performed. That is, in this case, every time a desired recording object is imaged, the operation of acquiring the corresponding blackboard specification data from the terminal device 40 is repeated.

  Then, on the display unit 17 of the imaging device 10, the blackboard image 202 based on the transferred blackboard specification data is displayed in a form superimposed on the live view image. FIG. 5 is an example of live view image display displayed on the display unit 17 of the imaging apparatus 10 at this time.

  On the other hand, in the case of the second usage pattern at the site, first, the first user 101 operates the imaging device 10 to select blackboard specification data corresponding to the recording object 300. Then, the blackboard image (simplified version) based on the blackboard specification data is superimposed and displayed on the live view image in a preset size at a preset position. The display on the display unit 17 of the imaging device 10 in this case is the same as the example shown in FIG.

  Here, as shown in FIG. 5, the blackboard image 202 displayed on the imaging device 10 side is a simplified display form including only frame images with specific numbers corresponding to predetermined blackboard specification data.

  In the imaging apparatus 10, the display form of the blackboard image based on the blackboard specification data is set to such a simplified form. Since the display unit 17 of the imaging apparatus 10 is small, all the detailed information is displayed on the display part 17. However, in order to read and display all information included in the blackboard specification data, the image processing unit 12 and the display control unit 24 of the imaging device 10 may not be able to be distinguished on the display screen. For example, there is a second reason that the amount of information at the time of display is reduced in order to reduce the load on the circuit units because the circuit units related to image display are overloaded.

  At this time, the first user 101 of the imaging apparatus 10 displays on the blackboard image 202 whether the displayed blackboard image 202 corresponds to correct blackboard specification data corresponding to the recording object 300. Can be identified by a specific number. That is, the content of the image specification data corresponding to this specific number can be displayed and confirmed by the terminal device 40 held by the second user 102. In the imaging apparatus 10 as well, for example, a region on the display screen corresponding to the blackboard image 202 is tapped during display of FIG. 3, or a predetermined operation member such as an OK button (not shown) is operated. Thus, it is possible to switch to a display form in which detailed information regarding the blackboard image 202 being displayed can be confirmed using the entire display screen of the display unit 17. And the confirmation display can be immediately returned to the display state of FIG. 5 by one action operation etc. with respect to a predetermined operation member.

  Subsequently, the first user 101 performs an operation of adjusting the position, size, and the like of the blackboard image 202 on the display screen while viewing the live view image of the display unit 17 of the imaging device 10. This adjustment operation is an operation common to the first usage pattern and the second usage pattern.

  In other words, this adjustment operation is an operation for adjusting the blackboard image 202 in consideration of, for example, whether the blackboard image 202 has a position and size so as not to hide the recording object 300 in the display screen. This adjustment operation is performed using a predetermined operation member or a touch panel in the operation unit 18 of the imaging apparatus 10. In the first usage pattern, the second user 102 stands by during the adjustment operation by the first user 101.

  During this adjustment operation, for example, the setting of the frame size (also referred to as blackboard image size) of the blackboard image 202 on the display screen may be too small compared to the set recording image size.

  In this case, depending on the set recording image size, the resolution of the blackboard image 202 (the ability to identify various information (character information) described in the blackboard image) is reduced. Considering this, in the imaging device 10 of the present embodiment, the minimum value of the blackboard image size is defined according to the setting of the recording image size. In the above adjustment operation, as a result of changing the setting of the size of the blackboard image 202, the frame image size information of the blackboard image 202 that has been set is below the specified minimum size value (too small) ), Warning displays 211 a and 211 b as shown in FIG. 6 are performed on the display unit 17 of the imaging apparatus 10.

  Here, the warning display 211a in FIG. 6 is a display example indicating that the blackboard image size is inappropriate, and an example in which a diagonal line that cancels the frame image area of the blackboard image 202 is displayed. Further, the warning display 211b in FIG. 6 is an example in which a character string indicates that the blackboard image size is inappropriate.

  Such warning display is, for example, display control performed by the display control unit 24 in response to a determination result by the resolution determination unit 23. Here, the display control unit 24 may perform a display prompting a resetting operation for the blackboard image size in addition to the warning display.

  When such an adjustment operation is performed, new blackboard specification data reflecting the adjustment result is generated, the new blackboard specification data updates the old data, and the new blackboard specification data is stored in the recording unit of the imaging device 10. 20 is recorded.

  Here, the screen setting (setting whether the vertical position or the horizontal position) may be changed according to the situation at the site. The imaging apparatus 10 according to the present embodiment includes a sensor unit 16 that automatically detects a posture at the time of performing an imaging operation. Therefore, when the screen setting (vertical position or horizontal position setting) corresponding to the posture detection result by the sensor unit 16 when the imaging operation is executed is different from the screen setting specified in advance (specifically Specifically, for example, when the vertical position setting is specified and the image capturing operation is performed in the horizontal position, the data related to the screen setting in the blackboard specification data is automatically updated.

  As described above, when performing the adjustment before the imaging operation in the field, when the imaging operation with a different screen setting is executed with respect to the screen setting specified in advance, the position and size of the blackboard image are also set. The display automatically switches to an appropriate position and size according to the screen. The user may make fine adjustments appropriately while watching this.

  After the blackboard image 202 is adjusted in this way, the first user 101 performs an image acquisition operation (imaging operation) by the imaging device 10. In response to this, the imaging apparatus 10 performs a normal image acquisition operation. Then, normal image data is acquired. The acquired image data is recorded in the recording unit 20. At this time, corresponding blackboard specification data is recorded in association with the image data.

  In this case, the blackboard specification data corresponding to the image data may be recorded in a separate file format, or may be recorded as one file in which the image data and the corresponding blackboard specification data are integrated. You may do it. When both are recorded in separate file formats, for example, the tag data attached to the header portion of the image data may be associated by adding information indicating that the corresponding blackboard specification data exists. . In order to record both as one file, for example, blackboard specification data may be included in the header portion of the image data and recorded.

  Here, the plurality of image data acquired by the imaging device 10 are stored in a plurality of folders generated based on information on arbitrary items (for example, date, construction name, object name, etc.) of the associated blackboard specification data. They may be classified and recorded in each corresponding folder.

  In the first usage pattern, the adjusted new blackboard specification data is recorded together with the image data on the imaging device 10 side. At the same time, the new blackboard specification data and the corresponding image data are transferred from the imaging device 10 to the terminal device 40 as a set. Thereby, the blackboard specification data on the terminal device 40 side is also updated.

  In the terminal device 40, a predetermined image composition process is performed based on the transferred image data and the blackboard specification data corresponding thereto. As a result, composite image data with a blackboard image is generated, and an image based on this is displayed on the display unit 42. A display example of the composite image with the blackboard image displayed on the display unit 42 of the terminal device 40 at this time is shown in FIG.

  Thus, in the case of the first usage pattern, acquisition of a plurality of image data and creation of a plurality of composite image data are performed while the imaging device 10 and the terminal device 40 are linked in the field. In the case of the second usage pattern, on the site, the imaging device 10 is used to acquire a plurality of image data and associate the blackboard specification data corresponding to each image data.

  Thus, after the series of imaging operations at the site is finished, in the case of the first usage pattern, the imaging device 10 and the terminal device 40 are brought back to the office. In the case of the second usage pattern, the imaging device 10 is taken back to the office.

  In the office, the organizing work is performed on the plurality of image data acquired at the site as described above. This organizing work is an organizing work of acquired image data or the like performed after a recording operation such as a target recording work is performed at the site using the imaging system 1 (see FIG. 2).

  In the case of the first usage pattern, a plurality of acquired image data, a plurality of blackboard specification data corresponding to and associated with each of the acquired image data, and further, a composite process is performed based on these data (every time an imaging operation is performed in the field). The plurality of generated composite image data is recorded in the recording unit 44 of the terminal device 40.

  In the case of the second usage pattern, a plurality of acquired image data and a plurality of blackboard specification data corresponding to and associated with the acquired image data are recorded in the recording unit 20 of the imaging apparatus 10.

  Accordingly, in the office, in the first usage pattern, if desired image data is displayed using the terminal device 40, the blackboard specification data associated with the displayed image data is automatically read out. Thus, the image is superimposed and displayed at a designated position in the image data. Alternatively, the composite image data automatically created on site may be displayed as it is.

  A document (document) such as a recording report as shown in FIG. 8 is automatically created based on the composite image data and various types of information included in the corresponding blackboard specification data. The user can arbitrarily input (add) desired information to a desired item for the record report created in this way. The additional input operation is performed using the operation unit 43 of the terminal device 40.

  Note that the record report or the like is assumed to be, for example, a document in a report format having a predetermined format (format).

  The data of the recording report created in this way may be recorded in the recording unit 44 of the terminal device 40 and uploaded to the external server 60, for example.

  In the case of the second usage pattern in the office, first, the user transfers a plurality of acquired image data from the imaging device 10 to the terminal device 40 (located in the office), and A plurality of corresponding blackboard specification data is transferred via the communication means 71.

  Thereafter, predetermined arrangement work is performed in the terminal device 40. The subsequent organizing work is the same as that described in the first usage pattern.

  The recording, classification, and organizing operations such as the recording target work performed using the imaging device 10 of the present embodiment and the imaging system 1 to which the imaging device 10 is applied will be briefly described. When a plurality of blackboard specification data is prepared in advance according to a plan (blackboard specification data) planned in advance for the recording object, and a plurality of image data respectively corresponding to the plurality of blackboard specification data is acquired, The blackboard specification data corresponding to the image data is recorded in association with each other, and a plurality of blackboard image composites based on the plurality of image data thus obtained and the plurality of blackboard specification data associated with each of the plurality of image data. Generate image data, classify the generated composite image data with blackboard images based on the specified items of each blackboard specification data, and put them in separate folders Ri divided record and, further, to create the plurality of board images with the composite image data, the document recording reports, etc. based on the blackboard specification data such as the corresponding thereto.

  Note that the image capturing apparatus 10 of the present embodiment has image data (each data for displaying a live view image) acquired each time by an image sensor (not shown) included in the image capturing unit 13 when the image data is acquired by the image capturing apparatus 10. ), The dimension value of the object can be calculated.

  FIG. 9 is a conceptual diagram when the dimension value of the object is calculated from the acquired image data in the imaging apparatus of the present embodiment.

  Here, in order to calculate the dimension value of the object from the image data acquired by the imaging unit 13, it is calculated from the image data (recorded image data or live view display image data) acquired by the imaging unit 13. Information (for example, the dimension value X of the object on the imaging screen: see FIG. 9) and various types of information included in the imaging device specification data 53 (for example, the focal length F of the lens unit 31, the angle of view φ) , Based on the light receiving surface size X0 of the image sensor of the imaging unit 13 and the like (see FIG. 9), various information obtained by the AF operation (for example, the distance D from the imaging device 10 to the object 300, etc .: see FIG. 9), and the like. Thus, the size W of the object (see FIG. 9) can be calculated by the equation (1).

W = D · X / F (1)
The angle of view φ can be calculated by equation (2).

φ ≒ arctanX0 / F (2)
The size W calculated in this way is compared with various kinds of information included in the blackboard specification data (for example, the design dimension value of a specific recording object previously extracted from the construction design drawing data 61 or the like). It can be confirmed whether or not the object is built as designed.

  Therefore, the imaging apparatus 10 according to the present embodiment can confirm whether the recording target construction or the like is performed as designed by acquiring the image data of the target object.

  For this purpose, for example, a determination unit for determining a comparison result between the size W of the object calculated from the image data and the design value of the size of the object is provided in the image processing unit 12 of the imaging device 10. Good.

  Next, the operation of the imaging apparatus of the present embodiment described above and the imaging system to which the imaging apparatus is applied will be described below with reference to the flowcharts of FIGS.

  FIG. 10 is a flowchart of a material creation sequence performed in the imaging system according to the embodiment of the present invention.

  FIG. 11 is a flowchart showing the operation of the imaging apparatus in the imaging system according to the embodiment of the present invention.

  FIG. 12 is a flowchart showing the operation of the terminal device in the imaging system according to the embodiment of the present invention.

  FIG. 13 is a flowchart after branching in step S52 of FIG.

  FIG. 14 is a flowchart after branching in step S58 of FIG.

  First, the flow of a material creation sequence performed in the imaging system 1 of the present embodiment will be described below with reference to FIG.

  First, here, it is assumed that the imaging system 1 of the present embodiment is in a state as shown in FIG. In that state, the imaging device 10, the terminal device 40, and the external server 60 are all in an operating state. Further, it is assumed that the imaging device 10 and the terminal device 40 are in a state where data can be transmitted and received between each other via the communication unit 71. The terminal device 40 and the external server 60 are in a state where data can be transmitted and received between each other via the network 70.

  In this state, in step S <b> 11 of FIG. 10, the control unit (not shown) of the terminal device 40 can monitor the terminal side first communication unit 41 and perform communication with the body side second communication unit 19. As described above, the operation is performed in a predetermined standby mode.

  In the next step S12, a control unit (not shown) of the terminal device 40 confirms whether or not predetermined design drawing data is acquired. Here, when acquiring the said design drawing data, it progresses to the process of following step S13. If it is not necessary to acquire the design drawing data, the process proceeds to step S15.

  In step S <b> 13, the control unit (not shown) of the terminal device 40 creates a series of imaging plans using the design drawing data acquired by the detailed processing.

  Subsequently, in step S14, the control unit (not shown) of the terminal device 40 creates a plurality of blackboard specification data corresponding to a plurality of necessary image data based on the imaging plan created by the above-described processing. I do. The plurality of blackboard specification data created in this way is transferred to the imaging device 10 via the communication means 71. This transfer process may be omitted depending on circumstances.

  In step S15, the control unit (not shown) of the terminal device 40 confirms whether or not to execute the document creation mode. Here, when executing the document creation mode, the process proceeds to the next step S16. If the document creation mode is not executed, the process returns to the above-described step S11 and waits.

  In step S <b> 16, the control unit (not shown) of the terminal device 40 performs processing for displaying a related image. Here, the related image is, for example, an image displayed by composite image data created based on acquired image data and corresponding blackboard specification data.

  Subsequently, in step S17, a control unit (not shown) of the terminal device 40 executes a predetermined document creation process based on the related image and various information corresponding to the related image. Here, the created document data is a document such as the above-described recording report. After the predetermined document is created, the document is recorded.

  In the same processing step, online submission processing or the like may be performed for the document. Here, the online submission process is a transfer process from the terminal device 40 via the network 70 to another terminal device in a responsible office or a supplier company, for example. When these series of processes are completed, the process returns to the above-described step S11 and waits.

  In the present embodiment, only the blackboard specification data creation process (S12 to S14) and the document creation process (S16, S17) are explicitly shown as the material creation sequence, but are not limited thereto. If there is other processing, the sequence may be further branched to other processing in the processing of step S15 described above.

  Next, the operation of the imaging apparatus in the imaging system of one embodiment of the present invention will be described below with reference to the flowchart of FIG.

  First, it is assumed that the imaging device 10 is activated in a usable state, for example, in a power-on state. At this time, the control unit (not shown) of the imaging device 10 activates a communication standby process with another device, such as the terminal device 40, in the background, as shown in step S21 of FIG. ing. In other words, the imaging apparatus 10 has an operation mode in which communication is always waited in the background when activated. Of course, this operation mode can always be in the off state. That is, the communication operation mode in the imaging device 10 can be turned on and off as necessary.

  Next, in step S <b> 22, the control unit (not shown) of the imaging device 10 confirms whether or not a setting for specifying another device (here, the terminal device 40) to be a communication partner is made. If it is confirmed that the setting for specifying the communication partner device (terminal device 40) has not been made, the process proceeds to step S23. If it is confirmed that the setting for specifying the communication partner device (terminal device 40) is made, the process proceeds to the next step S26.

  If the communication partner setting is not confirmed in step S22, the process proceeds to step S23. In step S23, the control unit (not shown) of the imaging apparatus 10 confirms whether or not a communication partner setting operation is performed. Here, when setting operation of a communication partner is performed, the process proceeds to step S24. If the communication partner setting operation is not performed, the process returns to step S21.

  In step S24, a control unit (not shown) of the imaging device 10 executes a predetermined setting procedure process for setting a communication partner. Thereafter, the process proceeds to step S25.

  In step S25, the control unit (not shown) of the imaging device 10 stores the setting process result of the communication partner setting process performed in the process of step S24 described above in a predetermined storage unit (for example, an internal memory (not shown)). To do. Thereafter, the process returns to step S21.

  On the other hand, when the setting of the communication partner is confirmed in step S22 and the process proceeds to step S26, in step S26, the control unit (not shown) of the imaging device 10 determines whether the operation mode of the imaging device 10 is the imaging mode. Confirm whether or not. Here, when the operation mode of the imaging device 10 is the imaging mode, the process proceeds to the next step S27. If the operation mode of the imaging device 10 is set to an operation mode other than the imaging mode, the process proceeds to step S41.

  In step S27, the control unit (not shown) of the imaging device 10 controls the imaging unit 13 to execute image acquisition processing, and at the same time controls the body side first communication unit 15 to communicate with the lens side communication unit 34. And the drive control of the AF unit 32 and the zoom unit 33 are performed via the lens control unit 14. Then, a control unit (not shown) of the imaging apparatus 10 controls the display unit 17 via the display control unit 24 to execute live view image display processing.

  Further, at the same time as these processes, a predetermined operation is executed as necessary. Here, the predetermined operation refers to, for example, executing image determination processing, measurement processing, or the like as necessary, and acquiring the processing results.

  The image determination process refers to image data acquired by the image sensor of the imaging unit 13 and blackboard specification data, and determines whether or not the main subject in the image data is a desired recording object. It is.

  The measurement process includes image data acquired by the image sensor of the imaging unit 13, basic information (lens focal length, element size, angle of view, etc.) of the image capturing apparatus 10, and an object obtained by AF operation. This is a process of calculating the size of a predetermined part of the object formed in the image data based on the distance information. The data of the measurement result is stored in a predetermined area such as the recording unit 20.

  Subsequently, in step S28, the control unit (not shown) of the imaging device 10 selects an object on which an imaging operation is to be performed.

  In step S29, the control unit (not shown) of the imaging device 10 confirms whether or not blackboard image data included in the blackboard specification data corresponding to the object selected in step S28 described above exists. . If it is confirmed that the corresponding blackboard image data exists, the process proceeds to the next step S30. If there is no corresponding blackboard image data, step S30 is skipped and the process proceeds to step S31.

  In step S30, the control unit (not shown) of the imaging device 10 detects posture information detected based on the output from the sensor unit 16 and various types of information set in advance (for example, the setting position of the blackboard image in the display screen, And various types of blackboard images created based on blackboard specification data having information such as the size of the blackboard image. At the same time, when the user operates the operation unit 18, various setting changes (mainly, position and size change in the screen) for the blackboard image are performed.

  In step S31, a control unit (not shown) of the imaging device 10 checks whether or not the setting change in step S30 described above is possible. If the setting can be changed, the process of step S32 is skipped and the process proceeds to the next step S33. If the setting cannot be changed, the process proceeds to the next step S32.

  Here, whether the setting can be changed is, for example, a setting change related to the size of the blackboard image. As described above, it is impossible to change the setting when the blackboard image size in the display screen is inappropriate (for example, too small) with respect to the setting of the recording image size set in the imaging device 10 (for example, too small). (Invalid) is determined.

  In step S32, the control unit (not shown) of the imaging apparatus 10 performs a warning display indicating that the setting change operation performed in the process of step S30 described above is impossible. An example of the warning display performed here is a warning display as shown in FIG. 6, for example.

  Subsequently, in step S <b> 33, the control unit (not shown) of the imaging device 10 confirms whether or not an instruction signal for starting the imaging operation is generated. Here, the imaging operation start instruction signal is, for example, generation of a shutter release signal generated by operating a shutter release operation member. If a warning display is displayed in the process of step S32 described above, the user naturally does not issue an imaging operation start instruction. That is, when it is confirmed that the imaging operation start instruction signal is generated, the process proceeds to step S34. If the generation of the imaging operation start instruction signal is not confirmed, the process returns to step S21 and the subsequent processes are repeated.

  When the generation of the imaging operation start instruction signal is confirmed and the process proceeds to step S34, the control unit (not shown) of the imaging apparatus 10 executes predetermined imaging operation processing in step S34. This imaging operation process is the same as the process performed by a conventional general imaging apparatus.

  Subsequently, in step S35, a control unit (not shown) of the imaging apparatus 10 performs predetermined processing for associating the currently set blackboard specification data with the image data acquired in the imaging operation process in step S34 described above. Perform data processing. This predetermined data processing is, for example, tag data creation processing for attaching the contents of the blackboard specification data to the header portion of the image data.

  Subsequently, in step S36, the control unit (not shown) of the imaging apparatus 10 associates the image data acquired in the imaging operation process in step S34 described above with the currently set blackboard specification data into a file. The image file processing to be executed is executed. Here, in the image file conversion, for example, the image data and the blackboard specification data are recorded as separate files associated with each other, the image data and the blackboard specification data are recorded as one file, the image data and the blackboard specification. There are various file formats such as a format in which data is synthesized and recorded as synthesized image data. When the composite image data is recorded, collation information for the composite image is created by the collation information creating unit 25 and recorded in association with the composite image data, so that collation information for verifying falsification of the composite image data is obtained. Can be acquired and verified. Then, it returns to the process of above-mentioned step S21, and repeats the subsequent processes.

  On the other hand, when the operation mode of the imaging apparatus 10 is set to an operation mode other than the imaging mode in the process of step S26 described above, the process proceeds to step S41. A control unit (not shown) checks whether or not the operation mode of the imaging apparatus 10 is set to the reproduction / communication mode. Here, when the operation mode of the imaging device 10 is not the reproduction / communication mode, the process returns to the above-described step S21.

  In the process sequence of FIG. 11 described above, an example is shown in which the process returns to the process of step S21 when the playback / communication mode is not set. However, the present invention is not limited to this mode. For example, if the imaging apparatus 10 has another operation mode other than the reproduction / communication mode, the operation mode may be shifted to the other operation mode.

  When the imaging device 10 is in the reproduction / communication mode in the processing of step S41 described above and proceeds to the processing of step S42, in this step S42, the control unit (not shown) of the imaging device 10 sends the recording unit 20 A list display of a plurality of recorded image data is performed using the display unit 17. Here, the user performs a predetermined operation on the list display being displayed on the display unit 17 and performs a selection operation for selecting desired image data.

  In the next step S43, the control unit (not shown) of the imaging apparatus 10 confirms whether or not a predetermined selection signal has been generated by performing a selection operation by the user. Here, when the generation of the predetermined selection signal is confirmed, the process proceeds to the next step S44. If the generation of the predetermined selection signal is not confirmed, the process proceeds to step S45.

  In step S <b> 44, the control unit (not shown) of the imaging device 10 executes a selection image reproduction process for causing the display unit 17 to display an image (selection image) based on image data corresponding to a predetermined selection signal.

  In step S <b> 45, the control unit (not shown) of the imaging device 10 transmits the image data of the selected image being reproduced and displayed to the terminal device 40 when the communication request signal is confirmed. If the communication request signal is not confirmed here, the process proceeds to the next step S46.

  In step S46, the control unit (not shown) of the imaging apparatus 10 generates an instruction signal for terminating the processing sequence (referred to as an end instruction signal), for example, a switching signal from the reproduction / communication mode to another operation mode. Confirm. Here, when the end instruction signal is confirmed, the processing returns to the above-described step S21. If the end instruction signal is not confirmed, the process returns to the above-described step S43 and the subsequent processes are repeated.

  Although illustration is omitted in order to avoid complication of the drawing, in the case where, for example, a power-off signal is confirmed as an end instruction signal in the processing of step S46 described above, the imaging is performed. A series of processing sequence of the apparatus 10 is finished.

  Next, the operation of the terminal device in the imaging system according to the embodiment of the present invention will be described below with reference to the flowcharts of FIGS.

  First, it is assumed that the terminal device 40 is activated, for example, in a power-on state and usable. At this time, the control unit (not shown) of the imaging apparatus 10 displays a list of various operation modes that can be operated on the display screen of the display unit 42, as shown in step S51 of FIG.

  In step S52, the control unit (not shown) of the terminal device 40 confirms whether or not the camera mode is selected from the various operation modes. Here, the camera mode is an operation mode in which communication is performed with the imaging apparatus 10 and various operations are executed in cooperation with the imaging apparatus 10. In the following description, the imaging device 10 may be simply referred to as a camera for simplification.

  If it is confirmed in step S52 that the camera mode is selected, the process proceeds to the next step S53. If it is confirmed in step S52 that a mode other than the camera mode has been selected, the process proceeds to the process sequence of FIG. 13 (process of step S71) (see reference numeral 13A in FIGS. 12 and 13).

  In step S53, the control unit (not shown) of the terminal device 40 confirms whether or not a specific imaging device 10 as a communication partner has already been designated. This process corresponds to the process in step S22 of FIG. Here, if it is confirmed that the imaging apparatus 10 has already been designated, the process proceeds to the next step S55. If the imaging device 10 is not designated, the process proceeds to step S54.

  In step S54, a control unit (not shown) of the terminal device 40 performs an operation for designating a specific imaging device 10 to be a communication partner in response to a predetermined operation by the user. This designation operation is, for example, an input operation of communication connection settings (for example, connection ID, password, etc.) for establishing communication between the terminal device 40 and the imaging device 10. When the information input operation for communication connection setting by the user is completed, the control unit (not shown) of the terminal device 40 records these information as electronic data in a predetermined area or the like in the recording unit 44. Thereafter, the process returns to step S53.

  Next, in step S <b> 55, the control unit (not shown) of the terminal device 40 starts a predetermined communication process via the communication unit 71 for the specified specific imaging device 10.

  Subsequently, in step S56, a control unit (not shown) of the terminal device 40 confirms whether or not communication with the specified specific imaging device 10 has been established. Here, when communication between the two is established (communication OK), the process proceeds to the next step S58. If communication between the two is not established (communication NG), the process proceeds to step S57.

  If communication between the terminal device 40 and the imaging device 10 cannot be established and the process proceeds to step S57, in step S57, the control unit (not shown) of the terminal device 40 performs the position information clock information unit 47. Referring to, after a predetermined time has elapsed, a predetermined warning is displayed on the display unit. Thereafter, the process returns to step S32, and the subsequent processes are repeated.

  On the other hand, when it is confirmed that the communication between the terminal device 40 and the specified specific imaging device 10 has been established in the process of step S56 described above, and the process proceeds to step S58, in step S58, A control unit (not shown) of the terminal device 40 confirms whether to perform imaging pre-processing. Here, the imaging pre-processing is blackboard specification data creation processing or the like. When performing this imaging pre-processing, the user performs an input operation for starting the imaging pre-processing from the operation unit 43 of the terminal device 40. Then, when the execution of the imaging pre-processing is confirmed, the process proceeds to the next step S59. When the imaging pre-processing is not performed, the process proceeds to the processing sequence of FIG. 14 (step S81 processing) (see reference numeral 14A in FIGS. 12 and 14).

  In step S59, the control unit (not shown) of the terminal device 40 executes imaging pre-processing. Here, first, a control unit (not shown) of the terminal device 40 controls the terminal-side second communication unit 46 to access the external server 60 via the network 70, and from the external server 60, a predetermined recording target construction is performed. To obtain (download) construction design drawing data 61 corresponding to the above.

  Subsequently, in step S60, a control unit (not shown) of the terminal device 40 confirms whether or not a recording object is designated. Here, the user refers to the construction design drawing data 61 acquired in the process of step S59 described above, and performs an operation of selecting and specifying a desired recording object from the data. When it is confirmed that the recording target has been designated, the process proceeds to the next step S61. If the recording object is not designated, the designation input is waited.

  Next, in step S61, a control unit (not shown) of the terminal device 40 creates blackboard specification data related to the recording target designated in the process of step S60 described above. The blackboard specification data created here may be automatically created by fetching predetermined information from the construction design drawing data 61, or the user may input necessary information arbitrarily. It may be.

  In the blackboard specification data, in addition to the template image data of the blackboard image, the frame image data for the simplified version of the blackboard image, etc., information common to the target construction subject to recording (information of construction name, location, etc.) And information specific to the recording object (information such as the object name, arrangement position, and size).

  The blackboard specification data includes a specific number for a simplified blackboard image. The specific number of the recording object may be numbered in the order of creation of the blackboard specification data created for each recording object (numbers are sequentially assigned), or may be arbitrarily input by the user. Also good.

  Subsequently, in step S62, the control unit (not shown) of the terminal device 40 confirms whether or not to end the imaging pre-processing. Here, when the end instruction signal of the imaging pre-processing is confirmed, the process proceeds to the next step S63. On the other hand, when the end instruction signal for the imaging pre-processing is not confirmed, the processing returns to step S60 and the subsequent processing is repeated. That is, until the user performs an operation for generating an imaging pre-processing end instruction signal, the user can continue to specify each recording object and create blackboard specification data related to the specified recording object. it can.

  When the completion instruction signal for the imaging pre-processing is confirmed and the process proceeds to the next step S63, in step S63, the control unit (not shown) of the terminal device 40 captures the plurality of blackboard specification data that have been created. 10 to confirm whether or not to transfer. Here, when a transfer processing instruction signal to the imaging device 10 is confirmed in response to an operation by the user, the process proceeds to the next step S64. If the transfer processing instruction signal to the imaging device 10 is not confirmed, the process returns to step S52 described above.

  Subsequently, in step S <b> 64, a control unit (not shown) of the terminal device 40 transmits information such as various setting conditions (including prohibited items) to the imaging device 10. Thereafter, the process returns to step S52.

  On the other hand, when it is confirmed in the process of step S52 described above that a mode other than the camera mode has been selected, the process proceeds to step S71 of FIG. 13 (reference numeral 13A in FIGS. 12 and 13). A control unit (not shown) of the apparatus 40 confirms whether or not the operation mode selected in the process of step S52 (FIG. 12) is the document creation mode. If it is confirmed that the document creation mode is selected, the process proceeds to the next step S72. If a mode other than the document creation mode is selected, the process proceeds to step S74.

  In step S72, the control unit (not shown) of the terminal device 40 receives an operation by the user, and selects a plurality of synthesized image data (image data acquired at the site and the image data associated with the selected image data). Image data obtained by synthesizing the blackboard specification data; see FIG. 7) is displayed on the display unit 42 as a list, and the series of synthesized image data is collectively transmitted to the external server 60.

  Subsequently, in step S73, a control unit (not shown) of the terminal device 40 executes a document creation process. This document creation process is defined in advance by, for example, a selected series of composite image data, blackboard specification data associated therewith, and various corresponding information (predetermined information extracted from construction design drawing data). This is a process of creating a recorded report (document) in the form (format). This recording report creation processing is performed in a batch based on a plurality of composite image data and various related information related to a predetermined recording target construction or the like. Thereafter, the series of processes is terminated, and the process returns to the above-described process of step S51 in FIG. 12 (see reference numeral 13B in FIGS. 13 and 12).

  If it is confirmed in step S71 that other than the document creation mode, the process proceeds to step S74. In this step S74, the control unit (not shown) of the terminal device 40, for example, works design drawing data. Execute other operation modes such as acquisition mode. Since these other operation modes are not directly related to the present invention, the description thereof is omitted. Thereafter, the series of processes is terminated, and the process returns to the above-described process of step S51 in FIG. 12 (see reference numeral 13B in FIGS. 13 and 12).

  On the other hand, when the imaging pre-processing is not performed in the process of step S58 described above, the process proceeds to the process of step S81 in FIG. 14 (see reference numeral 14A in FIG. 12 and FIG. 14). A control unit (not shown) checks whether or not to execute the image acquisition / synthesis process.

  This image acquisition / synthesis process includes a process of acquiring a plurality of image data acquired from the imaging device 10 and a plurality of blackboard specification data associated with the plurality of image data, a plurality of image data acquired thereby, This is a series of processes for creating a composite image data with a blackboard image by performing a predetermined image composition process based on the blackboard specification data.

  Here, when the instruction to execute the image acquisition / synthesis process is confirmed, the process proceeds to the next step S82. When the instruction to execute the image acquisition / synthesis process is not confirmed, the process returns to the process of step S51 in FIG. 12 (see reference numeral 14B in FIGS. 14 and 12).

  In step S <b> 82, the control unit (not shown) of the terminal device 40 accesses the imaging device 10 via the terminal-side first communication unit 41, and a plurality of image data recorded in the recording unit 20 of the imaging device 10. The blackboard specification data associated with the plurality of image data is fetched in a batch. The captured image data and the like are recorded in a predetermined storage area of the recording unit 44 in the terminal device 40.

  After the completion of the capturing process, the control unit (not shown) of the terminal device 40 further controls the recording unit 44 and the display unit 42 to execute thumbnail list display of the plurality of captured image data.

  Subsequently, in step S83, a control unit (not shown) of the terminal device 40 confirms whether or not the user has selected desired image data. If the image data selection instruction is confirmed, the process proceeds to the next step S84. When the image data selection instruction is not confirmed, the selection instruction is waited.

  In step S84, the control unit (not shown) of the terminal device 40 reads out the image data selected and instructed in the process of step S83 from the recording unit 44, reproduces and displays it on the display unit 42, and displays the image data in the image data. With reference to the associated blackboard specification data, a predetermined blackboard image is superimposed and displayed on the image data being displayed at a specified position and size. At the same time, the image processing unit 45 executes a composition process of the image data and the corresponding blackboard image to create composite image data with a blackboard image.

  Next, in step S84A, collation information is created for the created composite image data by a collation information creation unit (not shown) in the image processing unit 45, and is recorded in the recording unit 44 in association with the composite image data. .

  Subsequently, in step S85, a control unit (not shown) of the terminal device 40 confirms whether or not to end the image acquisition synthesis process. If the end instruction signal for the image acquisition / synthesis process is not confirmed, the process returns to the above-described step S83, and the subsequent processes are repeated. That is, until the user performs an operation to generate an image acquisition / combination end instruction signal, the user performs an operation of selecting image data for the synthesis process and continues to create a desired composite image data with a blackboard image. be able to. Further, when the end instruction signal for the image acquisition / synthesis processing is confirmed, the series of processing ends, and the processing returns to the processing in step S51 in FIG. 12 described above (see reference numeral 14B in FIGS. 14 and 12).

  As described above, according to the above-described embodiment, in the terminal device 40, each imaging target is based on the information data group related to the recording target construction (recording target event) including the plurality of incidental information regarding the plurality of imaging targets. By creating a plurality of accompanying information images (plural blackboard specification data) corresponding to each of the objects in advance by the terminal device and transferring the plurality of accompanying information images (plural blackboard specification data) to the imaging device 10 In the imaging device 10, when generating image data of the imaging object, an image based on the image data is displayed on the display unit 17 and displayed on the display unit 17 among the plurality of accompanying information images. A specific accompanying information image corresponding to the image inside is superimposed and displayed at a predesignated position in the display screen with a predesignated size.

  In this state, when image data is acquired by executing an imaging operation by the imaging apparatus 10, blackboard image data representing the accompanying information image corresponding to the acquired image data is recorded in association with it. .

  When the image data thus recorded and the associated blackboard image data are transferred to the terminal device 40 side and the image data is displayed on the terminal device 40 side, the terminal device 40 displays the image data being displayed, The image data of the corresponding accompanying information image (blackboard image) is synthesized to generate and record the synthesized image data.

  In the imaging device 10, the acquired image data and the associated information image data (blackboard image data) corresponding thereto are recorded in association with each other, and at the same time, the image data being displayed and the corresponding accompanying information image (blackboard image) are recorded. It is also possible to generate composite image data by combining the image data.

  In this case, if the set size of the blackboard image to be combined and combined with the recording image size set in the imaging device 10 is inappropriate (for example, too small), a warning display to that effect is displayed. Like to do. As a result, the user performs a blackboard image resetting operation, so there is no possibility of associating an inappropriate blackboard image, thus preventing failure and reliably obtaining desired composite image data. can do.

  Note that each process sequence described in each of the above-described embodiments can allow a change in procedure as long as it does not contradict its nature. Therefore, for each of the above-described processing sequences, for example, the order of the processing steps is changed each time the processing order is changed, the processing steps are executed simultaneously, or a series of processing sequences are executed. It may be. That is, even if the operation flow in the claims, the description, and the drawings is described using “first”, “next”, etc. for the sake of convenience, it means that it is essential to carry out in this order. Not what you want. Further, it goes without saying that in each step constituting these operation flows, it is possible to appropriately omit portions that do not affect the essence of the invention.

  Of the technologies described here, many of the controls and functions described mainly in the flowcharts are often settable by a software program. The computer program reads and executes the software program described above. Control and functions can be realized. The software program is a computer program product in advance in the product manufacturing process, such as the storage medium or storage unit, specifically, a portable medium such as a flexible disk CD-ROM or a non-volatile memory, a hard disk volatile memory, or the like. Electronic data that is stored or recorded in whole or in part on a storage medium. Apart from this, it can be distributed or provided at the time of product shipment or via a portable medium or a communication line. Users can operate by downloading their software programs and installing them on a computer or installing them from a storage medium via a communication network or the Internet even after the product is shipped. As a result, the imaging apparatus of the present embodiment can be easily realized. Further, the imaging unit and the display unit may be separate. In this case, the display device for imaging is invented.

  The present invention is not limited to the above-described embodiments, and it is needless to say that various modifications and applications can be implemented without departing from the spirit of the invention. Further, the above embodiments include inventions at various stages, and various inventions can be extracted by appropriately combining a plurality of disclosed constituent elements. For example, even if several constituent requirements are deleted from all the constituent requirements shown in the above-described embodiment, if the problem to be solved by the invention can be solved and the effect of the invention can be obtained, this constituent requirement is deleted. The configured structure can be extracted as an invention. Furthermore, constituent elements over different embodiments may be appropriately combined. The invention is not limited by the specific embodiments thereof, except as limited by the appended claims.

  The present invention is not limited to an imaging apparatus specialized for an imaging function such as a digital camera, and other forms of electronic devices having an imaging function, such as a video camera, a mobile phone, a smartphone, an electronic notebook, an electronic dictionary, The present invention can be widely applied to various electronic devices with an imaging function such as a portable information terminal, a personal computer, a tablet terminal device, a game device, a television, a clock, and a navigation device using a GPS (Global Positioning System).

DESCRIPTION OF SYMBOLS 1 ... Imaging system 10 ... Imaging device 11 ... Body unit 12 ... Image processing part 13 ... Imaging part 14 ... Lens control part 15 ... Body side 1st communication part 16 ... Sensor part 17 ... Imaging Device side display unit 18... Imaging device side operation unit 19... Second body side communication unit 20... Imaging device side recording unit 21... Composite image creation unit 22. ... Display control section 25 ... Collation information creation section 31 ... Lens unit 32 ... AF section 33 ... Zoom section 34 ... Lens side communication section 40 ... Terminal device 41 ... Terminal side first communication section 42 ... Terminal side display unit 43 …… Terminal side operation unit 44 …… Terminal side recording unit 45 …… Terminal side image processing unit 46 …… Terminal side second communication unit 47 …… Position information clock information unit 51, 61 …… Construction design Drawing data 52, 62 ... Blackboard specification data 53 ... Imaging device specification data 60 ... external server 63 ... image data 70 ... network 71 ... communication means 101 ... first user 102 ... second user 201 ... template image 202 ... blackboard images 211a and 211b …… Warning indication 300 …… Recording object

Claims (23)

An imaging unit that receives an optical image of the object and generates and outputs image data;
A display unit that displays an image based on the image data output from the imaging unit and various types of information, a communication unit that communicates with a terminal device to acquire accompanying information about the object, and
A display control unit that superimposes and displays an image based on the accompanying information corresponding to the image in the image being displayed on the display unit;
Comprising
The image pickup apparatus, wherein the display control unit performs display control for displaying an image based on the accompanying information at a position specified in advance in a display screen of the display unit. An operation unit for performing an operation of changing a display position and a display size in the display screen of the image based on the accompanying information;
2. The display control unit according to claim 1, wherein the display control unit performs display control to change a display position and a display size of an image based on the accompanying information in accordance with a display change operation by the operation unit. Imaging device.   The communication unit transfers information about a display position and a display size of an image on the display screen based on the accompanying information changed by the display control unit in response to a display change operation by the operation unit to the terminal device. The imaging apparatus according to claim 2.   The imaging apparatus according to claim 1, further comprising a recording unit that records the image data output from the imaging unit in association with the accompanying information corresponding to the image data. A composite image creating unit that generates composite image data by combining the image data output from the imaging unit and the image data of the accompanying information image based on the corresponding accompanying information;
The imaging apparatus according to claim 4, wherein the recording unit records the composite image data generated by the composite image creation unit.   The imaging apparatus according to claim 5, further comprising a collation information creating unit that calculates, as collation information, a detection value for detecting falsification of the composite image from the composite image data.   The imaging apparatus according to claim 6, wherein the recording unit records the composite image data and the verification information in association with each other. The communication unit transfers the composite image data to the terminal device,
The image pickup apparatus according to claim 6, wherein, in the transfer, the composite image data and the collation information are transferred in association with each other.   The display control unit displays an image different from the accompanying information image included in the image based on the composite image data when the accompanying information image is superimposed on the image being displayed on the display unit. The imaging apparatus according to claim 1, wherein control is performed.   The imaging apparatus according to claim 9, wherein the display control unit causes an image in a simplified form based on the accompanying information to be superimposed on an image being displayed on the display unit. A resolution determination unit that determines whether or not the size of the accompanying information image is appropriate based on preset recording image size information and the size information of the accompanying information image set by the operation unit; And
The imaging apparatus according to claim 2, wherein the display control unit performs control to display a predetermined warning display on the display screen of the display unit when the determination result by the resolution determination unit is negative. .   The resolution determination unit is inappropriate for the incidental information image size set by the operation unit when the incidental information image size set by the operation unit is smaller than a predetermined minimum value. The imaging apparatus according to claim 11, wherein it is determined that the determination result is negative.   The display control unit, when the determination result by the resolution determination unit is NO, performs the warning display and at the same time, further displays a display for prompting a resetting operation of the accompanying information image size. Item 12. The imaging device according to Item 11. An imaging unit that receives an optical image of an object to generate and output image data, a display unit that displays an image and various information based on the image data output from the imaging unit, and a terminal device communicate with each other. A body-side communication unit that performs acquisition of accompanying information related to the object, and display control that superimposes and displays an image based on the accompanying information corresponding to the image in an image being displayed on the display unit at a predetermined position. An imaging device comprising:
A terminal-side communication unit that communicates with the imaging device via the body-side communication unit; a recording unit that records an information data group related to a recording target event including a plurality of accompanying information related to a plurality of imaging objects; A terminal device comprising: an image processing unit that creates an accompanying information image based on the accompanying information on each of the imaging objects based on the information data group recorded in the recording unit;
An imaging system, comprising:   The terminal device further includes a recording unit that records the image data acquired by the imaging device in association with the image data representing the accompanying information image corresponding to the image data. The imaging system according to claim 14.   The image processing apparatus further includes a composite image creating unit that generates composite image data obtained by combining image data acquired by the imaging device and image data representing the accompanying information image corresponding to the image data. Item 15. The imaging system according to Item 14.   The imaging system according to claim 16, wherein the terminal device further includes a collation information creating unit that calculates, as collation information, a detection value for detecting falsification of the composite image from the composite image data.   The imaging system according to claim 17, wherein the recording unit of the terminal device records the composite image data and the collation information in association with each other. Creating a plurality of accompanying information images corresponding to each of the individual imaging objects based on an information data group related to a recording target event including a plurality of accompanying information about a plurality of imaging objects;
Transferring the plurality of accompanying information images between the terminal device and the imaging device;
Receiving the optical image of the imaging object, generating image data,
An image based on the image data is displayed and a specific accompanying information image corresponding to the image being displayed among the plurality of accompanying information images is superimposed and displayed at a predetermined position in the display screen,
An image pickup method comprising: recording image data representing an image being displayed in association with data representing the accompanying information image corresponding to the image data. Creating a plurality of accompanying information images corresponding to each of the individual imaging objects based on an information data group related to a recording target event including a plurality of accompanying information about a plurality of imaging objects;
Receiving the optical image of the imaging object, generating image data,
An image based on the image data is displayed, and a specific accompanying information image corresponding to the image being displayed among the plurality of accompanying information images is superimposed and displayed at a predetermined position in the display screen.
An imaging program characterized in that image data representing an image being displayed and data representing the accompanying information image corresponding to the image data are recorded in association with each other. A display unit that displays an image based on image data from an imaging unit that receives an optical image of an object and generates and outputs image data;
A communication unit that communicates with a terminal device to acquire accompanying information about the object;
A display control unit that superimposes and displays an image based on the accompanying information corresponding to the image in the image being displayed on the display unit;
Comprising
The display device for imaging, wherein the display control unit performs display control for displaying an image based on the accompanying information at a position specified in advance in a display screen of the display unit. An operation unit for performing an operation of changing a display position and a display size in the display screen of the image based on the accompanying information;
The display control unit according to claim 21, wherein the display control unit performs display control to change a display position and a display size of an image based on the accompanying information in accordance with a display change operation by the operation unit. Imaging display device.   The communication unit transfers information about a display position and a display size of an image on the display screen based on the accompanying information changed by the display control unit in response to a display change operation by the operation unit to the terminal device. The display device for imaging according to claim 22.

Images