JP4380059B2 - Imaging system, imaging apparatus, imaging method, and recording medium - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
  The present invention relates to an imaging system, an imaging apparatus,Imaging methodAnd a recording medium.
[0002]
[Prior art]
In a conventional digital camera, a liquid crystal display panel mounted on the camera body is used as an electronic viewfinder, and capture processing is executed by operating a shutter switch while an image of a subject is displayed on a monitor, and captured image data is built-in. Recorded in memory or memory card.
[0003]
  When it is desired to synthesize a captured image with other image data (including graphic data), it is common to use another information device having an image composition function, such as a personal computer. As a method of transferring captured image data to a computer, a memory card that records captured image data is used.Camera bodyAnd connecting the camera body to the computer with a communication cable and transferring image data from the camera body to the computer.
[0004]
A digital camera having an image composition function is also known, and such a camera can shoot while confirming the composition result. That is, by displaying the subject image on the electronic viewfinder screen with the composition source image overlapped on the screen of the electronic viewfinder, the composited image can be confirmed in advance on the electronic viewfinder. The shutter is operated. After that, the synthesis process is actually executed.
[0005]
If you want to add additional information such as text data and numerical data to the shot image, similarly, transfer the shot image data to another information device and add it on another information device, or add information to the digital camera itself. This is possible by any method using a digital camera having a function.
[0006]
In a conventional digital camera, a storage location (directory) and a storage file name in a memory for storing captured image data are determined in advance for each digital camera and cannot be determined freely by a user.
[0007]
[Problems to be solved by the invention]
  In the conventional example, when an image composition process or an information addition process is performed on an information device other than a camera, a captured image must be transferred to the information device, which requires a troublesome operation. If the camera itself has an image composition processing function or information addition processing function, there is no need to transfer the captured image.. HoweverSince the camera is designed and manufactured with emphasis on portability,The capacity of the recording medium in the camera is not large, and it has been impossible to store a sufficient amount of data to be combined with the captured image in the recording medium in the camera. Therefore, there are few choices of data to be combined to be combined with the photographed image. Also, because the camera is designed and manufactured with emphasis on portability,There are few operation keys, and it is very troublesome to create additional information data with a camera.
[0008]
If the photographed image can be saved in a desired directory with a desired file name, image composition processing or information addition processing is facilitated. However, in the conventional example, such a selection is impossible.
[0009]
  The present invention provides an imaging system, an imaging apparatus,Imaging methodAnd to provide a recording medium.
[0010]
[Means for Solving the Problems]
  An imaging system according to the present invention is an imaging system including an imaging device and an information processing device capable of communicating with the imaging device, and the imaging device converts an optical image into an image signal;A receiving unit that receives an operation instruction in the composite shooting mode among a plurality of operation modes including at least a composite shooting mode, another shooting mode, and a playback mode based on an operation on the operation unit; In response to receiving an operation instruction in the composite shooting mode by the means,Composite shootingmodeIs transmitted to the information processing apparatus, and the information processing apparatus synthesizes the captured image with the captured image.Graphic data forFirst communication means for receiving the synthesized data, temporary storage means for temporarily storing the synthesized data received by the first communication means, and the synthesized data stored in the temporary storage means from the imaging means Composite to input imageDisplay control means for controlling to display on the display means, and after the synthesized data and the input image are combined and displayed by the display control means,Depending on the operation of the shutter switch, the imaging meansI took a pictureCombining means for synthesizing the synthesized data with the photographed image, and control means for controlling the synthesized image output from the synthesizing means to be stored in a storage device, wherein the information processing apparatus converts the synthesized data into Storage means for storing and communication means for communicating with the first communication means, wherein second data is transmitted to the image pickup apparatus in accordance with reception of the command from the image pickup apparatus. Means.
  The recording medium according to the present invention includes a first computer and a second computer that can communicate with each other, the first computer based on an operation on an imaging unit that converts an optical image into an image signal and an operation unit. Receiving means for receiving an operation instruction in the composite shooting mode among a plurality of operation modes including at least the composite shooting mode, another shooting mode, and a playback mode; and operating in the composite shooting mode by the receiving means In response to receiving the instruction, the command indicating execution of the composite shooting mode is transmitted to the second computer, and the combined data, which is graphic data for combining with the captured image from the second computer, is transmitted. First communication means for receiving, temporary storage means for temporarily storing the synthesized data received by the first communication means, and storage by the temporary storage means The combined data and the input image are combined and displayed by the display control unit for controlling the combined data to be displayed on the display unit after being combined with the input image from the imaging unit. Later, it functions as a synthesizer for synthesizing the data to be synthesized with a photographed image taken by the imaging means in response to an operation of a shutter switch, and as a controller for controlling the synthesized image output from the synthesizer to be stored in a storage device. Storage means for storing the data to be synthesized and communication means for communicating with the first communication means, wherein the second computer is stored in the storage means in accordance with the reception of the command from the first computer. A computer recording a program for functioning as second communication means for transmitting the combined data to be transmitted to the first computer Over data is readable recording medium.
  An imaging apparatus according to the present invention is an imaging apparatus capable of communicating with an information processing apparatus, and includes at least a composite shooting mode based on an imaging unit that converts an optical image into an image signal, and an operation on the operation unit, and other Of a plurality of operation modes including a shooting mode and a playback mode, a reception unit that receives an operation instruction in the composite shooting mode, and a response that the reception unit receives an operation instruction in the composite shooting mode A communication unit that transmits a command indicating execution of the composite shooting mode to the information processing apparatus and receives data to be combined that is graphic data to be combined with a captured image from the information processing apparatus; and the communication unit Temporary storage means for temporarily storing the received combined data, and the combined data stored in the temporary storage means combined with an input image from the imaging means A display control unit that controls display on the display unit, and the display control unit that synthesizes and displays the combined data and the input image, and then captures images taken by the imaging unit in response to an operation of a shutter switch. The image processing apparatus includes combining means for combining the data to be combined with an image, and control means for controlling to store a combined image output from the combining means in a storage device.
  An imaging method according to the present invention is an imaging method in an imaging device capable of communicating with an information processing device, and includes an imaging step for converting an optical image into an image signal, and at least a composite shooting mode based on an operation on an operation unit. Among the plurality of operation modes including other shooting modes and playback modes, a reception step for receiving an operation instruction in the composite shooting mode, and an operation instruction in the composite shooting mode in the reception step Accordingly, a communication step of transmitting a command indicating execution of the composite shooting mode to the information processing apparatus and receiving combined data that is graphic data for combining with the captured image from the information processing apparatus; Temporary storage step for temporarily storing the data to be combined received in the communication step, and the compound to be combined stored in the temporary storage step A display control step for controlling the image to be combined with the image captured in the imaging step and displaying it on the display means, and after the combined data and the input image are displayed by the display control step, A synthesis step of synthesizing the data to be synthesized with the captured image captured in the imaging step according to an operation of a shutter switch; and a control step of controlling to store the synthesized image generated by the synthesis step in a storage device. It is characterized by that.
  The recording medium according to the present invention includes a computer communicable with an information processing apparatus, an imaging unit that converts an optical image into an image signal, and at least a composite shooting mode based on an operation to the operation unit, and other shooting modes, A receiving unit that receives an operation instruction in the composite shooting mode from among a plurality of operation modes including a playback mode; and the composite shooting in response to receiving an operation instruction in the composite shooting mode by the receiving unit A communicator for transmitting a command indicating execution of a mode to the information processing apparatus and receiving data to be synthesized which is graphic data for compositing with a captured image from the information processing apparatus; and the data to be synthesized received by the communication means Temporary storage means for temporarily storing the data to be combined, and the combined data stored in the temporary storage means combined with an input image from the imaging means for display means Display control means for controlling the display, and the display control means synthesizes and displays the combined data and the input image, and then displays the captured image taken by the imaging means in response to an operation of a shutter switch. A computer-readable recording medium that records a program for functioning as a synthesis unit that synthesizes synthesized data and a control unit that controls to store a synthesized image output from the synthesis unit in a storage device.
[0022]
【Example】
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0023]
FIG. 1 shows a schematic block diagram of a first embodiment of the present invention. Reference numeral 10 denotes a digital camera, and 30 denotes an information processing apparatus having an image composition function. Both the camera 10 and the information processing apparatus 30 are battery-driven portable types and can be used outdoors.
[0024]
The camera 10 includes a control circuit 12, an imaging unit 14, a storage device 16, a display device 18, operation keys 20, and a communication circuit 22. The photographing unit 14, the storage device 16, the display device 18, the operation key 20, and the communication circuit 22 are connected to the control circuit 12, and the control circuit 12 performs overall control thereof. The control circuit 12 also executes digital processing including compression processing of captured image data from the imaging unit 14, interpretation and execution of commands received by the communication circuit 22, control corresponding to instructions from the operation keys 20, and the like.
[0025]
The imaging unit 14 includes a photographing lens, an imaging element, and a digital image processing circuit. The image sensor converts an optical image obtained by the photographing lens into an electric signal. The digital image processing circuit digitizes an image signal output from the image sensor, performs exposure correction and white balance correction, converts the image signal into a YUV format, and outputs the YUV format. The imaging unit 14 also has a composite photographing function (described later) that synthesizes other graphic data and the like with the photographed image.
[0026]
The storage device 16 is a flash memory that stores image data photographed by the photographing unit 14 and compressed by the control circuit 12, a ROM (read-only memory) that stores a control program executed by the control circuit 12, and a control. The program includes a RAM (random access memory) that is used as a work area and temporarily stores captured image data. The storage device 16 also includes connection means for connecting an external memory card.
[0027]
The display device 18 includes D / A conversion means for converting YUV digital image data into NTSC analog signals, a TFT color liquid crystal display panel (LCD), its control circuit, and drive circuit. The TFT color LCD is about 1.8 inches in size and has a QVGA size (320 × 240 dots) number of pixels capable of displaying an NTSC image.
[0028]
The operation key 20 includes various switches for instructing operation modes and the like, and a shutter switch for photographing. When the operator operates a predetermined operation key, the control circuit 12 operates with a corresponding program.
[0029]
The communication circuit 22 can transmit / receive image data and control commands to / from an external communication device. In the case of wireless communication, the communication circuit 22 includes an antenna and an RF module.
[0030]
The information processing device 30 includes a control circuit 32, a storage device 34, a display device 36, a tablet 38, and a communication circuit 40. The storage device 34, the display device 36, the tablet 38, and the communication circuit 40 are connected to the control circuit 32, and the control circuit 32 performs overall control thereof.
[0031]
The control circuit 32 controls communication by the communication circuit 40, can create graphic data and text data used for composite shooting, and controls each unit in accordance with an operation command input from the tablet 38.
[0032]
The storage device 34 is a ROM (Read Only Memory) that stores a control program executed by the control circuit 32, and is used as a work area by the control program, such as graphic data, text, and numerical values created for composite photography. It consists of a RAM (Random Access Memory) that temporarily stores data, and a flash memory that stores image and graphic data samples used for synthesis.
[0033]
The display device 36 includes conversion means for converting various graphic data into digital RGB signals, a TFT color liquid crystal display panel (LCD), its control circuit, and drive circuit. The TFT color LCD has a VGA size (640 × 480 dots) of a size of 4 inches or more and can display an image with high definition.
[0034]
The tablet 38 is integrated with the TFT color LCD of the display device 36, and the operator can input a desired instruction to the control circuit 32 by operating the tablet 38 with a pen or the like.
[0035]
The communication circuit 40 can transmit and receive image data and control commands to and from the communication circuit 22. In the case of wireless communication, the communication circuit 40 includes an antenna and an RF module.
[0036]
The control processing procedure of this embodiment will be described in detail with reference to the flowcharts in FIG.
[0037]
FIG. 2 shows a flowchart of main processing in the camera 10. The presence / absence of a composite shooting operation instruction by the operation key 20 is checked (S1), and if it is not the composite shooting mode (S1), the corresponding processing, for example, normal shooting processing, playback processing, editing processing, environment setting processing, and the like are executed. (S2). In the composite shooting mode (S1), a compositing instruction command is transmitted from the communication circuit 22 to a predetermined communication partner (here, the communication circuit 40 of the information processing apparatus 30) (S3). The communication partner is registered in the camera 10 in advance.
[0038]
For example, if a transmission error occurs due to factors such as the communication partner is not turned on, the communication partner is not in reception mode, or the communication partner is not in a place where communication is possible (S4), error processing is executed. The process ends (S8). In this error processing, an error message is displayed on the display device of the camera 10, and the operator is made to select a desired operation from resending, canceling the composite photographing processing, switching to the normal photographing mode, and the like.
[0039]
If there is no transmission error (S4), the communication circuit 22 is switched to the reception mode and a response from the communication partner is waited (S5). When a certain time elapses without any response from the communication partner (S6, S7), various factors (for example, the communication partner is turned off, the communication partner cancels communication, or the communication partner cannot reply) If the communication partner is out of a place where communication is possible, the communication partner is deemed not to be in a communicable state, and error processing is executed (S8).
[0040]
When the synthesized data is received from the communication partner (here, the information processing device 30) (S6), the received synthesized data is temporarily stored in the RAM of the storage device 16 (S9). An image composite photographing process is executed (S10). The composite photographing process is temporarily stored in the RAM in a state in which a finder process (a process of using the display device 18 of the camera 10 as an electronic viewfinder to display an input image from the photographing lens on a monitor) is being executed. When the combined data is displayed in an overlapping manner and the operator presses the shutter switch, the imaging unit 14 superimposes the combined data on the image signal from the image sensor and generates YUV format image data. Consists of. FIG. 3 shows how a composite image is obtained by superimposing composite data on a captured image.
[0041]
As shown in FIG. 3, the method of combining the captured image and the combined data includes a method of superimposing the combined data on the captured image, a method of combining them in independent regions, There are a method of taking a logical sum and a method of combining data to be combined as semi-transparent. The operator can select and specify in advance what kind of synthesis method is employed.
[0042]
The control circuit 12 compresses the composite image data in the YUV format from the imaging unit 14 by the JPEG method (S11), and saves it as a JPEG file in the flash memory of the storage device 16 (S12).
[0043]
FIG. 4 shows a flowchart of the main process of the information processing apparatus 30. It is determined whether or not it is a mode (composite shooting mode) in which image shooting processing is executed in cooperation with the camera 10 (S21). In other modes (S21), the corresponding processing is executed and the processing is terminated (S22). .
[0044]
In the case of the composite shooting mode (S21), the communication circuit 40 is switched to the reception mode and a command from the camera 10 is waited (S23). When a composite shooting instruction command is received (S24), menu items representing a method for creating image data are displayed on the screen (S25), and the operator is made to select them (S26). The creation method displayed on the menu includes (1) manually creating data to be combined (image data or graphic data) to be combined with a photographed image using a tool or the like, and (2) pre-saving in the storage device 34. There are two ways to select from the data that has been recorded.
[0045]
  When manual creation is selected (S26), composite data is created by image processing software such as an image editor, a graphic editor, and a paint tool. FIG. 5 shows a schematic diagram of a pattern for creating data to be synthesized. On the tablet 38 integrated with the display device 36InEnter desired characters and figures with the pen 42 or the like. The entry shape is input as image data and displayed on the screen of the display device 36 as it is, following the entry. The created data is temporarily stored in the RAM of the storage device 34 (S30), and transmitted from the communication circuit 40 to the camera 10 (S31).
[0046]
When manual creation is not selected (S26), sample images stored in the flash memory of the storage device 34 are displayed as a list as illustrated in FIG. The operator selects a desired sample image from the list display (S29). The selected sample image is temporarily stored in the RAM of the storage device 34 (S30), and transmitted from the communication circuit 40 to the camera 10 (S31).
[0047]
FIG. 6 is a display example of a list screen of image and graphic data. Each image 44 is displayed in a small size, but is stored in the flash memory of the storage device 34 in a full size (640 × 480 dots). A frame 46 indicating the selected state is displayed together with the image 44 being selected. When a desired image is touched with a pen, the image touched with the pen is selected and displayed with a frame. When the adoption icon 48 is pen-touched with any image selected, the image currently selected is adopted as the data to be combined. When the selected image is pen-touched again or a desired image is double-touched with the pen, the image is displayed in full size on the entire screen. Thereby, a synthesized image can be confirmed in detail.
[0048]
In the above-described embodiment, when performing composite shooting, a command for instructing execution of composite shooting is transmitted from the camera 10 to the information processing apparatus 30 and then the data to be combined is created (selected) in the information processing apparatus 30. The present invention is not limited to this. For example, the combined data created by the information processing apparatus 30 must match the image data photographed by the camera 10 with the pixel size and photographing direction (horizontal or vertical). For this purpose, parameters indicating various shooting conditions may be added to the command transmitted from the camera 10 to the information processing apparatus 30.
[0049]
FIG. 7 shows a flowchart in the case where a parameter indicating the seed photographing condition is added in the command transmission process (S3). A shooting size (number of shooting pixels) is selected (S41). Shooting sizes include, for example, UXGA size (1600 × 1200 dots), SXGA (1280 × 1024 dots), XGA (1024 × 768 dots), VGA (640 × 480 dots), and the like. Next, the shooting direction is selected (S42). The shooting direction is vertical shooting or horizontal shooting. In these selection processes, options are displayed on the display device 18 of the camera 10, and the operator operates the cursor keys to select the options, or the dials or keys are assigned options, and the operator directly operates the dials or keys. And use the method you choose.
[0050]
Transmission data reflecting the selected condition is created (S43), and transmitted from the communication circuit 22 to the information processing apparatus 30 as an instruction command for the composite photographing operation (S44).
[0051]
FIG. 8 shows an example of the structure of the transmission data created in S43. Reference numeral 50 denotes a code indicating a command for instructing composite shooting. When the information processing apparatus 30 receives the command, the information processing apparatus 30 interprets the code and executes a process for composite photography. 52 is a parameter indicating the shooting size, and 54 is a parameter indicating the shooting direction. The shooting size parameter 52 is assigned 2 bytes each in vertical and horizontal directions. For example, in the case of the UXGA size, 0 × 0640 and 0 × 0460 are stored. The parameter 54 indicating the shooting direction stores 0 for horizontal shooting and 1 for vertical shooting.
[0052]
The information processing apparatus 30 creates (selects) synthesized data according to parameters added to the command from the camera 10. In the case of manual creation, an image size and direction that match the designated shooting size and direction are set as default values for image creation. When selecting from the list display, image samples having image sizes and directions that match the designated shooting size and direction are displayed as a list.
[0053]
In the above-described embodiment, the camera 10 receives the combined data for performing the composite photographing of the image from the information processing apparatus 30 and uses it for the finder processing of the camera 10, but the present invention is not limited to this. In other words, in the embodiment shown in FIG. 1, various types of information to be added to the captured image data are created by the information processing apparatus 30, transmitted to the camera 10, and the various types of information are added and stored simultaneously with the shooting by the camera 10. be able to. The various information to be added includes, for example, data for specifying the size / number of sheets for printing or print service, text data such as a comment for a photographed image, and numerical data such as a photographing condition. Consists of necessary information. Further, the additional information created by the information processing device 30 includes information unique to the camera 10, such as the manufacturer and lot number, the name of the owner, and the shooting conditions. It may be transmitted from the camera 10 prior to the creation process.
[0054]
FIG. 9 is an operation flowchart of the camera 10 when the additional information created by the information processing apparatus 30 is transmitted to the camera 10 and added to the captured image.
[0055]
It is checked whether or not there is an instruction for an information-added shooting operation using the operation key 20 (S51). If the information-added shooting mode is not set (S51), the corresponding processing, for example, normal shooting processing, playback processing, editing processing, environment setting processing, etc. Execute (S52). In the information addition shooting mode (S51), an information addition instruction command is created (S53), and transmitted from the communication circuit 22 to a predetermined communication partner (here, the communication circuit 40 of the information processing apparatus 30) (S54). The communication partner is registered in the camera 10 in advance. As shown in FIG. 10, the information addition instruction command includes information determined in advance by the camera 10, for example, information such as the manufacturer and lot number of the camera 10, the name of the owner, and shooting conditions as parameters. Etc. are added.
[0056]
FIG. 10 shows an example of the structure of an information addition instruction command. Reference numeral 60 denotes a code indicating a command for instructing information-added shooting. When receiving this command, the information processing apparatus 30 interprets the code 60 and executes processing for information-added shooting. A block 62 stores data unique to the camera 10. The data unique to the camera 10 includes, for example, a manufacturer, a lot number, a model name, and a firmware version. Reference numeral 64 denotes a block in which personal data (address and name) indicating the owner of the camera 10 is stored. Reference numeral 66 denotes a block in which data of setting information of shooting size and image quality (for example, data indicating shooting size (number of pixels) and image quality (conditions such as JPEG compression rate) set prior to shooting operation) is stored. is there. Reference numeral 68 denotes other set values for photographing, and includes values such as white balance, exposure adjustment, and shutter speed, or correction values thereof. A setting value that is fixed in advance by setting the shooting mode or the like is also included in the shooting setting value 68.
[0057]
For example, if a transmission error occurs due to factors such as the communication partner is not turned on, the communication partner is not in the reception mode, or the communication partner is not in a place where communication is possible (S55), error processing is executed. The process ends (S59). In this error processing, an error message is displayed on the display device of the camera 10, and the operator is allowed to select a desired operation from resending, canceling the information-added shooting mode, switching to the normal shooting mode, and the like.
[0058]
If there is no transmission error (S55), the communication circuit 22 is switched to the reception mode and a response from the communication partner is awaited (S56). When a certain time elapses without any response from the communication partner (S57, S58), various factors (for example, the communication partner is turned off, the communication partner cancels communication, or the communication partner cannot reply) If the communication partner is out of a place where communication is possible, the communication partner is deemed not to be in a communicable state, error processing is executed, and the process ends (S59).
[0059]
When the additional information data is received from the communication partner (in this case, the information processing device 30) (S57), the received additional information data is temporarily stored in the RAM of the storage device 16 (S60). An image photographing process is executed (S61). The imaging process includes a series of processes from when the operator presses the shutter switch until the imaging unit 14 performs a predetermined process on the image signal from the imaging element to generate image data in the YUV format.
[0060]
The control circuit 12 compresses the YUV format image data from the imaging unit 14 by the JPEG method (S62), adds the additional information data temporarily stored in the RAM, and creates an extended JPEG file (S63). The JPEG file is saved in the flash memory of the storage device 16 (S64).
[0061]
FIG. 11 shows the data structure of the extended JPEG file. Reference numeral 70 denotes additional information data that holds text data and numerical data in a table structure. Reference numeral 72 denotes a JPEG header that holds an image compression parameter and a table, and 74 denotes image data compressed by the JPEG method.
[0062]
FIG. 12 shows a flowchart of the main process of the information processing apparatus 30 corresponding to FIG. It is determined whether or not it is a mode for executing image shooting processing (information addition shooting mode) in cooperation with the camera 10 (S71). In other modes (S71), the corresponding processing is executed and the processing is terminated (S72). ).
[0063]
In the information-added shooting mode (S71), the communication circuit 40 is switched to the reception mode and a command from the camera 10 is waited (S73). When a command for instructing information-added shooting is received (S74), information to be added to the shot image is created (s75). The information to be created includes information unique to the camera transferred from the camera body 10 as described with reference to FIG. 10, and this information is corrected as necessary, and further information is added. In this creation process, the operator inputs various additional information data. For example, an operator selects and inputs necessary input items by a menu method. A method in which the operator responds to what is asked by the Q & A method may be used, or a method in which the operator enters data in a frame necessary for the format screen display as shown in FIG.
[0064]
The created additional information data is temporarily stored in the RAM of the storage device 34 (S76) and transmitted from the communication circuit 40 to the camera 10 (S77).
[0065]
FIG. 13 shows an example of a format screen for inputting additional information. Reference numeral 80 denotes an entry frame for data unique to the camera, for example, data such as manufacturer, lot number, model name, and firmware version. In this frame 80, the data previously transmitted from the camera 10 is automatically set as an initial value. Has been entered. Reference numeral 82 denotes an entry frame for personal data. For example, the name and address of the operator are entered. Reference numeral 84 denotes an entry frame for the title of the image data. Reference numeral 86 denotes a comment entry frame for the image data. These data are added to the captured image as text data. Reference numeral 88 denotes a frame for entering photographing conditions. For example, numerical data of various conditions set in photographing such as an exposure value, a zoom value, a shutter speed, an image size, and a quality are input. Reference numeral 90 denotes a frame for entering printing conditions, and the number of prints, size, other print conditions, and the like are input. In each of the entry frames 80 to 90, data can be input using handwritten character recognition by a pen operation or a Kana-Kanji conversion system.
[0066]
FIG. 14 shows a format example in the process (S77) of transmitting various information input on the screen shown in FIG. 13 to the camera 10. 100 is information specific to the camera, 102 is personal data of the owner, 104 is information on the shooting size and image quality, 106 is an additional and modified shooting setting value, 108 is data on the printing conditions, 110 is print order to a print service laboratory, etc. Information necessary for this is shown, 112 is text data of the title of the photographed image, and 114 is text data of a comment on the photographed image.
[0067]
In this embodiment, data indicating the storage location of the captured image (storage device to be stored, storage location and file name) is transferred from the camera 10 to the information processing device 30 and displayed on the screen of the information processing device 30 for display on the operator. The selected image is transferred to the camera 10 and the captured image can be stored in the specified location with the specified file name.
[0068]
FIG. 15 shows a flowchart of the main process of the camera 10 for the operation. It is determined whether or not a file-designated shooting operation mode for designating the storage location and file name of the photographed image is designated by the operation key 20 (S81). If it is not the file-designated photography operation mode (S81), a corresponding process, for example, Then, normal photographing processing, reproduction processing, editing processing, environment setting processing, and the like are executed (S82). In the case of the file designation shooting mode (S81), the shooting image management structure of the flash memory of the storage device 16, specifically, the storage area information data including the directory tree structure and file name information is created (S83). Then, the data is transmitted from the communication circuit 22 to a predetermined communication partner (here, the communication circuit 40 of the information processing apparatus 30) (S84). The communication partner is registered in the camera 10 in advance.
[0069]
For example, if a transmission error occurs due to factors such as the communication partner is not turned on, the communication partner is not in the reception mode, or the communication partner is not in a place where communication is possible (S85), error processing is executed. The process ends (S89). In this error process, an error message is displayed on the display device of the camera 10, and the operator is made to select a desired operation from resending, canceling the file designation shooting process, switching to the normal shooting mode, and the like.
[0070]
If there is no transmission error (S85), the communication circuit 22 is switched to the reception mode and a response from the communication partner is waited (S86). When a certain time elapses without any response from the communication partner (S87, S88), various factors (for example, the communication partner is turned off, the communication partner cancels communication, or the communication partner cannot reply) If the communication partner is out of a communicable location or the like, it is determined that the communication is not possible, and error processing is executed (S89).
[0071]
When the file designation data is received from the communication partner (in this case, the information processing device 30) (S87), the received file designation data is temporarily stored in the RAM of the storage device 16 (S90). An image photographing process is executed (S91). The imaging process includes a series of processes from when the operator presses the shutter switch until the imaging unit 14 performs a predetermined process on the image signal from the imaging element to generate image data in the YUV format.
[0072]
The control circuit 12 compresses the YUV format image data from the imaging unit 14 by the JPEG method (S92), refers to the file designation data temporarily stored in the RAM, and saves the designated file in the flash memory of the storage device 16 The JPEG file is stored in the location with the specified file name (S93).
[0073]
FIG. 16 shows a flowchart of the main process of the information processing apparatus 30 corresponding to FIG. It is determined whether or not it is a mode for executing image shooting processing (file designated shooting mode) in cooperation with the camera 10 (S101). In other modes (S101), the corresponding processing is executed and the processing is terminated (S102). ).
[0074]
In the case of the file designation shooting mode (S101), the communication circuit 40 is switched to the reception mode and the data from the camera 10 is waited (S103). When the file storage area information is received from the camera 10 (S104), the received information, that is, the directory structure and file name of the flash memory of the storage device 16 of the camera 10 is displayed on the display device 36 (S105). For example, as shown in FIG. 17, there are a method of displaying a list of directory structures and file names in a tree structure, or a method of displaying directories and file names side by side as text.
[0075]
The operator refers to the display information and designates the storage location and file name of the image data captured by the camera 10 (S106). For example, there are a method of directly specifying displayed data with a pen, or a method of inputting a storage location and a file name as text. The designated or input storage area information data is transmitted from the communication circuit 40 to the camera 10 (S107).
[0076]
In FIG. 17, 120 is an area for displaying a tree structure of a directory and a list of files stored therein, and 122 is an area for designating and inputting a file name and displaying a determination icon for designation information. Reference numerals 124 and 126 denote directories. The directory 126 is displayed with a frame indicating that it is in a selected state. The selected directory can be changed by pen-touching the directory name display portion. The file names of the image files included in the selected directory 126 are displayed in a list as indicated by reference numeral 128. Reference numeral 130 denotes a text input box for inputting a file name of an image photographed by the camera 10, and a file name can be freely designated by inputting characters into the box 130 with a pen. Reference numeral 132 denotes an icon for instructing determination of input data. After the designation of the directory and the input of the file name are completed, the file storage destination information is determined by pen-touching the determination icon 132.
[0077]
As the main process of the camera 10, the shooting operation is performed after the instruction data for performing the shooting process is transmitted to the information processing apparatus 30. However, the shooting operation is transmitted to the information processing apparatus 30 or the information processing apparatus 30 transmits the instruction data. It may be preceded by data reception from. That is, after the camera 10 performs the shooting process first, the instruction data may be transmitted to the information processing apparatus 30 and information from the information processing apparatus 30 may be received, or the instruction data may be transmitted from the camera 10 to the communication partner. Then, the image may be taken and information from the information processing apparatus 30 may be received.
[0078]
Although the embodiment in which the camera 10 and the information processing apparatus 30 are wirelessly connected has been described, it goes without saying that a wired connection may be used. The information processing device 30 may be a stationary device. The information processing apparatus 30 may automatically turn on the power when detecting data reception even in the power-off state, and receive data after switching to the photographing processing mode. As an information addition method for an image, the embodiment has been described in which additional information data is expanded JPEG data in addition to JPEG compressed image data. However, other addition methods may be used, for example, separate files associated with each other. Although the tablet 38 integrated with the display device 36 is illustrated as an operation unit of the information processing device 30, for example, a full keyboard with a typewriter arrangement, various dedicated keys, and a pointing device such as a mouse and a trackball may be used.
[0079]
In the case of wireless connection, information specifying the information processing apparatus to which the combined data should be transmitted may be transmitted from the camera side. This is because when there are multiple devices that can transmit data to be combined, the processing that can be executed differs from device to device, or the stored data is different. Can prevent errors. Also, from the viewpoint of security and privacy protection, it is not preferable to send a transmission request to an unknown processing device. Therefore, it is better to transmit information specifying the information processing device.
[0080]
【The invention's effect】
  As can be easily understood from the above description, according to the present invention, the data to be combined used for the synthesis isCommunicableCreated or selected by the information processing device, sent to the camera,Only the combined data required for the composite shooting to be executed is temporarily stored in the camera.So the camera'sRegardless of the capacity of the recording medium, various composite data were used.Composite shooting can be performed.
[0081]
  In addition,Regarding camera-specific information or shooting conditions set during shootingText or numerical dataofEven when information is added, the information to be added is created by another device and transmitted to the camera. Therefore, desired information can be easily added to the captured image and recorded without impairing the operability of the camera.
[0082]
In addition, the captured image can be saved with a designated storage location and a designated file name if necessary with a simple operation.
[Brief description of the drawings]
FIG. 1 is a schematic block diagram of an embodiment of the present invention.
FIG. 2 is a flowchart of a main process of the camera 10 in the first operation of the present embodiment.
FIG. 3 is a schematic diagram showing a state of synthesis.
FIG. 4 is a flowchart of a main process of the information processing apparatus 30 in the first operation of the embodiment.
Flow chart showing control procedure
FIG. 5 is a schematic diagram showing a state in which characters are entered with a pen.
FIG. 6 is a display example of a list screen of images and graphic data to be combined data.
FIG. 7 is a flowchart of a transmission data creation procedure when a shooting size and a shooting direction are transferred from the camera 10 to the information processing apparatus 30;
FIG. 8 is a structural example of transmission data when information on a shooting size and a shooting direction is transmitted from the camera 10 to the information processing apparatus 30;
FIG. 9 is a flowchart of a main process of the camera 10 in the second operation of the present embodiment.
FIG. 10 is a structural example of data transmitted from the camera to the information processing apparatus 30 in S54.
FIG. 11 is a structural example of extended JPEG data.
12 is a flowchart of main processing of the information processing apparatus 30 corresponding to FIG. 9;
FIG. 13 is an example of an additional information input screen.
14 is a data structure example of additional information transmitted from the information processing apparatus 30 to the camera 10. FIG.
FIG. 15 is a flowchart of main processing of the camera in the third operation of the present embodiment.
16 is a flowchart of main processing of the information processing apparatus 30 corresponding to FIG.
FIG. 17 is a display example of a storage location of an image file.
[Explanation of symbols]
10: Digital camera
12: Control circuit
14: Imaging unit
16: Storage device
18: Display device
20: Operation keys
22: Communication circuit
30: Information processing device
32: Control circuit
34: Storage device
36: Display device
38: Tablet
40: Communication circuit

Claims (8)

An imaging system comprising an imaging device and an information processing device capable of communicating with the imaging device,
The imaging device is
Imaging means for converting an optical image into an image signal;
A receiving unit that receives an operation instruction in the composite shooting mode among a plurality of operation modes including at least a composite shooting mode, another shooting mode, and a playback mode based on an operation on the operation unit;
In response to reception of the instruction for operation in the combined image capturing mode at the receiving unit, and transmits a command indicating execution of the combined image capturing mode to the information processing apparatus, for synthesizing the captured image from the information processing apparatus First communication means for receiving data to be combined which is graphic data of
Temporary storage means for temporarily storing the synthesized data received by the first communication means;
Display control means for controlling the synthesized data stored in the temporary storage means to be synthesized with an input image from the imaging means and displayed on the display means;
By said display control means, said after displaying by synthesizing the said input image and the synthetic data, synthesizes the object to be synthesized data to captured image captured me by the imaging means in response to operation of the shutter switch synthetic Means,
Control means for controlling to store the synthesized image output from the synthesizing means in a storage device,
The information processing apparatus is
Storage means for storing the synthesized data;
Communication means for communicating with the first communication means, comprising: second communication means for transmitting data to be combined stored in the storage means to the imaging apparatus in response to reception of the command from the imaging apparatus. An imaging system characterized by the above. The first communication means transmits information on photographing conditions including a photographing size and a photographing direction together with the command to the information processing apparatus, and the second communication means captures the combined data that matches the photographing conditions. The imaging system according to claim 1, wherein the imaging system is transmitted to the apparatus. The first communication means, the imaging system according to claim 1 or 2 transmits information for specifying the information processing apparatus to transmit the information to the first communication means. The imaging system according to any one of claims 1 to 3, further comprising power control means for automatically switching to a power-on state when the command is received in a power-off state. Of the first computer and the second computer that can communicate with each other,
The first computer;
An imaging means for converting an optical image into an image signal;
A receiving unit that receives an operation instruction in the composite shooting mode among a plurality of operation modes including at least the composite shooting mode, another shooting mode, and a playback mode based on an operation on the operation unit;
In response to reception of the instruction for operation in the combined image capturing mode at the receiving unit, a command indicating execution of the combined image capturing mode is transmitted to the second computer, combined with the captured image from the second computer First communication means for receiving data to be synthesized which is graphic data for
Temporary storage means for temporarily storing the data to be synthesized received by the first communication means;
Display control means for controlling the synthesized data stored in the temporary storage means to be synthesized with an input image from the imaging means and displayed on the display means;
By said display control means, said after displaying by synthesizing the said input image and the synthetic data, synthesizes the object to be synthesized data to captured image captured me by the imaging means in response to operation of the shutter switch synthetic means,
Function as control means for controlling to store the composite image output from the synthesis means in a storage device;
Said second computer;
Storage means for storing the data to be synthesized;
Communication means for communicating with the first communication means, wherein the data to be combined stored in the storage means is transmitted to the first computer upon receipt of the command from the first computer. A computer-readable recording medium on which a program for functioning is recorded. An imaging device capable of communicating with an information processing device,
Imaging means for converting an optical image into an image signal;
A receiving unit that receives an operation instruction in the composite shooting mode among a plurality of operation modes including at least a composite shooting mode, another shooting mode, and a playback mode based on an operation on the operation unit;
In response to reception of the instruction for operation in the combined image capturing mode at the receiving unit, and transmits a command indicating execution of the combined image capturing mode to the information processing apparatus, for synthesizing the captured image from the information processing apparatus Communication means for receiving the synthesized data which is the graphic data of
Temporary storage means for temporarily storing the synthesized data received by the communication means;
Display control means for controlling the synthesized data stored in the temporary storage means to be synthesized with an input image from the imaging means and displayed on the display means;
By said display control means, said after displaying by synthesizing the said input image and the synthetic data, synthesizes the object to be synthesized data to captured image captured me by the imaging means in response to operation of the shutter switch synthetic Means,
An image pickup apparatus comprising: control means for controlling to store a composite image output from the composition means in a storage device. An imaging method in an imaging device capable of communicating with an information processing device,
An imaging step for converting an optical image into an image signal;
An accepting step of receiving an operation instruction in the composite photographing mode among a plurality of operation modes including at least the composite photographing mode, another photographing mode, and a reproduction mode based on an operation on the operation unit;
In response to reception of the instruction for operation in the combined image capturing mode at the receiving step, it transmits a command indicating execution of the combined image capturing mode to the information processing apparatus, for synthesizing the captured image from the information processing apparatus It communicates step of receiving the synthesized data is graphic data,
A temporary storage step of temporarily storing the object to be synthesized data received by said communications step,
A display control step for controlling the combined data stored in the temporary storage step to be combined with the image captured in the imaging step and displayed on the display means;
Combining the combined data with the captured image captured in the imaging step in accordance with an operation of a shutter switch after combining and displaying the combined data and the input image by the display control step ;
And a control step for controlling the composite image generated by the composite step to be stored in a storage device. A computer that can communicate with the information processing device
An imaging means for converting an optical image into an image signal;
A receiving unit that receives an operation instruction in the composite shooting mode among a plurality of operation modes including at least the composite shooting mode, another shooting mode, and a playback mode based on an operation on the operation unit;
In response to reception of the instruction for operation in the combined image capturing mode at the receiving unit, and transmits a command indicating execution of the combined image capturing mode to the information processing apparatus, for synthesizing the captured image from the information processing apparatus Means for receiving data to be synthesized which is graphic data of
Temporary storage means for temporarily storing the synthesized data received by the communication means;
Display control means for controlling the synthesized data stored in the temporary storage means to be synthesized with an input image from the imaging means and displayed on the display means;
By said display control means, said after displaying by synthesizing the said input image and the synthetic data, synthesizes the object to be synthesized data to captured image captured me by the imaging means in response to operation of the shutter switch synthetic means,
A computer-readable recording medium having recorded thereon a program for causing it to function as control means for controlling to store a synthesized image output from the synthesizing means in a storage device.

Images