JP2001326802A - Image pickup device and image processing method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To simply realize recording of desired information also on a recording material in the case of recording an image on the recording material. SOLUTION: Information to be attached to a photo print (voice, character and illustration information) is recorded on a sheet material in a form of bar codes or by hand-writing (in the case of the character and illustration information) and the information to be attached is inputted to the digital camera by picking up the sheet material with a digital camera. A user selects the information to be attached and designates its recording position (198-208), the information to be attached, information to designate the recording position of the information to be attached and information to designate a recording format in response to the kind of the information to be attached are attached to data of the image on the photo print to which the information is to be attached (210). In the case that the information above is attached to the photo print to be generated, the information to be attached is recorded at the recording position designated on the photo print in the designated recording format.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup apparatus and an image processing method, and more particularly, to an image pickup apparatus such as a digital still camera or a digital video camera having an image pickup means for picking up an optical image and converting it into image information. The present invention relates to an image processing method for recording desired information on the same recording material when an image represented by the image information is recorded on the recording material.

[0002]

2. Description of the Related Art In recent years, a digital still camera, which has been rapidly spreading, has an image pickup device such as a CCD, takes an optical image by the image pickup device, and converts an analog image signal obtained by the photographing into digital image data. After converting the image data into a smart media or the like, the image data is stored in an information storage medium (memory card) such as a smart media. It is also possible to obtain a print or simply record the image represented by the image data on paper or the like using a printer possessed by the user.

[0003]

In recent years, demands for photographic prints have been diversified, and there has been a demand for the creation of photographic prints to which information such as arbitrary characters and illustrations desired by the user has been added. As described above, in the method of recording an image using digital image data, as compared with the conventional method of recording an image once recorded on a photographic film on a photographic paper by surface exposure, the method for recording an image is optional. It is also possible to add information such as characters and illustrations.

[0004] However, if a user who wants to add some information to the photo print is to provide a service for adding the information instructed by the user to the photo print, the user does not want to add the information to the photo print. Information may be brought into the lab in various forms,
For example, if information that is not converted into data, such as handwritten characters or handwritten illustrations, is brought in as information to be added to the photo print, the handwritten characters or handwritten illustrations brought into the lab are scanned and the photo print is read. It is necessary to convert the data so that it can be added to It is also necessary to manage information instructed by the user to be added to a photo print in association with an image of the photo print to which the information is to be added.

As described above, in order to provide a service for adding information desired by a user to a photographic print, it is necessary to perform complicated processing on the lab side in order to accept information brought in by the user. Also, for the user side, the work to request the creation of a photo print is complicated, such as bringing the information desired to be added to the photo print to the laboratory and specifying the photo print to which the information is to be added. It is possible that

[0006] Audio information can also be considered as information that can be added to a photo print. It is conceivable that this audio information is recorded in a photo print in a predetermined format in which the audio can be easily reproduced by using a predetermined reader, for example. At present, no technology has been established for smooth operation without complicating the operation of the user and the user.

SUMMARY OF THE INVENTION The present invention has been made in view of the above facts, and provides an image pickup apparatus and an image processing method which can easily realize recording desired information at the time of recording an image on a recording material. Is the purpose.

[0008]

According to a first aspect of the present invention, there is provided an image capturing apparatus which captures an optical image and converts the optical image into image information, wherein predetermined information can be visually recognized. A recognition unit configured to recognize the predetermined information based on image information obtained by the imaging when an optical image including the medium displayed in the first format is captured by the imaging unit; A storage unit for storing the predetermined information recognized by the unit; and a second storage unit that stores the predetermined information on the same recording material when the image represented by the image information is recorded on the recording material. And an adding means for adding to the image information as information to be recorded in the format described above.

The image pickup apparatus according to the first aspect has an image pickup means for picking up an optical image and converting it into image information. As the image capturing apparatus, for example, a digital still camera, a digital video camera, a portable information terminal having an image capturing section, a mobile phone having an image capturing section, and the like can be applied. According to the first aspect of the present invention, when an optical image including a medium displaying predetermined information in a first format in which the predetermined information can be viewed is captured, the predetermined information is determined based on image information obtained by the imaging. A recognition unit for recognizing information is provided, and the predetermined information recognized by the recognition unit is stored in the storage unit.

The first format according to the present invention may be any format that allows predetermined information to be displayed visually, and any format such as "handwriting" can be applied. However, if the predetermined information is codeable information (information in which target information can be replaced by code information represented by a group of codes defined by a predetermined code system), the first format is a recognition unit. It is desirable to use a format that can be easily recognized by, for example, the barcode described in claim 2 can be applied. When a barcode is used as the first format, predetermined information can be displayed on the medium at a high density (especially, a two-dimensional barcode is preferable because the predetermined information can be displayed at a higher density).
In addition, even when the amount of information is large, it is possible to avoid a decrease in the recognition rate of the predetermined information.

According to the first aspect of the present invention, the adding means converts the predetermined information stored in the storage means into a first format on the same recording material when the image represented by the image information is recorded on the recording material. Is added to the image information as information to be recorded in a second format different from the second format. As the second format, for example, any format desired by the user can be adopted. By adding predetermined information to the image information as information to be recorded on the same recording material in the second format, the image information is input to an image recording apparatus installed in a lab, for example, and the image represented by the image information is input. In the aspect in which the image recording apparatus records on the recording material, the predetermined information is input to the image recording apparatus together with the image information, and when the image represented by the image information is recorded on the recording material by the image recording apparatus, the same information is used. It will be recorded on the recording material in the second format.

Thus, when the user desires to add a character or illustration displayed on a medium such as paper in a “handwritten” format to the recording material,
If the image is captured by the image capturing apparatus according to the first aspect of the present invention, the character or illustration is recognized and stored in the storage unit as character information or illustration information. The character information or the illustration information is recorded in a second format on a recording material on which an image represented by the image information is recorded as information to be recorded as an illustration image.

For example, when the user desires to add predetermined audio information to the recording material, a medium in which the predetermined audio information is displayed in a format such as a barcode is provided. If the image is captured by the image capturing apparatus according to the above, after the predetermined audio information is recognized and stored in the storage unit, the predetermined information is stored in the second format (for example, a format in which audio can be easily reproduced by using a predetermined reader or the like). The predetermined audio information is recorded in a second format on a recording material on which an image represented by the image information is recorded as information to be recorded.

As described above, according to the first aspect of the present invention, when recording an image on a recording material, desired information is recorded together by using an image pickup unit of an image pickup apparatus.
Since the desired information can be realized by imaging the medium on which the desired information is displayed in the first format by the image capturing device, it is easy to record any information together with the recording of the image on the recording material. can do.

The predetermined information according to the present invention may be a specific single type of information, or a case where a plurality of types of information exist as the predetermined information, or a case where the type of the predetermined information is indeterminate. In such a case, the identification information indicating the type of the predetermined information is added to the predetermined information, and the type of the predetermined information can be recognized based on the identification information. preferable. For example, when the predetermined information is displayed on a medium in a format such as a barcode, the addition of the identification information can be realized by displaying the information obtained by adding the identification information to the predetermined information as a barcode. it can. Thus, the recognition means can reliably recognize the type of the predetermined information.

When a plurality of types of information are present as the predetermined information, or when the type of the predetermined information is indeterminate, etc., the format (first format) for recording the predetermined information on the recording material is used. 2) is also undefined, but in this case, as described in claim 4, the second format is determined according to the type of the recognized predetermined information, and the information specifying the second format is determined. It is preferable to add the image information together with the predetermined information to the image information. Thereby, the predetermined information can be recorded on the recording material in an appropriate format according to the type of the predetermined information.

When the predetermined information is audio information, for example, as the second format, the audio information is displayed so that the audio represented by the audio information can be easily reproduced. Audio information display format can be used. Further, for example, when the predetermined information is character information, an image display format for displaying a character represented by the character information as an image can be used as the second format, for example, as described in claim 6. . Further, for example, when the predetermined information is illustration information, an image display format for displaying an illustration represented by the illustration information as an image can be used as the second format. . Further, for example, when the predetermined information is a character or an illustration displayed in a “handwritten” format, an image display format that represents the character or the illustration as an image can be used as the second format.

Further, a designation means for designating the second format may be provided, and the user may designate the second format via the designation means. In this case, when the user specifies the second format via the specifying means, predetermined information can be recorded on the recording material in a format desired by the user.

According to the image processing method of the present invention, a predetermined image to be recorded on the same recording material as the image represented by the image information is provided by an image capturing apparatus having an image capturing means for converting an optical image into image information. By imaging a medium displaying information in a first format in which information can be visually recognized, recognizing the predetermined information based on image information obtained by the imaging, and storing the predetermined information in a storage unit. Inputting the predetermined information to the image capturing apparatus, and
When the image represented by the image information is recorded on a recording material, the same information is added to the image information as information to be recorded in a second format different from the first format, and the predetermined information is added. When the image represented by the image information is recorded on the recording material, the predetermined information is
Since the recording is performed on the same recording material in the format described above, it is possible to easily realize the recording of desired information together with the recording of the image on the recording material, similarly to the first aspect of the invention.

[0020]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS An embodiment of the present invention will be described below in detail with reference to the drawings. FIG. 1 shows a digital still camera 10 to which the image processing method according to the present invention can be applied.
It is shown. Note that this digital still camera 10
Corresponds to the image pickup device according to the present invention.

As shown in FIG. 1, the main body 12 of the digital still camera 10 is substantially box-shaped, and has a projection (gripping portion) formed on the left side when viewed from the front to facilitate gripping of the main body 12. It has been. As shown in FIG. 1A, a lens 14 is attached to the center of the front side of the main body 12,
Above the lens 14 of the main body 12, an optical finder 16 for a user to visually confirm a photographing range and the like, and a strobe 18 for emitting auxiliary light when photographing at low illuminance and the like are mounted.

As shown in FIG. 1B, a color display 26 (which may be a monochrome display) composed of a reflective display device or a transmissive display device (for example, LCD) is provided below the rear surface of the main body 12. The menu switch 28, the execution / screen changeover switch 30, and the operation switch 32 are mounted on the upper side of the display 26.

FIG. 2 shows the configuration of the electric system of the digital still camera 10. Specifically, the lens 14 is a zoom lens (variable focal length lens) having an autofocus (AF) mechanism, and the AF mechanism and the zoom mechanism of the lens 14 are driven by a drive circuit 36. Note that a fixed focal length lens having only an AF mechanism may be used as the lens 14 instead of the zoom lens.

At a position corresponding to the focal position of the lens 14 inside the main body 12, an image pickup device 38 composed of an area CCD sensor or the like is arranged. An image is formed on the light receiving surface of the device 38. The imaging device 38 is driven at a timing synchronized with a timing signal generated by a timing generation circuit (not shown) incorporated in the driving circuit 36, and outputs an image signal (a large number of pixels arranged in a matrix on a light receiving surface). Signal indicating the amount of light received in each of the photoelectric conversion cells)
Is output.

A shutter / aperture 40 is arranged between the lens 14 and the imaging device 38. The shutter and the aperture are driven by a drive circuit 36. The shutter is for preventing the occurrence of smear due to light entering the light receiving surface of the imaging device 38 when an image signal is output from the imaging device 38.
8 may be omitted depending on the configuration of FIG. The aperture may be configured by a single aperture capable of continuously changing the aperture amount, or may be configured to switch a plurality of apertures having different aperture amounts. The strobe 18 is also connected to the drive circuit 36. The strobe 18 is emitted by the drive circuit 36 when it is detected that the illuminance is low or when the user gives an instruction to emit light.

An analog signal processing unit 42, an A / D converter 44, a digital signal processing unit 46, and a memory 48 are sequentially connected to a signal output terminal of the imaging device 38. The analog signal processing unit 42 amplifies the image signal output from the imaging device 38 and performs correction such as white balance on the amplified image signal. The image signal output from the analog signal processing unit 42 is converted into digital image data by the A / D converter 44 and input to the digital signal processing unit 46. In the digital signal processing unit 46,
Color correction / γ correction / Y / C for input image data
Performs various processes such as conversion. The image data output from the digital signal processing unit 46 is temporarily stored in a memory 48 such as a RAM.

The image data stored in the memory 48 corresponds to the image information according to the present invention.
The imaging device 38, the analog signal processing unit 42, the A / D converter 44, and the digital signal processing unit 46 correspond to an imaging unit according to the present invention.

The driving circuit 36, the analog signal processing unit 42,
A / D converter 44, digital signal processing unit 46, memory 4
8 and a compression / decompression unit 50 (described later) are connected to a bus 52. The bus 52 includes a CPU 54 and a non-volatile memory (eg, an EEPROM or a RAM connected to a backup power supply) 58 whose storage contents can be rewritten. Connected, power switch 20, menu switch 28,
Switches such as an execution / screen changeover switch 30 and an operation switch 32 (in FIG. 2, referred to as “operation switches”), and a shutter switch 56 that is turned on / off by operating the shutter button 22 are connected. Although not shown, the CPU 54 is configured to include peripheral circuits such as a ROM, a RAM, and an input / output port. Further, the nonvolatile memory 58 corresponds to the storage unit of the present invention.

The display 26 and the compression / expansion unit 50 are connected to the memory 48, respectively. When displaying an image on the display 26, the CPU 54
Is transferred to the display 26. Thus, an image represented by the image data temporarily stored in the memory 48 is displayed on the display 26. Further, when an instruction to store the image data in the memory card inserted into the slot 24 is given by the shutter button 22 being operated and the shutter switch 56 being turned on, the CPU 54 temporarily stores the image temporarily stored in the memory 48. The data is read and transferred to the compression / decompression unit 50.
Thus, the image data is stored in the memory card after being compressed by the compression / expansion unit 50. Note that image data may be stored in a memory card without being compressed depending on a shooting mode or the like.

When the reproduction (display) of the image represented by the image data stored in the memory card inserted into the slot 24 is instructed, the image data is read from the memory card and read. If the image data has been compressed and stored, the compressed image data is temporarily expanded (decompressed) by the compression / expansion unit 50 and then temporarily stored in the memory 48. Then, the image is displayed (reproduced) on the display 26 using the image data temporarily stored in the memory 48.
Is performed.

Next, as an operation of the present embodiment, while the digital still camera 10 is turned on,
Will be described with reference to the flowchart of FIG. In step 100, it is determined which mode is selected as the processing mode, and the processing branches according to the current processing mode. The digital still camera 10 according to the present embodiment includes, as processing modes, a shooting mode selected when shooting a subject, an image playback mode selected when displaying a shot image on the display 26, and a digital still mode. An information input mode selected when inputting information to the camera 10 is provided.

If the photographing mode is selected as the processing mode, the process proceeds to step 104, and the photographing conditions currently set as the photographing conditions used for photographing the subject are fetched. This imaging condition is, for example, a strobe (emission /
Includes various parameters such as no light emission / automatic, AE mode (aperture priority / shutter speed priority), highlight part imaging conditions (saturated shooting / saturated shooting), auto white balance (on / off) (The choices for each parameter are shown in parentheses attached to each parameter).

In step 106, the image is taken by operating the image pickup device 38, and the image is stored in the memory 48 via the analog signal processing unit 42, the A / D converter 44, and the digital signal processing unit 46 by the image pickup. Based on the obtained image data, it is analyzed whether or not the optical image captured by the imaging device 38 includes a subject corresponding to a barcode. Then, in Step 108, Step 10
Based on the result of the analysis in step 6, it is determined whether or not the captured optical image includes a subject corresponding to a barcode.

The input of information to the digital still camera 10 in the information input mode according to the present embodiment depends on the type of information to be input by imaging a medium on which a two-dimensional barcode representing the information is recorded. Is done.
Therefore, if the captured optical image includes a subject corresponding to a barcode, the user may have erroneously selected the processing mode. If the determination is negative, the process proceeds to step 112. When the determination is affirmative, in step 110, for example, a message for confirming to the user whether or not to transit to the information input mode is displayed on the display 26 to confirm the intention of the user. It is determined whether or not to transition to the information input mode.

If the user has not instructed the transition to the information input mode, the determination at step 110 is denied, and the routine proceeds to step 112, where the shutter button 2
It is determined whether or not the shutter switch 56 is turned on by operating the button 2. If the determination is negative, the process returns to step 104 and repeats steps 104 to 112 described above. Further, when the transition to the information input mode is instructed, the determination in step 110 is affirmed, and in step 10
Then, the process proceeds to 2 to perform an information input process (described later).

Thus, although the user has performed an operation for inputting information to the digital still camera 10, the photographing mode was incorrectly selected as the processing mode, and the information to the digital still camera 10 was transferred to the digital still camera 10. Failure to input can be avoided. Note that the analysis / determination of whether or not the captured optical image includes a subject corresponding to a barcode may take a long time, so the user determines in advance whether to perform the analysis / determination. When the selection is possible and the user does not select to perform the analysis / determination, even if the optical image captured in the shooting mode includes the subject corresponding to the barcode, it may be ignored. .

When the shutter switch 56 is turned on by operating the shutter button 22, step 11
When the determination of step 2 is affirmative, the routine proceeds to step 114, where the image data stored in the memory 48 is captured by the imaging device 38, and the AE process for automatically determining the exposure based on the image data is performed. Next step 116
Then, based on the result of the AE process, the shutter speed (the charge accumulation time in the imaging device 38) and the aperture amount in the aperture are determined in consideration of the imaging conditions captured in step 104, and the imaging device 38 is driven via the driving circuit 36.
Control of the operation timing of the electronic shutter mechanism and driving of the aperture.

The capturing of the imaging conditions in step 104 is repeated as long as the determination in step 112 is denied as described above. Therefore, the digital still camera 10 is turned on and the shooting mode is selected. If the imaging conditions are changed during the period from to when the shutter switch 56 is turned on, an image is captured according to the changed imaging conditions.

In the next step 118, an AF process for searching for a focus position (a lens position in a focus state) is performed. In step 120, the stepping motor of the AF mechanism of the lens 14 is driven so as to be in a focus state (focus state) based on the lens position at the focus position detected in step 118, and the imaging device 38 in the focus state Image a subject (optical image).

The image data obtained by the above-described imaging is temporarily stored in the memory 48, and is stored in the memory card in the next step 122. After performing the processing of step 122, the process returns to step 100, and the current processing mode is determined again.

Next, the processing in the information input mode will be described. If the information input mode is selected by the user as the processing mode in order to input information to the digital still camera 10, the process proceeds from step 100 to step 102 to perform information input processing. This information input process will be described with reference to the flowchart of FIG. Note that the information input processing corresponds to the recognition means of the present invention.

In step 150, the image pickup device 38 is operated to perform image pickup. Based on the image data stored in the memory 48 by the image pickup, the optical image picked up by the image pickup device 38 corresponds to a bar code. Analyze whether a subject is included or not. In step 152, based on the result of the analysis in step 150, it is determined whether or not the captured optical image includes a subject corresponding to a barcode.

When inputting desired information to the digital still camera 10, the user takes an image of the medium on which the desired information is recorded (displayed) by the digital still camera 10 to which the information is to be input. In this embodiment,
The information that can be input to the digital still camera 10 includes: imaging condition information that defines the imaging conditions of the digital still camera 10; processing condition information that defines the processing conditions for image processing on image data; and information to be added to the photo print.
Broadly classified into types.

In the present embodiment, the imaging condition information is a unit of information corresponding to a single imaging condition of the digital still camera 10, and a plurality of types of information are prepared corresponding to a plurality of types of imaging conditions. . The imaging condition information is coded,
It is recorded on a sheet material such as paper as a visible two-dimensional barcode (which may be a stack type or a matrix type). The recording of the imaging condition information as a two-dimensional barcode on a sheet material is performed by, for example, a manufacturer of the digital still camera 10, and the imaging condition information is a unit of information corresponding to a single imaging condition or a plurality of pieces of information. In a state where the information corresponding to the kind of imaging conditions is put together, the information is recorded as a two-dimensional barcode on the sheet material, and the sheet material is supplied to the user. The supply of the sheet material may be performed, for example, by mailing to a registered user, or may be performed by posting in a book such as a magazine.

As shown in FIG. 6A, information (coded information) recorded as a two-dimensional barcode includes, as an example, an information body (in this case, imaging condition information) and a type of the information body. After the header information (identification information described in claim 3) is added, the information is recorded on the sheet material as a two-dimensional barcode as shown in FIG. 6B, for example. This header information is used when detecting the type of the information body included in the coded information obtained from the two-dimensional barcode. When the user wants to input the imaging condition information to the digital still camera 10, the user sets the part of the sheet material on which the two-dimensional barcode representing the imaging condition information is recorded, to the part on which the two-dimensional barcode is recorded, using a digital still camera. An image is taken by the camera 10. Thereby, the imaging condition information is input to the digital still camera 10.

In the present embodiment, the processing condition information is a unit of information corresponding to a single processing condition, and a plurality of types of information are prepared corresponding to a plurality of types of processing conditions. The parameter that constitutes the processing condition is, for example, “saturation”
"Sharpness""Red-eyecorrection""Setuplevel"
There are “color conversion table”, “gradation setting”, and the like.

Note that “saturation” is a parameter that defines how to control the saturation in the saturation control process of controlling the saturation of the image by controlling the coefficients of the 3 × 3 matrix, and “sharpness” is "Red-eye correction" is a parameter that defines how much sharpness is enhanced in hyper-sharpness processing that enhances sharpness while suppressing graininess. Red-eye correction processing that corrects poor color tone (so-called red-eye) in an area corresponding to the eyes of a person "Setup level" specifies whether to perform gamma correction in density / color correction processing or only correction of density and color balance, and "color conversion table" specifies density / color. Defines which of the multiple color conversion tables used for color balance correction in the correction process The parameter “tone setting” is a parameter that defines whether the image is to be softened or hardened in the tone conversion processing.

The above processing condition information is also coded and added with the above-mentioned header information, and is recorded on a sheet material such as paper as a visible two-dimensional bar code.
The processing condition information is also recorded on the sheet material as a two-dimensional barcode, for example, by a manufacturer of the digital still camera 10, and the processing condition information may be a unit of information corresponding to a single processing condition or a plurality of pieces of information. The information corresponding to the various processing conditions is collected and recorded on the sheet material as a two-dimensional barcode, and the sheet material is supplied to the user. When the user wants to input the processing condition information to the digital still camera 10, the user can select a part of the supplied sheet material on which the two-dimensional barcode representing the processing condition information is recorded, on which the two-dimensional barcode is recorded. Images are taken by the digital still camera 10.

In the present embodiment, an image represented by image data obtained by the user imaging an arbitrary subject using the digital still camera 10 is recorded on a recording material such as photographic paper to create a photographic print. At this time, arbitrary information (for example, voice information, character information, and illustration information) specified by the user can be added (recorded) to the photo print. In the present embodiment, such information is generically referred to as information to be added to a photographic print. The information to be added to the photographic print corresponds to “predetermined information to be recorded on the same recording material when an image represented by the image information is recorded on the recording material” according to the present invention.

As the audio information, for example, in an image obtained by photographing an event, a theme park, a sightseeing spot, a building, or a product as a subject, there is voice information representing a sound explaining the subject. The sound information according to the present embodiment is obtained by adding name information indicating the name of the sound represented by the sound data to digital sound data obtained by sampling and A / D converting an analog sound signal at a predetermined cycle. An information main body is configured, and the information main body is recorded on a medium as a visually recognizable two-dimensional barcode (corresponding to the first format according to the present invention) with the header information added thereto.
For example, a two-dimensional barcode of audio information is recorded on a signboard or the like installed at the site if it is a barcode of audio information that describes audio describing events, theme parks, sightseeing spots, buildings, displayed products, and the like. can do.

Events, theme parks, sightseeing spots, buildings,
When a user who shoots a product or the like on display as a subject wants to add audio information describing the shot subject to the photo print, the user describes the shot subject among the signboards installed in the field. Audio information 2
The digital still camera 10 captures an image of the part where the dimensional barcode is recorded (displayed). In this case, digital audio data and name information are input to the digital still camera 10 as audio information, and stored in the corresponding storage area of the nonvolatile memory 58. Then, the digital still camera 10 performs processing (information addition processing described later) for adding the input audio information to the photo print.

Note that the audio information according to the present embodiment is not limited to information representing audio that describes a subject.
For example, it may be voice information or the like representing a voice uttering a word for classifying an image (for example, a title of each image or a keyword added to each image). Since image classification is often performed by selectively using general-purpose plural types of words and the like, plural types of audio information corresponding to plural types of words used for image classification are recorded on a sheet material such as paper. A plurality of types of audio information may be input to the digital still camera 10 by recording the two-dimensional barcode in advance as a two-dimensional barcode.

As the character information, for example, in an image obtained by photographing an event, a theme park, a sightseeing spot, a building, or a product as a subject, there is a character information representing a description explaining the subject. This character information is converted into a visible two-dimensional barcode (corresponding to the first format according to the present invention) on a medium in a state in which the above-mentioned header information is added to text data representing a sentence such as the above-mentioned explanation. Be recorded. A two-dimensional barcode representing character information is, for example, a signboard installed at the site if it is a barcode of character information representing a description explaining an event, a theme park, a sightseeing spot, a building, a displayed product, or the like. Can be recorded.

Events, theme parks, sightseeing spots, buildings,
When a user who has taken a photographed product or the like as a subject wants to add text information describing the photographed subject to the photo print, the user describes the photographed subject among the signboards installed at the site. The digital still camera 10 captures an image of the portion where the two-dimensional barcode representing the character information to be recorded is recorded (displayed). in this case,
The character information is input to the digital still camera 10 as text data, and is stored in a corresponding storage area of the nonvolatile memory 58. Then, the digital still camera 10 performs a process (information addition process) for adding the input character information to the photo print.

Note that the character information according to the present embodiment may be, for example, character information representing words for classifying images, and a plurality of types of characters corresponding to a plurality of types of words used for classifying images. Information may be recorded in advance as a two-dimensional barcode on a sheet material such as paper, and the plurality of types of character information may be input to the digital still camera 10 by imaging the two-dimensional barcode.

As the illustration information, for example, in an image obtained by photographing an event, a theme park, a sightseeing spot, a building, or a product as a subject, there is illustrated information representing a map around a place where the subject is photographed. The illustration information may be bitmap data representing the density of each color component of each dot when the above-described illustration of a map or the like is decomposed into a number of dots, or the position of each line segment constituting the illustration or the line. In the state where the above-mentioned header information is added to the vector data representing the illustration by the information such as the density for each color component of each area divided by the minute,
It is recorded on the medium as a visible two-dimensional barcode (corresponding to the first format according to the present invention). As for the two-dimensional barcode representing the illustration information, for example, if it is a barcode of illustration information representing an illustration representing a map around a place where an event, a theme park, a sightseeing spot, a building, a displayed product, etc. is photographed, etc. It can be recorded on signs installed at the site.

Events, theme parks, sightseeing spots, buildings,
When a user who has taken a product or the like on display as a subject wants to add illustration information representing a map around a place where the subject was taken to a photo print, the user:
The digital still camera 10 captures an image of a part of a signboard installed at the site where a two-dimensional barcode of illustration information representing a map or the like around a place where the subject is photographed is recorded (displayed). In this case, the illustration information is input to the digital still camera 10 as bitmap data or vector data, and stored in the corresponding storage area of the nonvolatile memory 58. Then, the digital still camera 10 performs processing (information addition processing) for adding the input illustration information to the photographic print.

In the present embodiment, input of character information and illustration information to the digital still camera 10 is performed by imaging characters and illustrations recorded in a handwritten format or the like without using a two-dimensional barcode. It is also possible. For example, when it is desired to add a character or illustration written by hand to a photo print, the user may input an input sheet in a certain format in which entry fields for a title, a keyword, a memo, and an illustration are provided in advance as shown in FIG. Using a digital still camera 10
The user inputs a character or illustration to be input into the corresponding entry field by handwriting, and takes an image of the completed input sheet by the digital still camera 10. In this case, character information and illustration information are input to the digital still camera 10 as bitmap data, and stored in the corresponding storage area of the nonvolatile memory 58. And digital still camera 1
By 0, a process (information adding process described later) for adding the input character information and illustration information to the photo print is performed.

If there are a plurality of types of input sheets having different formats, a bar code representing the format of the input sheet (the position and size of each entry field) is added to the input sheet. The bar code may be recognized by the digital still camera 10.

The medium on which the barcode representing the information to be input to the digital still camera 10 is recorded can be accessed by a user using a personal computer or the like to access a predetermined homepage on which the barcode is posted. Can also be obtained by printing after downloading. The information may be input to the digital still camera 10 by taking an image of the display with the digital still camera 10 while the predetermined homepage is displayed on a display of a personal computer or the like.

As described above, the digital still camera 1
In imaging for inputting various types of information into 0, there are cases where an optical image to be photographed includes a subject corresponding to a barcode, and cases where a subject corresponding to the barcode is not included. Therefore, if it is determined in step 152 that the captured optical image includes the subject corresponding to the barcode, the process proceeds to step 156, where the image data stored in the memory 48 by the imaging is represented. The outer edge of the area corresponding to the barcode in the image is recognized, and an imaging frame corresponding to the shape of the area corresponding to the barcode is selected from a plurality of types of imaging frames prepared in advance and having different aspect ratios.

The imaging frame may be selected by the user. That is, an image represented by the image data stored in the memory 48 by the imaging is displayed on the display 26, a graphic representing an imaging range of a specific imaging frame is displayed on the image in a superimposed manner, and the displayed graphic is displayed. Switching to a figure represented by the imaging range of another imaging frame in response to an instruction from the user may select the imaging frame corresponding to the figure selected by the user.

Further, in a state where the image is displayed on the display 26, the position of the corner of the imaging range determined by the user to be appropriate is designated by the user on the display surface of the display 26, and based on the designated position. The imaging range determined to be appropriate may be recognized, and an imaging frame having an imaging range similar to the recognized imaging range may be selected.

In the next step 158, after the bar code image capturing conditions fixedly stored in a predetermined storage area of the nonvolatile memory 58 and fixed in advance for bar code image capturing are fetched, step 160 is executed. Move to. In addition, as the imaging condition for barcode imaging, it is preferable to use an imaging condition in which a recognition rate of information represented by a two-dimensional barcode recorded on a sheet material has a maximum value or a value close to the maximum. Can be used, and the “AE mode” and “aperture priority” imaging conditions can be used.

On the other hand, if it is determined in step 152 that the captured optical image does not include a subject corresponding to a barcode, the process proceeds to step 154, where character information and illustration information, etc., written by hand are entered. After fetching standard imaging conditions preset for imaging and fixedly stored in a predetermined storage area of the nonvolatile memory 58, the process proceeds to step 160.

In step 160, the shutter button 22
Is operated, it is determined whether or not the shutter switch 56 is turned on. If the determination is negative, the process returns to step 150, and steps 150 to 160 are repeated.

When the shutter switch 56 is turned on by operating the shutter button 22, step 16 is executed.
When the determination of 0 is affirmed, the process proceeds to step 162, and the image photographing process (steps 114 to 12 in the flowchart of FIG.
0). If the optical image to be captured includes a subject corresponding to a barcode, the image capturing process is performed in accordance with the barcode capturing conditions captured in step 158. Also, the information represented by the barcode can be recognized with a high recognition rate.

In the next step 164, step 162
It is determined again whether or not the optical image captured by the image photographing process includes a subject corresponding to a barcode. If the determination in step 164 is negative, it can be determined that the information to be input to the digital still camera 10 is not information represented by a two-dimensional bar code.
Based on the image data stored in the image data 8, a character area or an illustration area where characters and illustrations to be input to the digital still camera 10 are recorded (displayed) among the images represented by the image data are recognized, and the recognized characters are recognized. Based on the region or the illustration region, an image of a character region (bitmap data corresponding to character information) or an image of an illustration region (bitmap data corresponding to illustration information) is extracted from the image data.

According to the above processing, even when the user desires to add the characters and illustrations written by hand to the photo print, the user can copy the sheet material with the characters and illustrations written by hand into the photo print. It is not necessary to bring it to the lab where it is created, and it is not necessary for the lab to perform work to convert the characters and illustrations written by hand into data.

In the storage area of the nonvolatile memory 58, storage areas for storing information input to the digital still camera 10 are provided for each type of information.
In the next step 168, the type of information extracted in step 166 is detected based on the area from which the information is extracted, and stored in the storage area of the nonvolatile memory 58 corresponding to the detected type. The input processing ends.

On the other hand, if the determination in step 164 is affirmative, it can be determined that the information input to the digital still camera 10 is information represented by a two-dimensional bar code. Based on the image data stored in the memory 48 by the photographing process, a barcode area in which a two-dimensional barcode is recorded in an image represented by the image data is recognized, and information of the recognized barcode area is determined from the image data. Extract.

In the next step 172, the information of the extracted barcode area is analyzed, and the two-dimensional barcode recorded in the area is converted into coded information represented by the two-dimensional barcode. In step 174, it is determined whether or not the coded information obtained from the two-dimensional barcode has a contradiction.

In the present embodiment, since the header information indicating the type of the information body of the coded information is added to the coded information, the header information of the header information added to the coded information obtained from the two-dimensional bar code is added. If there is a contradiction in the contents (for example, the code indicating the type of the information body is not set in the header information), the determination in step 174 is affirmed, and the process proceeds to step 176, for example, to call the user's attention. By issuing a warning sound or displaying a message on the display 26, the user is notified that the barcode recognition has failed.

As a result, the user can display 2 representing specific information.
Although a medium on which a three-dimensional barcode is recorded is imaged, it can be recognized that the specific information has not been normally input to the digital still camera 10, and the digital still camera can be correctly recognized. It is possible to take countermeasures such as changing the position and orientation of the camera 10 and performing imaging, changing the lighting conditions, and performing imaging.

On the other hand, if the determination in step 174 is denied, the flow shifts to step 178 where the bar code is recognized by emitting an electronic sound different from the above-mentioned warning sound or displaying a message on the display 26, for example. Notify the user of success. Thus, the user has captured the medium on which the two-dimensional barcode representing the specific information is recorded, and the specific information is stored in the digital still camera 10.
Can be recognized as being normally input.

In the next step 180, the type of the information body included in the code information is detected by referring to the header information added to the coded information obtained from the two-dimensional bar code, and the non-volatile memory 58 The information main body is stored in the storage area corresponding to the detected type among the storage areas described above, and the information input process ends. This step 18
0 corresponds to the recognition means of the third aspect. Through the above processing, even a user who does not have an information processing device such as a personal computer can input and store various information in the digital still camera 10. Upon completion of the information input process, the process returns to step 100 of the flowchart in FIG. 3, and the current processing mode is determined again.

As for various types of information input to the digital still camera 10 by the above-described information input processing, specific information is selectively used from among a plurality of pieces of information stored in the digital still camera 10. Therefore, the above-described information input processing is performed a plurality of times for each type of information. For example, for audio information, a plurality of audio data representing different audios are named as the names of the audios represented by the audio data. Each of them is stored in the corresponding storage area of the nonvolatile memory 58 of the digital still camera 10 in association with the name information to be represented.

Next, the processing in the image reproduction mode will be described. When the image reproduction mode is selected as the processing mode, the process proceeds from step 100 to step 126, where the image data of the image to be displayed on the display 26 is fetched from the memory card and stored in the memory 48.

In step 128, the pixel density of the image data stored in the memory 48 is converted in accordance with the number of pixels of the display 26 (the number of vertical and horizontal pixels of the image represented by the image data matches the number of vertical and horizontal pixels of the display 26). The image data after the pixel density conversion is developed in a display image data storage area (bit map memory) provided in advance on the memory 48, and the image stored in the display image data storage area is converted. The data is transferred to the display 26. Thus, an image represented by the image data stored in the memory 48 is displayed on the display 26. In addition,
In displaying images on the display 26, it goes without saying that a plurality of images may be arranged and displayed in a matrix.

In the next step 130, the display 2
Then, it is determined whether or not an instruction to switch an image to be displayed is given in step S6. If the determination in step 130 is negative, the process proceeds to step 132, where it is determined whether termination of the image reproduction mode has been instructed. If the determination in step 132 is also negative, the process returns to step 138, and steps 130 and 132 are repeated until switching of the image to be displayed or termination of the image reproduction mode is instructed.

When switching of the image to be displayed is instructed, for example, by operating the operation switch 32, the determination in step 130 is affirmed, and step 126 is performed.
The image displayed on the display 26 is switched by repeating the processing from step 126 onward. When the end of the image reproduction mode is instructed, step 1 is executed.
The determination at 32 is affirmative and the process returns to step 100, where the current processing mode is determined again.

Next, an interruption process which is activated by an interruption when the user turns on the menu switch 28 will be described with reference to the flowchart of FIG. In step 190, a predetermined item to be displayed when the menu switch 28 is turned on is displayed on the display 26.
In the list. The item displayed at this time represents the name of a process that can be executed in accordance with a user's instruction. In the present embodiment, the item is displayed on a general digital still camera 10 when the menu switch 28 is turned on. In addition to the items, each item of “imaging condition”, “processing condition”, and “information addition” is also displayed on the display 26.

At step 192, it is determined whether or not any of the items listed on the display 26 has been selected by the user, and the process waits until the determination is affirmed. The operation switches 32 provided on the back of the main body 12 of the digital still camera 10 are provided with switches corresponding to the ends in the up, down, left, and right directions of the substantially rectangular button, respectively. Is pressed, the corresponding switch is turned on.

In the interrupt processing, the operation switch 32 is used by the user to select information, and when the user selects a specific item from the items displayed in the list, for example, the upper switch or the lower switch of the operation switch 32 is used. This can be performed by turning on the side switch to move the cursor, and turning on the execution / screen changeover switch 30 while the cursor is positioned on the specific item.

If any item is selected by the user, the determination in step 192 is affirmed, and step 194 is selected.
Then, it is determined whether or not the item selected by the user is “information addition”. If the item selected by the user is an item other than “information addition”, the determination in step 194 is denied, and the process proceeds to step 196, where processing corresponding to the item selected by the user is performed.

For example, if the selected item is “imaging condition”, the user is allowed to select specific imaging condition information from the imaging condition information stored in the nonvolatile memory 58, and the imaging condition selected by the user is selected. A process for setting the imaging conditions defined by the information in the digital still camera 10 is performed. Thus, the imaging of the subject in the shooting mode is performed according to the set imaging conditions.

For example, if the selected item is “processing condition”, the user is allowed to select specific processing condition information from the processing condition information stored in the non-volatile memory 58, and On the other hand, various image processings (for example, saturation control processing, hyper sharpness processing, density / color correction processing, gradation conversion processing, etc.) are performed under processing conditions defined by information selected by the user. When the process of step 196 is completed, the interrupt process ends. After the image processing of the image data of the specific image is completed, the specific image may be displayed on the display 26 using the image data of the specific image after the image processing. This allows the user to visually check the result of the image processing.

On the other hand, a desired photographic print out of photographic prints created by recording an image on a recording material such as photographic paper using image data obtained by imaging an arbitrary subject can be used. (For example, audio information, character information, and illustration information), the user specifies a process (additional processing information (to be described in detail later)) for adding desired information to a specific photo print. In order to perform the information addition process to be added to the image data of the image data, first, in a state where the image to be processed is selected (for example, in the image reproduction mode, the image to be processed is displayed on the display 26), The user turns on the switch 28 to display a predetermined item on the display 26 in a list, and then selects “add information” from the displayed item.
As a result, the determination at step 194 is affirmed, and the process proceeds to step 198, where the information adding process is performed after step 198. This information addition processing corresponds to the addition means of the present invention.

That is, in step 198, the type names of information (“voice information”, “text information”, and “illustration information”) that can be added to the photo print are displayed on the display 26 in a list. In the next step 200, it is determined whether or not a specific type name has been selected by the user from among the type names of information that can be added to the photo prints displayed in the list, and the process waits until the determination is affirmed. When the user operates the operation switch 3
Turn on the upper switch or the lower switch of 2 to move the cursor, and execute / execute in a state where the cursor matches the type name of the information desired to be added to a specific photo print.
When the user selects a type name of information to be added to a specific photo print by turning on the screen switch 30 or the like, the determination in step 200 is affirmed, and the process proceeds to step 202.

In step 202, the nonvolatile memory 58
Of the information corresponding to the type name selected by the user, a list of all information stored in the storage area and information to be added to a specific photo print are displayed. Is displayed on the display 26 requesting the user to make a selection. Note that, if the type name selected by the user is “voice information”, the name display stored in the voice information storage area of the nonvolatile memory 58 in association with each voice data indicates that the type name selected by the user is “voice information”. This is accomplished by listing the names to be represented.

Further, character information is input and stored as bitmap data (when a character recorded in a format such as handwriting is captured) and when it is input and stored as text data (character information). (In the case where a two-dimensional barcode representing the image is captured). Therefore, when “character information” is selected as the type name by the user, for the bitmap data stored in the character information storage area of the nonvolatile memory 58, the number of dots of the bitmap data is displayed on the display 26. After performing pixel density conversion so as to match the number of dots in the display area on the surface, the image (image including character information) represented by the bitmap data is displayed in a predetermined display area to display the character information. For text data stored in the character information storage area, character patterns (dot patterns representing characters) corresponding to individual characters represented by the text data
Are respectively developed on a bitmap memory, thereby generating bitmap data of a character image including character information represented by text data, and displaying the character image represented by the bitmap data in a predetermined display area. Display character information.

Also, illustration information may be input and stored as bitmap data, or may be input and stored as vector data. Therefore, when “illustration information” is selected as the type name by the user, for the bitmap data stored in the illustration information storage area of the nonvolatile memory 58, the number of dots of the bitmap data is displayed on the display 26. After performing pixel density conversion so as to match the number of dots in the display area on the screen, the image represented by the bitmap data (illustration image including illustration information) is displayed in a predetermined display area to display the illustration information. However, regarding the vector data stored in the illustration information storage area, the vector data is processed on the bitmap memory by performing processing such as drawing a line segment and filling a specific area on the basis of each information constituting the vector data. Bitmap data of the illustration image including the illustration information to be represented, and generating the bitmap data. Metadata display illustrations information by displaying an illustration image in a predetermined display area represents.

Instead of displaying a list of information corresponding to the type name selected as described above, a single piece of information is displayed on the display 26, and
May be switched according to a user's instruction, or it may be possible to select whether to display a list or individually.

In the next step 204, it is determined whether or not information to be added to a specific photo print is selected, and the process waits until the determination is affirmative. When the information to be added is selected by the user, the determination in step 204 is affirmed, and the process proceeds to step 206, where a request is made to designate a recording position when the selected information is added (recorded) to a specific photo print. . Then, in step 208, it is determined whether or not a recording position for adding information to the photo print has been designated, and the process waits until the determination is affirmed.

In the present embodiment, the recording position of the information to be added to the photo print is, for example, the side (first position) of the image recording area on the image recording surface shown in FIG. Back side of image recording surface shown in FIG. 8 (B) (second position)
(Character information or illustration information is recorded in an area described as a “character or illustration information recording area”, and audio information is recorded in an “audio information recording area”).
Recorded in the area described as "). When the user designates the first position or the second position as the recording position of the information to be added to the photo print, the determination in step 208 is affirmed, and the process proceeds to step 210.

In this embodiment, the recording format for recording information that can be added to a photographic print is as follows.
It is fixedly determined for each type of the information. That is, in the present embodiment, as the recording format of the character information and the illustration information, an image display format for displaying a character represented by the character information or an illustration represented by the illustration information as an image is used. Format.

In this audio information display format, audio data compressed according to a predetermined compression method is divided in units of a fixed amount of data, and each of the divided data is converted into a binary pattern similar to a bar code according to a predetermined rule. (A pattern consisting of a white portion and a black portion), and the divided individual data are sequentially recorded on a medium as a binary pattern along a predetermined direction, so that the audio information is elongated and visible. This is a format for recording as a pattern sequence. The audio information recorded according to the audio information display format can be easily reproduced as real audio by using a predetermined audio information reproducing reader.

That is, the audio information reproducing reader comprises: a light emitting section for irradiating the above-mentioned visible pattern row with light; a photoelectric conversion section for converting the light reflected by the visible pattern row to an electric signal;
An A / D converter for sampling an analog electric signal sequentially output from the photoelectric converter and converting it into digital data; and decompressing digital data (ie, compressed audio data) sequentially output from the A / D converter. And a sound reproducing unit for converting the decompressed sound data into an analog sound signal and reproducing the sound as real sound, and irradiating position of light emitted from the sound information reproducing reader. The audio information reproducing reader is moved so that the audio information moves along the long visible pattern sequence in the predetermined direction, whereby the audio information recorded in accordance with the audio information display format is reproduced as real audio.

For this reason, in step 210, information (voice information or character information or illustration information) to be added to the specific photo print selected by the user, information for specifying the recording position of the information to be added, and A process of adding information indicating a recording format corresponding to the type of information to be added among the recording formats fixedly defined for each type of information that can be added to specific image data corresponding to a specific photo print Add as information. As described above, step 210 corresponds to the adding means described in claim 4.

In step 212, based on the specific image data and the additional processing information added to the image data, a simulation image of a photographic print obtained from the specific image data (as shown in FIG. 8A or 8B). Image data representing the image is generated, and a simulation image is displayed on the display 26 based on the generated image data. By referring to the simulation image, the user can visually check a photographic print in which desired information is added at a desired position in accordance with the various selections and designations described above before the photographic print is actually created. You can check.

In the next step 214, a message is displayed on the display 26 for confirming to the user whether or not all the information to be added to the specific photo print has been selected. It is determined whether or not all the information for which the addition is desired has been added as additional processing information.

When the user desires to add a plurality of information to a specific photo print, the user operates the operation switch 32 and the execution / screen switch 30 to obtain all the information to be added. When information indicating that the selection has not been completed is input, step 21
The determination in step 4 is denied, and the process returns to step 198, and steps 198 to 214 are repeated. In this case, a plurality of pieces of additional processing information are respectively added to the image data corresponding to a plurality of pieces of information to be added.

When the selection of all the information to be added to the specific photo print is completed, and the simulation image of the specific photo print in which all the desired information has been added to the desired position is displayed on the display 26, When the determination at 214 is affirmative, the process proceeds to step 216, where the specific image data to which various information has been added is stored in the memory card, and the interrupt process (image synthesis process) ends.

Next, the creation of a photographic print will be described. When a user sends a memory card storing image data of an image to be recorded as a photographic print to a lab and requests the lab to create a photographic print, the lab creates a photographic print as follows.

That is, first, image data is read from the memory card, and it is determined whether additional processing information is added to the read image data. For image data to which no additional processing information has been added, after performing various image processing (for example, saturation control processing, hyper sharpness processing, density / color correction processing, gradation conversion processing, etc.), the image exposure of the photographic printer is performed. Transfer to department. The image exposure section of the photographic printer modulates the intensity of the laser light emitted from the R, G, and B laser light sources in accordance with the image data, and deflects the intensity-modulated laser light to form a recording material (eg, photographic paper). ), The image represented by the image data after the image processing is scanned and exposed on the recording material. Then, the recording material on which the image has been exposed and recorded is subjected to various processes such as color development, bleach-fixing, washing, and drying, and the recording material is cut into individual visualized images to perform additional processing. A photo print is created from image data to which no information has been added.

On the other hand, for image data to which additional processing information has been added, the type of information to be added to the photographic print, the recording position and the recording format are determined by referring to the contents of the additional processing information, and the additional information is added to the photographic print. Recording data for recording information to be recorded at a designated recording position in a designated recording format is generated.

For example, if the information to be added to the photo print is audio information, the audio data included in the corresponding additional processing information is compressed according to a predetermined compression method (the audio data is added in a compressed state). Compression is not necessary if the data is compressed), the compressed audio data is divided into a fixed amount of data as a unit, and each of the divided data is converted into a binary pattern in accordance with a predetermined rule. Pattern data representing a long visible pattern row when the binary patterns of the data are sequentially arranged along a certain direction (each dot when the visible pattern row is decomposed into many Or "black").

Further, in image recording on a recording material, the resolution and the number of colors that can be expressed in dot units are different between the image recording surface and the back surface (for example, image recording on the back surface is relatively low). Since the resolution and the number of representable colors are small (often a monochrome printer in a prominent example), the generated binary pattern sequence data is
Pixel density conversion is performed according to the resolution at the time of image recording at the designated recording position (recording surface) for the audio information, and 1 according to the number of representable colors at the time of image recording at the designated recording position. Recording data is generated by converting the number of bits of data per dot. When audio information is recorded on the image recording surface, the recording data is recorded in the predetermined format so that a visible pattern sequence representing the audio information is simultaneously exposed and recorded in a predetermined format as shown in FIG. Is combined with the image data according to the format of

For example, if the information to be added to the photo print is character information, and if the character information included in the corresponding additional processing information is text data, the character corresponding to each character represented by the text data By developing a pattern on a bitmap memory, bitmap data representing a character image is generated, and then the resolution in image recording at a recording position (recording surface) designated for character information and expressible. Recording data is generated by performing pixel density conversion and conversion of the number of bits of data per dot in accordance with the number of colors. When character information is recorded on the image recording surface, the recording data is converted into image data according to the predetermined format so that the character image is exposed and recorded simultaneously with the image in a predetermined format as shown in FIG. Combine with

If the information to be added to the photo print is character information and the character information included in the corresponding additional processing information is bitmap data, the character information is added to the bitmap data. According to the resolution corresponding to the recording position and the number of expressible colors, pixel density conversion and 1
The recording data is generated by converting the number of bits of data per dot, and if the recording position of the character information is an image recording surface, the recording data is combined with the image data according to a predetermined format.

Further, for example, when the information to be added to the photo print is illustration information, if the illustration information included in the corresponding additional processing information is bitmap data, the bitmap data is According to the resolution corresponding to the illustration information recording position and the number of expressible colors, pixel density conversion and conversion of the number of bits of data per dot are performed to generate recording data, and further, recording of the illustration information If the position is on the image recording surface, the recording data is combined with the image data according to a predetermined format.

Further, for example, when the information to be added to the photo print is the illustration information and the illustration information included in the corresponding additional processing information is the vector data, the information based on the information constituting the vector data is used. By performing processing such as drawing a line segment and filling a specific area on a bitmap memory, bitmap data including an image represented by vector data (an image including illustration information) is generated, and a recording position of the illustration information is recorded. The recording data is generated by performing pixel density conversion and conversion of the number of bits of data per dot in accordance with the resolution corresponding to the number of colors that can be represented, and furthermore, the recording position of the illustration information is determined on the image recording surface. If so, the recording data is combined with the image data according to a predetermined format.

When information to be added to the photographic print is recorded on the image recording surface, the image data obtained by synthesizing the recording data is transferred to the image exposure unit of the photographic printer.
As a result, the laser light whose intensity has been modulated based on the image data obtained by synthesizing the recording data is scanned over the recording material, so that the image represented by the recording data is added to the image (FIG. 8A). An image as shown) is exposed and recorded on the image recording surface of the recording material, and a photographic print in which information desired by the user is added to the image recording surface is created.

When information to be added to a photographic print is to be recorded on the back side of the image recording surface, the image data not combined with the recording data is transferred to the image exposure unit of the photographic printer, and the recording material is recorded. The recording data is transferred to a back print unit of a photographic printer that records characters, images, and the like on the back surface. Thereby, an image is exposed and recorded on the image recording surface of the recording material, and as shown in FIG.
Information represented by the recording data is recorded on the back side of the image recording surface by the back print unit, and a photographic print in which information desired by the user is added to the back side of the image recording surface is created.

As described above, when requesting the creation of a photo print to which desired information has been added, a recording medium such as paper on which the information to be added is recorded is transferred to the laboratory, or the photo print to which the desired information is to be added. It is not necessary for the user to perform a complicated operation such as designating a photo print, and the burden on the user for requesting the creation of a photo print so that the user can obtain a desired photo print can be reduced.

In the above description, the case where the recording format is fixedly determined for each type of information that can be added to a photographic print has been described. However, the present invention is not limited to this. ), A plurality of formats can be selected, and information indicating the recording format selected by the user is added to the image data, so that the information can be added to the photographic print in the selected format. As an example, another format that can be selected when adding audio information to a photographic print is, for example, a format in which audio information is magnetically recorded on a recording material coated with a magnetic material in advance so that audio can be easily reproduced. No. Other formats that can be selected when adding character information to a photographic print include, for example, a format such as a braille block in which each character represented by the character information is represented by an uneven pattern.

In the above description, the first position (specific position on the image recording surface) or the second position (specific position on the back surface of the image recording surface) is used as the recording position of the information added to the photo print. Although the case of selection has been described, the present invention is not limited to this. A variety of formats are prepared as formats for recording information to be added to a photographic print, and these various formats are digitally captured by a bar code using a digital still camera. 10 can be entered and memorized,
From the formats stored in the digital still camera 10 (if a large number of formats are stored,
A format selected by the user (out of the multiple formats) may be used.

In the above description, an embodiment in which a photographic print is created in a laboratory has been described. However, the present invention is not limited to this. When an image is recorded on a recording material such as paper by a printer connected to a digital still camera. The digital still camera may have a function of controlling the printer so that information defined by the additional processing information added to the image data is recorded on the same recording material.

Further, in the above, the digital still camera 10 has been described as an example of the image pickup apparatus according to the present invention. However, the present invention is not limited to this. It is needless to say that the present invention can be applied to any device having a function of converting to.

[0120]

As described above, according to the first aspect of the present invention, when an optical image including a medium displaying predetermined information in the first format in which the predetermined information can be viewed is captured, the optical information is obtained by the imaging. Recognizing the predetermined information based on the obtained image information, storing the recognized predetermined information, and storing the predetermined information on the same recording material when the image represented by the image information is recorded on the recording material. Since the information to be recorded in the format is added to the image information, there is an excellent effect that it is possible to easily record the desired information together with the recording of the image on the recording material.

According to the second aspect of the present invention, since a bar code is used as the first format in the first aspect of the present invention, in addition to the above-described effects, predetermined information can be displayed at high density on a medium, and There is an effect that the recognition rate of the predetermined information can be prevented from lowering even when the amount is large.

According to a third aspect of the present invention, in the first aspect of the present invention, identification information representing a predetermined information type is added to the predetermined information, and the predetermined information type is recognized based on the identification information. In addition to the above-described effects, there is an effect that the type of predetermined information can be reliably recognized.

According to a fourth aspect of the present invention, in the third aspect of the invention, the second format is determined according to the type of the predetermined information, and the information designating the second format is
Since the information is added to the image information together with the predetermined information, in addition to the above-described effects, there is an effect that the predetermined information can be recorded on the recording material in an appropriate format according to the type of the predetermined information.

[0124] According to the eighth aspect of the present invention, a medium in which predetermined information to be recorded on the same recording material as the image represented by the image information is displayed in a first format in which it can be visually recognized, is picked up by an image pickup device. Recognize predetermined information based on image information obtained by imaging, and use the predetermined information as information to be recorded in the same recording material in the second format when the image represented by the image information is recorded on the recording material. When the image represented by the image information is added to the image information and the image represented by the image information is recorded on the recording material, the predetermined information is recorded on the same recording material in the second format. Recording can be easily realized.

[Brief description of the drawings]

FIG. 1 illustrates a digital still camera according to an embodiment.
(A) is a perspective view seen from the front side, (B) is a perspective view seen from the back side.

FIG. 2 is a block diagram showing a schematic configuration of an electric system of the digital still camera shown in FIG.

FIG. 3 is a flowchart showing the contents of a main routine of a process executed by the digital still camera according to the embodiment.

FIG. 4 is a flowchart showing the contents of an information input process.

FIG. 5 is a flowchart showing the contents of interrupt processing.

FIG. 6A is a conceptual diagram showing a configuration of coded information recorded as a barcode, and FIG. 6B is an image diagram showing an example of a two-dimensional barcode.

FIG. 7 is an image diagram showing an example of a format of an input sheet for inputting character information and illustration information entered by handwriting.

FIGS. 8A and 8B are image diagrams each showing an example of a format when information is added to a photographic print.

[Explanation of symbols]

 10 Digital Still Camera 26 Display 32 Operation Switch 38 Imaging Device 48 Memory 54 CPU 58 Non-Volatile Memory

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat ゛ (Reference) H04N 5/91 H04N 101: 00 // H04N 101: 00 5/91 HJ F term (Reference) 5C022 AA13 AB12 AB15 AB19 AB66 AC01 AC12 AC32. LA11 5C062 AA01 AB22 AC04 AC24 AE01 AE08 5C076 AA14 AA15 AA16 BA02 BA03 BA06 CA02

Claims (8)

[Claims] An imaging unit configured to capture an optical image and convert the image information into image information; and an optical image including a medium displaying predetermined information in a first format in which the information can be visually recognized. Recognizing means for recognizing the predetermined information based on image information obtained by the imaging; storage means for storing the predetermined information recognized by the recognizing means; and storing the predetermined information in the image. An image capturing apparatus comprising: an adding unit that, when an image represented by the information is recorded on the recording material, is added to the image information as information to be recorded on the same recording material in a second format different from the first format. 2. The apparatus according to claim 1, wherein the first format is a barcode. 3. The predetermined information is added with identification information indicating a type of the predetermined information, and the recognizing means recognizes the type of the predetermined information based on the identification information. The image pickup device according to claim 1, wherein: 4. The method according to claim 1, wherein the adding unit determines the second format according to a type of the predetermined information recognized by the recognizing unit, and outputs information specifying the second format together with the predetermined information. The image pickup apparatus according to claim 3, wherein the image information is added to the image information. 5. The method according to claim 1, wherein the predetermined information is audio information, and the second format is an audio information display format for displaying the audio information so that the audio represented by the audio information can be easily reproduced. The image pickup device according to claim 1. 6. The image pickup apparatus according to claim 1, wherein the predetermined information is character information, and the second format is an image display format for displaying a character represented by the character information as an image. apparatus. 7. The predetermined information is illustration information,
2. The image pickup apparatus according to claim 1, wherein the second format is an image display format for displaying an illustration represented by the illustration information as an image. 8. An image pickup apparatus provided with an image pickup means for converting an optical image into image information, wherein predetermined information to be recorded on the same recording material as an image represented by the image information is displayed in a visible first format. Imaging the medium, and recognizing the predetermined information based on the image information obtained by the imaging, and storing the predetermined information in a storage unit, so that the predetermined information is stored in the image capturing apparatus. Inputting, and adding the predetermined information to the image information as information to be recorded on the same recording material in a second format different from the first format when the image represented by the image information is recorded on the recording material. An image processing method for recording the predetermined information on the same recording material in the second format when an image represented by the image information to which the predetermined information is added is recorded on the recording material.