WO2006011067A2

WO2006011067A2 - Backing-up image data

Info

Publication number: WO2006011067A2
Application number: PCT/IB2005/052242
Authority: WO
Inventors: Maarten P. Bodlaender; Erik Niessen; Peter Bingley
Original assignee: Koninklijke Philips Electronics NV
Current assignee: Koninklijke Philips NV
Priority date: 2004-07-19
Filing date: 2005-07-06
Publication date: 2006-02-02
Anticipated expiration: 2007-01-19
Also published as: WO2006011067A3

Abstract

A method of backing-up image data (100) is disclosed, in particular image data which is stored in an internal memory device (202) of an image acquisition apparatus (200), the image data (100) comprising a pixel matrix (104) representing a picture. The method comprises: transferring the image data (100) to an external memory device (216); and creating an annotated thumbnail (107) which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data (100) is back-upped.

Description

Backing-up image data

The invention relates to a method of backing-up image data which is stored in an internal memory device of an image acquisition apparatus, the image data comprising a pixel matrix representing a picture.

The invention further relates to an apparatus for backing-up image data which is stored in an internal memory device of an image acquisition apparatus, the image data comprising a pixel matrix representing a picture.

The invention further relates to an image acquisition apparatus.

The invention further relates to a computer program product to be loaded by a computer arrangement, comprising instructions to back-up image data which is stored in an internal memory device of an image acquisition apparatus.

Typically, digital photos which have been acquired by an image acquisition apparatus like a digital camera are downloaded to a backup apparatus like a personal computer (PC). Several mechanisms exist for downloading this type of image data. For example downloading based on a flexible transfer medium like a flash card. Alternatively, a cable connection is used e.g. based on the universal serial bus (USB) standard. A further alternative is based on a wireless connection.

After the backup has been completed, the image data which is stored in the internal memory device of the image acquisition apparatus can be erased. However, the user of the image acquisition apparatus might wish to delay the deletion of image data. A reason for this might be that the user wants to show the images to other users. In that case the image acquisition apparatus is used as a kind of data transport and display medium. It will be clear that continuing with making new images without deletion of old images eventually results in a fully occupied internal memory device. In other words, at a certain moment the user has to delete some of the old images to make space for storing new images to be acquired. It is an object of the invention to provide a method of the kind described in the opening paragraph which enables the user to determine which of the images which are stored in the internal memory device of the image acquisition apparatus have been back-upped to an external memory device. This object of the invention is achieved in that the method comprises: transferring the image data to an external memory device; creating an annotated thumbnail which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data is back-upped. Typically, an image acquisition apparatus comprises a display device for displaying thumbnails of the pictures which have been acquired. By displaying an annotated thumbnail of which a group of pixels represent an annotation that the image data is back- upped, the user is informed that the corresponding picture is back-upped. The creation of the annotated thumbnail is part of the method of backing-up. This creation enables the displaying of the annotated thumbnail. In principle, displaying the annotated thumbnail is not part of the method of backing-up, but is typically part of a method of browsing.

The sequence of steps of transferring the image data and creating an annotated thumbnail is not fixed. The transferring can succeed or precede the creating of the annotated thumbnail or the transferring and creating can be performed partly simultaneously. That means that the term "annotation that the image data is back-upped" should not be interpreted literally related to tense. Mind that the annotation may have been created even before the transfer was started.

With image data is meant an image file comprising a number of components. A typical format for such an image file is known as EXIF (exchangeable image file format). This standard specifies that an image file comprises a high-resolution representation of the picture a pixel matrix representing a picture, a thumbnail of the picture and some meta-data. The thumbnail comprises a group of pixels which represent an annotation that the image data is back-upped. This group of pixels may correspond to an icon, a character or text which is to be interpreted by the user that the corresponding image data is back-upped. An important aspect of the invention is that the information about that status is part of the pixel matrix which represents the thumbnail. That means that there is no need for an additional flag or attribute to indicate that status. The probability of persistence of this information is relatively high if it is stored within the thumbnail. The probability that such an additional flag is lost is relatively high because such a flag is not widely supported by back¬ up apparatus. The usage of thumbnails however is common.

The proposed solution of creating the annotated thumbnail is also advantageous and s regarding to backwards compatibility. The support of thumbnails already exists for several years. That means that even older equipment, e.g. for backup can benefit from this invention.

An other advantage of the proposed solution, is that it is relatively easy to create the annotated thumbnails.

In an embodiment of the method according to the invention, the annotated thumbnail is created by modifying a number of pixel values of a further thumbnail which was created on basis of the pixel matrix. In that event before starting the method of backing-up their was already a thumbnail. That means that a previously created thumbnail corresponding to the same picture is modified into a annotated thumbnail. Alternatively, there was no thumbnail before the method of backing-up started and the annotated thumbnail is created as part of the method of backing-up .

In an embodiment of the method according to the invention, the annotated thumbnail is created by the image acquisition apparatus. Alternatively, the annotated thumbnail is created by a further apparatus which comprises the external memory device and subsequently the annotated thumbnail is transferred to the image acquisition apparatus and stored into the internal memory device of the image acquisition apparatus. An advantage of this latter approach is that the method of backing-up according to the invention can also be applied in combination with an image acquisition apparatus which doesn't have the functionality to create the annotated thumbnail itself. At the moment, there is a huge installed base of digital cameras which do not support creating of annotated thumbnails. However the method of backing-up according to the invention can be applied for the installed base of the digital cameras which do support the storage of thumbnails but do not support the creation of annotated thumbnails according to the invention. That means that this embodiment according to the invention is backwards compatible.

It is a further object of the invention to provide an apparatus for backing-up image data of the kind described in the opening paragraph which enables the user to determine which of the images which are stored in the internal memory device of the image acquisition apparatus have been back-upped to an external memory device.

This object of the invention is achieved in that the apparatus comprises: receiving means for receiving the image data; a memory device for storing the image data; processing means for creating an annotated thumbnail which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data is back-upped; and - sending means for sending the annotated thumbnail to the image acquisition apparatus.

It is a further object of the invention to provide an image acquisition apparatus of the kind described in the opening paragraph which enables the user to determine which of the images which are stored in the internal memory device of the image acquisition apparatus have been back-upped to an external memory device.

This object of the invention is achieved in that image acquisition apparatus comprises: acquisition means for acquiring image data, the image data comprising a pixel matrix representing a picture; - an internal memory device for storing the image data; transferring means for transferring the image data to an external memory device; processing means for creating an annotated thumbnail which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data is back-upped.

It is a further object of the invention to provide a computer program product of the kind described in the opening paragraph which enables the user to determine which of the images which are stored in the internal memory device of the image acquisition apparatus have been back-upped to an external memory device. This object of the invention is achieved in that the computer program product after being loaded provide processing means with the capability to carry out: transferring the image data to an external memory device belonging to a further apparatus which is external from the image acquisition apparatus; creating an annotated thumbnail which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data is back-upped.

The computer program product may be loaded to processing means which are part of the image acquisition apparatus. Alternatively, the computer program product may be loaded to processing means which are part of the further apparatus, i.e. a backup apparatus. In that case a further processing may be required: sending the annotated thumbnail to the image acquisition apparatus.

Modifications of the image acquisition apparatus and variations thereof may correspond to modifications and variations thereof of the apparatus for backing-up image, of the computer program product and of the method, being described.

These and other aspects of the image acquisition apparatus, of the apparatus for backing-up image, of the computer program product and of the method, according to the invention will become apparent from and will be elucidated with respect to the implementations and embodiments described hereinafter and with reference to the accompanying drawings, wherein:

Fig. IA schematically shows image data before backing-up and Fig. IB schematically shows the image data after backing-up; and Fig. 2 schematically shows an embodiment of the image acquisition apparatus according to the invention in combination with an embodiment of the apparatus for backing- up image data according to the invention.

Same reference numerals are used to denote similar parts throughout the figures.

Fig. 1 A schematically shows image data 100 before backing-up. The image data 100 comprises a pixel matrix 104 representing a picture. The pixel matrix 104 comprises a number of pixel values. Pixel values correspond to color and/or luminance values. The image data 100 further comprises meta-data 102 related to the picture. Typical attributes of the meta data 102 are the date and location of acquisition of the picture. Other attributes may be related to the number of pixels of the matrix, the number of bits used per pixel, the type of compression which optionally was used and the compression ratio which was applied. Optionally, the image data also comprises a thumbnail 106. A thumbnail 106 corresponds to a downscaled version of the picture, i.e. a thumbnail is based on interpolation of the pixel values of the pixel matrix 104. Typically, the number of pixels of the thumbnail is relatively low compared with the number of pixels of the pixel matrix 104 representing the picture. As a consequence the number of bits is relatively low. Accessing these bits from the internal memory device of the image acquisition apparatus is faster than accessing these bits of the pixel matrix 104. A typical usage of thumbnails is providing a user and impression of the acquired picture. An example of a file format comprising most of the elements mentioned above is the so-called EXIF format. A specification of this format can be found at www.exif.org. Fig. IB schematically shows the image data after backing-up. Basically the image data comprises the same components as described in connection with Fig. IA. The only difference is that in Fig. IB an annotated thumbnail 107 is depicted, while in Fig. IA a thumbnail 106 without annotation is depicted. This annotated thumbnail 107 substantially corresponds to a downscaled version of the picture. A group of pixels of the annotated thumbnail 107 represent an annotation 108 that the image data 100 is back-upped. The word "substantially" is used to indicate that because of the annotation 108 the annotated thumbnail 107 differs from a direct downscaled version of the picture.

It will be clear that the annotation 108 as depicted in Fig. IB is just example. Alternative representations are possible. The size of the annotation, its color, its position within the annotated thumbnail may be different from what is depicted in Fig. IB. As an alternative for an icon, text may be used.

Fig. 2 schematically shows an embodiment of the image acquisition apparatus 200 according to the invention in combination with an embodiment of the apparatus for backing-up image data 201 according to the invention. The image acquisition apparatus 200 comprises: acquisition means 212 for acquiring image data. The acquisition means comprises a lens 214 and an imaging sensor based on CMOS or alternatively a CCD; an internal memory device 202 for storing the image data. Typically the internal memory device 202 comprises RAM of preferably SD-RAM; - a communication unit 206 for image data exchange with other apparatus, e.g. a backup apparatus 201. The communication unit 206 comprise a physical output interface 208 and some internal wires. Typically, the communication is bi-directional, i.e. both sending and receiving of data are supported. Optionally, the communication unit 206 comprises a transmitter/receiver for wireless transmission of image data. - a processing unit 204 and which is arranged to create thumbnails. That means that the processing unit 204 is arranged to downscale an acquired picture into a thumbnail by means of interpolation of pixel values of the acquired picture. Optionally, the processing unit 204 is also arranged to create an annotated thumbnail 107 which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data is back-upped; and a display device 210 for displaying thumbnails, including annotated thumbnails. Typically such display device comprises an LCD. It should be noted that the depicted architecture of the image acquisition apparatus 200 is an example. The central position of the processing unit 204, connecting the other components of the image acquisition apparatus 200 is optional. Alternatively, an embodiment of the image acquisition apparatus according to the invention comprises an internal bus system for data exchange between the components of the apparatus. The apparatus for backing-up image data 201 comprises: a further communication unit 218 for image data exchange with other apparatus, e.g. an image acquisition apparatus 200. The further communication unit 218 comprise a physical output interface 2 24 and some internal wires. Typically, the communication is bi-directional, i.e. both sending and receiving of data are supported. Optionally, the further communication unit 218 comprises a transmitter/receiver for wireless transmission of image data. a memory device 216 for storing data, e.g. image data. The memory device 216 may be based on optical storage like CD or DVD or hard disk based. Alternatively, the memory device 216 is based on solid state; a further processing unit 222 and which is arranged to create annotated thumbnails. That means that the processing unit 222 is arranged to downscale a received picture into a thumbnail by means of interpolation of pixel values of the received picture. Optionally, the processing unit 222 is also arranged to create an annotated thumbnail 107 which substantially corresponds to a downscaled version of the received picture and of which a group of pixels represent an annotation that the image data is received by the apparatus for backing-up image data 201 ;and an internal bus system 220 via which data can be exchanged between the different components of the apparatus 201, e.g. the further communication unit 218, the memory device 216 and the further processing unit 222. The method of backing-up image data according to the invention comprises: transferring image data 100 to an external memory device 216; creating an annotated thumbnail 107 which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation 108 that the image data 100 is back-upped; and optionally comprises: sending the annotated thumbnail 107 to the image acquisition apparatus 200.

The apparatus for backing up 201 may be a personal computer PC. Alternatively it is an other type of consumer electronics apparatus like a personal video recorder for storage of all kinds of audio, video and still picture data which is to be distributed in a home or office.

Whether the sending of the annotated thumbnail 107 takes place depends on where the creating of the annotated thumbnail 107 is performed. The creation of the annotated thumbnail 107 may be performed by the image acquisition apparatus 200 or it may be performed by the receiving apparatus for backing-up image data 201. In the latter case, the creation of the updated thumbnails is succeeded by transmission of the annotated thumbnail to the image acquisition apparatus 200. Tables 1 and 2 summarize the different steps for these scenarios. The second column of the Tables 1 and 2 list the actions being performed by the image acquisition apparatus 200. The third column of the Tables 1 and 2 lists the actions being performed by the apparatus for backing-up 201.

Table 1 : creation of annotated thumbnail by the image acquisition apparatus.

Table 2: creation of annotated thumbnail by the apparatus for backing-up.

The action "store annotated thumbnail" preferably corresponds to overwrite the data representing the thumbnail 106 with data representing the annotated thumbnail 107. A preferred connection between the image acquisition apparatus 200 and the apparatus for backing up 201 is based on a USB connection. Most digital cameras, i.e. the image acquisition apparatus provide "usb mass storage" capabilities. That means that they allow access to their internal memory device 202 in a similar way as a windows file system (fat) on a hard disk. The specification of the usb mass storage class can be found at the following url: http://www.usb.org/developers/devclass docs/usb_msc_overview_ L2.pdf. That means that a computer program product being loaded in the processing means, comprising the further processing unit 222 and some processing memory, which is not depicted in Fig. 2, is arranged to provide instructions to access image data from the internal memory device 202 of the image acquisition apparatus 200. The computer program product is also arranged to overwrite the data of the thumbnail with data of the corresponding annotated thumbnail. It will be clear that such a computer program product being loaded in a standard PC allows to operate with an image acquisition apparatus which is not arranged to create an annotated thumbnail itself.

It should be noted that the above-mentioned embodiments illustrate rather than limit the invention and that those skilled in the art will be able to design alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be constructed as limiting the claim. The word 'comprising' does not exclude the presence of elements or steps not listed in a claim. The word "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention can be implemented by means of hardware comprising several distinct elements and by means of a suitable programmed computer. In the unit claims enumerating several means, several of these means can be embodied by one and the same item of hardware. The usage of the words first, second and third, etcetera do not indicate any ordering. These words are to be interpreted as names.

Claims

CLAIMS:

1. A method of backing-up image data (100) which is stored in an internal memory device (202) of an image acquisition apparatus (200), the image data (100) comprising a pixel matrix (104) representing a picture, the method comprising: transferring the image data (100) to an external. memory device (216); and - creating an annotated thumbnail (107) which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation that the image data (100) is back-upped.

2. A method as claimed in Claim 1, whereby the annotated thumbnail (107) is created by modifying a number of pixel values of a further thumbnail (106) which was created on basis of the pixel matrix (104).

3. A method as claimed in Claim 1 or 2, whereby the annotated thumbnail (107) is created by the image acquisition apparatus (200).

4. A method as claimed in Claim 1 or 2, whereby the annotated thumbnail (107) is created by a further apparatus (201) which comprises the external memory device (216) and whereby the annotated thumbnail (107) is transferred to the image acquisition apparatus (200) and stored into the internal memory device (202) of the image acquisition apparatus (200)

5. An apparatus for backing-up image data (100) which is stored in an internal memory device (202) of an image acquisition apparatus (200), the image data (100) comprising a pixel matrix (104) representing a picture, the apparatus comprising: - receiving means (218) for receiving the image data (100); a memory device (216) for storing the image data (100); processing means (222) for creating an annotated thumbnail (107) which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation (108) that the image data (100) is back-upped; and sending means (218) for sending the annotated thumbnail (107) to the image acquisition apparatus (200).

6. An image acquisition apparatus (200) comprising: - acquisition means (212) for acquiring image data (100), the image data (100) comprising a pixel matrix (104) representing a picture; an internal memory device (202) for storing the image data (100); transferring means (206) for transferring the image data (100) to an external memory device (216); and - processing means (204) for creating an annotated thumbnail (107) which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation (108) that the image data (100) is back-upped.

7. A computer program product to be loaded by a computer arrangement, comprising instructions to back-up image data (100) which is stored in an internal memory device (202) of an image acquisition apparatus (200), the image data (100) comprising a pixel matrix (104) representing a picture, the computer arrangement comprising processing means, the computer program product, after being loaded, providing said processing means with the capability to carry out: - transferring the image data (100) to an external memory device (216) belonging to a further apparatus which is external from the image acquisition apparatus (200); and creating an annotated thumbnail (107) which substantially corresponds to a downscaled version of the picture and of which a group of pixels represent an annotation (108) that the image data (100) is back-upped.

8. A computer program product as claimed in Claim 7, whereby the computer program product further provides said processing means the capability to carry out sending the annotated thumbnail (107) to the image acquisition apparatus (200).