CN101335819B - Continuous photo processing device, method and image processing equipment - Google Patents
Continuous photo processing device, method and image processing equipment Download PDFInfo
- Publication number
- CN101335819B CN101335819B CN2008101441006A CN200810144100A CN101335819B CN 101335819 B CN101335819 B CN 101335819B CN 2008101441006 A CN2008101441006 A CN 2008101441006A CN 200810144100 A CN200810144100 A CN 200810144100A CN 101335819 B CN101335819 B CN 101335819B
- Authority
- CN
- China
- Prior art keywords
- area
- difference
- comparison
- repeated
- continuous shooting
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Landscapes
- Image Processing (AREA)
- Compression Of Band Width Or Redundancy In Fax (AREA)
Abstract
本发明连拍照片处理装置包括:临时存储单元,用于临时存储各连拍照片的像素数据;差异比较单元,用于对各连拍照片的对应位置像素数据进行比较,以获得包括重复区域信息和差异区域信息的差异比较结果;关联信息记录单元,用于记录各连拍照片差异区域与重复区域的关联信息,所述关联信息足够用来合并还原连拍照片;编码存储单元,用于分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数;解码合并单元,用于对差异区域和该差异区域关联的重复区域进行解码,并根据关联信息,合并差异区域和重复区域,以还原连拍照片。本发明可以提高照片的压缩率,降低其在图象处理设备中的存储空间。
The continuous shooting photo processing device of the present invention includes: a temporary storage unit for temporarily storing the pixel data of each continuous shooting photo; a difference comparison unit for comparing the corresponding position pixel data of each continuous shooting photo to obtain information including overlapping regions and the difference comparison result of the difference area information; the associated information recording unit is used to record the associated information of the difference area and the repeated area of each continuous shot photo, and the associated information is enough to merge and restore the continuous shot photos; the encoding storage unit is used for respectively The repeated area and the difference area of each continuous shooting photo participating in the comparison are coded and stored, wherein the number of encodings of the repeated area is less than the number of photos participating in the comparison; the decoding and merging unit is used to perform the encoding and storage of the difference area and the repeated area associated with the difference area Decode, and merge the difference regions and duplicate regions according to the associated information to restore the continuous shooting photos. The invention can improve the compression rate of the photos and reduce the storage space in the image processing equipment.
Description
技术领域technical field
本发明涉及一种数字图象处理技术,尤其是一种连拍照片的处理装置、方法及图象处理设备。The invention relates to a digital image processing technology, in particular to a processing device, method and image processing equipment for continuously shooting photos.
背景技术Background technique
现有的很多数字处理产品,如数码相机、手机等在提供照相功能的同时,还提供连拍功能,即可以连续拍摄多张照片后一次性存储,连拍的张数取决于手机等照相设备的存储空间大小,随着技术的不断成熟,连拍的张数越来越多,但同时对图象处理产品的存储空间也是一个挑战,因为在在众多文件中,图片文件所占的空间都是比较大的,手机等产品的存储介质都是有限的,增大存储空间必然意味着成本的上升。所以有效的图片压缩对于手机的整个成本有着非常重要的作用。Many existing digital processing products, such as digital cameras and mobile phones, not only provide camera functions, but also provide continuous shooting functions, that is, they can take multiple photos continuously and store them at one time. The number of continuous photos depends on the camera equipment such as mobile phones. The size of the storage space, with the continuous maturity of technology, the number of continuous shooting is increasing, but at the same time it is also a challenge to the storage space of image processing products, because among many files, the space occupied by picture files is It is relatively large, and the storage media of products such as mobile phones are limited, and increasing the storage space will inevitably mean an increase in cost. Therefore, effective image compression plays a very important role in the overall cost of the mobile phone.
发明内容Contents of the invention
本发明要解决的技术问题是提供在一种连拍照片的处理方法、装置及图象处理设备,以提高照片的压缩率,降低其在图象处理设备中的存储空间。The technical problem to be solved by the present invention is to provide a processing method, device and image processing equipment for continuously shooting photos, so as to improve the compression rate of photos and reduce the storage space in the image processing equipment.
为了解决上述问题,本发明提供了一种连拍照片的处理方法,该方法包括以下步骤:In order to solve the above-mentioned problems, the invention provides a kind of processing method of continuous shooting photo, and this method comprises the following steps:
(a)暂存至少两张连拍照片的像素数据;(a) Temporarily store the pixel data of at least two consecutive photos;
(b)比较连拍照片对应位置的像素数据,获得包括重复区域信息和差异区域信息的差异比较结果;(b) compare the pixel data of the corresponding positions of the continuous shooting photos, and obtain the difference comparison result including the repeated area information and the difference area information;
(c)分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数;(c) respectively encode and store the repeated regions and the difference regions of the consecutive photographs participating in the comparison, wherein the number of encodings of the repeated regions is less than the number of photographs participating in the comparison;
(d)记录各连拍照片重复区域和差异区域的关联信息,所述的关联信息足够用来合并还原连拍照片;(d) Record the associated information of the repeated area and the difference area of each continuous shooting photo, and the described related information is sufficient for merging and restoring the continuous shooting photos;
(e)浏览连拍照片时,对差异区域及与该差异区域关联的重复区域进行解码,并根据记录的关联信息合并重复区域和差异区域,以还原连拍照片。(e) When browsing the continuous shooting photos, the difference area and the repeated area associated with the difference area are decoded, and the repeated area and the difference area are merged according to the recorded associated information to restore the continuous shooting photos.
进一步地,步骤(a)中将至少两张连拍照片按相同的方法划分为若干个分区,该至少两张照片称为一个比较小组;步骤(b)中,完成比较小组各对应分区的比对,分区比对时,逐一比对对应的像素数据,若发现一个对应像素数据不同,则放弃比较该分区其他对应像素数据,且标示该分区为该比较小组的差异区域,若比较小组某分区的所有对应像素数据均相同,则标示该分区为该比较小组的重复区域。Further, in the step (a), at least two continuous photos are divided into several partitions in the same way, and the at least two photos are called a comparison group; in the step (b), the comparison of each corresponding partition of the comparison group is completed. Yes, when comparing partitions, compare the corresponding pixel data one by one. If a corresponding pixel data is found to be different, then abandon the comparison of other corresponding pixel data in the partition, and mark the partition as the difference area of the comparison group. If a partition in the comparison group If all the corresponding pixel data of , the partition is marked as the duplicated region of the comparison group.
进一步地,步骤(c)中对各连拍照片的差异区域进行编码前,根据差异比较结果将各连拍照片中的重复区域裁掉,并用简易数据填充;所述简易数据指编码后占用字节较少的重复数据。Further, in step (c), before coding the difference area of each continuous shooting photo, the repeated area in each continuous shooting photo is cut out according to the difference comparison result, and filled with simple data; the simple data refers to the occupied word after coding Section less duplicate data.
进一步地,所述关联信息包括差异区域存储的文件名、关联的重复区域的编号以及重复区域与差异区域的相对区域位置信息。Further, the association information includes the file name stored in the difference area, the number of the associated repeated area, and the relative area position information between the repeated area and the difference area.
进一步地,所述的照片和分区均为矩形,所述重复区域和连拍照片的差异区域包括一个或多个分区矩形,各分区组合或分别编码。Further, the photos and the partitions are both rectangles, the repeated area and the difference area of the continuous shooting photos include one or more partition rectangles, and each partition is combined or coded separately.
为解决上述技术问题,本发明还提供了一种连拍照片处理装置,该装置包括临时存储单元、差异比较单元、关联信息存储单元、编码存储单元及解码合并单元,其中,In order to solve the above technical problems, the present invention also provides a continuous photo processing device, which includes a temporary storage unit, a difference comparison unit, an associated information storage unit, an encoding storage unit and a decoding and merging unit, wherein,
临时存储单元,用于临时存储各连拍照片的像素数据;The temporary storage unit is used for temporarily storing the pixel data of each continuous shooting photo;
差异比较单元,用于对各连拍照片的对应位置像素数据进行比较,以获得包括重复区域信息和差异区域信息的差异比较结果;A difference comparison unit, configured to compare the corresponding position pixel data of each continuous shooting photo to obtain a difference comparison result including repeated area information and difference area information;
关联信息记录单元,用于记录各连拍照片差异区域与重复区域的关联信息,所述关联信息足够用来合并还原连拍照片;The associated information recording unit is used to record the associated information between the difference area and the repeated area of each continuous shooting photo, and the associated information is enough to merge and restore the continuous shooting photos;
编码存储单元,用于分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数;An encoding storage unit is used to encode and store the repeated area and the difference area of each continuous shooting photo participating in the comparison, wherein the number of encodings of the repeated area is less than the number of photos participating in the comparison;
解码合并单元,用于对差异区域和该差异区域关联的重复区域进行解码,并根据关联信息,合并差异区域和重复区域,以还原连拍照片。The decoding merging unit is configured to decode the difference area and the repeated area associated with the difference area, and merge the difference area and the repeated area according to the associated information to restore the continuous shooting photos.
进一步地,所述临时存储单元将至少两张连拍照片按相同的方法划分为若干个分区,该至少两张照片称为一个比较小组;所述差异比较单元用于完成比较小组各对应分区的比对,分区比对时,逐一比对对应的像素数据,若发现一个对应像素数据不同,则放弃比较该分区其他对应像素数据,且标示该分区为该比较小组的差异区域,若比较小组某分区的所有对应像素数据均相同,则标示该分区为该比较小组的重复区域。Further, the temporary storage unit divides at least two continuous photos into several partitions in the same way, and the at least two photos are called a comparison group; the difference comparison unit is used to complete the comparison of each corresponding partition of the group Comparison, when comparing partitions, compare the corresponding pixel data one by one. If a corresponding pixel data is found to be different, then abandon the comparison of other corresponding pixel data in the partition, and mark the partition as the difference area of the comparison group. If all corresponding pixel data of a partition are the same, the partition is marked as a duplicated region of the comparison group.
进一步地,所述装置还包括裁减填充单元,用于根据差异比较单元的差异比较结果将连拍照片中的重复区域裁减掉,并用简易数据填充;所述简易数据指编码后占用字节较少的重复数据。Further, the device also includes a cutting and filling unit, which is used to cut out the repeated area in the continuous shooting photos according to the difference comparison result of the difference comparison unit, and fill it with simple data; the simple data refers to less bytes after encoding of duplicate data.
进一步地,所述关联信息包括差异区域存储的文件名、关联的重复区域的编号以及重复区域与差异区域的相对区域位置信息。Further, the association information includes the file name stored in the difference area, the number of the associated repeated area, and the relative area position information between the repeated area and the difference area.
为解决上述技术问题,本发明还提供了一种图象处理设备,该设备具有辅助连拍功能的连拍照片处理装置,该装置包括临时存储单元、差异比较单元、关联信息存储单元、编码存储单元及解码合并单元,其中,In order to solve the above technical problems, the present invention also provides an image processing device, which has a continuous shooting photo processing device with auxiliary continuous shooting function, and the device includes a temporary storage unit, a difference comparison unit, an associated information storage unit, a coding storage unit and decoding merging unit, wherein,
临时存储单元,用于临时存储各连拍照片的像素数据;The temporary storage unit is used for temporarily storing the pixel data of each continuous shooting photo;
差异比较单元,用于对各连拍照片的对应位置像素数据进行比较,以获得包括重复区域信息和差异区域信息的差异比较结果;A difference comparison unit, configured to compare the corresponding position pixel data of each continuous shooting photo to obtain a difference comparison result including repeated area information and difference area information;
关联信息记录单元,用于记录各连拍照片差异区域与重复区域的关联信息,所述关联信息足够用来合并还原连拍照片;The associated information recording unit is used to record the associated information between the difference area and the repeated area of each continuous shooting photo, and the associated information is enough to merge and restore the continuous shooting photos;
编码存储单元,用于分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数;An encoding storage unit is used to encode and store the repeated area and the difference area of each continuous shooting photo participating in the comparison, wherein the number of encodings of the repeated area is less than the number of photos participating in the comparison;
解码合并单元,用于对差异区域和该差异区域关联的重复区域进行解码,并根据关联信息,合并差异区域和重复区域,以还原连拍照片。The decoding merging unit is configured to decode the difference area and the repeated area associated with the difference area, and merge the difference area and the repeated area according to the associated information to restore the continuous shooting photos.
进一步地,所述临时存储单元将至少两张连拍照片按相同的方法划分为若干个分区,该至少两张照片称为一个比较小组;所述差异比较单元用于完成比较小组各对应分区的比对,分区比对时,逐一比对对应的像素数据,若发现一个对应像素数据不同,则放弃比较该分区其他对应像素数据,且标示该分区为该比较小组的差异区域,若比较小组某分区的所有对应像素数据均相同,则标示该分区为该比较小组的重复区域。Further, the temporary storage unit divides at least two continuous photos into several partitions in the same way, and the at least two photos are called a comparison group; the difference comparison unit is used to complete the comparison of each corresponding partition of the group Comparison, when comparing partitions, compare the corresponding pixel data one by one. If a corresponding pixel data is found to be different, then abandon the comparison of other corresponding pixel data in the partition, and mark the partition as the difference area of the comparison group. If all corresponding pixel data of a partition are the same, the partition is marked as a duplicated region of the comparison group.
进一步地,所述装置还包括裁减填充单元,用于根据差异比较单元的差异比较结果将连拍照片中的重复区域裁减掉,并用简易数据填充;所述简易数据指编码后占用字节较少的重复数据。Further, the device also includes a cutting and filling unit, which is used to cut out the repeated area in the continuous shooting photos according to the difference comparison result of the difference comparison unit, and fill it with simple data; the simple data refers to less bytes after encoding of duplicate data.
进一步地,所述关联信息包括差异区域存储的文件名、关联的重复区域的编号及重复区域和差异区域的相对区域位置信息。Further, the associated information includes the file name stored in the difference area, the number of the associated repeated area, and the relative area position information of the repeated area and the difference area.
进一步地,所述的照片和分区均为矩形,所述重复区域和连拍照片的差异区域包括一个或多个分区矩形,各分区组合或分别编码。Further, the photos and the partitions are both rectangles, the repeated area and the difference area of the continuous shooting photos include one or more partition rectangles, and each partition is combined or coded separately.
本发明方法、装置和设备利用连拍照片之间的相似性,对像素数据进行比对后,获得重复区域和差异区域信息,编码时,分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数,最佳方式是对重复区域只编码一次,作为共享数据存储,待解码的时候共同使用拼出原始图像。这样可以提高照片的压缩率,降低其在图象处理设备中的存储空间。The method, device and equipment of the present invention use the similarity between the continuous shooting photos to compare the pixel data to obtain the information of the repeated area and the difference area. The area is coded and stored, and the number of codes for the repeated area is less than the number of photos involved in the comparison. The best way is to encode the repeated area only once, store it as shared data, and use it together to spell out the original image when it is to be decoded. This can improve the compression rate of the photo and reduce its storage space in the image processing device.
附图说明Description of drawings
图1是本发明连拍照片处理装置的框图。Fig. 1 is a block diagram of the continuous shooting photo processing device of the present invention.
图2是本发明连拍照片压缩存储方法的流程图。Fig. 2 is a flow chart of the method for compressing and storing continuous shooting photos of the present invention.
图3是对分割存储像素数据的示意图。FIG. 3 is a schematic diagram of storing pixel data for divisions.
图4是本发明连拍照片解码合并的流程图。Fig. 4 is a flow chart of decoding and merging of continuous shooting photos in the present invention.
图5是本发明方法的应用实例示意图。Fig. 5 is a schematic diagram of an application example of the method of the present invention.
具体实施方式Detailed ways
本发明连拍照片的处理装置设置在图象处理设备中,用于对连拍照片进行编码存储及解码处理,如图1所示,该连拍照片处理装置包括临时存储单元、差异比较单元、裁减填充单元、编码存储单元、关联信息记录单元及解码合并单元,其中,The processing device for continuous shooting photos of the present invention is arranged in an image processing device, and is used for encoding, storing and decoding processing of continuous shooting photos. As shown in Figure 1, the continuous shooting photo processing device includes a temporary storage unit, a difference comparison unit, Cutting and filling unit, encoding storage unit, associated information recording unit and decoding and merging unit, wherein,
临时存储单元,用于临时分割存储连拍照片的像素数据;The temporary storage unit is used to temporarily divide and store the pixel data of the continuous shooting photos;
目前原始图形都是以矩形方式表现,临时存储单元将完整的矩形照片的所有像素数据进行线性存储后,按统一的方法分割成若干个子矩形,再以子矩形为单元存储各连拍照片的像素数据。At present, the original graphics are represented in a rectangular form. After the temporary storage unit linearly stores all the pixel data of the complete rectangular photo, it is divided into several sub-rectangles according to a unified method, and then the pixels of each continuous shooting photo are stored in sub-rectangle units. data.
分割的子矩形的个数可以根据实际像素数和压缩比例需求预先设置。The number of divided sub-rectangles can be preset according to the actual number of pixels and the compression ratio requirements.
该临时存储单元存储的数据将在照片编码存储后由系统自动删除。The data stored in the temporary storage unit will be automatically deleted by the system after the photo is coded and stored.
差异比较单元,用于比较连拍照片各对应子矩形的对应像素数据,获得差异区域和重复区域;The difference comparison unit is used to compare the corresponding pixel data of each corresponding sub-rectangle of the continuous shooting photos, and obtain the difference area and the repeated area;
为了加快差异比较速度,可根据就近原则,将连拍照片组中的两张或多张照片划分为一个比较小组,根据连拍照片的张数划分成多个比较小组,为了优化该组连拍照片的比较速度,设置为每张照片参与一次比较。如,连拍照片共有5张,则可以将前两张组成第一比较小组,后三张组成第二比较小组。In order to speed up the comparison of differences, according to the principle of proximity, two or more photos in the continuous shooting group can be divided into a comparison group, and divided into multiple comparison groups according to the number of continuous shooting photos. In order to optimize the continuous shooting of this group The comparison speed of photos is set to one comparison for each photo. For example, if there are 5 photos taken continuously, the first two photos may form the first comparison group, and the last three photos may form the second comparison group.
对比较小组内照片进行比较时,以子矩形为单位进行逐像素数据比较,若在某对应子矩形发现一个对应像素数据不同,则停止对该比较小组的该子矩形其他像素数据的比较,并标示该子矩形区域为差异区域。若某对应子矩形中所有对应像素数据都相同,则标示该子矩形为重复区域。When comparing photos in the comparison group, compare pixel-by-pixel data in units of sub-rectangles. If a corresponding pixel data is found to be different in a corresponding sub-rectangle, stop comparing other pixel data of the sub-rectangle in the comparison group, and Mark this sub-rectangular area as a difference area. If all corresponding pixel data in a corresponding sub-rectangle are the same, the sub-rectangle is marked as a repeated area.
重复区域及差异区域是包括一个或若干个子矩形,根据差异面积的大小及位置,整体上表现为一个矩形或不规则形状,如图5所示,重复区域包括3个子矩形,整体上表现为不规则形状,而差异区域包括一个子矩形,整体上表现为矩形。The repeated area and the difference area include one or several sub-rectangles. According to the size and position of the difference area, the overall appearance is a rectangle or an irregular shape. As shown in Figure 5, the repeated area includes 3 sub-rectangles, and the overall appearance is different. Regular shape, while the difference area includes a sub-rectangle, which behaves as a rectangle overall.
裁减填充单元,用于对连拍照片进行处理,裁剪重复区域的像素数据并用简易数据填充裁减后的区域,获得处理后的差异区域。The cropping and filling unit is used for processing the continuous shooting photos, cropping the pixel data of repeated regions and filling the cropped regions with simple data to obtain processed difference regions.
这里所说的简易数据指以编码后占用字节较少的重复数据,如全部填充0或其他数据,以获得完整数据的矩形图片信息。The simple data mentioned here refers to repetitive data that occupies less bytes after encoding, such as filling all 0 or other data, so as to obtain the rectangular picture information of the complete data.
在重复区域作填0操作,是由于普通编码器在编码的时候多采用的编码方式如下:000000占6位,而编码后为60,占两位,从而可以大大减少编码后占用的存储空间,提高压缩比率。The operation of filling 0 in the repeated area is because the encoding method used by ordinary encoders is as follows: 000000 occupies 6 digits, and after encoding, it is 60, accounting for two digits, which can greatly reduce the storage space occupied after encoding. Increase the compression ratio.
编码存储单元,用于对处理后的连拍照片和重复区域分别进行编码存储。The encoding storage unit is used for encoding and storing the processed continuous shooting photos and repeated areas respectively.
编码存储单元采用编码器实现,图片的编码是有多种格式的,而本发明不关心图片编码格式,即不关心是JPEG或者PNG或其他格式,只是在原始数据上进行修改后,对修改后的照片和重复区域进行编码存储,确保高效率压缩。The encoding storage unit is implemented by an encoder, and the encoding of pictures has multiple formats, and the present invention does not care about the encoding format of the pictures, that is, it does not care about JPEG or PNG or other formats, but after modifying the original data, the modified Images and repeated regions are encoded and stored to ensure high-efficiency compression.
若重复区域包括多个连续或非连续的子矩形,可以就多个子矩形分别编码存储,或根据重复区域子矩形的连续性重新组合成一个或多个矩形再进行编码存储,总得来说,一个比较小组的重复区域只进行一次编码。If the repeated area includes multiple continuous or non-continuous sub-rectangles, the multiple sub-rectangles can be coded and stored separately, or recombined into one or more rectangles according to the continuity of the sub-rectangles of the repeated area and then encoded and stored. In general, a Repeated regions of the comparison group were coded only once.
处理后的连拍照片编码后以装置自动产生的文件名进行存储,该文件名是用户可更改的,而重复区域编码后的编号是不可更改的,从而绑定相关关联信息。The processed continuous shooting photos are coded and stored with the file name automatically generated by the device. The file name can be changed by the user, while the coded number of the repeated area cannot be changed, so as to bind relevant associated information.
重复区域编码后以与对应处理后连拍照片的文件名关联的编号进行存储。Repeated region coding is stored with a number associated with the file name of the corresponding processed burst photo.
根据差异区域进行处理后的连拍照片的数据内容与原差异区域的数据内容是相当的。The data content of the continuous shooting photos processed according to the difference area is equivalent to the data content of the original difference area.
关联信息记录单元用于记录各连拍照片及重复区域间的关联信息,以根据该关联信息合并还原连拍照片。The associated information recording unit is used for recording the associated information between each of the continuously shot photos and the overlapping regions, so as to combine and restore the continuously shot photos according to the associated information.
该关联信息包括连拍照片的文件名、与该文件名关联的重复区域编号以及重复区域与处理后照片的相对区域位置关系。The associated information includes the file name of the continuously shot photo, the number of the repeated area associated with the file name, and the relative positional relationship between the repeated area and the processed photo.
根据差异比较结果,重复区域可能包括多个子矩形,从而获得多个编码存储编号及多个相对区域位置关系。According to the difference comparison result, the repeated area may include multiple sub-rectangles, thereby obtaining multiple encoded storage numbers and multiple relative area position relationships.
解码合并单元,用于根据用户浏览需求,对差异区域和重复区域进行解码处理,并根据关联信息记录单元的关联信息进行合并还原,以显示完整的照片。The decoding and merging unit is used to decode the difference area and the repeated area according to the user's browsing requirements, and perform merging and restoration according to the associated information of the associated information recording unit, so as to display the complete photo.
根据关联的重复区域的编号可以查找到重复区域编码存储的文件,根据相对位置关系对解码后的差异区域和重复区域进行合并还原。According to the number of the associated repeated area, the file encoded and stored in the repeated area can be found, and the decoded difference area and the repeated area are merged and restored according to the relative positional relationship.
具有连拍功能的图象处理设备,采用本发明连拍照片处理装置后,同样可以提高连拍照片的压缩比。The image processing equipment with the continuous shooting function can also improve the compression ratio of the continuous shooting photos after adopting the continuous shooting photo processing device of the present invention.
以下对本发明连拍照片的处理方法,进行说明。The processing method of the continuous shooting photos of the present invention will be described below.
在用户启动连拍功能,进行连拍后,对连拍照片的处理包括以下步骤:After the user activates the continuous shooting function and performs continuous shooting, the processing of the continuous shooting photos includes the following steps:
步骤201,将各连拍照片的所有像素数据存储后,按照相同的划分方法划分为若干个子矩形;
步骤202:根据划分的子矩形重新存储各子矩形像素数据;Step 202: re-store the pixel data of each sub-rectangle according to the divided sub-rectangles;
以下以图3为例,说明如何分割及存储各子矩形像素数据。Taking FIG. 3 as an example, how to divide and store the sub-rectangular pixel data will be described below.
假设图3为其中一张连拍照片,宽度width=10,以左上角顶点为坐标原点,y表示第几行,取值为0-6,x表示第几列,取值为0-9,根据x,y坐标定位到图像的任何一个点上,例如整张照片的像素数据存储在char类型的数组当中,呈线性排列,存储为:123456789012345678901234567890123456789012345678901234567890,根据image[y*width+x]就可以计算出坐标x,y的像素值(width即整个矩形照片的宽度,为10),若将该照片划分为6个子矩形,存储第一个子矩形区域时,取两行数据,它的取法就是:image[0*width+0]为起点取5个像素,然后再次image[1*width+0]为起点取5个像素,这两次取出来的数据连接在一起就是第一个子矩形的像素数据,存储为:1234512345。Assuming that Figure 3 is one of the continuous shooting photos, the width width=10, the upper left corner vertex is taken as the origin of the coordinates, y indicates the row, the value is 0-6, x indicates the column, the value is 0-9, Locate to any point of the image according to the x and y coordinates. For example, the pixel data of the entire photo is stored in an array of char type, arranged linearly, and stored as: 12345678901234567890123456789012345678901234567890, which can be calculated according to image[y*width+x] Get the pixel values of coordinates x and y (width is the width of the entire rectangular photo, which is 10). If the photo is divided into 6 sub-rectangles, when storing the first sub-rectangle area, two rows of data are taken, and its method is: Image[0*width+0] takes 5 pixels as the starting point, and then image[1*width+0] takes 5 pixels as the starting point again. The data taken out of these two times are connected together to form the pixels of the first sub-rectangle Data, stored as: 1234512345.
步骤203:分比较小组,对各比较小组的对应子矩形的像素数据进行比较,获得重复区域信息和差异区域信息;Step 203: Divide into comparison groups, compare the pixel data of the corresponding sub-rectangles of each comparison group, and obtain repeated area information and difference area information;
将所有连拍照片以至少两张为一组,分为若干个比较小组,同时或依次比较各比较小组内,对应子矩形的对应的像素数据是否相同,若对应子矩形的像素数据均相同,则标识该子矩形为重复区域,否则为差异区域。Divide all continuous shooting photos into groups of at least two, and compare whether the corresponding pixel data of the corresponding sub-rectangles in each comparison group are the same at the same time or sequentially. If the pixel data of the corresponding sub-rectangles are the same, Then identify the sub-rectangle as a repeated area, otherwise it is a difference area.
若发现某对对应子矩形的某对对应像素数据不同,则标示该对应子矩形为差异区域,结束对该对应子矩形的比较,若某对对应子矩形的所有对应像素数据都相同,则标示该对应子矩形为重复区域,继续下一对对应子矩形数据像素的比较;完成所有比较小组及其子矩形的比较,获得各比较小组的重复区域和各比较小组内各照片的差异区域,If it is found that a pair of corresponding pixel data of a pair of corresponding sub-rectangles is different, mark the corresponding sub-rectangle as a difference area, and end the comparison of the corresponding sub-rectangle; if all corresponding pixel data of a certain pair of corresponding sub-rectangles are the same, mark The corresponding sub-rectangle is a repeated area, and the comparison of the next pair of corresponding sub-rectangle data pixels is continued; the comparison of all comparison groups and their sub-rectangles is completed, and the repeated area of each comparison group and the difference area of each photo in each comparison group are obtained.
包括差异区域信息和重复区域信息的差异比较结果可以存储在暂存区的文件系统中。The difference comparison result including difference region information and duplicate region information may be stored in the file system of the temporary storage area.
步骤204:对各比较小组的重复区域进行编码存储;Step 204: Code and store the repeated regions of each comparison group;
对一个比较小组而言,重复区域只需编码一次,且重复区域越大,压缩率就越高。For a comparison group, repeated regions need only be encoded once, and the larger the repeated region, the higher the compression ratio.
步骤205:对各比较小组内的连拍照片进行处理,即根据比较结果裁减重复区域,并填充简易数据,如0;Step 205: Process the continuous shooting photos in each comparison group, that is, cut the repeated area according to the comparison result, and fill in simple data, such as 0;
根据比较结果,重复区域和差异区域的位置是已知的,这时采用memoryset的方法(一种标准C语言对内存的操作,这个内存中存储着图像数据)对区域外的重复区域的像素数据设定为0,对原照片的重复区域填入0后送到编码器进行压缩。According to the comparison result, the positions of the repeated area and the difference area are known. At this time, the method of memoryset (a standard C language operation on memory, in which image data is stored) is used to process the pixel data of the repeated area outside the area. Set it to 0, fill in 0 in the repeated area of the original photo and send it to the encoder for compression.
步骤206:对处理后的照片进行编码存储,同时记录各比较小组重复区域与原照片的关联信息,以根据该关联信息合并还原。Step 206: Code and store the processed photos, and record the association information between the overlapping areas of each comparison group and the original photos at the same time, so as to combine and restore them according to the association information.
关联信息存储在图片存储数据库中,包括处理后照片的文件名,与该文件名关联的重复区域编号,重复区域在原照片中的位置信息(或重复区域与差异区域的相对区域位置信息)等。The associated information is stored in the image storage database, including the file name of the processed photo, the number of the repeated area associated with the file name, the position information of the repeated area in the original photo (or the relative area position information between the repeated area and the difference area), etc.
图象处理设备中可能存储着多个这种处理方式的,而文件名是独立不重名的,以文件和编号的重复区域关联起来,在显示图片的时候才知道需要把哪个重复区域取出来一起显示。There may be multiple such processing methods stored in the image processing device, and the file names are independent and not duplicated. The file is associated with the repeated area of the number, and it is only known which repeated area needs to be taken out when the picture is displayed. displayed together.
以上的连拍照片存储方法,可以由数字图象处理设备进行连拍后的高压缩存储功能实现:即用户选择先连拍功能进行连拍;连拍完成后,用户选择保存功能并选择高压缩存储保存所拍摄的照片。The above continuous shooting photo storage method can be realized by the high-compression storage function after the continuous shooting of the digital image processing device: that is, the user selects the continuous shooting function to perform continuous shooting; after the continuous shooting is completed, the user selects the save function and selects high compression Storage Save the captured pictures.
用户浏览保存的连拍照片时,启动照片浏览功能,选择要浏览的某张连拍照片后,连拍照片处理装置执行以下步骤:When the user browses the stored continuous shooting photos, the photo browsing function is activated, and after selecting a continuous shooting photo to be browsed, the continuous shooting photo processing device performs the following steps:
步骤401:根据用户选择浏览的照片(此处的照片是处理后的、只有差异区域的照片)的文件名的关联编号,找到关联的重复区域的编码存储文件;Step 401: According to the association number of the file name of the photo selected by the user to browse (the photo here is a processed photo with only a difference area), find the coded storage file of the associated repeated area;
步骤402:对重复区域及处理后照片进行解码;Step 402: Decoding the repeated area and the processed photo;
解码的过程是将重复区域和差异区域的图片变回像素数据的过程。The process of decoding is the process of converting the picture of the repeated area and the difference area back into pixel data.
步骤403:根据关联信息中重复区域的位置信息,合并解码后的处理后照片(差异区域)和重复区域,获得完整照片像素数据,以显示完整照片。Step 403: Merge the decoded processed photo (difference region) and the repeated region according to the location information of the repeated region in the associated information to obtain pixel data of the complete photo to display the complete photo.
解码后的图片的像素数据存储在char类型的数组当中,呈线性排列,我们可根据x,y坐标定位到图像的任何一个点上,例如image[y*width+x]就是坐标x,y的像素值,重复区域编号在图片存储数据库中查找坐标信息,根据找到的x,y坐标信息,用memcpy的方法(这是标准的C语言数据处理函数,用来进行数据合并)把重复区域的像素数据拷贝到原始图片的像素数据中。The pixel data of the decoded picture is stored in an array of char type, which is arranged linearly. We can locate any point of the image according to the x, y coordinates. For example, image[y*width+x] is the coordinates of x, y Pixel value, repeat area number Look up the coordinate information in the picture storage database, according to the found x, y coordinate information, use the method of memcpy (this is a standard C language data processing function, used for data merging) to convert the pixels of the repeat area The data is copied into the pixel data of the original image.
连拍照片的形状及划分后的形状,取决于编码器的能力,就目前技术来讲,以划分为矩形分区,比较易于实现,但随着编码技术的发展,分区的形状或可变化,在某种意义上,这种分区可细化到行或列或单个像素,完成差异比较后,只要比较小组的重复区域进行一次编码并记录足够的关联信息,都可以实现本发明目的。The shape of the continuous shooting photos and the shape after division depend on the ability of the encoder. As far as the current technology is concerned, it is easier to implement by dividing into rectangular partitions. However, with the development of encoding technology, the shape of the partition may change. In a sense, this partition can be subdivided into rows or columns or a single pixel. After the difference comparison is completed, as long as the repeated areas of the comparison group are coded once and enough associated information is recorded, the purpose of the present invention can be achieved.
差异比较后,对原照片根据差异比较结果进行裁减填充,一方面需要记录的关联信息相对较少,且裁减填充后,对原照片的差异区域来说,无论差异区域是否连续,只要一次编码存储即可,浏览时,因处理后照片相较原照片尺寸大小不变,重复区域解码后也比较容易实现与处理后照片的合并处理。After the difference comparison, the original photo is cut and filled according to the difference comparison result. On the one hand, there is relatively little related information to be recorded. That is, when browsing, because the size of the processed photo is unchanged compared with the original photo, it is relatively easy to realize the merge processing with the processed photo after decoding the repeated region.
基于本发明思想,也可以保留(比较小组内的)一张照片不进行裁减填充处理,记录其与(比较小组内)其他照片的重复区域在照片中的坐标位置,无论浏览哪张照片,都需要先对未进行处理的照片进行解码,以将其中重复区域的像素数据拷贝到要浏览的处理后的照片的像素数据的适当位置,以还原要浏览的照片,这种方法相对来说比较复杂。Based on the idea of the present invention, it is also possible to keep a photo (in the comparison group) without cutting and filling processing, and record the coordinate position of the overlapping area between it and other photos (in the comparison group) in the photo, no matter which photo is browsed, It is necessary to decode the unprocessed photo first, so as to copy the pixel data of the repeated area to the appropriate position of the pixel data of the processed photo to be browsed, so as to restore the photo to be browsed, this method is relatively complicated .
还有一种方法是,各照片均不进行裁减填充,而只是根据差异比较结果,分别编码存储差异区域及(比较小组的)重复区域,为了能还原照片,需要记录的关联信息相对较多,包括原照片大小,差异区域及重复区域在原照片中的位置信息(比如在原照片坐标系中的边界坐标位置、或隐含位置关系的顺序信息),和/或差异区域与重复区域的相对区域位置。Another method is that each photo is not cut and filled, but is only coded and stored according to the difference comparison result and the repeated area (of the comparison group). In order to restore the photo, there are relatively many related information that need to be recorded, including The size of the original photo, the location information of the difference area and the repeated area in the original photo (such as the boundary coordinate position in the original photo coordinate system, or the order information of the implied position relationship), and/or the relative area position of the difference area and the repeated area.
总得来说,记录的关联信息一定是足够用来合并重复区域和差异区域还原照片的信息总和。In general, the recorded associated information must be the sum of information that is sufficient to merge the repeated regions and the difference regions to restore the photos.
无论是否进行裁减填充,因分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,只要保证重复区域的编码次数少于参与比较的照片数,就可以提高连拍照片的压缩率,当然最佳处理方式是对重复区域只编码一次。Regardless of whether to cut and fill, because the repeated area and the difference area of each continuous shooting photo participating in the comparison are coded and stored separately, as long as the number of coding times of the repeated area is less than the number of photos participating in the comparison, the compression rate of the continuous shooting photo can be improved , of course the best way to deal with it is to encode the repeated region only once.
应用实例Applications
如图5所示,连拍两张照片图5-1(以下称为P1)和图5-2(以下称为P2),对这两张连拍照片的压缩存储过程包括以下步骤:As shown in Figure 5, two pictures are taken continuously in Figure 5-1 (hereinafter referred to as P1) and Figure 5-2 (hereinafter referred to as P2), the compression storage process of these two continuous shooting pictures includes the following steps:
a.临时存储a. Temporary storage
将连拍照片一P1和连拍照片二P2分割成4个子矩形R1、R2、R3、R4进行临时像素数据存储;Divide continuous shooting photo 1 P1 and continuous shooting photo 2 P2 into 4 sub-rectangles R1, R2, R3, R4 for temporary pixel data storage;
连拍照片一P1的各子矩形分别表示为R11、R12、R13、R14;The sub-rectangles of the continuous shooting photo one P1 are denoted as R11, R12, R13, R14 respectively;
连拍照片二P2的各子矩形分别表示为R21、R22、R23、R24;Each sub-rectangle of the continuous shooting photo 2 P2 is represented as R21, R22, R23, R24 respectively;
各子矩形中的像素数据分别以char类型数组,呈线性排列The pixel data in each sub-rectangle is arrayed in char type and arranged linearly
b.差异比对b. Difference comparison
以子矩形为单元,对P1和P2的各对应子矩形中各对应像素数据进行差异比较,若某对子矩形中的某对像素数据不同,则认定该对应子矩形区域为差异区域,依次完成对4对子矩形的差异对比,得到第4个子矩形区域为差异区域,即R14与R24不同,重复区域为R11(R21)、R12(R22)及R13(R23);Take the sub-rectangle as the unit, compare the difference between the corresponding pixel data in the corresponding sub-rectangles of P1 and P2, if a pair of pixel data in a certain pair of sub-rectangles is different, the corresponding sub-rectangle area is determined to be the difference area, and the steps are completed in sequence Comparing the difference between the 4 pairs of sub-rectangles, the fourth sub-rectangle area is the difference area, that is, R14 is different from R24, and the repeated areas are R11 (R21), R12 (R22) and R13 (R23);
c.编码存储c. Code storage
对重复区域及P1、P2的各差异区域分别进行编码存储;Code and store the repeated regions and the difference regions of P1 and P2 respectively;
若编码器只能对矩形图片进行编码,则重复区域以R11(R21)、R12(R22)组成的矩形区域进行一次编码,存储标号为R1121,以R13(R23)的矩形区域进行一次编码,存储编号为R1323,对于P1的差异区域R14进行一次编码,存储文件名为P1,对于P2的差异区域R24进行一次编码,存储文件名为P2。If the encoder can only encode rectangular pictures, the repeated area is encoded once with the rectangular area composed of R11 (R21) and R12 (R22), and the storage label is R1121, and the rectangular area of R13 (R23) is encoded once, and stored The number is R1323, and the difference area R14 of P1 is encoded once, and the storage file name is P1, and the difference area R24 of P2 is encoded once, and the storage file name is P2.
这里应当理解,虽然重复区域根据划分的分区重组后进行了2次编码,但对整个重复区域而言,只进行了一次编码,应当认为重复区域的编码次数(1次)少于参与比较的照片数(2张)。It should be understood here that although the repeated area was coded twice after being reorganized according to the divided partitions, but for the entire repeated area, only one encoding was performed, and it should be considered that the number of times (one) encoded in the repeated area was less than that of the photographs involved in the comparison. Number (2 sheets).
d.记录关联信息d. Record related information
记录的照片P1的关联信息包括:The associated information of the recorded photo P1 includes:
文件名:P1;File name: P1;
重复区域编号:R1121、R1323;Repeated region numbers: R1121, R1323;
位置信息:差异区域为R4,重复区域为R1、R2、R3。Location information: the difference region is R4, and the repeat regions are R1, R2, and R3.
记录的照片P2的关联信息包括:The associated information of the recorded photo P2 includes:
文件名:P2;File name: P2;
重复区域编号:R1121、R1323;Repeated region numbers: R1121, R1323;
位置信息:差异区域为R4,重复区域为R1、R2、R3Position information: the difference area is R4, and the repeat area is R1, R2, R3
该应用实例中的位置信息,是采用隐含了坐标位置的顺序编号。The location information in this application example adopts sequential numbers that imply coordinate locations.
本发明利用连拍照片之间的相似性,对像素数据进行比对后,获得重复区域和差异区域信息,编码时,分别对重复区域和参与比较的各连拍照片的差异区域进行编码存储,其中重复区域的编码次数少于参与比较的照片数,最佳方式是对重复区域只编码一次,作为共享数据存储,待解码的时候共同使用拼出原始图像。这样可以提高照片的压缩率,降低其在图象处理设备中的存储空间。The present invention uses the similarity between the continuous shooting photos, compares the pixel data, and obtains the information of the repeated area and the difference area. When encoding, the repeated area and the difference area of each continuous shooting photo participating in the comparison are coded and stored respectively. The number of encoding times of the repeated area is less than the number of photos participating in the comparison. The best way is to encode the repeated area only once, store it as shared data, and use it together to spell out the original image when it is to be decoded. This can improve the compression rate of the photo and reduce its storage space in the image processing device.
Claims (14)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101441006A CN101335819B (en) | 2008-08-06 | 2008-08-06 | Continuous photo processing device, method and image processing equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN2008101441006A CN101335819B (en) | 2008-08-06 | 2008-08-06 | Continuous photo processing device, method and image processing equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN101335819A CN101335819A (en) | 2008-12-31 |
| CN101335819B true CN101335819B (en) | 2010-06-16 |
Family
ID=40198105
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN2008101441006A Active CN101335819B (en) | 2008-08-06 | 2008-08-06 | Continuous photo processing device, method and image processing equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101335819B (en) |
Families Citing this family (20)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8655085B2 (en) * | 2010-10-28 | 2014-02-18 | Microsoft Corporation | Burst mode image compression and decompression |
| JP5115619B2 (en) * | 2010-11-25 | 2013-01-09 | カシオ計算機株式会社 | Imaging apparatus, imaging control method, and program |
| CN104202522B (en) * | 2014-08-29 | 2017-11-24 | 广东欧珀移动通信有限公司 | A kind of continuous photo storage method and mobile terminal applied to mobile terminal |
| CN105528798B (en) * | 2014-09-29 | 2019-10-08 | 优视科技有限公司 | Picture compression method and device |
| CN104361070B (en) * | 2014-11-11 | 2018-05-08 | 惠州Tcl移动通信有限公司 | Save continuous photo storage method, photo restoring method and the system of memory space |
| CN104469069B (en) * | 2014-12-15 | 2019-07-30 | 北京百度网讯科技有限公司 | Photo synchronization method and device |
| CN104462422A (en) * | 2014-12-15 | 2015-03-25 | 北京百度网讯科技有限公司 | Object processing method and device |
| CN104506752B (en) * | 2015-01-06 | 2017-08-25 | 河海大学常州校区 | A kind of similar image compression method based on residual error compressed sensing |
| CN106326908A (en) * | 2015-06-30 | 2017-01-11 | 中兴通讯股份有限公司 | Picture management method and apparatus, and terminal equipment |
| CN105120164B (en) * | 2015-08-28 | 2016-10-19 | 努比亚技术有限公司 | The processing means of continuous photo and method |
| CN105224671A (en) * | 2015-10-14 | 2016-01-06 | Tcl移动通信科技(宁波)有限公司 | A kind of photo storage method and system based on mobile terminal |
| CN105630961A (en) * | 2015-12-24 | 2016-06-01 | Tcl集团股份有限公司 | Processing method and system of same-name file during picture copying |
| CN106454122A (en) * | 2016-11-24 | 2017-02-22 | 广州赛意信息科技股份有限公司 | Processing method and system for fast continuous shooting |
| CN108241645B (en) * | 2016-12-23 | 2020-03-17 | 腾讯科技(深圳)有限公司 | Image processing method and device |
| CN108540726B (en) * | 2018-05-15 | 2020-05-05 | Oppo广东移动通信有限公司 | Continuous image processing method, device, storage medium and terminal |
| CN110012225B (en) * | 2019-03-27 | 2021-09-24 | 维沃移动通信有限公司 | An image processing method, device and mobile terminal |
| CN113596401A (en) * | 2021-07-29 | 2021-11-02 | 上海应用技术大学 | Image de-similarity transmission and restoration method based on ORB similarity judgment |
| CN115942107A (en) * | 2021-08-05 | 2023-04-07 | Oppo广东移动通信有限公司 | Data presentation method and data storage method, chip, device, equipment, medium |
| CN116095337A (en) * | 2021-11-05 | 2023-05-09 | 华为技术有限公司 | Video compression, decompression method and electronic device |
| CN115341944A (en) * | 2022-08-22 | 2022-11-15 | 华能澜沧江水电股份有限公司 | Tunnel dust removal device and method |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1202675A (en) * | 1997-03-26 | 1998-12-23 | 松下电器产业株式会社 | image decoding device |
-
2008
- 2008-08-06 CN CN2008101441006A patent/CN101335819B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1202675A (en) * | 1997-03-26 | 1998-12-23 | 松下电器产业株式会社 | image decoding device |
Non-Patent Citations (2)
| Title |
|---|
| JP特开2001-333430A 2001.11.30 |
| JP特开2006-166359A 2006.06.22 |
Also Published As
| Publication number | Publication date |
|---|---|
| CN101335819A (en) | 2008-12-31 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101335819B (en) | Continuous photo processing device, method and image processing equipment | |
| KR101012618B1 (en) | Processing of Images in the Imaging System | |
| US6298166B1 (en) | Image transformations in the compressed domain | |
| JP2018501693A (en) | How to create a video | |
| JP2006501522A5 (en) | ||
| JPH10198337A5 (en) | ||
| EP1037165B1 (en) | Method and apparatus for processing image files | |
| CN108322727A (en) | A panoramic video transmission method and device | |
| WO2008153313A2 (en) | System and method for generating and regenerating 3d image files based on 2d image media standards | |
| KR102842573B1 (en) | Method and device for encoding/decoding a point cloud representing a 3D object | |
| WO2006080240A1 (en) | Encoding device, encoding method, encoding program, and imaging device | |
| CN115022670B (en) | Video file storage method, restoration method, device, equipment and storage medium | |
| CN106469208B (en) | A heat map data processing method, heat map data retrieval method and device | |
| CN104243886B (en) | A kind of high speed image parsing and video generation method based on plug-in part technology | |
| CN103795928B (en) | A kind of raw data format photo processing method and system | |
| CA2687874C (en) | Method and system for processing of images | |
| US7747097B2 (en) | Method for simple hardware implementation of JPEG size limiter | |
| US20050036046A1 (en) | Method of or device for processing image data, a processed image data format, and a method of or device for displaying at least one image from the processed image data | |
| CN102724471A (en) | Picture and video converting method and device | |
| JP2017192080A (en) | Image compression apparatus, image decoding apparatus, image compression method, and image compression program | |
| CN110232657A (en) | A kind of image-scaling method, device, equipment and medium | |
| US11615573B2 (en) | Method, system, and non-transitory computer-readable record medium for providing animation using sprite JPEG | |
| CN103903285B (en) | Thumbnail extraction method of PNG image and BMP image | |
| US8165424B1 (en) | Method and device for video transformations | |
| CN114463454A (en) | Image reconstruction method, image coding method, image decoding method, image coding device, image decoding device, and image decoding device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant |