CN117252886B - Invoice identification method and system based on image segmentation - Google Patents
Invoice identification method and system based on image segmentation Download PDFInfo
- Publication number
- CN117252886B CN117252886B CN202311171722.9A CN202311171722A CN117252886B CN 117252886 B CN117252886 B CN 117252886B CN 202311171722 A CN202311171722 A CN 202311171722A CN 117252886 B CN117252886 B CN 117252886B
- Authority
- CN
- China
- Prior art keywords
- preset
- image
- invoice
- area
- difference
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/60—Rotation of whole images or parts thereof
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Geometry (AREA)
- Image Analysis (AREA)
Abstract
本发明涉及发票信息识别技术领域，尤其涉及一种基于图像分割的发票识别系统，包括：步骤S1，获取黑白发票图像；步骤S2，灰度扫描组件对发票图像灰度值进行检测，中控模块对获取的发票图像的有效性进行判定；步骤S3，所述中控模块对图像获取组件的倾斜角度进行调节，或，根据发票图像的噪点面积占比对发票图像清晰度进行二次判定；步骤S4，在二次判定后，所述中控模块对图像获取组件的感光度进行调节，或，根据发票图像边缘缺失面积对数据训练系统的训练频率进行调节；步骤S5，所述中控模块根据发票图像信息的提取时长对发票图像的单块分割面积进行调节，本发明实现了发票的识别效率和识别的有效性的提高。
The present invention relates to the technical field of invoice information recognition, and in particular to an invoice recognition system based on image segmentation, comprising: step S1, obtaining a black-and-white invoice image; step S2, a grayscale scanning component detects the grayscale value of the invoice image, and a central control module determines the validity of the acquired invoice image; step S3, the central control module adjusts the inclination angle of the image acquisition component, or, according to the noise area ratio of the invoice image, performs a secondary determination on the clarity of the invoice image; step S4, after the secondary determination, the central control module adjusts the sensitivity of the image acquisition component, or, according to the missing area of the invoice image edge, adjusts the training frequency of the data training system; step S5, the central control module adjusts the single-block segmentation area of the invoice image according to the extraction time of the invoice image information. The present invention realizes the improvement of the recognition efficiency and the recognition validity of the invoice.
Description
技术领域Technical Field
本发明涉及发票信息识别技术领域，尤其涉及一种基于图像分割的发票识别方法及系统。The present invention relates to the technical field of invoice information recognition, and in particular to an invoice recognition method and system based on image segmentation.
背景技术Background Art
随着科技的发展，现阶段内商业发票主要利用机打发票，传统的发票统计工作是通过人工进行逐张发票进行校对、审查，不仅效率低下，而且受人为因素的影响。现有技术中，利用计算机识别发票号码和发票代码，通过光学字符识别获取目标区域的字符识别信息，大大减少了发票统计、审查工作任务。With the development of science and technology, commercial invoices are mainly machine-printed at present. The traditional invoice statistics work is to proofread and review each invoice manually, which is not only inefficient but also affected by human factors. In the existing technology, computers are used to identify invoice numbers and invoice codes, and optical character recognition is used to obtain character recognition information of the target area, which greatly reduces the tasks of invoice statistics and review.
中国专利公开号：CN114694162A公开了一种基于图像处理的发票图像识别方法及系统，包括：获得只包含机打内容的差值图像；根据差值图像中的边缘像素点的梯度直方图；选择一个预设梯度方向的边缘像素点作为角点，同时筛选获得第一角点；获得字符区域，字符区域为一个完整机打字符串的最小外接矩形；利用第一角点之间的结构参数对所有字符区域中的每个字符周围的第一角点进行筛选获得字符区域中所有字符的结构角点；根据字符区域中属于每个字符的结构角点的坐标对字符进行分割并识别，由此可见，所述基于图像处理的发票图像识别方法及系统存在以下问题：由于光源的光照强度过强导致发票识别的精准性下降。Chinese Patent Publication No.: CN114694162A discloses an invoice image recognition method and system based on image processing, including: obtaining a difference image containing only machine-printed content; according to the gradient histogram of edge pixel points in the difference image; selecting an edge pixel point in a preset gradient direction as a corner point, and simultaneously screening to obtain the first corner point; obtaining a character area, the character area being the minimum circumscribed rectangle of a complete machine-printed character string; using the structural parameters between the first corner points to screen the first corner points around each character in all character areas to obtain the structural corner points of all characters in the character area; according to the coordinates of the structural corner points belonging to each character in the character area, the characters are segmented and recognized. It can be seen that the invoice image recognition method and system based on image processing have the following problems: the accuracy of invoice recognition is reduced due to the excessive light intensity of the light source.
发明内容Summary of the invention
为此，本发明提供一种基于图像分割的发票识别方法及系统，用以克服现有技术中由于光源的光照强度过强导致发票识别的精准性下降的问题。To this end, the present invention provides an invoice recognition method and system based on image segmentation, so as to overcome the problem in the prior art that the accuracy of invoice recognition is reduced due to the excessive illumination intensity of the light source.
为实现上述目的，本发明提供一种基于图像分割的发票识别方法，包括：步骤S1，使用图像获取组件对发票图像进行获取，中控模块将所述发票图像转换成黑白发票图像；步骤S2，所述中控模块控制与所述图像获取组件相连的灰度扫描组件对发票图像灰度值进行检测并计算发票图像与标准图像的灰度值差异量以对获取的发票图像的有效性进行判定；步骤S3，在判定图像获取的有效性低于允许范围时，所述中控模块将图像获取组件的倾斜角度调节至对应角度，或，根据发票图像的噪点面积占比对发票图像清晰度进行二次判定；步骤S4，在二次判定发票图像清晰度低于允许范围后，所述中控模块将图像获取组件的感光度调节至对应值，或，根据发票图像边缘缺失面积将数据训练系统的训练频率调节至对应频率；步骤S5，在完成对数据训练系统的训练频率的调节时，所述中控模块根据发票图像信息的提取时长将发票图像的单块分割面积调节至对应面积。To achieve the above-mentioned purpose, the present invention provides an invoice recognition method based on image segmentation, comprising: step S1, using an image acquisition component to acquire an invoice image, and a central control module converting the invoice image into a black and white invoice image; step S2, the central control module controls a grayscale scanning component connected to the image acquisition component to detect the grayscale value of the invoice image and calculate the grayscale value difference between the invoice image and the standard image to determine the validity of the acquired invoice image; step S3, when it is determined that the validity of image acquisition is lower than an allowable range, the central control module adjusts the inclination angle of the image acquisition component to a corresponding angle, or, according to the noise area ratio of the invoice image, performs a secondary determination on the clarity of the invoice image; step S4, after the secondary determination that the clarity of the invoice image is lower than the allowable range, the central control module adjusts the sensitivity of the image acquisition component to a corresponding value, or, according to the edge missing area of the invoice image, adjusts the training frequency of the data training system to a corresponding frequency; step S5, when the adjustment of the training frequency of the data training system is completed, the central control module adjusts the single block segmentation area of the invoice image to a corresponding area according to the extraction time of the invoice image information.
进一步地，所述中控模块根据发票图像与标准图像的灰度值差异量确定图像获取的有效性是否在允许范围内的三种判定方法，其中，Furthermore, the central control module determines whether the validity of image acquisition is within the allowable range according to the difference in grayscale values between the invoice image and the standard image using three determination methods, wherein:
第一种判定方法为，所述中控模块在预设第一差异量条件下判定图像获取的有效性在允许范围内；The first determination method is that the central control module determines that the validity of image acquisition is within an allowable range under a preset first difference amount condition;
第二种判定方法为，所述中控模块在预设第二差异量条件下判定图像获取的有效性低于允许范围，通过计算发票图像与标准图像的灰度值差异量与预设第一差异量的差值将图像获取组件的倾斜角度调节至对应角度；The second determination method is that the central control module determines that the validity of image acquisition is lower than the allowable range under the preset second difference amount condition, and adjusts the tilt angle of the image acquisition component to the corresponding angle by calculating the difference between the gray value difference amount between the invoice image and the standard image and the preset first difference amount;
第三种判定方法为，所述中控模块在预设第三差异量条件下判定图像获取的有效性低于允许范围，初步判定发票图像清晰度低于允许范围，并根据发票图像的噪点面积占比对发票图像清晰度是否低于允许范围进行二次判定；The third determination method is that the central control module determines that the validity of image acquisition is lower than the allowable range under the preset third difference amount condition, preliminarily determines that the clarity of the invoice image is lower than the allowable range, and performs a secondary determination on whether the clarity of the invoice image is lower than the allowable range based on the noise area ratio of the invoice image;
其中，所述预设第一差异量条件为，发票图像与标准图像的灰度值差异量小于等于预设第一差异量；所述预设第二差异量条件为，发票图像与标准图像的灰度值差异量大于预设第一差异量且小于等于预设第二差异量；所述预设第三差异量条件为，发票图像与标准图像的灰度值差异量大于预设第二差异量，所述预设第一差异量小于所述预设第二差异量。Among them, the preset first difference amount condition is that the grayscale value difference between the invoice image and the standard image is less than or equal to the preset first difference amount; the preset second difference amount condition is that the grayscale value difference between the invoice image and the standard image is greater than the preset first difference amount and less than or equal to the preset second difference amount; the preset third difference amount condition is that the grayscale value difference between the invoice image and the standard image is greater than the preset second difference amount, and the preset first difference amount is less than the preset second difference amount.
进一步地，所述中控模块在预设第二差异量条件下根据发票图像与标准图像的灰度值差异量与预设第一差异量的差值确定针对图像获取组件的倾斜角度的两种调节方法，其中，Furthermore, the central control module determines two adjustment methods for the tilt angle of the image acquisition component according to the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference under the preset second difference condition, wherein:
第一种角度调节方法为，所述中控模块在预设第一差异量差值条件下使用预设第一角度调节系数将图像获取组件的倾斜角度调节至第一角度；The first angle adjustment method is that the central control module uses a preset first angle adjustment coefficient to adjust the tilt angle of the image acquisition component to a first angle under a preset first difference value condition;
第二种角度调节方法为，所述中控模块在预设第二差异量差值条件下使用预设第二角度调节系数将图像获取组件的倾斜角度调节至第二角度；The second angle adjustment method is that the central control module uses a preset second angle adjustment coefficient to adjust the tilt angle of the image acquisition component to a second angle under a preset second difference value condition;
其中，所述预设第一差异量差值条件为，发票图像与标准图像的灰度值差异量与预设第一差异量的差值小于等于预设差异量差值；所述预设第二差异量差值条件为，发票图像与标准图像的灰度值差异量与预设第一差异量的差值大于预设差异量差值；所述预设第一角度调节系数小于所述预设第二角度调节系数。Among them, the preset first difference difference condition is that the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference is less than or equal to the preset difference difference; the preset second difference difference condition is that the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference is greater than the preset difference difference; the preset first angle adjustment coefficient is less than the preset second angle adjustment coefficient.
进一步地，所述中控模块在预设第三差异量条件下根据发票图像的噪点面积占比确定发票图像清晰度是否在允许范围内的三种二次判定方法，其中，Furthermore, the central control module determines whether the clarity of the invoice image is within the allowable range according to the noise area ratio of the invoice image under the preset third difference amount condition using three secondary determination methods, wherein:
第一种二次判定方法为，所述中控模块在预设第一面积占比条件下判定发票图像清晰度在允许范围内；The first secondary determination method is that the central control module determines that the clarity of the invoice image is within an allowable range under a preset first area ratio condition;
第二种二次判定方法为，所述中控模块在预设第二面积占比条件下判定发票图像清晰度低于允许范围，通过计算发票图像的噪点面积占比与预设第一面积占比的差值将图像获取组件的感光度调节至对应值；The second secondary determination method is that the central control module determines that the clarity of the invoice image is lower than the allowable range under the preset second area ratio condition, and adjusts the sensitivity of the image acquisition component to the corresponding value by calculating the difference between the noise area ratio of the invoice image and the preset first area ratio;
第三种二次判定方法为，所述中控模块在预设第三面积条件下判定发票图像清晰度低于允许范围，初步判定发票信息的完整性低于允许范围，并根据发票图像边缘缺失面积对发票信息的完整性进行二次判定；The third secondary determination method is that the central control module determines that the clarity of the invoice image is lower than the allowable range under the preset third area condition, preliminarily determines that the integrity of the invoice information is lower than the allowable range, and performs a secondary determination on the integrity of the invoice information based on the missing area of the edge of the invoice image;
其中，所述预设第一面积占比条件为，发票图像的噪点面积占比小于等于预设第一面积占比；所述预设第二面积占比条件为，发票图像的噪点面积占比大于预设第一面积占比且小于等于预设第二面积占比；所述预设第三面积占比条件为，发票图像的噪点面积占比大于预设第二面积占比，所述预设第一面积占比小于所述预设第二面积占比。Among them, the preset first area ratio condition is that the noise area ratio of the invoice image is less than or equal to the preset first area ratio; the preset second area ratio condition is that the noise area ratio of the invoice image is greater than the preset first area ratio and less than or equal to the preset second area ratio; the preset third area ratio condition is that the noise area ratio of the invoice image is greater than the preset second area ratio, and the preset first area ratio is less than the preset second area ratio.
进一步地，所述中控模块在预设第二面积占比条件下根据发票图像的噪点面积占比与预设第一面积占比的差值确定针对图像获取组件的感光度的两种调节方法，其中，Furthermore, the central control module determines two adjustment methods for the sensitivity of the image acquisition component according to the difference between the noise area ratio of the invoice image and the preset first area ratio under the preset second area ratio condition, wherein:
第一种感光度调节方法为，所述中控模块在预设第一面积占比差值条件下使用预设第一感光度调节系数将图像获取组件的感光度调节至第一数值；The first sensitivity adjustment method is that the central control module uses a preset first sensitivity adjustment coefficient to adjust the sensitivity of the image acquisition component to a first value under a preset first area ratio difference condition;
第二种感光度调节方法为，所述中控模块在预设第二面积占比差值条件下使用预设第二感光度调节系数将图像获取组件的感光度调节至第二数值；The second sensitivity adjustment method is that the central control module uses a preset second sensitivity adjustment coefficient to adjust the sensitivity of the image acquisition component to a second value under a preset second area ratio difference condition;
其中，所述预设第一面积占比差值条件为，发票图像的噪点面积占比与预设第一面积占比的差值小于等于预设面积占比差值；所述预设第二面积占比差值条件为，发票图像的噪点面积占比与预设第一面积占比的差值大于预设面积占比差值，所述预设第一感光度调节系数小于所述预设第二感光度调节系数。Among them, the preset first area ratio difference condition is that the difference between the noise area ratio of the invoice image and the preset first area ratio is less than or equal to the preset area ratio difference; the preset second area ratio difference condition is that the difference between the noise area ratio of the invoice image and the preset first area ratio is greater than the preset area ratio difference, and the preset first sensitivity adjustment coefficient is less than the preset second sensitivity adjustment coefficient.
进一步地，所述中控模块在预设第三面积条件下根据发票图像边缘缺失面积确定发票信息的完整性是否在允许范围内的两种二次判定方法，其中，Furthermore, the central control module uses two secondary determination methods to determine whether the integrity of the invoice information is within an allowable range according to the missing area of the invoice image edge under a preset third area condition, wherein:
第一种完整性二次判定方法为，所述中控模块在预设第一面积条件下判定发票信息的完整性在允许范围内；The first secondary integrity determination method is that the central control module determines that the integrity of the invoice information is within an allowable range under a preset first area condition;
第二种完整性二次判定方法为，所述中控模块在预设第二面积条件下判定发票信息的完整性低于允许范围，通过计算发票图像边缘缺失面积与预设面积的差值将数据训练系统的训练频率调节至对应频率；The second secondary integrity determination method is that the central control module determines that the integrity of the invoice information is lower than the allowable range under the preset second area condition, and adjusts the training frequency of the data training system to the corresponding frequency by calculating the difference between the missing area of the invoice image edge and the preset area;
其中，所述预设第一面积条件为，发票图像边缘缺失面积小于等于预设面积；所述预设第二面积条件为，发票图像边缘缺失面积大于预设面积。The preset first area condition is that the missing area of the edge of the invoice image is less than or equal to the preset area; the preset second area condition is that the missing area of the edge of the invoice image is greater than the preset area.
进一步地，所述中控模块在预设第二面积条件下根据发票图像边缘缺失面积与预设面积的差值确定针对数据训练系统的训练频率的两种调节方法，其中，Furthermore, the central control module determines two adjustment methods for the training frequency of the data training system according to the difference between the edge missing area of the invoice image and the preset area under the preset second area condition, wherein:
第一种频率调节方法为，所述中控模块在预设第一面积差值条件下使用预设第一频率调节系数将训练频率调节至第一频率；The first frequency adjustment method is that the central control module adjusts the training frequency to the first frequency using a preset first frequency adjustment coefficient under a preset first area difference condition;
第二种频率调节方法为，所述中控模块在预设第二面积差值条件下使用预设第二频率调节系数将训练频率调节至第二频率；The second frequency adjustment method is that the central control module adjusts the training frequency to the second frequency using a preset second frequency adjustment coefficient under a preset second area difference condition;
其中，所述预设第一面积差值条件为，发票图像边缘缺失面积与预设面积的差值小于等于预设面积差值；所述预设第二面积差值条件为，发票图像边缘缺失面积与预设面积的差值大于预设面积差值，所述预设第一频率调节系数小于所述预设第二频率调节系数。Among them, the preset first area difference condition is that the difference between the missing area of the edge of the invoice image and the preset area is less than or equal to the preset area difference; the preset second area difference condition is that the difference between the missing area of the edge of the invoice image and the preset area is greater than the preset area difference, and the preset first frequency adjustment coefficient is less than the preset second frequency adjustment coefficient.
进一步地，所述中控模块根据发票图像信息的提取时长确定图像分割有效性是否在允许范围内的两种判定方法，其中，Furthermore, the central control module determines whether the image segmentation validity is within the allowable range according to the extraction time of the invoice image information in two determination methods, wherein:
第一种有效性判定方法为，所述中控模块在预设第一时长条件下判定图像分割有效性在允许范围内；The first validity determination method is that the central control module determines that the validity of the image segmentation is within an allowable range under a preset first time condition;
第二种有效性判定方法为，所述中控模块在预设第二时长条件下判定图像分割有效性低于允许范围，通过计算发票图像信息的提取时长与预设时长的差值将发票图像的单块分割面积调节至对应面积；The second validity determination method is that the central control module determines that the image segmentation validity is lower than the allowable range under the preset second time condition, and adjusts the single block segmentation area of the invoice image to the corresponding area by calculating the difference between the extraction time of the invoice image information and the preset time;
其中，所述预设第一时长条件为，发票图像信息的提取时长小于等于预设时长；所述预设第二时长条件为，发票图像信息的提取时长大于预设时长。The first preset time condition is that the time for extracting the invoice image information is less than or equal to the preset time; the second preset time condition is that the time for extracting the invoice image information is greater than the preset time.
进一步地，所述中控模块在预设第二时长条件下根据发票图像信息的提取时长与预设时长的差值确定针对发票图像的单块分割面积的两种调节方式，其中，Furthermore, the central control module determines two adjustment methods for the single block segmentation area of the invoice image according to the difference between the extraction time of the invoice image information and the preset time under the preset second time condition, wherein:
第一种分割面积调节方式为，所述中控模块在预设第一时长差值条件下使用预设第二面积调节系数将发票图像的单块分割面积调节至第一面积；The first segmentation area adjustment method is that the central control module uses a preset second area adjustment coefficient to adjust the single segmentation area of the invoice image to the first area under a preset first time difference condition;
第二种分割面积调节方式为，所述中控模块在预设第二时长差值条件下使用预设第一面积调节系数将发票图像的单块分割面积调节至第二面积；The second segmentation area adjustment method is that the central control module uses a preset first area adjustment coefficient to adjust the single segmentation area of the invoice image to a second area under a preset second time difference condition;
其中，所述预设第一时长差值条件为，发票图像信息的提取时长与预设时长的差值小于等于预设时长差值；所述预设第二时长差值条件为，发票图像信息的提取时长与预设时长的差值大于预设时长差值，所述预设第一面积调节系数小于所述预设第二面积调节系数。Among them, the preset first time difference condition is that the difference between the extraction time of the invoice image information and the preset time is less than or equal to the preset time difference; the preset second time difference condition is that the difference between the extraction time of the invoice image information and the preset time is greater than the preset time difference, and the preset first area adjustment coefficient is less than the preset second area adjustment coefficient.
本发明还提供一种基于图像分割的发票识别方法的发票识别系统，包括：The present invention also provides an invoice recognition system based on the invoice recognition method of image segmentation, comprising:
信息获取模块，用于获取一级发票特征数据和发票信息，所述发票信息包括所述图像获取组件获取的发票图像；所述发票一级特征数据包括所述灰度扫描组件获取的发票图像灰度值、发票图像的噪点面积、发票图像的整体面积以及发票图像边缘缺失面积；An information acquisition module, used to acquire primary invoice feature data and invoice information, wherein the invoice information includes the invoice image acquired by the image acquisition component; the primary invoice feature data includes the grayscale value of the invoice image acquired by the grayscale scanning component, the noise area of the invoice image, the overall area of the invoice image, and the edge missing area of the invoice image;
数据处理模块，其与所述数据获取模块相连，用于对所述一级发票特征数据进行计算以输出二级发票特征参数，所述二级发票特征参数包括发票图像与标准图像的灰度值差异量、发票图像的噪点面积占比以及发票图像信息的提取时长；A data processing module connected to the data acquisition module, used to calculate the primary invoice feature data to output secondary invoice feature parameters, wherein the secondary invoice feature parameters include the gray value difference between the invoice image and the standard image, the noise area ratio of the invoice image, and the extraction time of the invoice image information;
中控模块，其分别与所述数据获取模块和所述数据处理模块相连，用于在根据发票图像与标准图像的灰度值差异量判定图像获取的有效性低于允许范围时将图像获取组件的倾斜角度调节至对应角度，或，根据发票图像的噪点面积占比将图像获取组件的感光度调节至对应值，The central control module is connected to the data acquisition module and the data processing module respectively, and is used to adjust the inclination angle of the image acquisition component to a corresponding angle when the validity of the image acquisition is determined to be lower than the allowable range according to the difference in grayscale values between the invoice image and the standard image, or to adjust the sensitivity of the image acquisition component to a corresponding value according to the proportion of the noise area of the invoice image.
以及，根据发票图像边缘缺失面积将数据训练系统的训练频率调节至对应频率；and, adjusting the training frequency of the data training system to a corresponding frequency according to the missing area of the edge of the invoice image;
以及，根据发票图像信息的提取时长与预设时长的差值将发票图像的单块分割面积调节至对应面积。And, the single-block segmentation area of the invoice image is adjusted to a corresponding area according to the difference between the extraction time of the invoice image information and the preset time.
与现有技术相比，本发明的有益效果在于，本发明所述方法通过设置步骤S1-S5，中控模块获取发票图像并对发票图像进行图像分割和识别，以达到对发票的有效识别，所述中控模块在获取到发票图像灰度值与标准图像的差异量后，对图像获取的有效性进行判定，通过对图像获取组件的倾斜角度进行调节，减小由于光照角度问题对图像获取有效性的影响，调节图像获取组件的倾斜角度有助于减小发票图像灰度值，在获取发票图像的噪点面积占比后对发票图像清晰度进行二次判定，并根据发票图像的噪点面积占比对图像获取组件的感光度进行调节，通过增大识别系统的图像获取组件的感光度进而提高画面的清晰程度，或，根据发票图像边缘缺失面积对获取的图像发票信息的完整性进行判定并对训练频率进行调节，通过增大训练频率进而减小发票图像边缘缺失面积和提高了信息的完整程度，实现了发票的识别效率和识别的有效性的提高。Compared with the prior art, the beneficial effect of the present invention lies in that, by setting steps S1-S5, the central control module acquires the invoice image and performs image segmentation and recognition on the invoice image to achieve effective recognition of the invoice. After acquiring the difference between the grayscale value of the invoice image and the standard image, the central control module determines the validity of image acquisition, and reduces the influence of the illumination angle problem on the validity of image acquisition by adjusting the inclination angle of the image acquisition component. Adjusting the inclination angle of the image acquisition component helps to reduce the grayscale value of the invoice image. After acquiring the noise area ratio of the invoice image, the clarity of the invoice image is secondary determined, and the sensitivity of the image acquisition component is adjusted according to the noise area ratio of the invoice image. The clarity of the picture is improved by increasing the sensitivity of the image acquisition component of the recognition system, or the integrity of the invoice information of the acquired image is determined according to the missing area of the invoice image edge and the training frequency is adjusted. The missing area of the invoice image edge is reduced and the completeness of the information is improved by increasing the training frequency, thereby improving the recognition efficiency and the effectiveness of the invoice.
进一步地，本发明所述方法通过设置预设第一差异量条件、预设第二差异量条件以及预设第三差异量条件，所述中控模块对图像获取的有效性进行判定，发票图像与标准图像的灰度值差异量体现了光照对发票图像获取的影响，通过设置预设第一差异量差值条件、预设第二差异量差值条件、预设第一角度调节系数以及预设第二角度调节系数，所述中控模块对图像获取组件的倾斜角度进行调节，通过调节倾斜角度，有效规避光照强度对发票图像获取的影响，进一步提高了发票的识别效率和识别的有效性。Furthermore, the method of the present invention sets a preset first difference condition, a preset second difference condition and a preset third difference condition, and the central control module determines the effectiveness of image acquisition. The difference in grayscale value between the invoice image and the standard image reflects the influence of light on the invoice image acquisition. By setting a preset first difference condition, a preset second difference condition, a preset first angle adjustment coefficient and a preset second angle adjustment coefficient, the central control module adjusts the inclination angle of the image acquisition component. By adjusting the inclination angle, the influence of light intensity on the invoice image acquisition is effectively avoided, thereby further improving the recognition efficiency and effectiveness of the invoice.
进一步地，本发明所述方法通过设置预设第一面积条件、预设第二面积条件以及预设第三面积条件，所述中控模块根据发票图像的噪点面积占比对发票图像清晰度进行二次判定，通过设置预设第一面积差值条件、预设第二面积差值条件、预设第一感光度调节系数以及预设第二感光度调节系数，所述中控模块对图像获取组件的感光度进行调节，通过增大图像获取组件的感光度增大画面的流畅度进而提高发票图像清晰度，进一步提高了发票的识别效率和识别的有效性。Furthermore, the method of the present invention sets a preset first area condition, a preset second area condition and a preset third area condition, and the central control module performs a secondary determination on the clarity of the invoice image according to the noise area ratio of the invoice image, and adjusts the sensitivity of the image acquisition component by setting a preset first area difference condition, a preset second area difference condition, a preset first sensitivity adjustment coefficient and a preset second sensitivity adjustment coefficient, so as to increase the smoothness of the picture and thereby improve the clarity of the invoice image by increasing the sensitivity of the image acquisition component, thereby further improving the recognition efficiency and effectiveness of the invoice.
进一步地，本发明所述方法通过设置预设第一面积条件和预设第二面积条件，所述中控模块对发票信息的完整性进行判定，在对图像进行分割后由于图像获取原因导致图像信息缺失发票识别有效性下降，通过设置预设第一面积差值条件、预设第二面积差值条件、预设第一频率调节系数以及预设第二频率调节系数，所述中控模块对数据训练系统的训练频率进行调节，通过增大训练频率进而提高图像的完整性，进一步提高了发票的识别效率和识别的有效性。Furthermore, the method of the present invention sets a preset first area condition and a preset second area condition, and the central control module determines the integrity of the invoice information. After the image is segmented, the image information is missing due to image acquisition reasons, and the effectiveness of invoice recognition is reduced. By setting a preset first area difference condition, a preset second area difference condition, a preset first frequency adjustment coefficient, and a preset second frequency adjustment coefficient, the central control module adjusts the training frequency of the data training system, and increases the training frequency to improve the integrity of the image, thereby further improving the recognition efficiency and effectiveness of the invoice.
进一步地，本发明所述方法通过设置预设第一时长条件和预设第二时长条件对图像分割有效性进行判定，通过设置预设第一时长差值条件、预设第二时长差值条件、预设第一面积调节系数以及预设第二面积调节系数，所述中控模块对发票图像的单块分割面积进行调节，通过减小发票图像的单块分割面积从而提高了图像信息分析的速度，进一步提高了发票的识别效率和识别的有效性。Furthermore, the method of the present invention determines the effectiveness of image segmentation by setting a preset first time condition and a preset second time condition, and by setting a preset first time difference condition, a preset second time difference condition, a preset first area adjustment coefficient, and a preset second area adjustment coefficient, the central control module adjusts the single-block segmentation area of the invoice image, thereby increasing the speed of image information analysis by reducing the single-block segmentation area of the invoice image, and further improving the recognition efficiency and effectiveness of the invoice.
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例基于图像分割的发票识别方法的整体流程图；FIG1 is an overall flow chart of an invoice recognition method based on image segmentation according to an embodiment of the present invention;
图2为本发明实施例基于图像分割的发票识别系统的整体结构框图；FIG2 is a block diagram of the overall structure of an invoice recognition system based on image segmentation according to an embodiment of the present invention;
图3为本发明实施例基于图像分割的发票识别系统的数据获取模块的具体结构框图；FIG3 is a specific structural block diagram of a data acquisition module of an invoice recognition system based on image segmentation according to an embodiment of the present invention;
图4为本发明实施例基于图像分割的发票识别系统的数据获取模块与中控模块相连接的连接结构框图。FIG. 4 is a block diagram of the connection structure between the data acquisition module and the central control module of the invoice recognition system based on image segmentation according to an embodiment of the present invention.
具体实施方式DETAILED DESCRIPTION
为了使本发明的目的和优点更加清楚明白，下面结合实施例对本发明作进一步描述；应当理解，此处所描述的具体实施例仅仅用于解释本发明，并不用于限定本发明。In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.
下面参照附图来描述本发明的优选实施方式。本领域技术人员应当理解的是，这些实施方式仅仅用于解释本发明的技术原理，并非在限制本发明的保护范围。The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.
请参阅图1、图2、图3以及图4所示，其分别为本发明实施例基于图像分割的发票识别方法的整体流程图、基于图像分割的发票识别系统的整体结构框图、数据获取模块的具体结构框图以及数据获取模块与中控模块相连接的连接结构框图；本发明一种基于图像分割的发票识别方法，包括：Please refer to FIG. 1, FIG. 2, FIG. 3 and FIG. 4, which are respectively an overall flow chart of an invoice recognition method based on image segmentation according to an embodiment of the present invention, an overall structural block diagram of an invoice recognition system based on image segmentation, a specific structural block diagram of a data acquisition module, and a connection structural block diagram of a data acquisition module connected to a central control module; an invoice recognition method based on image segmentation according to the present invention comprises:
步骤S1，使用图像获取组件对发票图像进行获取，中控模块将所述发票图像转换成黑白发票图像；Step S1, using an image acquisition component to acquire an invoice image, and the central control module converts the invoice image into a black and white invoice image;
步骤S2，所述中控模块控制与所述图像获取组件相连的灰度扫描组件对发票图像灰度值进行检测并计算发票图像与标准图像的灰度值差异量以对获取的发票图像的有效性进行判定；Step S2, the central control module controls the grayscale scanning component connected to the image acquisition component to detect the grayscale value of the invoice image and calculate the grayscale value difference between the invoice image and the standard image to determine the validity of the acquired invoice image;
步骤S3，在判定图像获取的有效性低于允许范围时，所述中控模块将图像获取组件的倾斜角度调节至对应角度，或，根据发票图像的噪点面积占比对发票图像清晰度进行二次判定；Step S3, when it is determined that the validity of the image acquisition is lower than the allowable range, the central control module adjusts the tilt angle of the image acquisition component to a corresponding angle, or performs a secondary determination on the clarity of the invoice image according to the noise area ratio of the invoice image;
步骤S4，在二次判定发票图像清晰度低于允许范围后，所述中控模块将图像获取组件的感光度调节至对应值，或，根据发票图像边缘缺失面积将数据训练系统的训练频率调节至对应频率；Step S4, after secondarily determining that the clarity of the invoice image is lower than the allowable range, the central control module adjusts the sensitivity of the image acquisition component to a corresponding value, or adjusts the training frequency of the data training system to a corresponding frequency according to the missing area of the invoice image edge;
步骤S5，在完成对数据训练系统的训练频率的调节时，所述中控模块根据发票图像信息的提取时长将发票图像的单块分割面积调节至对应面积。Step S5, when the training frequency of the data training system is adjusted, the central control module adjusts the single block segmentation area of the invoice image to a corresponding area according to the extraction time of the invoice image information.
具体而言，所述发票图像与标准图像的灰度值差异量为发票图像灰度值减去标准发票图像灰度值的差值。Specifically, the grayscale value difference between the invoice image and the standard image is the difference between the grayscale value of the invoice image and the grayscale value of the standard invoice image.
具体而言，所述图像获取组件包括底座、与所述底座相连的用以支撑所述图像获取组件的支撑杆、设置在所述支撑杆上用以对图像获取组件的倾斜角度进行调节的转动轴以及与所述转动轴相连的用以获取发票图像的摄像机。Specifically, the image acquisition component includes a base, a support rod connected to the base for supporting the image acquisition component, a rotating shaft arranged on the support rod for adjusting the inclination angle of the image acquisition component, and a camera connected to the rotating shaft for acquiring the invoice image.
具体而言，所述发票图像信息包括企业名称、纳税识别号以及企业地址。Specifically, the invoice image information includes the company name, tax identification number and company address.
本发明所述方法通过设置步骤S1-S5，中控模块获取发票图像并对发票图像进行图像分割和识别，以达到对发票的有效识别，所述中控模块在获取到发票图像灰度值与标准图像的差异量后，对图像获取的有效性进行判定，通过对图像获取组件的倾斜角度进行调节，减小由于光照角度问题对图像获取有效性的影响，调节图像获取组件的倾斜角度有助于减小发票图像灰度值，在获取发票图像的噪点面积占比后对发票图像清晰度进行二次判定，并根据发票图像的噪点面积占比对图像获取组件的感光度进行调节，通过增大识别系统的图像获取组件的感光度进而提高画面的清晰程度，或，根据发票图像边缘缺失面积对获取的图像发票信息的完整性进行判定并对训练频率进行调节，通过增大训练频率进而减小发票图像边缘缺失面积和提高了信息的完整程度，实现了发票的识别效率和识别的有效性的提高。The method of the present invention sets steps S1-S5, wherein the central control module acquires the invoice image and performs image segmentation and recognition on the invoice image to achieve effective recognition of the invoice. After acquiring the difference between the grayscale value of the invoice image and the standard image, the central control module determines the validity of the image acquisition, and reduces the influence of the illumination angle problem on the validity of the image acquisition by adjusting the inclination angle of the image acquisition component. Adjusting the inclination angle of the image acquisition component helps to reduce the grayscale value of the invoice image. After acquiring the noise area ratio of the invoice image, the clarity of the invoice image is secondarily determined, and the sensitivity of the image acquisition component is adjusted according to the noise area ratio of the invoice image. The clarity of the picture is improved by increasing the sensitivity of the image acquisition component of the recognition system, or the integrity of the invoice information of the acquired image is determined according to the missing area of the invoice image edge and the training frequency is adjusted. The missing area of the invoice image edge is reduced and the completeness of the information is improved by increasing the training frequency, thereby improving the recognition efficiency and the effectiveness of the invoice.
请继续参阅图1所示，所述中控模块根据发票图像与标准图像的灰度值差异量确定图像获取的有效性是否在允许范围内的三种判定方法，其中，Please continue to refer to FIG. 1 , the central control module determines whether the validity of image acquisition is within the allowable range according to the difference in grayscale values between the invoice image and the standard image in three determination methods, wherein:
第一种判定方法为，所述中控模块在预设第一差异量条件下判定图像获取的有效性在允许范围内；The first determination method is that the central control module determines that the validity of image acquisition is within an allowable range under a preset first difference amount condition;
第二种判定方法为，所述中控模块在预设第二差异量条件下判定图像获取的有效性低于允许范围，通过计算发票图像与标准图像的灰度值差异量与预设第一差异量的差值将图像获取组件的倾斜角度调节至对应角度；The second determination method is that the central control module determines that the validity of image acquisition is lower than the allowable range under the preset second difference amount condition, and adjusts the tilt angle of the image acquisition component to the corresponding angle by calculating the difference between the gray value difference amount between the invoice image and the standard image and the preset first difference amount;
第三种判定方法为，所述中控模块在预设第三差异量条件下判定图像获取的有效性低于允许范围，初步判定发票图像清晰度低于允许范围，并根据发票图像的噪点面积占比对发票图像清晰度是否低于允许范围进行二次判定；The third determination method is that the central control module determines that the validity of image acquisition is lower than the allowable range under the preset third difference amount condition, preliminarily determines that the clarity of the invoice image is lower than the allowable range, and performs a secondary determination on whether the clarity of the invoice image is lower than the allowable range based on the noise area ratio of the invoice image;
其中，所述预设第一差异量条件为，发票图像与标准图像的灰度值差异量小于等于预设第一差异量；所述预设第二差异量条件为，发票图像与标准图像的灰度值差异量大于预设第一差异量且小于等于预设第二差异量；所述预设第三差异量条件为，发票图像与标准图像的灰度值差异量大于预设第二差异量，所述预设第一差异量小于所述预设第二差异量。Among them, the preset first difference amount condition is that the grayscale value difference between the invoice image and the standard image is less than or equal to the preset first difference amount; the preset second difference amount condition is that the grayscale value difference between the invoice image and the standard image is greater than the preset first difference amount and less than or equal to the preset second difference amount; the preset third difference amount condition is that the grayscale value difference between the invoice image and the standard image is greater than the preset second difference amount, and the preset first difference amount is less than the preset second difference amount.
具体而言，发票图像与标准图像的灰度值差异量记为P，预设第一差异量记为P1，预设第二差异量记为P2，发票图像与标准图像的灰度值差异量与预设第一差异量的差值记为△P，设定△P＝P-P1。Specifically, the grayscale value difference between the invoice image and the standard image is recorded as P, the preset first difference is recorded as P1, the preset second difference is recorded as P2, and the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference is recorded as △P, and △P=P-P1 is set.
请继续参阅图1所示，所述中控模块在预设第二差异量条件下根据发票图像与标准图像的灰度值差异量与预设第一差异量的差值确定针对图像获取组件的倾斜角度的两种调节方法，其中，Please continue to refer to FIG. 1 , the central control module determines two adjustment methods for the tilt angle of the image acquisition component according to the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference under the preset second difference condition, wherein:
第一种角度调节方法为，所述中控模块在预设第一差异量差值条件下使用预设第一角度调节系数将图像获取组件的倾斜角度调节至第一角度；The first angle adjustment method is that the central control module uses a preset first angle adjustment coefficient to adjust the tilt angle of the image acquisition component to a first angle under a preset first difference value condition;
第二种角度调节方法为，所述中控模块在预设第二差异量差值条件下使用预设第二角度调节系数将图像获取组件的倾斜角度调节至第二角度；The second angle adjustment method is that the central control module uses a preset second angle adjustment coefficient to adjust the tilt angle of the image acquisition component to a second angle under a preset second difference value condition;
其中，所述预设第一差异量差值条件为，发票图像与标准图像的灰度值差异量与预设第一差异量的差值小于等于预设差异量差值；所述预设第二差异量差值条件为，发票图像与标准图像的灰度值差异量与预设第一差异量的差值大于预设差异量差值；所述预设第一角度调节系数小于所述预设第二角度调节系数。Among them, the preset first difference difference condition is that the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference is less than or equal to the preset difference difference; the preset second difference difference condition is that the difference between the grayscale value difference between the invoice image and the standard image and the preset first difference is greater than the preset difference difference; the preset first angle adjustment coefficient is less than the preset second angle adjustment coefficient.
具体而言，预设差异量差值记为△P0，预设第一角度调节系数记为α1，预设第二角度调节系数记为α2，其中，1＜α1＜α2，图像获取组件的倾斜角度记为A，调节后的图像获取组件的倾斜角度记为A’，设定A’＝A×αi，其中，αi为预设第i角度调节系数，i＝1，2。Specifically, the preset difference value is recorded as △P0, the preset first angle adjustment coefficient is recorded as α1, and the preset second angle adjustment coefficient is recorded as α2, wherein 1＜α1＜α2, the inclination angle of the image acquisition component is recorded as A, and the inclination angle of the image acquisition component after adjustment is recorded as A’, and A’＝A×αi is set, wherein αi is the preset i-th angle adjustment coefficient, i＝1, 2.
本发明所述方法通过设置预设第一差异量条件、预设第二差异量条件以及预设第三差异量条件，所述中控模块对图像获取的有效性进行判定，发票图像与标准图像的灰度值差异量体现了光照对发票图像获取的影响，通过设置预设第一差异量差值条件、预设第二差异量差值条件、预设第一角度调节系数以及预设第二角度调节系数，所述中控模块对图像获取组件的倾斜角度进行调节，通过调节倾斜角度，有效规避光照强度对发票图像获取的影响，进一步提高了发票的识别效率和识别的有效性。The method of the present invention sets a preset first difference condition, a preset second difference condition and a preset third difference condition, and the central control module determines the effectiveness of image acquisition. The gray value difference between the invoice image and the standard image reflects the influence of light on the invoice image acquisition. By setting a preset first difference condition, a preset second difference condition, a preset first angle adjustment coefficient and a preset second angle adjustment coefficient, the central control module adjusts the inclination angle of the image acquisition component. By adjusting the inclination angle, the influence of light intensity on the invoice image acquisition is effectively avoided, thereby further improving the recognition efficiency and effectiveness of the invoice.
请继续参阅图1所示，所述中控模块在预设第三差异量条件下根据发票图像的噪点面积占比确定发票图像清晰度是否在允许范围内的三种二次判定方法，其中，Please continue to refer to FIG. 1 , which shows three secondary determination methods for the central control module to determine whether the clarity of the invoice image is within the allowable range according to the noise area ratio of the invoice image under the preset third difference amount condition, wherein:
第一种二次判定方法为，所述中控模块在预设第一面积占比条件下判定发票图像清晰度在允许范围内；The first secondary determination method is that the central control module determines that the clarity of the invoice image is within an allowable range under a preset first area ratio condition;
第二种二次判定方法为，所述中控模块在预设第二面积占比条件下判定发票图像清晰度低于允许范围，通过计算发票图像的噪点面积占比与预设第一面积占比的差值将图像获取组件的感光度调节至对应值；The second secondary determination method is that the central control module determines that the clarity of the invoice image is lower than the allowable range under the preset second area ratio condition, and adjusts the sensitivity of the image acquisition component to the corresponding value by calculating the difference between the noise area ratio of the invoice image and the preset first area ratio;
第三种二次判定方法为，所述中控模块在预设第三面积条件下判定发票图像清晰度低于允许范围，初步判定发票信息的完整性低于允许范围，并根据发票图像边缘缺失面积对发票信息的完整性进行二次判定；The third secondary determination method is that the central control module determines that the clarity of the invoice image is lower than the allowable range under the preset third area condition, preliminarily determines that the integrity of the invoice information is lower than the allowable range, and performs a secondary determination on the integrity of the invoice information based on the missing area of the edge of the invoice image;
其中，所述预设第一面积占比条件为，发票图像的噪点面积占比小于等于预设第一面积占比；所述预设第二面积占比条件为，发票图像的噪点面积占比大于预设第一面积占比且小于等于预设第二面积占比；所述预设第三面积占比条件为，发票图像的噪点面积占比大于预设第二面积占比，所述预设第一面积占比小于所述预设第二面积占比。Among them, the preset first area ratio condition is that the noise area ratio of the invoice image is less than or equal to the preset first area ratio; the preset second area ratio condition is that the noise area ratio of the invoice image is greater than the preset first area ratio and less than or equal to the preset second area ratio; the preset third area ratio condition is that the noise area ratio of the invoice image is greater than the preset second area ratio, and the preset first area ratio is less than the preset second area ratio.
具体而言，发票图像的噪点面积占比记为C，预设第一面积记为C1，预设第二面积记为C2，发票图像的噪点面积占比与预设第一面积的差值记为△C，设定△C＝C-C1。Specifically, the noise area ratio of the invoice image is recorded as C, the preset first area is recorded as C1, the preset second area is recorded as C2, the difference between the noise area ratio of the invoice image and the preset first area is recorded as △C, and △C is set to be C-C1.
请继续参阅图1所示，所述中控模块在预设第二面积占比条件下根据发票图像的噪点面积占比与预设第一面积占比的差值确定针对图像获取组件的感光度的两种调节方法，其中，Please continue to refer to FIG. 1 , the central control module determines two adjustment methods for the sensitivity of the image acquisition component according to the difference between the noise area ratio of the invoice image and the preset first area ratio under the preset second area ratio condition, wherein:
第一种感光度调节方法为，所述中控模块在预设第一面积占比差值条件下使用预设第一感光度调节系数将图像获取组件的感光度调节至第一数值；The first sensitivity adjustment method is that the central control module uses a preset first sensitivity adjustment coefficient to adjust the sensitivity of the image acquisition component to a first value under a preset first area ratio difference condition;
第二种感光度调节方法为，所述中控模块在预设第二面积占比差值条件下使用预设第二感光度调节系数将图像获取组件的感光度调节至第二数值；The second sensitivity adjustment method is that the central control module uses a preset second sensitivity adjustment coefficient to adjust the sensitivity of the image acquisition component to a second value under a preset second area ratio difference condition;
其中，所述预设第一面积占比差值条件为，发票图像的噪点面积占比与预设第一面积占比的差值小于等于预设面积占比差值；所述预设第二面积占比差值条件为，发票图像的噪点面积占比与预设第一面积占比的差值大于预设面积占比差值，所述预设第一感光度调节系数小于所述预设第二感光度调节系数。Among them, the preset first area ratio difference condition is that the difference between the noise area ratio of the invoice image and the preset first area ratio is less than or equal to the preset area ratio difference; the preset second area ratio difference condition is that the difference between the noise area ratio of the invoice image and the preset first area ratio is greater than the preset area ratio difference, and the preset first sensitivity adjustment coefficient is less than the preset second sensitivity adjustment coefficient.
具体而言，预设面积差值记为△C0，预设第一感光度调节系数记为β1，预设第二感光度调节系数记为β2，其中，0＜β1＜β2＜1，图像获取组件的感光度记为R，调节后的图像获取组件的感光度记为R’，设定R’＝R×(1-βj)，其中，βj为预设第j感光度调节系数，j＝1，2。Specifically, the preset area difference is recorded as △C0, the preset first sensitivity adjustment coefficient is recorded as β1, and the preset second sensitivity adjustment coefficient is recorded as β2, wherein 0＜β1＜β2＜1, the sensitivity of the image acquisition component is recorded as R, and the sensitivity of the adjusted image acquisition component is recorded as R’, and R’＝R×(1-βj), wherein βj is the preset j-th sensitivity adjustment coefficient, j＝1,2.
本发明所述方法通过设置预设第一面积条件、预设第二面积条件以及预设第三面积条件，所述中控模块根据发票图像的噪点面积占比对发票图像清晰度进行二次判定，通过设置预设第一面积差值条件、预设第二面积差值条件、预设第一感光度调节系数以及预设第二感光度调节系数，所述中控模块对图像获取组件的感光度进行调节，通过增大图像获取组件的感光度增大画面的流畅度进而提高发票图像清晰度，进一步提高了发票的识别效率和识别的有效性。The method of the present invention sets a preset first area condition, a preset second area condition and a preset third area condition. The central control module performs a secondary determination on the clarity of the invoice image according to the noise area ratio of the invoice image. The central control module adjusts the sensitivity of the image acquisition component by setting a preset first area difference condition, a preset second area difference condition, a preset first sensitivity adjustment coefficient and a preset second sensitivity adjustment coefficient. By increasing the sensitivity of the image acquisition component, the smoothness of the picture is increased, thereby improving the clarity of the invoice image, and further improving the recognition efficiency and effectiveness of the invoice.
请继续参阅图1所示，所述中控模块在预设第三面积条件下根据发票图像边缘缺失面积确定发票信息的完整性是否在允许范围内的两种二次判定方法，其中，Please continue to refer to FIG. 1 , where the central control module determines whether the integrity of the invoice information is within the allowable range according to the missing area of the edge of the invoice image under the preset third area condition.
第一种完整性二次判定方法为，所述中控模块在预设第一面积条件下判定发票信息的完整性在允许范围内；The first secondary integrity determination method is that the central control module determines that the integrity of the invoice information is within an allowable range under a preset first area condition;
第二种完整性二次判定方法为，所述中控模块在预设第二面积条件下判定发票信息的完整性低于允许范围，通过计算发票图像边缘缺失面积与预设面积的差值将数据训练系统的训练频率调节至对应频率；The second secondary integrity determination method is that the central control module determines that the integrity of the invoice information is lower than the allowable range under the preset second area condition, and adjusts the training frequency of the data training system to the corresponding frequency by calculating the difference between the missing area of the invoice image edge and the preset area;
其中，所述预设第一面积条件为，发票图像边缘缺失面积小于等于预设面积；所述预设第二面积条件为，发票图像边缘缺失面积大于预设面积。The preset first area condition is that the missing area of the edge of the invoice image is less than or equal to the preset area; the preset second area condition is that the missing area of the edge of the invoice image is greater than the preset area.
具体而言，发票图像边缘缺失面积记为M，预设面积记为M0，发票图像边缘缺失面积与预设面积的差值记为△M，设定△M＝M-M0。Specifically, the missing area of the invoice image edge is recorded as M, the preset area is recorded as M0, the difference between the missing area of the invoice image edge and the preset area is recorded as △M, and △M=M-M0 is set.
请继续参阅图1所示，所述中控模块在预设第二面积条件下根据发票图像边缘缺失面积与预设面积的差值确定针对数据训练系统的训练频率的两种调节方法，其中，Please continue to refer to FIG. 1 , the central control module determines two adjustment methods for the training frequency of the data training system according to the difference between the edge missing area of the invoice image and the preset area under the preset second area condition, wherein:
第一种频率调节方法为，所述中控模块在预设第一面积差值条件下使用预设第一频率调节系数将训练频率调节至第一频率；The first frequency adjustment method is that the central control module adjusts the training frequency to the first frequency using a preset first frequency adjustment coefficient under a preset first area difference condition;
第二种频率调节方法为，所述中控模块在预设第二面积差值条件下使用预设第二频率调节系数将训练频率调节至第二频率；The second frequency adjustment method is that the central control module adjusts the training frequency to the second frequency using a preset second frequency adjustment coefficient under a preset second area difference condition;
其中，所述预设第一面积差值条件为，发票图像边缘缺失面积与预设面积的差值小于等于预设面积差值；所述预设第二面积差值条件为，发票图像边缘缺失面积与预设面积的差值大于预设面积差值，所述预设第一频率调节系数小于所述预设第二频率调节系数。Among them, the preset first area difference condition is that the difference between the missing area of the edge of the invoice image and the preset area is less than or equal to the preset area difference; the preset second area difference condition is that the difference between the missing area of the edge of the invoice image and the preset area is greater than the preset area difference, and the preset first frequency adjustment coefficient is less than the preset second frequency adjustment coefficient.
具体而言，预设面积差值记为△M0，预设第一频率调节系数记为δ1，预设第二频率调节系数δ2，其中，0＜δ1＜δ2＜1，训练频率记为H，调节后的训练频率记为H’，设定H’＝H×(1+δg)，δg为预设第g频率调节系数，g＝1，2。Specifically, the preset area difference is denoted as △M0, the preset first frequency adjustment coefficient is denoted as δ1, and the preset second frequency adjustment coefficient is δ2, wherein 0＜δ1＜δ2＜1, the training frequency is denoted as H, and the adjusted training frequency is denoted as H’, and H’＝H×(1+δg), δg is the preset gth frequency adjustment coefficient, g＝1,2.
本发明所述方法通过设置预设第一面积条件和预设第二面积条件，所述中控模块对发票信息的完整性进行判定，在对图像进行分割后由于图像获取原因导致图像信息缺失发票识别有效性下降，通过设置预设第一面积差值条件、预设第二面积差值条件、预设第一频率调节系数以及预设第二频率调节系数，所述中控模块对数据训练系统的训练频率进行调节，通过增大训练频率进而提高图像的完整性，进一步提高了发票的识别效率和识别的有效性。The method described in the present invention sets a preset first area condition and a preset second area condition, and the central control module determines the integrity of the invoice information. After the image is segmented, the image information is missing due to image acquisition reasons, and the effectiveness of invoice recognition is reduced. By setting a preset first area difference condition, a preset second area difference condition, a preset first frequency adjustment coefficient, and a preset second frequency adjustment coefficient, the central control module adjusts the training frequency of the data training system, and increases the training frequency to improve the integrity of the image, thereby further improving the recognition efficiency and effectiveness of the invoice.
请继续参阅图1所示，所述中控模块根据发票有效信息的发票图像信息的提取时长确定图像分割有效性是否在允许范围内的两种判定方法，其中，Please continue to refer to FIG. 1 , the central control module determines two determination methods of whether the image segmentation validity is within the allowable range according to the extraction time of the invoice image information of the invoice valid information, wherein:
第一种有效性判定方法为，所述中控模块在预设第一时长条件下判定图像分割有效性在允许范围内；The first validity determination method is that the central control module determines that the validity of the image segmentation is within an allowable range under a preset first time condition;
第二种有效性判定方法为，所述中控模块在预设第二时长条件下判定图像分割有效性低于允许范围，通过计算发票图像信息的提取时长与预设时长的差值将发票图像的单块分割面积调节至对应面积；The second validity determination method is that the central control module determines that the image segmentation validity is lower than the allowable range under the preset second time condition, and adjusts the single block segmentation area of the invoice image to the corresponding area by calculating the difference between the extraction time of the invoice image information and the preset time;
其中，所述预设第一时长条件为，发票图像信息的提取时长小于等于预设时长；所述预设第二时长条件为，发票图像信息的提取时长大于预设时长。The preset first time condition is that the time for extracting the invoice image information is less than or equal to the preset time; the preset second time condition is that the time for extracting the invoice image information is greater than the preset time.
具体而言，有效信息的发票图像信息的提取时长记为T，预设时长记为T0，发票图像信息的提取时长与预设时长的差值记为△T，设定△T＝T-T0。Specifically, the extraction time of the invoice image information of valid information is recorded as T, the preset time is recorded as T0, the difference between the extraction time of the invoice image information and the preset time is recorded as ΔT, and ΔT=T-T0 is set.
请继续参阅图1所示，所述中控模块在预设第二时长条件下根据发票图像信息的提取时长与预设时长的差值确定针对发票图像的单块分割面积的两种调节方式，其中，Please continue to refer to FIG. 1 , the central control module determines two adjustment methods for the single block segmentation area of the invoice image according to the difference between the extraction time of the invoice image information and the preset time under the preset second time condition, wherein:
第一种分割面积调节方式为，所述中控模块在预设第一时长差值条件下使用预设第二面积调节系数将发票图像的单块分割面积调节至第一面积；The first segmentation area adjustment method is that the central control module uses a preset second area adjustment coefficient to adjust the single segmentation area of the invoice image to the first area under a preset first time difference condition;
第二种分割面积调节方式为，所述中控模块在预设第二时长差值条件下使用预设第一面积调节系数将发票图像的单块分割面积调节至第二面积；The second segmentation area adjustment method is that the central control module uses a preset first area adjustment coefficient to adjust the single segmentation area of the invoice image to a second area under a preset second time difference condition;
其中，所述预设第一时长差值条件为，发票图像信息的提取时长与预设时长的差值小于等于预设时长差值；所述预设第二时长差值条件为，发票图像信息的提取时长与预设时长的差值大于预设时长差值，所述预设第一面积调节系数小于所述预设第二面积调节系数。Among them, the preset first time difference condition is that the difference between the extraction time of the invoice image information and the preset time is less than or equal to the preset time difference; the preset second time difference condition is that the difference between the extraction time of the invoice image information and the preset time is greater than the preset time difference, and the preset first area adjustment coefficient is less than the preset second area adjustment coefficient.
具体而言，预设时长差值记为△T0，预设第一面积调节系数记为ζ1，预设第二面积调节系数记为ζ2，0＜ζ1＜ζ2＜1，发票图像的单块分割面积记为S，调节后的发票图像的单块分割面积记为S’，设定S’＝S×ζk，其中，ζk为预设第k面积调节系数，k＝1，2。Specifically, the preset time difference is recorded as △T0, the preset first area adjustment coefficient is recorded as ζ1, the preset second area adjustment coefficient is recorded as ζ2, 0＜ζ1＜ζ2＜1, the single-block segmentation area of the invoice image is recorded as S, and the single-block segmentation area of the adjusted invoice image is recorded as S', and S'＝S×ζk is set, wherein ζk is the preset kth area adjustment coefficient, k＝1,2.
本发明所述方法通过设置预设第一时长条件和预设第二时长条件对图像分割有效性进行判定，通过设置预设第一时长差值条件、预设第二时长差值条件、预设第一面积调节系数以及预设第二面积调节系数，所述中控模块对发票图像的单块分割面积进行调节，通过减小发票图像的单块分割面积从而提高了图像信息分析的速度，进一步提高了发票的识别效率和识别的有效性。The method of the present invention determines the validity of image segmentation by setting a preset first time condition and a preset second time condition, and by setting a preset first time difference condition, a preset second time difference condition, a preset first area adjustment coefficient, and a preset second area adjustment coefficient. The central control module adjusts the single-block segmentation area of the invoice image, thereby increasing the speed of image information analysis by reducing the single-block segmentation area of the invoice image, and further improving the recognition efficiency and effectiveness of the invoice.
请继续参阅图2所示，一种基于图像分割的发票识别系统，包括：Please continue to refer to FIG. 2, an invoice recognition system based on image segmentation includes:
信息获取模块，用于获取一级发票特征数据和发票信息，所述发票信息包括所述图像获取组件获取的发票图像；所述发票一级特征数据包括所述灰度扫描组件获取的发票图像灰度值、发票图像的噪点面积、发票图像的整体面积以及发票图像边缘缺失面积；An information acquisition module, used to acquire primary invoice feature data and invoice information, wherein the invoice information includes the invoice image acquired by the image acquisition component; the primary invoice feature data includes the grayscale value of the invoice image acquired by the grayscale scanning component, the noise area of the invoice image, the overall area of the invoice image, and the edge missing area of the invoice image;
数据处理模块，其与所述数据获取模块相连，用于对所述一级发票特征数据进行计算以输出二级发票特征参数，所述二级发票特征参数包括发票图像与标准图像的灰度值差异量、发票图像的噪点面积占比以及发票图像信息的提取时长；A data processing module connected to the data acquisition module, used to calculate the primary invoice feature data to output secondary invoice feature parameters, wherein the secondary invoice feature parameters include the gray value difference between the invoice image and the standard image, the noise area ratio of the invoice image, and the extraction time of the invoice image information;
中控模块，其分别与所述数据获取模块和所述数据处理模块相连，用于在根据发票图像与标准图像的灰度值差异量判定图像获取的有效性低于允许范围时将图像获取组件的倾斜角度调节至对应角度，或，根据发票图像的噪点面积占比将图像获取组件的感光度调节至对应值，The central control module is connected to the data acquisition module and the data processing module respectively, and is used to adjust the inclination angle of the image acquisition component to a corresponding angle when the validity of the image acquisition is determined to be lower than the allowable range according to the difference in grayscale values between the invoice image and the standard image, or to adjust the sensitivity of the image acquisition component to a corresponding value according to the proportion of the noise area of the invoice image.
以及，根据发票图像边缘缺失面积将数据训练系统的训练频率调节至对应频率；and, adjusting the training frequency of the data training system to a corresponding frequency according to the missing area of the edge of the invoice image;
以及，根据发票图像信息的提取时长与预设时长的差值将发票图像的单块分割面积调节至对应面积。And, the single-block segmentation area of the invoice image is adjusted to a corresponding area according to the difference between the extraction time of the invoice image information and the preset time.
实施例1Example 1
本实施例1预设面积差值记为△M0，预设第一频率调节系数记为δ1，预设第二频率调节系数δ2，训练频率记为H，其中，△M0＝3cm2，δ1＝0.2，δ2＝0.3，H＝75HZ，In the present embodiment 1, the preset area difference is recorded as △M0, the preset first frequency adjustment coefficient is recorded as δ1, the preset second frequency adjustment coefficient is recorded as δ2, and the training frequency is recorded as H, wherein △M0= 3cm2 , δ1=0.2, δ2=0.3, H=75HZ,
本实施例求得△M＝0.7cm2，所述中控模块判定△M≤△M0并使用δ1对训练频率进行调节，调节后的训练频率记为H’＝75HZ×(1+0.2)＝90HZ。In this embodiment, ΔM=0.7 cm 2 is obtained, the central control module determines ΔM≤ΔM0 and uses δ1 to adjust the training frequency, and the adjusted training frequency is recorded as H'=75 Hz×(1+0.2)=90 Hz.
本实施例1在求得△M后，中控模块判定需使用δ1对训练频率进行调节，通过增大训练频率减小发票图像边缘的缺失程度，实现了发票的识别效率和识别的有效性的提高。In this embodiment 1, after obtaining ΔM, the central control module determines that δ1 needs to be used to adjust the training frequency. By increasing the training frequency, the degree of missing edges of the invoice image is reduced, thereby improving the recognition efficiency and effectiveness of the invoice.
至此，已经结合附图所示的优选实施方式描述了本发明的技术方案，但是，本领域技术人员容易理解的是，本发明的保护范围显然不局限于这些具体实施方式。在不偏离本发明的原理的前提下，本领域技术人员可以对相关技术特征做出等同的更改或替换，这些更改或替换之后的技术方案都将落入本发明的保护范围之内。So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.
以上所述仅为本发明的优选实施例，并不用于限制本发明；对于本领域的技术人员来说，本发明可以有各种更改和变化。凡在本发明的精神和原则之内，所作的任何修改、等同替换、改进等，均应包含在本发明的保护范围之内。The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.
Claims (8)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311171722.9A CN117252886B (en) | 2023-09-11 | 2023-09-11 | Invoice identification method and system based on image segmentation |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202311171722.9A CN117252886B (en) | 2023-09-11 | 2023-09-11 | Invoice identification method and system based on image segmentation |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN117252886A CN117252886A (en) | 2023-12-19 |
| CN117252886B true CN117252886B (en) | 2024-11-05 |
Family
ID=89128685
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202311171722.9A Active CN117252886B (en) | 2023-09-11 | 2023-09-11 | Invoice identification method and system based on image segmentation |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN117252886B (en) |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114694162A (en) * | 2022-05-31 | 2022-07-01 | 深圳航天信息有限公司 | Invoice image recognition method and system based on image processing |
| CN115187452A (en) * | 2022-09-05 | 2022-10-14 | 山东科技职业学院 | Image processing method and device |
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US11915279B2 (en) * | 1997-01-17 | 2024-02-27 | Chayapathy Gangadarappa | Automated invoice management system and platform |
| US7765155B2 (en) * | 2003-03-13 | 2010-07-27 | International Business Machines Corporation | Invoice processing approval and storage system method and apparatus |
| JP5792990B2 (en) * | 2011-04-28 | 2015-10-14 | キヤノン株式会社 | Image processing apparatus and control method thereof |
| CN107292823A (en) * | 2017-08-20 | 2017-10-24 | 平安科技（深圳）有限公司 | Electronic installation, the method for invoice classification and computer-readable recording medium |
| CN108345880B (en) * | 2018-01-26 | 2021-07-27 | 金蝶软件（中国）有限公司 | Invoice identification method and device, computer equipment and storage medium |
| CN108900782B (en) * | 2018-08-22 | 2020-01-24 | Oppo广东移动通信有限公司 | Exposure control method, device, and electronic device |
| CN109005369B (en) * | 2018-10-22 | 2020-07-10 | Oppo广东移动通信有限公司 | Exposure control method, exposure control device, electronic apparatus, and computer-readable storage medium |
| CN109766778A (en) * | 2018-12-19 | 2019-05-17 | 平安科技（深圳）有限公司 | Invoice information input method, device, equipment and storage medium based on OCR technology |
| CN113286142B (en) * | 2021-05-20 | 2023-01-24 | 众芯汉创（北京）科技有限公司 | Artificial intelligence-based image imaging sensitivity prediction method and system |
| CN113869190A (en) * | 2021-09-26 | 2021-12-31 | 深圳市伯阳投资管理有限公司 | Data processing method and system based on image analysis |
| CN116709046B (en) * | 2023-07-03 | 2023-12-15 | 深圳市度申科技有限公司 | Fixed pattern noise calculation and compensation method |
-
2023
- 2023-09-11 CN CN202311171722.9A patent/CN117252886B/en active Active
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN114694162A (en) * | 2022-05-31 | 2022-07-01 | 深圳航天信息有限公司 | Invoice image recognition method and system based on image processing |
| CN115187452A (en) * | 2022-09-05 | 2022-10-14 | 山东科技职业学院 | Image processing method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN117252886A (en) | 2023-12-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8204339B2 (en) | Photographic document imaging system | |
| US9805281B2 (en) | Model-based dewarping method and apparatus | |
| JP5001256B2 (en) | System and method for processing scanned data | |
| KR100792106B1 (en) | Captured Image Projector and Captured Image Correction Method | |
| JP3504054B2 (en) | Document processing apparatus and document processing method | |
| CN111712021A (en) | A kind of art museum lighting intelligent adjustment method, device and system | |
| JPH01253077A (en) | Detection of string | |
| CN117252886B (en) | Invoice identification method and system based on image segmentation | |
| CN115131271A (en) | RAW image processing method, chip and electronic device | |
| KR20220019501A (en) | Method for providing deep learning based paper book digitizing service | |
| CN111274891A (en) | Method and system for extracting pitches and corresponding lyrics for numbered musical notation images | |
| CN1460961A (en) | Recognition Method of Bill Image Layout | |
| AU2020273367A1 (en) | Photographic document imaging system | |
| CN100354876C (en) | Method and equipment for intensifying character line image and storage medium | |
| JPH08145642A (en) | Component recognition method and component recognition device | |
| AU2011253975A1 (en) | Photographic document imaging system | |
| CN120747008A (en) | Printing quality detection method, system, medium and product | |
| CN118262359A (en) | Method for improving OCR recognition speed | |
| CN111815507A (en) | A method and device for constructing a personal library | |
| CN1010513B (en) | pattern recognition system | |
| CN117671699A (en) | Intelligent Chinese ancient book character recognition, editing and teaching system | |
| JPH08202855A (en) | Image input device | |
| JP2000295435A (en) | Image reader, image reading method and storage medium | |
| HK1109670A (en) | Photographic document imaging system | |
| JPS61231682A (en) | Picture binarization processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |