CN118430001A

CN118430001A - Check information processing method and device, electronic equipment and medium

Info

Publication number: CN118430001A
Application number: CN202410758837.6A
Authority: CN
Inventors: 王嘉乐; 赵博
Original assignee: Industrial and Commercial Bank of China Ltd ICBC
Current assignee: Industrial and Commercial Bank of China Ltd ICBC
Priority date: 2024-06-13
Filing date: 2024-06-13
Publication date: 2024-08-02

Abstract

The check information processing method, device, electronic equipment and medium can be applied to the technical field of big data and the technical field of artificial intelligence. The method comprises the following steps: acquiring picture information of a business order-receiving application, wherein the picture information comprises a document property picture and an entity scene picture; for the document property picture: classifying the document property pictures, and sending the classified result to a corresponding recognition interface for recognizing the text information to obtain text application information; for the physical scene picture: the entity scene picture and the preset prompting word are sent to a multi-mode image question-answering interface for image analysis question-answering so as to acquire picture content description of the entity scene picture and an authenticity judgment conclusion of an entity operation place; and analyzing and judging the text application information, the picture content description and the authenticity judgment conclusion to obtain the auditing result of the merchant receipt application.

Description

Check information processing method and device, electronic equipment and medium

Technical Field

The invention relates to the technical field of big data and artificial intelligence, in particular to a check information processing method, a device, electronic equipment and a medium.

Background

In conventional check deposit methods, the user must physically travel to a bank or other financial institution to submit the check for verification and processing. This requirement is particularly inconvenient for overseas users, as they may face difficulties and costs of traveling across the country.

Although the Optical Character Recognition (OCR) technology currently used can automatically read information on checks, thereby simplifying the flow of check deposit to some extent, such technology generally involves only basic text recognition and lacks comprehensive assessment of check authenticity. Relying solely on OCR technology may result in an inability to effectively identify counterfeit or tampered checks, increasing the risk of fraud to banks and users.

In addition, for the check processing method introducing the electronic endorsement, although the electronic endorsement technology provides a way of endorsing without physically exchanging checks, there is still a great improvement in terms of safety and efficiency. Existing electronic endorsement procedures often lack efficient image processing and text recognition techniques, resulting in slow endorsement procedures and the ease of conflict with the original information on the check.

Disclosure of Invention

In view of the above problems, according to a first aspect of the present invention, there is provided a check information processing method applied to a server, the method comprising: in response to a user initiating an instruction for a target transaction service, obtaining a target check image from a client; adjusting the image quality of the target check image based on image enhancement to obtain a check enhanced image; taking the check enhanced image as input, and carrying out image region segmentation on the layout and structure of the check by utilizing an image segmentation model to obtain check segmentation regions, and extracting text data from the check segmentation regions; adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data; taking the check enhanced image processed by the electronic endorsement as input, evaluating the authenticity of the check by using an abnormal characteristic recognition model, and outputting a comprehensive evaluation result, wherein the abnormal characteristic recognition model comprises a plurality of sub-models for anti-counterfeiting characteristic detection, authenticity verification and compliance verification; and sending the check enhanced image processed by the electronic endorsement and the comprehensive evaluation result to the client for service confirmation.

According to some exemplary embodiments, the adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data specifically includes: generating an endorsement text based on the text data, wherein the endorsement text includes necessary transaction information; digitally signing the endorsed text using an encryption algorithm; and superimposing digitally signed endorsement text in a visual form over the check enhanced image based on the check segmentation area.

According to some exemplary embodiments, the superimposing digitally signed endorsement text in a visual form over the check enhanced image based on the check segmentation area specifically includes: adding an electronic mark on the check enhanced image based on the check segmentation area by utilizing an image analysis technology; and determining a specified blank area on the check enhanced image based on the electronic mark, and overlaying the digitally signed endorsed text on the specified blank area in a visual form.

According to some exemplary embodiments, the abnormal feature recognition model includes a security feature detection sub-model, a authenticity verification sub-model, and a compliance audit sub-model; the method for evaluating the authenticity of the check by using the abnormal characteristic recognition model and outputting the comprehensive evaluation result comprises the following steps of: based on the anti-counterfeiting feature detection submodel, positioning and analyzing the microstructure of the anti-counterfeiting feature by utilizing an image super-resolution technology and an image analysis technology, and outputting an anti-counterfeiting evaluation result; based on the authenticity verification sub-model, evaluating the authenticity of the signature on the check by utilizing a machine vision and pattern recognition technology, and outputting an authenticity evaluation result; based on the compliance audit submodel, carrying out compliance matching on transaction information on checks and outputting a compliance assessment result; and obtaining a comprehensive evaluation result based on the anti-counterfeiting evaluation result, the authenticity evaluation result and the compliance evaluation result.

According to some exemplary embodiments, the adjusting the image quality of the target check image based on the image enhancement, obtaining the check enhanced image specifically includes: performing quality assessment on the target check image; selecting an image enhancement technique to adjust the image quality based on the quality assessment result; and performing effect verification on the target check image subjected to the image quality adjustment, and taking the target check image subjected to the effect verification as the check enhancement image.

According to some exemplary embodiments, text data is extracted from the check segmentation area based on optical character recognition and natural language processing.

According to some exemplary embodiments, the method further comprises: acquiring updated fraud data in real time; and retraining and optimizing the abnormal feature identification model with the updated fraud data at predetermined time intervals.

According to a second aspect of the present invention, a method for processing check information is provided, applied to a client, and the method is characterized in that the method includes: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state; in response to the user authorization confirmation, guiding the user to capture a target check image based on the check scanning page; sending the target check image to a server, and acquiring a check enhancement image and a comprehensive evaluation result which are returned by the server and attached with an electronic endorsement, wherein the check enhancement image and the comprehensive evaluation result attached with the electronic endorsement are obtained according to the check information processing method in the first aspect; and performing a final decision based on the enhanced image of the check with the electronic endorsement and the composite evaluation result, the final decision including confirming or rejecting a deposit operation of the check.

According to a third aspect of the present invention, there is provided a check information processing apparatus for use in a server, the apparatus comprising: an image acquisition module for: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state; an image enhancement module for: adjusting the image quality of the target check image based on image enhancement to obtain a check enhanced image; an image segmentation module for: taking the check enhanced image as input, and carrying out image region segmentation on the layout and structure of the check by utilizing an image segmentation model to obtain check segmentation regions, and extracting text data from the check segmentation regions; the electronic endorsement adding module is used for: adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data; an authenticity assessment module for: taking the check enhanced image processed by the electronic endorsement as input, evaluating the authenticity of the check by using an abnormal characteristic recognition model, and outputting a comprehensive evaluation result, wherein the abnormal characteristic recognition model comprises a plurality of sub-models for anti-counterfeiting characteristic detection, authenticity verification and compliance verification; and a result transmitting module for: and sending the check enhanced image processed by the electronic endorsement and the comprehensive evaluation result to the client for service confirmation.

According to some example embodiments, the image enhancement module may include a quality assessment unit, an enhancement unit, and an effect verification unit.

According to some example embodiments, the quality assessment unit may be configured to perform quality assessment on the target check image.

According to some exemplary embodiments, the enhancement unit may be configured to select an image enhancement technique to adjust the image quality based on the quality evaluation result.

According to some exemplary embodiments, the effect verification unit may be configured to perform effect verification on the target check image after the image quality adjustment, and take the target check image after the effect verification as the check enhanced image.

According to some example embodiments, the electronic endorsement addition module may include an endorsement text generation unit, a digital signature unit, and an overlay module.

According to some example embodiments, the endorsement text generation unit may be configured to generate an endorsement text based on the text data, wherein the endorsement text includes necessary transaction information.

According to some example embodiments, the digital signature unit may be configured to digitally sign the endorsed text using an encryption algorithm. By digitally signing the endorsed text using an encryption algorithm, authenticity of the text and protection against unauthorized modification can be ensured.

According to some example embodiments, the overlay module may be configured to overlay digitally signed endorsed text in a visual form over the check enhanced image based on the check segmentation area.

According to some exemplary embodiments, the superimposition module may include an electronic mark adding unit and a blank region superimposition unit.

According to some exemplary embodiments, the electronic signature adding unit may be configured to add an electronic signature on the check enhanced image using an image analysis technique based on the check segmentation area.

According to some exemplary embodiments, the blank region superimposing unit may be configured to determine a specified blank region on the check enhanced image based on the electronic mark, and superimpose the digitally signed endorsed text on the specified blank region in a visual form.

According to some example embodiments, the authenticity assessment module may include a security feature detection unit, an authenticity verification unit, a compliance matching unit, and an integrated assessment unit.

According to some exemplary embodiments, the anti-counterfeiting feature detection unit may be configured to locate and analyze a microstructure of the anti-counterfeiting feature based on the anti-counterfeiting feature detection sub-model by using an image super-resolution technology and an image analysis technology, and output an anti-counterfeiting evaluation result.

According to some exemplary embodiments, the authenticity verification unit may be configured to evaluate the authenticity of the signature on the check based on the authenticity verification sub-model using machine vision and pattern recognition techniques, and output an authenticity evaluation result.

According to some exemplary embodiments, the compliance matching unit may be configured to perform compliance matching on transaction information on a check based on the compliance audit submodel, and output a compliance assessment result.

According to some exemplary embodiments, the comprehensive evaluation unit may be configured to obtain a comprehensive evaluation result based on the anti-counterfeit evaluation result, the authenticity evaluation result, and the compliance evaluation result.

According to some example embodiments, the processing device of check information may further include a model update module.

According to some example embodiments, the model update module may include a fraud data acquisition unit and an update unit.

According to some exemplary embodiments, the fraud data acquisition unit may be configured to acquire updated fraud data in real time.

According to some exemplary embodiments, the updating unit may be configured to retrain and optimize the abnormal feature identification model using the updated fraud data at predetermined time intervals.

According to a fourth aspect of the present invention, there is provided a check information processing apparatus, for application to a client, the apparatus comprising: a user authorization module for: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state; a guiding module for: in response to the user authorization confirmation, guiding the user to capture a target check image based on the check scanning page; the evaluation result acquisition module is used for: sending the target check image to a server, and acquiring a check enhancement image and a comprehensive evaluation result which are returned by the server and attached with an electronic endorsement, wherein the check enhancement image and the comprehensive evaluation result attached with the electronic endorsement are obtained according to the check information processing method in the first aspect; a final decision module for: based on the enhanced image of the check with the electronic endorsement and the comprehensive evaluation result, a final decision is performed, which includes confirming or rejecting a deposit operation of the check.

According to a fifth aspect of the present invention, there is provided an electronic device comprising: one or more processors; and a storage device for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method as described above.

According to a sixth aspect of the present invention there is provided a computer readable storage medium having stored thereon executable instructions which when executed by a processor cause the processor to perform the method as described above.

According to a seventh aspect of the present invention there is provided a computer program product comprising a computer program which, when executed by a processor, implements a method as described above.

One or more of the above embodiments have the following advantages or benefits: according to the check information processing method provided by the invention, the specially designed sub-model is used for processing the anti-counterfeiting feature detection, the authenticity verification and the compliance verification, so that the processing resources can be effectively allocated, and each model optimizes the performance aiming at a specific task to allow parallel processing, thereby improving the processing speed and the processing efficiency; accurate image segmentation and text extraction ensure that information submitted by a user is correctly processed, so that text data can be accurately converted into an electronic endorsement and applied to an image, the process reduces the time of manual input and inspection, and improves the processing efficiency; the user can obtain processing results, including results of electronic endorsements and authenticity assessment, almost instantaneously after uploading the check. The quick feedback mechanism not only enhances the trust of the user to the service, but also remarkably improves the overall satisfaction.

Drawings

The foregoing and other objects, features and advantages of the invention will be apparent from the following description of embodiments of the invention with reference to the accompanying drawings, in which:

FIG. 1 schematically illustrates an application scenario diagram of a method, apparatus, device, medium for processing check information applied to a server according to an embodiment of the present invention;

FIG. 2 schematically illustrates a flow chart of a processing method applied to server check information according to an embodiment of the present invention;

FIG. 3 schematically illustrates a flow chart of a method of processing check information applied to a client in accordance with an embodiment of the present invention;

FIG. 4 schematically illustrates a full flow chart of a method of processing check information according to an embodiment of the invention;

FIG. 5 schematically shows a block diagram of a processing apparatus of check information applied to a server according to an embodiment of the present invention;

FIG. 6 schematically shows a block diagram of a processing apparatus of check information applied to a client according to an embodiment of the present invention;

fig. 7 schematically shows a block diagram of an electronic device adapted for a method of processing check information according to an embodiment of the invention.

Detailed Description

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. It should be understood that the description is only illustrative and is not intended to limit the scope of the invention. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the invention. It may be evident, however, that one or more embodiments may be practiced without these specific details. In addition, in the following description, descriptions of well-known structures and techniques are omitted so as not to unnecessarily obscure the present invention.

The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. The terms "comprises," "comprising," and/or the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.

All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art unless otherwise defined. It should be noted that the terms used herein should be construed to have meanings consistent with the context of the present specification and should not be construed in an idealized or overly formal manner.

Where a convention analogous to "at least one of A, B and C, etc." is used, in general such a convention should be interpreted in accordance with the meaning of one of skill in the art having generally understood the convention (e.g., "a system having at least one of A, B and C" would include, but not be limited to, systems having a alone, B alone, C alone, a and B together, a and C together, B and C together, and/or A, B, C together, etc.).

In the technical scheme of the invention, the acquisition, storage, application and the like of the related personal information of the user accord with the regulations of related laws and regulations, necessary security measures are taken, and the public order harmony is not violated.

First, technical terms described herein are explained and illustrated as follows.

OCR: i.e., optical character recognition, can convert text information in an image into computer-processable text data.

Electronic endorsements refer to the process of adding endorsement information to an electronic document, which is commonly used in financial transactions, particularly when processing checks or other payment vouchers. Electronic endorsements include not only signatures in traditional endorsements, but also possibly encryption measures to ensure the security and integrity of the transaction. Through electronic endorsement, relevant transaction information such as date, payee, payment amount and the like can be digitized and security authentication is added, so that paperless financial flow is realized, the requirement of physical transaction is reduced, and the processing efficiency and security are improved.

Image enhancement is a technique in the field of image processing aimed at improving the quality of an image, making it more suitable for display or further analysis. Image enhancement can be achieved in a variety of ways, including adjusting brightness, contrast, sharpening, denoising, etc., in order to enhance the visual effect of the image or improve the interpretability of the information.

Natural language processing is a branch of computer science and artificial intelligence, which relates to techniques that enable computers to understand and process human (natural) language. NLP combines computer science, artificial intelligence, and linguistic techniques to fill the gap between human language and computer understanding.

In modern financial transactions, traditional check processing procedures typically require the user to physically travel to a bank for submission and verification of checks. This not only is inconvenient, but also increases processing time and cost, especially in cases involving transnational processing.

Although electronic endorsement techniques and Optical Character Recognition (OCR) techniques have been introduced to simplify part of the process, these techniques have remained deficient in terms of security, efficiency, and user experience. The existing electronic endorsement system often lacks efficient image processing and text recognition capability, which not only limits the processing speed, but also influences the accuracy of information extraction and increases the risk of error or misreading. Furthermore, this deficiency may lead to significant financial errors when dealing with financial documents that must be read without error.

In terms of security measures, while electronic endorsements provide a degree of data security, many systems have not fully met the current high standards of security for financial transactions. For example, the lack of advanced encryption measures and fraud detection functions may make the system vulnerable to network attacks, resulting in leakage of sensitive financial information. Such security vulnerabilities are particularly serious in international transactions, as they may involve legal and security standards in different countries.

Although the use of Optical Character Recognition (OCR) technology allows automatic reading of information on the check, thereby simplifying the flow of check deposit to some extent, such technology generally involves only basic text recognition and lacks comprehensive assessment of check authenticity. Relying solely on OCR technology may result in an inability to effectively identify counterfeit or tampered checks, increasing the risk of fraud to banks and users.

In terms of user experience, the prior art often fails to provide interfaces and interactive designs that meet the expectations of modern consumers. Users often face complex operation flows and insufficient operation guidance when using electronic endorsement services, which not only reduces user satisfaction, but also limits service usage. An intuitive, compact, and responsive user interface is critical to improving customer loyalty and service appeal.

Based on the above, the embodiment of the invention provides a check information processing method, which is applied to a server, and comprises the following steps: in response to a user initiating an instruction for a target transaction service, obtaining a target check image from a client; adjusting the image quality of the target check image based on image enhancement to obtain a check enhanced image; taking the check enhanced image as input, and carrying out image region segmentation on the layout and structure of the check by utilizing an image segmentation model to obtain check segmentation regions, and extracting text data from the check segmentation regions; adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data; taking the check enhanced image processed by the electronic endorsement as input, evaluating the authenticity of the check by using an abnormal characteristic recognition model, and outputting a comprehensive evaluation result, wherein the abnormal characteristic recognition model comprises a plurality of sub-models for anti-counterfeiting characteristic detection, authenticity verification and compliance verification; and sending the check enhanced image processed by the electronic endorsement and the comprehensive evaluation result to the client for service confirmation. According to the check information processing method provided by the invention, the specially designed sub-model is used for processing the anti-counterfeiting feature detection, the authenticity verification and the compliance verification, so that the processing resources can be effectively allocated, and each model optimizes the performance aiming at a specific task to allow parallel processing, thereby improving the processing speed and the processing efficiency; accurate image segmentation and text extraction ensure that information submitted by a user is correctly processed, so that text data can be accurately converted into an electronic endorsement and applied to an image, the process reduces the time of manual input and inspection, and improves the processing efficiency; the user can obtain processing results, including results of electronic endorsements and authenticity assessment, almost instantaneously after uploading the check. The quick feedback mechanism not only enhances the trust of the user to the service, but also remarkably improves the overall satisfaction.

In addition, the embodiment of the invention also provides a check information processing method, which is applied to the client, and comprises the following steps: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state; in response to the user authorization confirmation, guiding the user to capture a target check image based on the check scanning page; sending the target check image to a server, and acquiring a check enhancement image and a comprehensive evaluation result which are returned by the server and attached with an electronic endorsement, wherein the check enhancement image and the comprehensive evaluation result attached with the electronic endorsement are acquired according to the check information processing method applied to the server; and performing a final decision based on the enhanced image of the check with the electronic endorsement and the composite evaluation result, the final decision including confirming or rejecting a deposit operation of the check. By efficiently distributing and processing tasks between the client and the server, the overall operational efficiency of the system is significantly improved. Meanwhile, the operation simplicity and satisfaction of the user in the whole transaction process are ensured by optimizing the user interface and the interaction design.

It should be noted that the method, the device, the equipment and the medium for processing check information determined by the invention can be used in the technical field of big data and the technical field of artificial intelligence, can also be used in the financial field, and can also be used in various fields except the technical field of big data and the technical field of artificial intelligence as well as the financial field. The application fields of the check information processing method, the device, the equipment and the medium provided by the embodiment of the invention are not limited.

In the technical scheme of the invention, the related user information (including but not limited to user personal information, user image information, user equipment information, such as position information and the like) and data (including but not limited to data for analysis, stored data, displayed data and the like) are information and data authorized by a user or fully authorized by all parties, and the related data are collected, stored, used, processed, transmitted, provided, disclosed, applied and the like, all comply with related laws and regulations and standards, necessary security measures are adopted, no prejudice to the public order is provided, and corresponding operation entries are provided for the user to select authorization or rejection.

In the scenario of using personal information to make an automated decision, the method, the device and the system provided by the embodiment of the invention provide corresponding operation inlets for users, so that the users can choose to agree or reject the automated decision result; if the user selects refusal, the expert decision flow is entered. The expression "automated decision" here refers to an activity of automatically analyzing, assessing the behavioral habits, hobbies or economic, health, credit status of an individual, etc. by means of a computer program, and making a decision. The expression "expert decision" here refers to an activity of making a decision by a person who is specializing in a certain field of work, has specialized experience, knowledge and skills and reaches a certain level of expertise.

Fig. 1 schematically shows an application scenario diagram of a method, an apparatus, a device, and a medium for processing check information applied to a server according to an embodiment of the present invention.

As shown in fig. 1, an application scenario 100 according to this embodiment may include terminal devices 101, 102, 103, a network 104, and a server 105. The network 104 is used as a medium to provide communication links between the terminal devices 101, 102, 103 and the server 105. The network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.

The user may interact with the server 105 via the network 104 using the terminal devices 101, 102, 103 to receive or send messages or the like. Various communication client applications, such as shopping class applications, web browser applications, search class applications, instant messaging tools, mailbox clients, social platform software, etc. (by way of example only) may be installed on the terminal devices 101, 102, 103.

The terminal devices 101, 102, 103 may be a variety of electronic devices having a display screen and supporting web browsing, including but not limited to smartphones, tablets, laptop and desktop computers, and the like.

The server 105 may be a server providing various services, such as a background management server (by way of example only) providing support for websites browsed by users using the terminal devices 101, 102, 103. The background management server may analyze and process the received data such as the user request, and feed back the processing result (e.g., the web page, information, or data obtained or generated according to the user request) to the terminal device.

It should be noted that, the method for processing check information provided by the embodiment of the present invention may be generally performed by the server 105. Accordingly, the processing device for check information provided by the embodiment of the present invention may be generally disposed in the server 105. The processing method of check information provided by the embodiment of the present invention may also be performed by a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105. Accordingly, the processing apparatus for check information provided by the embodiment of the present invention may also be provided in a server or a server cluster that is different from the server 105 and is capable of communicating with the terminal devices 101, 102, 103 and/or the server 105.

It should be understood that the number of devices and networks in fig. 1 is merely illustrative. There may be any number of devices and networks, as desired for implementation.

Fig. 2 schematically shows a flow chart of a method of processing check information applied to a server according to an embodiment of the present invention.

As shown in fig. 2, the method 200 for processing check information applied to a server in this embodiment may include operations S210 to S260.

In operation S210, a target check image is acquired from the client in response to an instruction of the user initiating the target transaction service.

The terminal devices 101, 102, 103 are mainly smart devices of the user, such as smartphones or tablet computers, equipped with cameras for capturing check images, which can initiate a check deposit request by means of a banking or financial application installed on these devices. After the user authorizes and captures the check image via the device, the image data may be sent to the server 105 for further processing.

In operation S220, the image quality of the target check image is adjusted based on the image enhancement, and a check enhanced image is obtained.

In an embodiment of the present invention, the method for adjusting the image quality of the target check image may include operations S301 to S303, where operations S301 to S303 may at least partially execute operation S220.

In operation S301, a quality evaluation is performed on the target check image.

In an embodiment of the present invention, it may be first determined whether the original image meets the criteria and whether further image enhancement processing is required by performing a preliminary quality evaluation of the uploaded check image. In particular, it may include important information (such as check number, amount, signature, etc.) to check the sharpness, brightness, contrast of the image, whether there is blurring or occlusion.

In operation S302, an image enhancement technique is selected to adjust the image quality based on the quality evaluation result. Various processes may be involved with the image including, but not limited to, color correction, contrast adjustment, sharpening, denoising, etc., and the selection of a particular technique is based on the quality assessment results of operation S301 to determine the initial state of the image and the desired improvement.

In operation S303, an effect verification is performed on the target check image subjected to the image quality adjustment, and the target check image subjected to the effect verification is used as the check enhanced image. After image enhancement, the effect of the verification enhancement is to ensure that the application of the image enhancement technique actually improves the quality of the image, and that no new problems (such as loss of detail due to excessive processing) are introduced. Verification may be accomplished by automated image analysis techniques such as re-evaluating the sharpness and other key indicators of the image.

In operation S230, the check enhanced image is taken as an input, image region segmentation is performed for the layout and structure of the check using an image segmentation model, check segmentation regions are obtained, and text data is extracted from the check segmentation regions.

In an embodiment of the present invention, image segmentation is the process of subdividing a digital image into a plurality of image regions (sets of pixels). In check processing, this means that critical information areas on the check, such as date, amount, payee information, etc., are accurately identified and isolated. For example, CNN may be used for deep learning to efficiently perform image classification and recognition tasks. For example, an edge in an image may be detected using a region-based image segmentation technique to segment out different regions, suitable for use in an image segmentation task with unclear boundaries.

In an embodiment of the invention, text data is extracted from the check segmentation area based on optical character recognition and natural language processing. OCR is used to automatically scan segmented areas of check images and identify and extract information therefrom such as account number, payment amount, date, payee name, etc. After OCR extracts text, natural language processing techniques are used to parse, understand, and format the text data. NLP technology can help correct OCR errors, recognize patterns in text, and perform semantic analysis, such as checking whether text content conforms to a particular format or rule, and handling complex tasks such as case-based consistency verification of monetary amounts.

In operation S240, an electronic endorsement is added to the check enhanced image based on the check segmentation area and the text data. Electronic endorsements typically include the addition of validation information, such as digital signatures, dates, and other verification codes, to check images. Such information, as a legal and integrity guarantee for transactions, generally plays a critical role in digital processing and archiving.

In the embodiment of the invention, the method for adding the electronic endorsement to the check enhanced image may include operations S401 to S403, where operations S401 to S403 may at least partially execute operation S240.

In operation S401, an endorsement text is generated based on the text data, wherein the endorsement text includes necessary transaction information. Specifically, the required endorsement text may be generated based on text data of the payment amount, payee name, date, etc. extracted from the check image. This text typically includes all necessary transaction information to ensure validity and traceability of the transaction.

In operation S402, the endorsed text is digitally signed using an encryption algorithm. By digitally signing the endorsed text using an encryption algorithm, authenticity of the text and protection against unauthorized modification can be ensured.

In operation S403, a specified blank area is determined on the check enhanced image based on the electronic signature, and digitally signed endorsed text is superimposed on the specified blank area in a visual form.

In an embodiment of the present invention, a method for overlaying digitally signed endorsement text on a check enhanced image in a visual form may include operations S501-S502, where operations S501-S502 may at least partially execute operation S403.

In operation S501, an electronic signature is added to the check enhanced image using image analysis techniques based on the check segmentation regions.

In embodiments of the present invention, electronic marking involves identifying blank areas or specific fields on a check image that are suitable for placing additional information, such as digitally signed endorsed text, without overlaying important pre-existing information.

In operation S502, a specified blank area is determined on the check enhanced image based on the electronic signature, and digitally signed endorsed text is superimposed on the specified blank area in a visual form.

In operation S250, the check enhanced image processed by the electronic endorsement is used as input, the authenticity of the check is evaluated by using the abnormal feature recognition model, and the comprehensive evaluation result is output, wherein the abnormal feature recognition model comprises a plurality of sub-models for anti-counterfeiting feature detection, authenticity verification and compliance verification.

In an embodiment of the present invention, the method for evaluating the authenticity of the check by using the abnormal feature recognition model may include operations S601 to S604, where operations S601 to S604 may at least partially execute operation S250.

In operation S601, based on the security feature detection sub-model, the microstructure of the security feature is located and analyzed by using an image super-resolution technique and an image analysis technique, and a security evaluation result is output. Specifically, the image super-resolution technology can be utilized to convert the low-resolution image into high-resolution image, so that the image details are enhanced, and the tiny anti-counterfeiting features (such as micro-prints or special ink marks) are easier to identify and analyze; the fine patterns and security markings on the check are located and analyzed using image analysis techniques.

In operation S602, based on the authenticity verification sub-model, authenticity of the signature on the check is evaluated using machine vision and pattern recognition techniques, and an authenticity evaluation result is output. Specifically, the neural network structure of the difference between the images can be learned and compared based on the machine vision technology, so that feature extraction and similarity comparison are performed on the signature sample, and the authenticity of the signature can be estimated.

In operation S603, compliance matching is performed on the transaction information on the check based on the compliance audit submodel, and a compliance assessment result is output. In particular, the semantic content of the check text may be analyzed to ensure that transaction information, such as amount, date, is consistent with the compliance policies of the banks in the business logic management system.

In operation S604, a comprehensive evaluation result is obtained based on the anti-counterfeit evaluation result, the authenticity evaluation result, and the compliance evaluation result. The output of each analysis module can be collected and integrated by using a data integration tool, and a comprehensive evaluation report can be generated in real time.

In addition, the embodiment of the invention also provides a method for updating the model in real time, which can comprise operations S701-S702.

In operation S701, updated fraud data is acquired in real time. In particular, up-to-date fraud data from various sources may be received and integrated in real-time. Such data may include new fraud cases, changed fraud patterns, recently discovered fraud techniques, etc.

At operation S702, the abnormal feature recognition model is retrained and optimized using the updated fraud data at predetermined time intervals. The process of retraining and optimizing may include adjusting model parameters, introducing new data features, and possibly even replacing or upgrading the model architecture to accommodate new threats.

In operation S260, the text application information, the picture content description and the authenticity judgment conclusion are analyzed and judged, so as to obtain the auditing result of the merchant receipt application.

In addition, the embodiment of the invention also provides a processing method of check information applied to the client.

Fig. 3 schematically shows a flow chart of a method of processing check information applied to a client according to an embodiment of the invention.

As shown in fig. 3, the method for processing check information applied to a client according to the embodiment may include operations S310 to S340.

In operation S310, in response to an instruction of the user to initiate the target transaction service, user authorization is acquired based on the status of service opening.

When the user initiates a check deposit, the client first checks whether the user is first to use this feature, which involves accessing the user's history and status information, and determining whether an agreement record already exists. For the first time the user using this feature, the client will direct them to specific pages to read rules and regulations for the mobile check deposit. This ensures that the user is fully aware of the terms and conditions of the service before any action is taken.

Once the user clicks on the agreement on the interface, the client will record this action and update the user's status to agreed. In this way, the user will recognize that the user has agreed to the agreement and directly allow them to enter the mobile check deposit process when using this feature in the future.

If the client detects an update to the agreement content in the inner tube, it should be required that all users re-read and agree to the new agreement before the next transaction is made, ensuring that all transactions are made based on the latest terms approved by the users.

In operation S320, the user is guided to capture a target check image based on the check scan page in response to the user authorization confirmation.

In the embodiment of the invention, a clear and visual user interface can be designed to clearly indicate how the user operates. Including the location of the capture button, the necessary image alignment guidance, and any cues that help to improve image quality. After the first use or significant update, a shooting example or animation presentation may be provided to help the user understand the best shooting practices. After shooting is finished, immediate image quality feedback can be provided, and if the image is not satisfactory (such as blurring, overexposure, check not completely in frame, etc.), the user should be prompted to re-shoot.

In operation S330, the target check image is transmitted to a server, and a check enhanced image and a comprehensive evaluation result with an electronic endorsement returned by the server are acquired, wherein the check enhanced image and the comprehensive evaluation result with the electronic endorsement are acquired according to a processing method of check information applied to the processing method of check information of the server.

In operation S340, a final decision including confirming or rejecting a deposit operation of the check is performed based on the check enhanced image with the electronic endorsement and the comprehensive evaluation result.

FIG. 4 schematically shows a full flow chart of a method of processing check information according to an embodiment of the invention.

As shown in fig. 4, a user initiates a transaction instruction on a client (e.g., an intelligent application), and first the client needs to confirm the authorization status of the user. If the first use or agreement is updated, the user needs to read and agree to the relevant service clause, and after the user authorization, the client guides the user to the check scanning page. In check scan pages, the user captures images of the check according to system instructions, often requiring the inclusion of both the front and back sides of the check. The client can provide shooting quality feedback (such as image definition, focusing condition and the like) in real time so as to ensure that the image quality meets the requirements. After shooting is completed, the client sends the target check image to the server for further processing.

After receiving the check image, the server first performs image enhancement processing to improve the image quality so as to be suitable for subsequent data extraction and analysis work; dividing the check into a plurality of key areas according to the structure of the check by applying an image dividing technology, and extracting text data from the areas; an electronic endorsement is added to the check image based on the extracted text data. Electronic endorsements are a means of confirming payment details, typically including digital signatures; and evaluating the authenticity of the check by using an abnormal characteristic identification model, including anti-counterfeiting characteristic detection, authenticity verification and compliance verification. These models work together to ensure that the check has not been tampered with and that all relevant regulations are met. And finally, sending the enhanced check image with the electronic endorsement and the comprehensive evaluation result back to the client.

After receiving the results processed by the server, the client may view the processed check image and associated evaluation results. The intelligent application (which may be automatically executed depending on the settings) may make a final decision confirming or rejecting the deposit operation of the check.

According to the check information processing method provided by the invention, the specially designed sub-model is used for processing the anti-counterfeiting feature detection, the authenticity verification and the compliance verification, so that processing resources can be effectively allocated, and each model optimizes the performance aiming at a specific task to allow parallel processing, thereby improving the processing speed and the processing efficiency; accurate image segmentation and text extraction ensure that information submitted by a user is correctly processed, so that text data can be accurately converted into an electronic endorsement and applied to an image, the process reduces the time of manual input and inspection, and improves the processing efficiency; the user can obtain processing results, including results of electronic endorsements and authenticity assessment, almost instantaneously after uploading the check. The quick feedback mechanism not only enhances the trust of the user to the service, but also remarkably improves the overall satisfaction. Specifically, the following beneficial effects are brought:

1. By digitally signing the endorsement text using an encryption algorithm, adding an electronic tag, determining a specified blank area, and superimposing the endorsement text, key transaction endorsement information can be effectively added without disturbing the original check information. The processing not only improves the automation degree of check processing, but also strengthens the safety and compliance, so that the whole check processing flow is more efficient and safer;

2. By utilizing the anti-counterfeiting characteristic detection sub-model, the authenticity verification sub-model and the compliance auditing sub-model, a comprehensive evaluation result can be provided, and the safety, the authenticity and the compliance are ensured;

3. the server enhances and segments the shot check image, ensures that all key information such as payment amount, date, payee and the like are accurately captured and analyzed, and reduces the possibility of human input errors;

4. electronic endorsements are added to the images and abnormal feature detection is carried out, so that the transaction safety is enhanced, the authenticity and the legality of checks are ensured, and the fraud risk is reduced;

5. the combination of OCR technology and NLP technology not only increases the capability of extracting text from an image, but also improves the understanding depth of the text, so that the automation processing is more accurate and reliable. This is extremely important for automated check processing systems, as these systems must accurately process large amounts of data without human intervention. By the method, the system can provide quick and accurate check processing service, reduce error rate and improve user satisfaction and operation efficiency.

Fig. 5 schematically shows a block diagram of a processing apparatus of check information applied to a server according to an embodiment of the present invention.

As shown in fig. 5, the check information processing apparatus 500 according to this embodiment includes an image acquisition module 510, an image enhancement module 520, an image segmentation module 530, an electronic endorsement addition module 540, an authenticity assessment module 550, and a result transmission module 560.

The image acquisition module 510 may be configured to acquire, in response to an instruction from a user to initiate a target transaction, a user authorization based on a status of service activation. In an embodiment, the image obtaining module 510 may be configured to perform the operation S210 described above, which is not described herein.

The image enhancement module 520 may be configured to adjust the image quality of the target check image based on image enhancement to obtain a check enhanced image. In an embodiment, the image enhancement module 520 may be configured to perform the operation S220 described above, which is not described herein.

The image segmentation module 530 may be configured to take the check enhanced image as input, segment an image region for a layout and structure of a check using an image segmentation model, obtain a check segmentation region, and extract text data from the check segmentation region. In an embodiment, the image segmentation module 530 may be configured to perform the operation S230 described above, which is not described herein.

The electronic endorsement module 540 may be configured to add an electronic endorsement to the check enhanced image based on the check segmentation area and the text data. In an embodiment, the electronic endorsement adding module 540 may be configured to perform the operation S240 described above, which is not described herein.

The authenticity assessment module 550 may be configured to take the enhanced image of the check after the electronic endorsement process as an input, and use an abnormal feature recognition model to assess the authenticity of the check, and output a comprehensive assessment result, where the abnormal feature recognition model includes a plurality of sub-models for anti-counterfeiting feature detection, authenticity verification, and compliance verification. In an embodiment, the authenticity assessment module 550 may be configured to perform the operation S250 described above, which is not described herein.

The result sending module 560 may be configured to send the check enhanced image and the comprehensive evaluation result after the electronic endorsement processing to the client for service confirmation. In an embodiment, the result sending module 560 may be configured to perform the operation S260 described above, which is not described herein.

According to an embodiment of the present invention, the image enhancement module 1020 may include a quality assessment unit, an enhancement unit, and an effect verification unit.

The quality assessment unit may be configured to perform quality assessment on the target check image. In an embodiment, the quality evaluation unit may be configured to perform the operation S301 described above, which is not described herein.

The enhancement unit may be configured to select an image enhancement technique to adjust the image quality based on the quality assessment result. In an embodiment, the enhancing unit may be configured to perform the operation S302 described above, which is not described herein.

The effect verification unit may be configured to perform effect verification on the target check image after the image quality adjustment, and use the target check image after the effect verification as the check enhanced image. In an embodiment, the effect verification unit may be configured to perform the operation S303 described above, which is not described herein.

According to an embodiment of the present invention, the electronic endorsement adding module 1040 may include an endorsement text generating unit, a digital signature unit, and an overlapping module.

The endorsement text generation unit may be configured to generate an endorsement text based on the text data, wherein the endorsement text includes necessary transaction information. In an embodiment, the endorsement text generating unit may be configured to perform the operation S401 described above, which is not described herein.

The digital signature unit may be configured to digitally sign the endorsed text using an encryption algorithm. By digitally signing the endorsed text using an encryption algorithm, authenticity of the text and protection against unauthorized modification can be ensured. In an embodiment, the digital signature unit may be used to perform the operation S402 described above, which is not described herein.

The overlay module may be configured to overlay digitally signed endorsed text in a visual form over the check enhanced image based on the check segmentation area. In an embodiment, the stacking module may be configured to perform the operation S403 described above, which is not described herein.

According to an embodiment of the present invention, the superimposition module may include an electronic mark adding unit and a blank area superimposition unit.

The electronic signature adding unit may be configured to add an electronic signature on the check enhanced image using an image analysis technique based on the check segmentation area. In an embodiment, the electronic tag adding unit may be used to perform the operation S501 described above, which is not described herein.

The blank region superimposing unit may be configured to determine a specified blank region on the check enhanced image based on the electronic mark, and superimpose the digitally signed endorsed text on the specified blank region in a visual form. In an embodiment, the blank region overlapping unit may be configured to perform the operation S502 described above, which is not described herein.

According to an embodiment of the present invention, the authenticity assessment module 1050 may include a security feature detection unit, an authenticity verification unit, a compliance matching unit, and a comprehensive assessment unit.

The anti-counterfeiting feature detection unit can be used for positioning and analyzing the microstructure of the anti-counterfeiting feature by utilizing an image super-resolution technology and an image analysis technology based on the anti-counterfeiting feature detection submodel and outputting an anti-counterfeiting evaluation result. In an embodiment, the security feature detection unit may be used to perform the operation S601 described above, which is not described herein.

The authenticity verification unit may be configured to evaluate authenticity of the signature on the check based on the authenticity verification sub-model using machine vision and pattern recognition techniques, and output an authenticity evaluation result. In an embodiment, the authenticity verification unit may be configured to perform the operation S602 described above, which is not described herein.

The compliance matching unit can be used for carrying out compliance matching on transaction information on checks based on the compliance audit submodel and outputting a compliance assessment result. In an embodiment, the compliance matching unit may be configured to perform operation S603 described above, which is not described herein.

The comprehensive evaluation unit may be configured to obtain a comprehensive evaluation result based on the anti-counterfeit evaluation result, the authenticity evaluation result, and the compliance evaluation result. In an embodiment, the integrated evaluation unit may be configured to perform the operation S604 described above, which is not described herein.

According to an embodiment of the present invention, the check information processing apparatus 1000 may further include a model update module.

According to an embodiment of the invention, the model updating module may comprise a fraud data acquisition unit and an updating unit.

The fraud data acquisition unit may be configured to acquire updated fraud data in real time. In an embodiment, the fraud data obtaining unit may be configured to perform the operation S701 described above, which is not described herein.

The updating unit may be configured to retrain and optimize the abnormal feature identification model using the updated fraud data at predetermined time intervals. In an embodiment, the updating unit may be configured to perform the operation S702 described above, which is not described herein.

Any of the image acquisition module 510, the image enhancement module 520, the image segmentation module 530, the electronic endorsement addition module 540, the authenticity assessment module 550, the result transmission module 560 may be combined in one module to be implemented, or any of the modules may be split into a plurality of modules, according to an embodiment of the present invention. Or at least some of the functionality of one or more of the modules may be combined with, and implemented in, at least some of the functionality of other modules. According to embodiments of the present disclosure, at least one of the image acquisition module 510, the image enhancement module 520, the image segmentation module 530, the electronic endorsement module 540, the authenticity assessment module 550, the result transmission module 560 may be implemented at least in part as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system-on-chip, a system-on-substrate, a system-on-package, an Application Specific Integrated Circuit (ASIC), or as hardware or firmware in any other reasonable way of integrating or packaging the circuit, or as any one of or a suitable combination of three of software, hardware and firmware. Or at least one of the image acquisition module 510, the image enhancement module 520, the image segmentation module 530, the electronic endorsement addition module 540, the authenticity assessment module 550, the result transmission module 560 may be at least partially implemented as a computer program module, which, when executed, may perform the corresponding functions.

Fig. 6 schematically shows a block diagram of a processing apparatus of check information applied to a client according to an embodiment of the present invention.

As shown in fig. 6, the check information processing apparatus 1000 according to this embodiment includes a user authorization module 610, a guidance module 620, an evaluation result acquisition module 630, and a final decision module 640.

According to an embodiment of the present invention, the audit result obtaining module 1040 may include a feature engineering unit, a prediction unit, and a re-audit unit.

The user authorization module 610 may be configured to obtain user authorization based on a status of service activation in response to an instruction from a user to initiate a target transaction. In an embodiment, the user authorization module 610 may be configured to perform the operation S810 described above, which is not described herein.

The guidance module 620 may be configured to guide the user to capture a target check image based on the check scan page in response to a confirmation of user authorization. In an embodiment, the guiding module 620 may be configured to perform the operation S820 described above, which is not described herein.

The evaluation result obtaining module 630 may be configured to send the target check image to a server, and obtain a check enhanced image with an electronic endorsement and a comprehensive evaluation result returned by the server, where the check enhanced image with the electronic endorsement and the comprehensive evaluation result are obtained according to a processing method of check information applied to a processing method of check information of the server. In an embodiment, the evaluation result obtaining module 630 may be configured to perform the operation S830 described above, which is not described herein.

The final decision module 640 may be configured to perform a final decision including confirming or rejecting a deposit operation of a check based on the enhanced image of the check with the electronic endorsement and the composite evaluation result. In an embodiment, the final decision module 640 may be configured to perform the operation S840 described above, which is not described herein.

Any of the user authorization module 610, the guidance module 620, the evaluation result acquisition module 630, and the final decision module 640 may be combined in one module to be implemented, or any of the modules may be split into a plurality of modules according to an embodiment of the present invention. Or at least some of the functionality of one or more of the modules may be combined with, and implemented in, at least some of the functionality of other modules. According to embodiments of the present disclosure, at least one of the user authorization module 610, the guidance module 620, the evaluation result acquisition module 630, and the final decision module 640 may be implemented at least in part as hardware circuitry, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented in hardware or firmware in any other reasonable way of integrating or packaging the circuitry, or in any one of or a suitable combination of three of software, hardware, and firmware. Or at least one of the user authorization module 610, the guidance module 620, the evaluation result acquisition module 630, the final decision module 640 may be at least partly implemented as a computer program module which, when run, may perform the corresponding functions.

As shown in fig. 7, an electronic device 700 according to an embodiment of the present invention includes a processor 701 that can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. The processor 701 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or an associated chipset and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), or the like. The processor 701 may also include on-board memory for caching purposes. The processor 701 may comprise a single processing unit or a plurality of processing units for performing different actions of the method flow according to an embodiment of the invention.

In the RAM 703, various programs and data necessary for the operation of the electronic apparatus 700 are stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other through a bus 704. The processor 701 performs various operations of the method flow according to an embodiment of the present invention by executing programs in the ROM 702 and/or the RAM 703. Note that the program may be stored in one or more memories other than the ROM 702 and the RAM 703. The processor 701 may also perform various operations of the method flow according to embodiments of the present invention by executing programs stored in the one or more memories.

According to an embodiment of the invention, the electronic device 700 may further comprise an input/output (I/O) interface 705, the input/output (I/O) interface 705 also being connected to the bus 704. The electronic device 700 may also include one or more of the following components connected to the I/O interface 705: an input section 706 including a keyboard, a mouse, and the like; an output portion 707 including a Cathode Ray Tube (CRT), a Liquid Crystal Display (LCD), and the like, a speaker, and the like; a storage section 708 including a hard disk or the like; and a communication section 709 including a network interface card such as a LAN card, a modem, or the like. The communication section 709 performs communication processing via a network such as the internet. The drive 710 is also connected to the I/O interface 705 as needed. A removable medium 711 such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory, or the like is mounted on the drive 710 as necessary, so that a computer program read therefrom is mounted into the storage section 708 as necessary.

The present invention also provides a computer-readable storage medium that may be embodied in the apparatus/device/system described in the above embodiments; or may exist alone without being assembled into the apparatus/device/system. The computer-readable storage medium carries one or more programs which, when executed, implement methods in accordance with embodiments of the present invention.

According to embodiments of the present invention, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example, but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the context of this document, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to an embodiment of the invention, the computer-readable storage medium may include ROM 702 and/or RAM 703 and/or one or more memories other than ROM 702 and RAM 703 described above.

Embodiments of the present invention also include a computer program product comprising a computer program containing program code for performing the method shown in the flowcharts. The program code means for causing a computer system to carry out the methods provided by embodiments of the present invention when the computer program product is run on the computer system.

The above-described functions defined in the system/apparatus of the embodiment of the present invention are performed when the computer program is executed by the processor 701. The systems, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the invention.

In one embodiment, the computer program may be based on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted, distributed over a network medium in the form of signals, downloaded and installed via the communication section 709, and/or installed from the removable medium 711. The computer program may include program code that may be transmitted using any appropriate network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.

In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 709, and/or installed from the removable medium 711. The above-described functions defined in the system of the embodiment of the present invention are performed when the computer program is executed by the processor 701. The systems, devices, apparatus, modules, units, etc. described above may be implemented by computer program modules according to embodiments of the invention.

According to embodiments of the present invention, program code for carrying out computer programs provided by embodiments of the present invention may be written in any combination of one or more programming languages, and in particular, such computer programs may be implemented in high-level procedural and/or object-oriented programming languages, and/or in assembly/machine languages. Programming languages include, but are not limited to, such as Java, c++, python, "C" or similar programming languages. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In the case of remote computing devices, the remote computing device may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to an external computing device (e.g., connected via the Internet using an Internet service provider).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present invention. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.

The embodiments of the present invention are described above. These examples are for illustrative purposes only and are not intended to limit the scope of the present invention. Although the embodiments are described above separately, this does not mean that the measures in the embodiments cannot be used advantageously in combination. Various alternatives and modifications can be made by those skilled in the art without departing from the scope of the invention, and such alternatives and modifications are intended to fall within the scope of the invention.

Claims

1. A method for processing check information, applied to a server, the method comprising:

in response to a user initiating an instruction for a target transaction service, obtaining a target check image from a client;

Adjusting the image quality of the target check image based on image enhancement to obtain a check enhanced image;

taking the check enhanced image as input, and carrying out image region segmentation on the layout and structure of the check by utilizing an image segmentation model to obtain check segmentation regions, and extracting text data from the check segmentation regions;

adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data;

Taking the check enhanced image processed by the electronic endorsement as input, evaluating the authenticity of the check by using an abnormal characteristic recognition model, and outputting a comprehensive evaluation result, wherein the abnormal characteristic recognition model comprises a plurality of sub-models for anti-counterfeiting characteristic detection, authenticity verification and compliance verification; and

And sending the check enhanced image processed by the electronic endorsement and the comprehensive evaluation result to the client for service confirmation.

2. The method of claim 1, wherein the adding an electronic endorsement to the check enhanced image based on the check segmentation zone and the text data, in particular comprises:

Generating an endorsement text based on the text data, wherein the endorsement text includes necessary transaction information;

digitally signing the endorsed text using an encryption algorithm; and

Based on the check segmentation area, digitally signed endorsement text is superimposed in a visual form over the check enhanced image.

3. The method according to claim 2, wherein the superimposing digitally signed endorsed text in visual form on the check enhanced image based on the check segmentation zone, comprises:

adding an electronic mark on the check enhanced image based on the check segmentation area by utilizing an image analysis technology; and

And determining a specified blank area on the check enhanced image based on the electronic mark, and overlaying the endorsed text subjected to the digital signature on the specified blank area in a visual form.

4. The method of claim 1, wherein the abnormal feature identification model comprises a security feature detection sub-model, a authenticity verification sub-model, and a compliance audit sub-model;

the method for evaluating the authenticity of the check by using the abnormal characteristic recognition model and outputting the comprehensive evaluation result comprises the following steps of:

Based on the anti-counterfeiting feature detection submodel, positioning and analyzing the microstructure of the anti-counterfeiting feature by utilizing an image super-resolution technology and an image analysis technology, and outputting an anti-counterfeiting evaluation result;

Based on the authenticity verification sub-model, evaluating the authenticity of the signature on the check by utilizing a machine vision and pattern recognition technology, and outputting an authenticity evaluation result;

based on the compliance audit submodel, carrying out compliance matching on transaction information on checks and outputting a compliance assessment result; and

And obtaining a comprehensive evaluation result based on the anti-counterfeiting evaluation result, the authenticity evaluation result and the compliance evaluation result.

5. The method according to any one of claims 1 to 4, wherein said adjusting the image quality of the target check image based on image enhancement, obtaining a check enhanced image, comprises:

performing quality assessment on the target check image;

selecting an image enhancement technique to adjust the image quality based on the quality assessment result; and

And performing effect verification on the target check image subjected to the image quality adjustment, and taking the target check image subjected to the effect verification as the check enhancement image.

6. The method of claim 1, wherein text data is extracted from the check segmentation area based on optical character recognition and natural language processing.

7. The method according to claim 4, wherein the method further comprises:

Acquiring updated fraud data in real time; and

Retraining and optimizing the abnormal feature identification model using the updated fraud data at predetermined time intervals.

8. A method for processing check information, applied to a client, the method comprising:

responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state;

In response to the user authorization confirmation, guiding the user to capture a target check image based on the check scanning page;

Transmitting the target check image to a server, and acquiring a check enhancement image and a comprehensive evaluation result which are returned by the server and attached with an electronic endorsement, wherein the check enhancement image and the comprehensive evaluation result attached with the electronic endorsement are acquired according to the check information processing method of any one of claims 1 to 7; and

Based on the enhanced image of the check with the electronic endorsement and the comprehensive evaluation result, a final decision is performed, which includes confirming or rejecting a deposit operation of the check.

9. A check information processing apparatus applied to a server, the apparatus comprising:

An image acquisition module for: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state;

an image enhancement module for: adjusting the image quality of the target check image based on image enhancement to obtain a check enhanced image;

An image segmentation module for: taking the check enhanced image as input, and carrying out image region segmentation on the layout and structure of the check by utilizing an image segmentation model to obtain check segmentation regions, and extracting text data from the check segmentation regions;

the electronic endorsement adding module is used for: adding an electronic endorsement to the check enhanced image based on the check segmentation area and the text data;

an authenticity assessment module for: taking the check enhanced image processed by the electronic endorsement as input, evaluating the authenticity of the check by using an abnormal characteristic recognition model, and outputting a comprehensive evaluation result, wherein the abnormal characteristic recognition model comprises a plurality of sub-models for anti-counterfeiting characteristic detection, authenticity verification and compliance verification; and

The result sending module is used for: and sending the check enhanced image processed by the electronic endorsement and the comprehensive evaluation result to the client for service confirmation.

10. A check information processing apparatus for use in a client, the apparatus comprising:

a user authorization module for: responding to an instruction of a user for initiating a target transaction service, and acquiring user authorization based on a service opening state;

A guiding module for: in response to the user authorization confirmation, guiding the user to capture a target check image based on the check scanning page;

The evaluation result acquisition module is used for: transmitting the target check image to a server, and acquiring a check enhancement image and a comprehensive evaluation result which are returned by the server and attached with an electronic endorsement, wherein the check enhancement image and the comprehensive evaluation result attached with the electronic endorsement are acquired according to the check information processing method of any one of claims 1 to 7;

a final decision module for: based on the enhanced image of the check with the electronic endorsement and the comprehensive evaluation result, a final decision is performed, which includes confirming or rejecting a deposit operation of the check.

11. An electronic device, comprising:

One or more processors;

storage means for storing one or more computer programs,

Characterized in that the one or more processors execute the one or more computer programs to implement the steps of the method according to any one of claims 1-8.

12. A computer readable storage medium, on which a computer program is stored, characterized in that the computer program, when being executed by a processor, realizes the steps of the method according to any one of claims 1-8.