CN111008968B

CN111008968B - Picture processing method, device and storage medium

Info

Publication number: CN111008968B
Application number: CN201911227880.5A
Authority: CN
Inventors: 曾纪光; 张天皓; 高增禄; 周浩; 陈龙
Original assignee: Shenzhen Colibri Technologies Co ltd
Current assignee: Shenzhen Colibri Technologies Co ltd
Priority date: 2019-12-04
Filing date: 2019-12-04
Publication date: 2024-04-12
Anticipated expiration: 2039-12-04
Also published as: CN111008968A

Abstract

The embodiment of the application discloses a picture processing method, a picture processing device and a storage medium, wherein the method comprises the following steps: acquiring a first picture and a second picture to be processed; partitioning the first picture and the second picture according to a preset partitioning rule to obtain a third picture and a fourth picture, wherein the partitioning rule comprises the steps of listing areas of products which do not need to be detected as one partition, setting different surface areas of the products as different partitions, and setting different edge areas of the products as different partitions; and displaying the third picture and the fourth picture so that the user can conduct comparison. By implementing the embodiment of the application, the third picture and the fourth picture after partitioning are displayed at the same time, so that an operator can conveniently and intuitively compare the difference between the two pictures (such as a good picture and a defect picture).

Description

Picture processing method, device and storage medium

Technical Field

The present disclosure relates to the field of image processing technologies, and in particular, to a method and an apparatus for processing a picture, and a storage medium.

Background

In the field of product appearance defect detection, image processing is an extremely important link. Image analysis commonly used in the industry today includes visual (coarse inspection) and software inspection. The visual method can only observe and compare in one picture at the same time, find out the abnormal point visible to naked eyes, and sometimes need to constantly switch between good pictures and defective pictures for inspection. In this case, both efficiency and accuracy are affected. The software detection can improve accuracy and stability, but can not conveniently and intuitively compare the difference of each local detail of the good and bad pictures by an operator.

Content of the application

An embodiment of the application aims to provide a picture processing method, a picture processing device and a storage medium, so that an operator can intuitively compare differences of two pictures.

In order to achieve the above object, in a first aspect, an embodiment of the present application provides a method for processing a picture, including:

acquiring a first picture and a second picture to be processed;

partitioning the first picture and the second picture according to a preset partitioning rule to obtain a third picture and a fourth picture, wherein the partitioning rule comprises the steps of listing areas of products which do not need to be detected as one partition, setting different surface areas of the products as different partitions, and setting different edge areas of the products as different partitions;

and displaying the third picture and the fourth picture so that the user can conduct comparison.

As a preferred embodiment of the present application, after displaying the third picture and the fourth picture to enable the user to make a comparison, the method further includes:

and calculating the third picture and the fourth picture according to a preset picture defect judgment standard to obtain calculation result data and a condition judgment result.

Further, after obtaining the result data, the method further comprises:

and adjusting the picture defect judging standard according to the calculation result data and the condition judging result.

Further, before acquiring the first picture and the second picture to be processed, the method further includes:

setting partition rules and partition parameters of the partitions;

obtaining defect types, defect size standards and defect numbers;

and taking the partition parameters, the acquired defect types, the defect size standards and the defect number as the picture defect judging standards.

In a second aspect, an embodiment of the present application provides a picture processing apparatus, including:

the acquisition unit is used for acquiring a first picture and a second picture to be processed;

the partition unit is used for carrying out partition processing on the first picture and the second picture according to a preset partition rule to obtain a third picture and a fourth picture, wherein the partition rule comprises the steps of listing areas of a product which are not required to be detected as one partition, setting different surface areas of the product as different partitions and setting different edge areas of the product as different partitions;

and the display unit is used for displaying the third picture and the fourth picture so as to enable a user to compare the third picture and the fourth picture.

As a preferred embodiment of the present application, the apparatus further comprises:

the calculating unit is used for calculating the third picture and the fourth picture according to a preset picture defect judging standard so as to obtain calculation result data and a condition judging result;

and the adjusting unit is used for adjusting the picture defect judging standard according to the calculation result data and the condition judging result.

Further, the device also comprises a setting unit, a setting unit and a setting unit, wherein the setting unit is used for setting partition rules and partition parameters of the partitions;

the acquisition unit is also used for acquiring defect types, defect size standards and defect numbers;

the setting unit is further configured to set the partition parameter, the acquired defect type, the defect size standard, and the defect number as the picture defect determination standard.

In a third aspect, an embodiment of the present application further provides another image processing apparatus, including a processor, an input device, an output device, and a memory, where the processor, the input device, the output device, and the memory are connected to each other, where the memory is configured to store a computer program, and the computer program includes program instructions, and the processor is configured to invoke the program instructions to perform the method of the first aspect.

In a fourth aspect, embodiments of the present application also provide a computer readable storage medium having stored therein a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of the first aspect described above.

According to the embodiment of the application, the first picture and the second picture to be processed are firstly obtained, then the first picture and the second picture are subjected to partition processing according to the preset partition rule to obtain the third picture and the fourth picture, and finally the third picture and the fourth picture are displayed at the same time, so that an operator can conveniently and intuitively compare the difference of the two pictures (such as a good picture and a defect picture).

Drawings

In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings that are used in the description of the embodiments or the prior art will be briefly described below.

Fig. 1 is a schematic flowchart of a picture processing method provided in an embodiment of the present application;

FIG. 2 is an interface diagram of establishing partition 101;

FIGS. 3 and 4 are interface diagrams for creating a partition 201;

FIGS. 5 and 6 are interface diagrams of establishing partition 102;

FIG. 7 is an interface diagram of two pictures in comparison;

FIG. 8 is a diagram of a two-picture detail display interface;

FIG. 9 is a picture defect determination interface diagram;

FIG. 10 is an interface diagram for adjusting parameters of a picture defect decision criterion;

fig. 11 is a schematic structural diagram of a picture processing device according to an embodiment of the present application;

fig. 12 is a schematic diagram of another structure of a picture processing apparatus according to an embodiment of the present application.

Detailed Description

The following description of the embodiments of the present application will be made clearly and fully with reference to the accompanying drawings, in which it is evident that the embodiments described are some, but not all, of the embodiments of the present application. All other embodiments, which can be made by one of ordinary skill in the art without undue burden from the present disclosure, are within the scope of the present disclosure.

Please refer to fig. 1, which is a diagram processing method provided in an embodiment of the present application, which is mainly used for detecting and determining a surface defect of a metal part. Accordingly, the products mentioned hereinafter, unless otherwise indicated, are understood to be metal parts. As shown in fig. 1, the picture processing method may include:

s101, setting partition rules and partition parameters of the partitions.

The partitioning rules include, but are not limited to, independently listing areas of the product that do not need to be detected as one partition, setting different surface areas of the product as different partitions, and setting different edge areas of the product as different partitions. For example, the picture shown in fig. 2, a new partition 101 is created as a partition that does not need to be detected, and the chamfered corners and the junction in the picture are set as the partition. The detection of this partition may be masked by parameter settings at the time of subsequent image detection processing.

As further shown in fig. 3 and 4, a new partition 201 is created and an area is selected to be set as the partition. After different surface areas are set into different partitions, different parameters are set for the different partitions, so that the detection accuracy is improved.

As another example, fig. 5 and 6 illustrate creating a new partition 102 and selecting a partition edge to set as the partition. After different edge areas are set into different partitions, different parameters are set for the different partitions, so that the detection accuracy is improved.

S102, setting a picture defect judging standard.

Specifically, the defect type, the defect size standard and the defect number are obtained, and the partition parameter, the obtained defect type, the defect size standard and the defect number are used as picture defect judging standards.

S103, acquiring a first picture and a second picture to be processed.

In this embodiment, the first picture refers to a good picture, and the second picture refers to a defective picture.

S104, partitioning the first picture and the second picture according to a preset partitioning rule to obtain a third picture and a fourth picture.

Specifically, the first picture and the second picture are subjected to partition processing according to the aforementioned partition rule, for example, the first picture is divided into a mask area (no detection area is required), an edge area, and the like.

S105, displaying the third picture and the fourth picture so as to enable the user to conduct comparison.

Specifically, the third picture and the fourth picture are simultaneously displayed to the user, as shown in fig. 7, so that the user (operator) can conveniently perform comparison. It should be noted that, when one of the pictures (good picture or defective picture) is operated, for example, enlarged, reduced or dragged, the other picture will perform the same operation, so that the two pictures always display the same area at the same time, thereby facilitating the comparison of each detail by the user, as shown in fig. 8.

And S106, calculating the third picture and the fourth picture according to a preset picture defect judgment standard to obtain calculation result data and a condition judgment result.

As shown in fig. 9, the calculation result and the condition determination result include, but are not limited to: good picture calculation result data (upper left), defective picture calculation result data (upper right), difference values of two pieces of picture data (lower right), images corresponding to defective picture data (lower left and right), defect information (lower left middle), and a position adjustment tool for data display (lower left side).

In the present embodiment, the data display position adjustment can be performed by double-clicking the 2 images of fig. 7 or by the position adjustment tool of the data display of fig. 9, thereby realizing the function of quickly viewing the data of the specific position. In addition, clicking any data cell in fig. 9, the data in the corresponding positions of the three data frames will be selected (which is convenient for quick corresponding viewing), and the defect information window in fig. 9 will also display the position information and defect information of the current data cell.

And S107, adjusting the picture defect judging standard according to the calculation result data and the condition judging result.

Specifically, according to the display result of fig. 9, the threshold value, the defect type, the size standard and the defect number can be set for each different partition in real time (fig. 10). The adjustment is completed, a new test result can be rapidly calculated and analyzed, so that corresponding parameters meeting detection requirements can be rapidly found, and rapid setting of the parameters is completed.

According to the method, the first picture and the second picture to be processed are firstly obtained, then the first picture and the second picture are subjected to partition processing according to the preset partition rule to obtain the third picture and the fourth picture, and finally the third picture and the fourth picture are displayed at the same time, so that an operator can conveniently and intuitively compare differences of the two pictures (such as a good picture and a defect picture).

Based on the same inventive concept, the application also provides a picture processing device. As shown in fig. 11, the picture processing apparatus includes:

a setting unit 10, configured to set a partition rule and a partition parameter of the partition; the partitioning rule comprises the steps of listing areas of a product, which are not required to be detected, as one partition, setting different surface areas of the product as different partitions, and setting different edge areas of the product as different partitions;

an acquiring unit 11, configured to acquire a first picture and a second picture to be processed, a defect type, a defect size standard, and a defect number;

the setting unit 10 is further configured to set the partition parameter, the acquired defect type, the defect size standard, and the defect number as the picture defect determination standard;

the partition unit 12 is configured to partition the first picture and the second picture according to a preset partition rule, so as to obtain a third picture and a fourth picture;

a display unit 13, configured to display the third picture and the fourth picture so that a user performs comparison;

a calculating unit 14, configured to calculate the third picture and the fourth picture according to a preset picture defect determining standard, so as to obtain calculation result data and a condition determining result;

and an adjusting unit 15, configured to adjust the picture defect determination criterion according to the calculation result data and the condition determination result.

Optionally, another embodiment of the present application further provides a picture processing device. As shown in fig. 12, the picture processing apparatus may include: one or more processors 101, one or more input devices 102, one or more output devices 103, and a memory 104, the processors 101, input devices 102, output devices 103, and memory 104 being interconnected by a bus 105. The memory 104 is used for storing a computer program comprising program instructions, which the processor 101 is configured to invoke for performing the method of the above-described method embodiment part.

It should be appreciated that in embodiments of the present application, the processor 101 may be a central processing unit (Central Processing Unit, CPU), which may also be other general purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (Application Specific Integrated Circuit, ASIC), off-the-shelf programmable gate arrays (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, or the like. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The input device 102 may include a keyboard or the like, and the output device 103 may include a display (LCD or the like), a speaker or the like.

The memory 104 may include read only memory and random access memory and provides instructions and data to the processor 101. A portion of the memory 104 may also include non-volatile random access memory. For example, the memory 104 may also store information of device type.

In a specific implementation, the processor 101, the input device 102, and the output device 103 described in the embodiments of the present application may execute the implementation described in the embodiments of the method for processing a picture provided in the embodiments of the present application, which is not described herein again.

From the above description, it can be seen that the image processing device provided by the embodiment of the application completely combines the advantages of visual and software detection, and can enable an engineer to perform image partition processing, image detail display, image defect type and size determination and parameter adjustment on image defect determination standards.

Further, the embodiments of the present application also provide a readable storage medium storing a computer program, the computer program comprising program instructions that when executed by a processor implement: the picture processing method.

The computer readable storage medium may be an internal storage unit of the system according to any of the foregoing embodiments, for example, a hard disk or a memory of the system. The computer readable storage medium may also be an external storage device of the system, such as a plug-in hard disk, a Smart Media Card (SMC), a Secure Digital (SD) Card, a Flash memory Card (Flash Card) or the like, which are provided on the system. Further, the computer readable storage medium may also include both internal storage units and external storage devices of the system. The computer readable storage medium is used to store the computer program and other programs and data required by the system. The computer-readable storage medium may also be used to temporarily store data that has been output or is to be output.

Those of ordinary skill in the art will appreciate that the elements and algorithm steps described in connection with the embodiments disclosed herein may be embodied in electronic hardware, in computer software, or in a combination of the two, and that the elements and steps of the examples have been generally described in terms of function in the foregoing description to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.

In the several embodiments provided in this application, it should be understood that the disclosed apparatus and method may be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative, e.g., the division of the units is merely a logical function division, and there may be additional divisions when actually implemented, e.g., multiple units or components may be combined or integrated into another system, or some features may be omitted or not performed. In addition, the coupling or direct coupling or communication connection shown or discussed with each other may be an indirect coupling or communication connection via some interfaces, devices, or elements, or may be an electrical, mechanical, or other form of connection.

The units described as separate units may or may not be physically separate, and units shown as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units may be selected according to actual needs to achieve the purposes of the embodiments of the present application.

In addition, each functional unit in each embodiment of the present application may be integrated in one processing unit, or each unit may exist alone physically, or two or more units may be integrated in one unit. The integrated units may be implemented in hardware or in software functional units.

The integrated units, if implemented in the form of software functional units and sold or used as stand-alone products, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present application is essentially or a part contributing to the prior art, or all or part of the technical solution may be embodied in the form of a software product stored in a storage medium, comprising several instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to perform all or part of the steps of the method described in the embodiments of the present application. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a random access Memory (RAM, random Access Memory), a magnetic disk, or an optical disk, or other various media capable of storing program codes.

While the invention has been described with reference to certain preferred embodiments, it will be understood by those skilled in the art that various changes and substitutions of equivalents may be made and equivalents will be apparent to those skilled in the art without departing from the scope of the invention. Therefore, the protection scope of the present application shall be subject to the protection scope of the claims.

Claims

1. A picture processing method, comprising:

setting partition rules and partition parameters of the partitions; the partitioning rule comprises the steps of independently listing areas of a product, which are not required to be detected, as one partition, setting different surface areas of the product as different partitions, and setting different edges of the product as different partitions;

acquiring a first picture and a second picture to be processed; the first picture refers to a good picture, and the second picture refers to a defective picture;

obtaining defect types, defect size standards and defect numbers;

taking the partition parameters, the acquired defect types, the defect size standards and the defect number as picture defect judging standards;

displaying the third picture and the fourth picture so as to enable a user to conduct comparison;

calculating the third picture and the fourth picture according to a preset picture defect judgment standard to obtain and display calculation result data and a condition judgment result; the calculation result data and the condition determination result include: good picture calculation result data, defect picture calculation result data, difference values of two pieces of picture data, corresponding images of the defect picture data, defect information and a position adjustment tool for data display;

and double-clicking the position adjustment tools for displaying the third picture and the fourth picture or the data to adjust the data display position so as to realize the function of quickly looking up the data at the specific position.

2. The picture processing method according to claim 1, wherein after obtaining the result data, the method further comprises:

3. A picture processing apparatus, characterized by comprising:

the setting unit is used for setting partition rules and partition parameters of the partitions; the partitioning rule comprises the steps of independently listing areas of a product, which are not required to be detected, as one partition, setting different surface areas of the product as different partitions, and setting different edges of the product as different partitions;

the acquisition unit is used for acquiring a first picture and a second picture to be processed; the first picture refers to a good picture, and the second picture refers to a defective picture;

the setting unit is further used for setting the partition parameters, the acquired defect types, the defect size standards and the defect number as picture defect judging standards;

the display unit is used for displaying the third picture and the fourth picture so as to enable a user to conduct comparison;

the calculating unit is used for calculating the third picture and the fourth picture according to a preset picture defect judging standard so as to obtain calculation result data and a condition judging result; the calculation result data and the condition determination result include: good picture calculation result data, defect picture calculation result data, difference values of two pieces of picture data, corresponding images of the defect picture data, defect information and a position adjustment tool for data display; and double-clicking the position adjustment tools for displaying the third picture and the fourth picture or the data to adjust the data display position so as to realize the function of quickly looking up the data at the specific position.

4. A picture processing device as claimed in claim 3, wherein the device further comprises:

5. A picture processing apparatus comprising a processor, an input device, an output device and a memory, the processor, the input device, the output device and the memory being interconnected, wherein the memory is adapted to store a computer program comprising program instructions, the processor being configured to invoke the program instructions to perform the method of claim 2.

6. A computer readable storage medium, characterized in that the computer readable storage medium stores a computer program comprising program instructions which, when executed by a processor, cause the processor to perform the method of claim 2.