Summary of the invention
The object of the present invention is to provide one conveniently infrared thermometer Data Analysis Services platform and method thereof, carry out efficiently, accurately analyzing to the infrared measurement of temperature image that infrared thermometer sends, and system upgrade, parameter adjustment and function control can be carried out to infrared thermometer.
The technical solution realizing the object of the invention is: a kind of infrared thermometer Data Analysis Services platform, comprise CPU (central processing unit), and memory module, man machine operation interface, the interface module to be connected with this CPU (central processing unit), electric power system is connected with the power input of CPU (central processing unit), man machine operation interface, memory module, wherein:
CPU (central processing unit) is made up of ARM chip: chip internal is provided with data processing and control module, and this module realizes image analysis processing and system maintenance;
Memory module comprises program execution module and data memory module: program execution module comprises SDRAM and DDR2SDRAM, data memory module comprises SRAM and FLASH, and the data-interface of SDRAM, DDR2SDRAM, SRAM, FLASH is connected with the data-interface of ARM chip by data line, address interface is connected with the address interface of ARM chip by address wire, control interface is connected by the control interface of control line with ARM chip; Temperature Scaling curve is had in memory module;
Man machine operation interface comprises TFTLCD touch-screen and button: TFTLCD touch-screen is connected with the touch screen interface of ARM chip, and button is connected with the keystroke interface of ARM chip, sends calculation process signal by TFTLCD touch-screen and button to ARM chip;
Interface module comprises video interface, serial line interface, network transport interface and SD memory card interface: video interface receives the IR video stream of infrared thermometer; Serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer; Network transport interface receives the transmitted data on network of infrared thermometer; Video data in SD memory card interface reception SD storage card or infrared picture data;
Transmitted control signal by the TFTLCD touch-screen of man machine operation interface or the button ARM chip to CPU (central processing unit), control ARM chip by video interface receive infrared thermometer IR video stream, received by network transport interface infrared thermometer transmitted data on network or receive video data in SD storage card or infrared picture data by SD memory card interface; The ARM chip of CPU (central processing unit) memory module auxiliary under, analyzing and processing is carried out to the IR video stream received or infrared picture data, and the result of analyzing and processing is sent to the display of TFTLCD touch-screen by touch screen interface; Serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer.
A kind of infrared thermometer data analysis processing method, comprise image analysis processing and system maintenance, concrete steps are as follows:
Step 1, transmitted control signal by the TFTLCD touch-screen of man machine operation interface or the button ARM chip to CPU (central processing unit), control ARM chip by video interface receive infrared thermometer IR video stream, received by network transport interface infrared thermometer transmitted data on network or receive video data in SD storage card or infrared picture data by SD memory card interface;
Step 2, the ARM chip of CPU (central processing unit) memory module auxiliary under, image analysis processing is carried out to the IR video stream received or infrared picture data, and the result of image analysis processing is sent to the display of TFTLCD touch-screen by touch screen interface;
Step 3, serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer.
Compared with prior art, the present invention has following distinguishing feature:
(1) this analysis of image data processing platform is the miniaturization parametric controller of a portable infrared picture data treatment and analysis, as the matching component of general infrared thermometer, has volume equally little, lightweight, the feature be convenient for carrying;
(2) this system take ARM as hardware structure, interface is touched as man-machine friendship using TFTLCD touch-screen, there is low-power consumption, advantage that flying power is strong, system can pass through video port, serial line interface, network interface are directly connected with infrared thermometer, also can read the infrared picture data of preserving in infrared thermometer by SD storage card;
(3) for the limitation of infrared thermometer data-handling capacity, this platform can carry out more complicated image real time transfer, can provide the Temperature Distribution field pattern of a two field picture or continuous multiple frames image, user can select interested region to carry out analyzing and processing as required voluntarily;
(4) native system can be arranged by serial line interface as the product maintenance platform of infrared thermometer, the performance parameter of adjustment infrared thermometer, also can realize the upgrade function of infrared thermometer internal processing program;
(5) this platform is mainly used in the Data Analysis Services of general hand-held infrared thermometer, but function is not restricted to general hand-held infrared thermometer, also may be used for other forms of thermometric product, in this platform, the Temperature Scaling curve of image procossing can be revised according to demand by user;
(6) treated data message can be stored in SD card memory in the mode of image, video or word by this platform, this platform provides various video, image to store format transformation, H.264 or AVI form video data can be stored as MPEG-4, view data can be stored as BMP, JPEG or tiff format.
Embodiment
Below in conjunction with drawings and the specific embodiments, the present invention is described in further details.
Infrared thermometer Data Analysis Services platform of the present invention, a holonomic system containing Hardware Design and data processing and control, the annexation of itself and infrared thermometer as shown in Figure 1: infrared thermometer Data Analysis Services platform and infrared thermometer mainly contain three kinds of connecting interfaces: serial line interface, video interface (PAL, VGA) and network transport interface.Infrared thermometer Data Analysis Services platform receives the vision signal meeting pal mode standard or USB interface standard from infrared thermometer by video interface.Infrared thermometer Data Analysis Services platform sends serial ports control command bag by serial line interface to infrared thermometer, in order to change the running parameter of infrared thermometer inside, as pseudo-color coding mode, the setting of alarm temperature threshold value, Temperature Scaling parameter of curve; Infrared thermometer Data Analysis Services platform also can send a large amount of binary data by serial line interface to infrared thermometer, completes the renewal of infrared thermometer system core process and FPGA hardware program, updating operation.When carrying out mass data transmission, such as 640*512 infrared eye, PAL-system and USB interface agreement have been difficult to the real-time process ensureing signal, and now video flowing can be transmitted by Internet Transmission mouth.
Composition graphs 2, infrared thermometer Data Analysis Services platform of the present invention, comprise CPU (central processing unit), and memory module, man machine operation interface, the interface module to be connected with this CPU (central processing unit), electric power system is connected with the power input of CPU (central processing unit), man machine operation interface, memory module, wherein:
(1) CPU (central processing unit) is made up of ARM chip: chip internal is provided with data processing and control module, and this module realizes image analysis processing and system maintenance two parts function;
Composition graphs 3, described data processing and control module comprises data processing control units, and the infrared image half-tone information sub module stored to be connected with this data processing control units, temperature information sub module stored, mean information sub module stored, blind element information sub module stored, temperature curve rendering submodule, Image Coding submodule, video format conversion submodule, described temperature curve rendering submodule comprises 2D temperature curve drafting module, 3D temperature curve drafting module and color-grading Drawing of Curve module: wherein infrared image half-tone information sub module stored, temperature information sub module stored, mean information sub module stored, blind element information sub module stored, temperature curve rendering submodule is analyzed the IR video stream received or infrared picture data, Image Coding submodule completes image format conversion, video format conversion submodule completes video format conversion.
Described data processing and control module also comprises that the nonuniformity correction be connected with data processing control units controls submodule, pseudo-color coding model selection submodule, alarm temperature threshold value arrange submodule and system upgrade submodule, described system upgrade submodule comprises data format conversion module and upgrade file sending module: wherein nonuniformity correction controls submodule through the core processing module transmission single point correction order of serial line interface to infrared thermometer, and the single point correction module starting infrared thermometer carries out Nonuniformity Correction to infrared image; Pseudo-color coding model selection submodule sends pseudo-color coding Mode selection instructions through serial line interface to infrared thermometer, selects corresponding iris coding module, heavy metal look coding module or perceptual color space coding module to carry out pseudo-color coding process; Alarm temperature threshold value arranges submodule, sends alarm temperature threshold value setting command, upgrade the raw alarm temperature threshold in infrared thermometer through serial line interface to infrared thermometer; System upgrade submodule, the FPGA file transform that wherein data format conversion module will be upgraded becomes FLASH file layout, by serial line interface, system upgrade data are sent in the core processing module of infrared thermometer by upgrade file sending module again, the system upgrade data received write in EPCS chip by the core processing module of infrared thermometer, complete the system upgrade of infrared thermometer.
(2) memory module comprises program execution module and data memory module: program execution module comprises SDRAM and DDR2SDRAM, data memory module comprises SRAM and FLASH, and the data-interface of SDRAM, DDR2SDRAM, SRAM, FLASH is connected with the data-interface of ARM chip by data line, address interface is connected with the address interface of ARM chip by address wire, control interface is connected by the control interface of control line with ARM chip; Temperature Scaling curve is had in memory module.
(3) man machine operation interface comprises TFTLCD touch-screen and button: TFTLCD touch-screen is connected with the touch screen interface of ARM chip, and button is connected with the keystroke interface of ARM chip, sends calculation process signal by TFTLCD touch-screen and button to ARM chip; Described TFTLCD touch-screen is provided with the icon corresponding with each submodule in data processing and control module, controls to select each submodule to realize corresponding function by the icon touched on TFTLCD touch-screen.
(4) interface module comprises video interface, serial line interface, network transport interface and SD memory card interface: video interface receives the IR video stream of infrared thermometer; Serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer; Network transport interface receives the transmitted data on network of infrared thermometer; Video data in SD memory card interface reception SD storage card or infrared picture data.Serial line interface, video interface, network transport interface are all that directly the functional interface corresponding with on ARM chip connects, and connect as long as directly distribute according to the definition of ARM chip interface when design.
The course of work of described infrared thermometer Data Analysis Services platform is: transmitted control signal by the TFTLCD touch-screen of man machine operation interface or the button ARM chip to CPU (central processing unit), control ARM chip by video interface receive infrared thermometer IR video stream, received by network transport interface infrared thermometer transmitted data on network or receive video data in SD storage card or infrared picture data by SD memory card interface; The ARM chip of CPU (central processing unit) memory module auxiliary under, analyzing and processing is carried out to the IR video stream received or infrared picture data, and the result of analyzing and processing is sent to the display of TFTLCD touch-screen by touch screen interface; Serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer.
Composition graphs 4, infrared thermometer data analysis processing method of the present invention, comprise image analysis processing and system maintenance, concrete steps are as follows:
Step 1, transmitted control signal by the TFTLCD touch-screen of man machine operation interface or the button ARM chip to CPU (central processing unit), control ARM chip by video interface receive infrared thermometer IR video stream, received by network transport interface infrared thermometer transmitted data on network or receive video data in SD storage card or infrared picture data by SD memory card interface;
Step 2, the ARM chip of CPU (central processing unit) memory module auxiliary under, image analysis processing is carried out to the IR video stream received or infrared picture data, and the result of image analysis processing is sent to the display of TFTLCD touch-screen by touch screen interface; Described image analysis processing comprises analysis of image data, video data analysis, image format conversion and video format conversion:
(2.1) analysis of image data
Analysis of image data comprises computed image each point temperature information and drawing image temperature distribution history, as follows respectively:
1. computed image each point temperature information
Read the infrared picture data of RAW form in SD storage card to data processing and control module, according to the Temperature Scaling curve in memory module, convert the pixel value of the infrared image be input in data processing and control module to temperature value, obtain image each point temperature information, and show on the screen of TFTLCD touch-screen.
SD storage card is designed with in infrared thermometer, the infrared image that user needs to record can be stored at any time, infrared image in SD storage card has jpeg format and RAW form two kinds: RAW form infrared picture data to refer to the original infrared picture data that infrared thermometer gathers, and has only done the process of the simple image such as nonuniformity correction, histogram equalization by infrared thermometer; Jpeg format image makes Pseudo-color technology by the processor of thermal infrared imager to original infrared image and compresses generation, it remains with the temperature information of present image thermal self-restraint stress.The RAW form infrared picture data that what the Data Analysis Services platform of infrared thermometer read is in SD storage card, RAW form infrared picture data directly will enter data processing and control module.Data processing and control module is connected with capacitive touch screen by touch sensing parts, and user can be mutual with data processing and control module by touch-screen.
2. drawing image temperature distribution history
By TFTLCD touch-screen Selection and call temperature curve rendering submodule, data processing and control module is drawn out 2D thetagram, 3D thetagram or color-grading curve map according to the infrared image half-tone information stored in the corresponding submodule of infrared image, temperature information, mean information, blind element information, and is shown on the screen of TFTLCD touch-screen.
User also can touch and choose certain point, and be initial end points with this point, screen marks a curve, the path extraction that data processing and control module can be selected according to user goes out all pixels, and find out the temperature information of all pixels on this path, and show.
(2.2) video data analysis
Video data process in real time video data process or SD storage card is carried out in selection, if carry out real time video data process, selects by video interface or network transport interface reading video data; Reading video data is to data processing and control module, according to the Temperature Scaling curve in memory module, convert the pixel value of the video data be input in data processing and control module to temperature value, obtain the temperature information of real time video data, and show on the screen of TFTLCD touch-screen;
If process video data existing in SD storage card, first data processing and control module reads the video data in SD card by the data/address line of SD card, move in program execution module by the video data in SD card; User just can be operated by touch-screen, connected by touch sensing device between touch-screen and data processing and control module, each processing capacity of data processing module all exists with form of icons on the touchscreen, and user can check the interested image information of user such as temperature distribution history, this two field picture histogram information, this two field picture gray average of half-tone information on video, this two field picture frame by frame by touching icon; User also can select some frame video image data continuously or as required, the Temperature Distribution value choosing data is added up by data processing and control module, draw out corresponding 2D or 3D curve: take pixel value as horizontal ordinate, with temperature value corresponding to pixel value for ordinate, the 2D curve of image Temperature Distribution can be drawn out; With the positional information of pixel for x, y coordinate, with temperature value corresponding to pixel for z coordinate, the 3D curve of image Temperature Distribution can be drawn out.Drawing of Curve module used herein is identical with the mode of infrared thermometer Data Analysis Services platform to the analyzing and processing of view data.
(2.3) image format conversion
By TFTLCD touch-screen Selection and call Image Coding submodule, added in infrared image by process information and again preserve, image compression encoding mode adopts jpeg image compression standard, realizes infrared image and is converted to TIFF or BMP form.
For original infrared image, after a series of Data Analysis Services, again preserve in order to process information is added in infrared image, Image Coding submodule is devised in data processing and control module, the jpeg image compression standard that image compression encoding mode adopts jpeg image motion expert group to propose, and support that infrared image saves as the extended formattings such as TIFF, BMP.
(2.4) video format conversion
By TFTLCD touch-screen Selection and call video format conversion submodule, be provided with the coded system of corresponding video form in video format conversion submodule, video capable format conversion is MPEG-4 or AVI form.
Because original infrared video has the shortcoming that data volume is not easy to greatly storage, therefore the compression process of video will be carried out to the IR video stream gathering preservation, various video format converting module is comprised in data processing and control module, the coded system of corresponding video form is designed with in format converting module, specific coding mode, referring to corresponding video standard converter, supports that video format conversion is the format videos such as MPEG-4, AVI.
Step 3, serial line interface sends serial ports control command bag to infrared thermometer, carries out system maintenance to infrared thermometer.Described system maintenance comprises nonuniformity correction control, pseudo-color coding model selection, the setting of alarm temperature threshold value and system upgrade:
(3.1) nonuniformity correction controls
Submodule is controlled by TFTLCD touch-screen Selection and call nonuniformity correction, through the core processing module transmission single point correction order of serial line interface to infrared thermometer, after single point correction order received by infrared thermometer, the single point correction module starting infrared thermometer carries out Nonuniformity Correction to infrared image.
After system works long hours, or after the working environment of system changes, the focal plane detection actuator temperature of infrared thermometer also can change thereupon, because infrared eye relies on the temperature difference to carry out imaging, the instability of temperature can bring the heterogeneity on image, thus has influence on temperature measurement accuracy.By nonuniformity correction command control module, Nonuniformity Correction is carried out to infrared image, effectively can reduce the temperature measurement accuracy decline that temperature variation causes.
(3.2) pseudo-color coding model selection
By TFTLCD touch-screen Selection and call pseudo-color coding model selection submodule, pseudo-color coding Mode selection instructions is sent to infrared thermometer through serial line interface, after pseudo-color coding Mode selection instructions received by infrared thermometer, corresponding iris coding module, heavy metal look coding module or perceptual color space coding module is selected to carry out pseudo-color coding process;
Different coloud coding modules has different adaptability to different observed objects, and user switches 3 kinds of different pseudo-color coding modules to find the Pseudo-color technology mode of the most applicable current scene by sending control command.
(3.3) alarm temperature threshold value is arranged
Submodule is set by TFTLCD touch-screen Selection and call alarm temperature threshold value, sends alarm temperature threshold value setting command through serial line interface to infrared thermometer, upgrade the raw alarm temperature threshold in infrared thermometer;
When infrared thermometer detects temperature higher than a certain fixed value time, the temperature alarming module of infrared thermometer will send a high level signal to hummer, outwardly reports to the police.This fixed value be set in advance in temperature alarming module can be modified according to actual needs by user.Because the equipment of stress test in each thermometric process is different, their alarm temperature threshold value is closely not identical yet, and therefore tester can revise alarm threshold value easily by this function, improves or reduces alarm response sensitivity.
(3.4) system upgrade
By TFTLCD touch-screen Selection and call system upgrade submodule, wherein the FPGA file that will upgrade of data format conversion module and SOF file become the file layout stored in FLASH file layout and EPCS chip with ELF file transform, by serial line interface, system upgrade data are sent in the core processing module of infrared thermometer by upgrade file sending module again, the system upgrade data received write in EPCS chip by the core processing module of infrared thermometer, complete the system upgrade of infrared thermometer.
Embodiment 1
Infrared thermometer Data Analysis Services platform of the present invention, touch-screen used adopts capacitive touch screen, touch-screen is made up of touch sensing parts and touch screen controller ADS7843, touch sensing parts are arranged on before LCD liquid crystal display, for detecting user touch location, user's touch information is sent to ADS7843 controller, and convert contact coordinate to, give ARM process chip, ARM process chip includes touch-screen control interface, it can directly be connected with touch modules, according to the touch information received, carries out computing and process to signal.For different infrared thermometers, due to the difference of different infrared eyes, therefore also can there are some differences in Temperature Scaling curve accordingly.Better compatibility is had in order to make this platform, the Temperature Scaling curve computing formula of multiple different model as the infrared eye of the common civilian model of U.S. Tau series, French ULIS series is stored in advance in this platform, it is exactly a look-up table that these computing formula are stored in data processing platform (DPP): for each gray-scale value, corresponding storage temperature value.Approx, we can simulate a curve according to the corresponding relation of this gray scale-temperature, as the Temperature Scaling curve of this system.This platform is when processing different infrared images, concrete calibration curve formula also can by user's self-defining: user can input a series of gray-scale value and corresponding temperature value by touch screen in data processing platform (DPP), these values are generally by carrying out blackbody calibration acquisition to detector, and in general the parameter information of calibration curve is kept in the redundant information of infrared image.
Composition graphs 5 ~ 8, for a secondary infrared image, uses described infrared thermometer Data Analysis Services platform to draw the temperature distribution history of this image, comprises color-grading curve, 2D temperature curve and 3D temperature curve, and be presented in touch screen:
Fig. 5 is the original-gray image of infrared image, according to image intensity value, system, according to Temperature Scaling curve look-up table, finds the temperature value that each pixel of image is corresponding, in order to enable the Temperature Distribution field of human eye direct feel image, system needs intuitively to reflect image Temperature Distribution to graphically;
Fig. 6 is color-grading curve map, and the temperature value of image is become colored R, G, B value, according to temperature direction from low to high, is transferred to warm tones transition from cool colour, and human eye can according to the change of the change direct feel temperature of colour;
Fig. 7 is 2D thetagram, take gray-scale value as horizontal ordinate, and temperature value is ordinate, draws a temperature distribution history, and when user chooses certain some gray scale on image, the temperature spot of its correspondence will highlighted display on 2D temperature curve;
Fig. 8 is 3D thetagram, is x, y coordinate figure with image pixel positions, is z coordinate value, draws out 3 dimensional drawing by system with temperature value, and user can by touching the visual angle of rotated three dimensional stereographic map.
The kernel processor chip of infrared thermometer is the fpga chip of altera corp, and various hardware algorithm processing module all realizes in fpga chip, and the boot of fpga chip is stored in EPCS chip.Upgrade, change the hardware handles algorithm of infrared thermometer, be in fact exactly the boot rewriteeing fpga chip.General altera corp can provide special downloader to upgrade FPGA program for user, but the more new interface needing design fixing, use extra download device, inconvenience very, and can not upgrade a large amount of system simultaneously.The file that the present invention directly will be upgraded by serial line interface writes in EPCS chip.
In sum, the invention provides the infrared thermometer Data Analysis Services platform of a complete function, infrared thermometer collection can be processed and be stored in infrared image in storage card and SD card, also can directly receive view data from infrared thermometer by the mode of wire communication or wireless transmission; Meanwhile, the present invention have developed a set of powerful, special for infrared measurement of temperature data, practical data processing control methods, can carry out comprehensive, deep data analysis to the infrared image stored in the storage card of infrared thermometer; The present invention also can be used as the later maintenance platform that main process chip is the infrared thermometer of fpga chip, by the parameter information in serial line interface renewal, adjustment infrared thermometer, has important using value.