CN112634334B - Ultra-high dynamic projection display method and system based on fusion pixel modulation - Google Patents

Abstract

The invention belongs to the field of semi-physical simulation testing and is used for projection display of high dynamic simulation scene images. Aiming at the problem of binary grayscale modulation of DMD devices, as the dynamic range of projected simulation scene images increases, the number of bit plane decompositions increases, and the overall frame rate becomes lower. An ultra-high dynamic projection display method based on fusion pixel modulation is proposed. and system; the method includes setting the PWM timing; acquiring a high dynamic image; decomposing the high dynamic image into a ternary bit plane to obtain a ternary image; projecting the ternary image sequentially according to the PWM timing; The superimposed display of the projected ternary image can realize the projection display of the high dynamic simulation scene image. In this case, the binary bit plane of the high dynamic image acquired by the DMD is decomposed and converted into a ternary system. Through the change of the binary system, the number of decomposed bit planes is reduced, and the time for modulating the gray information of a frame of high dynamic image is significantly shortened, so that Projection frame rate increased compared to binary.

Description

Ultra-high dynamic projection display method and system based on fusion pixel modulation

technical field

The invention belongs to the field of hardware-in-the-loop simulation testing, in particular to an ultra-high dynamic projection display method and system based on fusion pixel modulation.

Background technique

High-Dynamic Range (HDR) projection display, compared with ordinary projection display, can provide more dynamic range and image details, and can better reflect the visual effect in the real environment, so as to meet high-performance Hardware-in-the-loop simulation testing requirements for imaging devices.

During the hardware-in-the-loop simulation test, the scene generation device is used to generate the simulation scene image, which determines the main performance indicators of the system, such as frame frequency, dynamic range, resolution, and working band. Compared with other scene generation devices, Digital Micromirror Device (DMD) has the advantages of higher spatial resolution, better image uniformity, stronger contrast, etc., and due to the reflective working characteristics, as long as the windows match, That is, it can be used to generate simulation scene images in any band, so the simulation scene projection system with DMD is usually used in the field to project and display the simulation scene images.

At present, the simulated scene projection system with DMD usually uses Pulse Width Modulation (PWM) technology to generate a pseudo-grayscale image within the detector integration time of the imaging system to be tested by using the "visual residual characteristic". The time for modulating a frame of grayscale image is related to the number of bit-plane decompositions and the base time t _0. The larger the dynamic range of the projected image, the more the number of bit-plane decompositions, the longer the time for modulating a frame of grayscale image, and the lower the frame rate. Low. At present, the general DMD-type simulation scene projection system can only project 8-bit grayscale images at a frame rate below 100Hz, which seriously restricts the application and development of the DMD-type simulation scene projection system. The backwardness of test equipment also greatly increases the high-performance imaging system. development and testing costs.

The domestic research on the simulation scene projection system focuses on the design of the optical system with a single DMD as the scene generation device, and realizes the mixed projection of multiple working bands by introducing a static interference target source. This solution is limited by the traditional PWM technology of DMD devices, and the parameters such as the frame rate and dynamic range of the simulated scene image are relatively low.

Therefore, solving the contradiction between the frame rate and dynamic range of DMD traditional PWM technology and improving the gray modulation efficiency will become the key factors to promote the development of the simulation scene projection system at this stage, and the effective ultra-high dynamic projection display method should become the focus of future research. focus. The existing DMD-type ultra-high dynamic projection display scheme is still improved on the basis of the PWM technology of a single DMD, and there are the following problems: (1) the improved PWM timing method, the modulation process is complicated, and the stability is poor; (2) the frame grayscale modulation method , the dynamic range of the projected image is limited; (3) the micro-mirror splicing plane modulation method sacrifices the resolution of the projected image, etc.; (4) the gray-scale wheel modulation method, the frame rate of the projected image is insufficient.

Contents of the invention

The present invention provides an ultra-high dynamic projection display method and system based on fused pixel modulation to solve the problem that in the prior art, when a DMD device is used for projection display, the larger the dynamic range of the projected image, the more the number of bit plane decompositions, and the modulation of one frame The longer the grayscale image is, the lower the frame rate is, that is, the frame rate and dynamic range are mutually restricted.

The basic scheme of the present invention is: an ultra-high dynamic projection display method based on fused pixel modulation, including:

Set PWM timing;

Acquire high dynamic images;

Decompose the ternary bit plane on the high dynamic image to obtain the ternary image;

The ternary image is sequentially projected according to the PWM timing.

The principle and beneficial effects of the basic scheme are as follows: In this scheme, the binary decomposition of the high dynamic image obtained by DMD is converted into ternary, and the number of decomposed bit planes is reduced by changing the binary system, so that the modulation of one frame of high dynamic The time of the grayscale information of the image is shortened, so that the projection frame rate is significantly improved compared with the binary system. Compared with the existing technology, the high frame rate projection of the high dynamic image can be realized under the premise of ensuring the image resolution, and reliable Performance and stability have been further enhanced.

Further, the setting PWM timing includes:

Add idle time in the two time intervals from bitplane 0 to bitplane 2, so that the display time of all previous bitplane images is longer than the loading time of the latter bitplane.

Beneficial effects: In traditional PWM modulation, when the data of the bit plane is loaded, the DMD will flip all the micromirrors in a global manner, and the base time is defined as the data loading time of 30.72 μs. After the micromirror completes a flip, it needs at least 8μs holding time. At this time, the micromirror can already display the corresponding image. If 8μs is used as the base time, because the display time of bit plane 0 and bit plane 1 is too short, it cannot be displayed in the current position. When the screen is displayed, the loading of the next plane is completed.

In this solution, free time is added in the two time intervals from bit plane 0 to bit plane 2 to ensure that the display time of all previous bit plane images is greater than the loading time of the latter bit plane, thereby reducing the base time from the original 30.72 μs Compression is 8μs.

Further, the said adding idle time in the two time intervals from bit plane 0 to bit plane 2 is through the "block clear" operation in the DMD control.

Further, the high dynamic image is decomposed into a ternary bit plane to obtain a ternary image, including:

Extracting the gray value of each pixel in the high dynamic image, converting the high dynamic image into a digital image matrix, the gray value of each pixel in the digital image matrix is decimal;

Convert the gray value of each pixel in the digital image matrix from decimal to ternary to form a ternary matrix;

All effective bit data of each pixel ternary gray value in the ternary matrix is extracted to form a new bit plane image, and the bit plane image is a frame of ternary image.

Beneficial effects: In this solution, the high dynamic image is decomposed by ternary system, and one high dynamic image is converted into multiple ternary bit plane images. Compared with the prior art that directly uses binary to decompose the high dynamic image, the number of bit plane images converted from the same high dynamic image in the present application is less. That is, the number of bit planes obtained by ternary decomposition is smaller than the number of bit planes obtained by binary decomposition in the prior art. In this way, the number of bit planes for high dynamic images is greatly reduced, and the gray modulation efficiency of each frame of high dynamic images is improved. .

Further, the ternary image is sequentially projected according to the PWM timing, including:

Use the frame decomposition algorithm to decompose each frame of ternary image into two binary images;

The two binary images are respectively sent to the two registered DMDs, and the pixels of the two registered DMDs are fused.

Beneficial effects: in this scheme, the display of the ternary image is formed by superimposing the two binary images through two DMD projections, and the structure is simple and easy to realize.

Further, the frame decomposition algorithm is used to decompose each frame of the ternary image into two binary images, specifically:

Obtain the gray value of the pixel in the ternary image, and decompose the gray value into two binary values;

The binary values split by different pixels are formed into two binary matrices, and the two binary matrices correspond to two binary images; the superposition of two binary values corresponding to pixels at the same position in the two binary matrices can obtain the The ternary system corresponds to the gray value of the pixel.

Further, the registration process of the two DMDs is:

Two DMDs respectively project two identical checkerboard templates;

Adjust the position of a DMD so that the two checkerboard images approximately coincide on the image plane of the imaging device;

Based on the checkerboard at the top corner position, through the image registration verification algorithm, the position of the above DMD is fine-tuned so that the two checkerboards are completely coincident.

Beneficial effects: In this scheme, two identical checkerboards are used as projection templates, and the setting of the checkerboards is convenient for staff to register; the DMD is fine-tuned based on the position of the top corner to improve the accuracy of DMD adjustment; During the calibration process, the two checkerboards are completely overlapped, which means that the pixels of the two DMDs are completely fused. After the DMDs are registered, the projections of the two DMDs are completely overlapped, and the pixels at the corresponding positions are fused into a basic unit. Each basic unit has three states to realize the display of the ternary image.

Further, projecting the ternary image sequentially according to the PWM timing also includes:

The incident light is modulated, and the spatial layout of the optical system is adjusted to reduce the diffraction effect caused by stray light during display.

Beneficial effects: In this solution, after the registration of the two DMDs is completed, when the DMD modulates the incident light, by adjusting the spatial layout of the optical system, it is ensured that the projection of the two DMDs on the ternary image is not affected by stray light. Improve the stability of grayscale modulation.

The present invention also provides an ultra-high dynamic projection display system based on fusion pixel modulation, the system includes an image acquisition module, a timing input module, an image modulation module and a DMD projection module;

The image generation module is used to obtain high dynamic images;

The timing input module is used to set the PWM timing and input;

The image modulation module is used to decompose the high dynamic image into a ternary bit plane and convert it into a ternary image;

The DMD projection module is used to display the ternary image.

The system also includes an image decomposition module, a DMD receiving module, a DMD storage module, a DMD control module, a DMD projection module and a DMD registration module;

The image decomposition module is used to decompose the ternary image generated by the image modulation module into two binary images, and in the two binary matrices corresponding to the two binary images, the two pixels corresponding to the same position Binary value superposition can obtain the gray value corresponding to the pixel of the ternary image;

The DMD receiving module is used to receive the binary image sent by the image decomposition module, and send the binary image to the DMD storage module;

The DMD storage module is used to store the PWM timing input by the timing input module and the binary image sent by the DMD receiving module;

The DMD control module is used to control the DMD projection module to project the binary image sequentially according to the PWM timing in the DMD storage module;

The DMD registration module is used for registering two DMD projection modules, so as to ensure pixel fusion in an image formed by projection when the two DMD projection modules project the same image.

Description of drawings

FIG. 1 is a flow chart of the ultra-high dynamic projection display method based on fused pixel modulation provided by the first embodiment of the present invention;

Figure 2(a) is a timing diagram of a traditional PWM timing;

Fig. 2(b) is a timing schematic diagram of PWM timing in Fig. 1;

Fig. 3 is the specific implementation flowchart of S3 in Fig. 1;

Fig. 4 is a schematic diagram of ternary bit plane decomposition for high dynamic images in Fig. 3;

Fig. 5 is the specific implementation flowchart of S4 in Fig. 1;

Fig. 6 is the schematic diagram of S4-1 and S4-2 in Fig. 5;

FIG. 7 is a block diagram of an ultra-high dynamic projection display system based on fusion pixel modulation provided by the second embodiment of the present invention.

Detailed ways

Further detailed explanation through specific implementation mode below:

In order to make the purpose, technical solutions and advantages of the embodiments of the present invention more clear, various implementation modes of the present invention will be described in detail below in conjunction with the accompanying drawings. However, those of ordinary skill in the art can understand that, in each implementation manner of the present invention, many technical details are provided for readers to better understand the present application. However, even without these technical details and various changes and modifications based on the following implementation modes, the technical solution claimed in this application can also be realized.

First implementation mode:

This embodiment provides an ultra-high dynamic projection display method based on fused pixel modulation. As shown in FIG. 1 , the method includes: S1, setting PWM timing; S2, acquiring high dynamic images; The bit plane is decomposed to obtain a ternary image; S4 projects the ternary image sequentially according to the PWM timing. The execution of S1 and S2 does not have a sequence relationship, but it is necessary to ensure that S2 is executed first and then S3 and S4 are executed, and S1 is executed before S4.

For example, a high dynamic image is an 8bit image. In the prior art, binary is used to decompose high-dynamic images. In this way, 8 binary bit planes are obtained after binary bit-plane decomposition of 8-bit images; in this embodiment, high-dynamic images are decomposed using ternary system, so that The 8bit image is decomposed into ternary planes to obtain 6 ternary planes. This means that when the base time is the same, the time for modulating an 8-bit image in this embodiment is shortened by 75%. That is to say, in this solution, the high dynamic image acquired by DMD is decomposed into binary bit plane and converted into ternary system. The time for high-resolution information is shortened, so that the projection frame rate is significantly improved compared with the binary system. Compared with the existing technology, it can realize the high frame rate projection of high-dynamic images under the premise of ensuring the image resolution, and at the same time, it is reliable and stable. Sexuality is further enhanced.

The following is a specific description of the implementation details of the ultra-high dynamic projection display method based on fusion pixel modulation in this embodiment. The following content is only the implementation details provided for easy understanding, and is not necessary to implement this solution. The specific flow of this embodiment is shown in the figure 1.

S1, set the PWM timing through the timing input module, and input the PWM timing to the DMD storage modules in the two registered DMDs.

Specifically, through the "block clear" operation in the DMD control, add free time in the two time intervals from bit plane 0 to bit plane 2, so that the display time of all previous bit plane images is longer than the loading of the latter bit plane time.

As shown in Figure 2, in Figure 2, 30.72 μs is the data loading time of the DMD chip, 8 μs is the holding time after the global micromirror is flipped, and 5 μs is the time-consuming process of the micromirror flip (this process can neither display nor load data) .

As shown in Figure 2(a), in traditional PWM modulation, when the data of the bit plane is loaded, the DMD will flip all the micromirrors globally, and the base time is defined as the data loading time of 30.72 μs. After the micromirror completes a flip, it needs at least 8μs holding time. At this time, the micromirror can already display the corresponding image. If 8μs is used as the base time, because the display time of bit plane 0 and bit plane 1 is too short, it cannot be displayed in the current position. When the screen is displayed, the loading of the next plane is completed.

As shown in Figure 2(b), this program uses FPGA to program PWM timing, and uses the "block clear" operation in DMD control to add free time in the two time intervals between bit plane 0 and bit plane 2 to ensure that all The display time of the former bit-plane image is longer than the loading time of the latter bit-plane, so the base time t ₀ is compressed from the original 30.72 μs to 8 μs. After the PWM timing is optimized, 10 bit planes can be displayed within 8309.28μs according to the display duration of different bit planes (2 ⁰ t ₀ , 2 ¹ t ₀ , 2 ² t ₀ ...2 ⁹ t ₀ ), and the corresponding The frame frequency is 120Hz, which can meet the test requirements of most high-performance imaging systems.

S2, acquiring a high dynamic image.

Specifically, in this embodiment, the high dynamic image is generated by relevant scene modeling software according to the requirements of the hardware-in-the-loop simulation test.

S3, performing ternary bit-plane decomposition on the high dynamic image to obtain a ternary image. The implementation of S3, as shown in Figure 3, includes the following steps:

S3-1, extracting the gray value of each pixel in the high dynamic image, converting the high dynamic image into a digital image matrix, the gray value of each pixel in the digital image matrix is decimal;

S3-2, converting the gray value of each pixel in the digital image matrix from decimal to ternary to form a ternary matrix;

S3-3, extracting all valid bit data of each pixel ternary gray value in the ternary matrix to form a new bit plane image, where the bit plane image is a frame of ternary image.

Specifically, taking the high dynamic image in Figure 4(a) as an example, there are 1024 pixels in the horizontal direction and 768 pixels in the vertical direction in Figure 4(a), the high dynamic image is an 8bit image, and the The information is 8bit.

Through step S3-1, extract the grayscale in the high dynamic image Figure 4 (a), and use the decimal system to represent the grayscale of each pixel, thereby forming the digital image matrix of Figure 4 (b), the digital image matrix In 4(b), there are 1024 values in the horizontal direction and 768 values in the vertical direction. The number of values corresponds to the number of pixels one by one, and each value corresponds to the decimal gray value of the pixel in Figure 4(a).

Through steps 3-2, convert the gray value of each pixel in the digital image matrix Figure 4(b) from decimal to ternary, such as converting the gray value 244 (decimal) in Figure 4(b) to 100110 (ternary), thereby obtaining the ternary matrix figure 4 (c), the difference between the ternary matrix figure 4 (c) and the digital image matrix figure 4 (b) is that the actual values of the corresponding pixels are the same, and the shown The bases are different.

Through steps 3-3, the ternary matrix image 4(c) is split into multiple ternary images. In Figure 4(c), the ternary value corresponding to each pixel has six valid bit data, step 3-3 splits Figure 4 into six ternary images in sequence according to the valid bit data of the pixel, these six The ternary images are bit plane 0, bit plane 2, bit plane 3, bit plane 4, and bit plane 5. Figure 4(d) is the bit-plane matrix corresponding to the ternary image of bit-plane 0 split in Figure 4(c), and Figure 4(e) is the ternary image of bit-plane 3 split in Figure 4(c). The bit-plane matrix corresponding to the binary image, FIG. 4(f) is the bit-plane matrix corresponding to the ternary image of the bit-plane 5 split in FIG. 4(c).

Therefore, through step S3, the original 8-bit high dynamic image is transformed into ternary images of 6 ternary bit planes, and each ternary image is 1 frame of image.

S4, sequentially projecting ternary images according to the PWM timing. The process is shown in Figure 5, including:

S4-1. Obtain the gray value of the pixel in the ternary image, and decompose the gray value into two binary values.

In Fig. 6, Fig. 6 (a) is the bit plane matrix corresponding to the ternary image of bit plane 0 decomposed in the above step S3-3, in this matrix, the value of each pixel is 0, 1, 2 Any gray value of , through step S4-1, the ternary gray value is decomposed into two binary values, that is, 0 (ternary) is decomposed into 0 (binary) and 0 (binary), 1 ( Ternary) is disassembled into 1 (binary) and 0 (binary), and 2 (ternary) is disassembled into 1 (binary) and 1 (binary).

S4-2, the binary values split by different pixels are formed into two binary matrices, and the two binary matrices are used as two binary images; the two binary values corresponding to the pixels at the same position in the two binary matrices Superposition can obtain the gray value corresponding to the pixel in the ternary system.

As shown in Figure 6, the ternary value of each pixel in Figure 6(a) is disassembled into two binary values, and the larger binary value disassembled from a single pixel is combined into a new binary matrix as shown in the figure 6(b), combine the smaller binary value of a single pixel into a new binary matrix as shown in Figure 6(c), to ensure that the pixels at the same position in the binary matrix Figure 6(b) and Figure 6(c) The gray value corresponding to the pixel in the ternary image matrix Figure 6(a) can be obtained by superimposing the corresponding two binary values.

Among them, the way of dismantling the two binary values of the same pixel ternary value into two binary matrices is not limited to the above-mentioned "dismantling the ternary value of a single pixel into a binary value and combining Into a new binary matrix" method, there are other combinations, only need to meet the superposition of two binary values corresponding to the pixel at the same position in the disassembled two binary matrices can get the ternary corresponding The gray value of the above pixel is enough.

S4-3, sending the binary images corresponding to the two binary matrices to the DMD receiving modules in the two registered DMDs respectively;

S4-4, the DMD receiving module sends the binary image received by itself to the DMD storage module for storage;

S4-5, the DMD control module controls the DMD projection module to sequentially display the binary images in the DMD storage module according to the PWM timing stored in the DMD storage module.

In this embodiment, the image decomposition module executes steps S4-1 and S4-2, and sends two binary images to two DMDs respectively, and each DMD includes a DMD receiving module, a DMD storage module, a DMD control module, and a DMD projection module and DMD registration module. In order to show the distinction, two DMDs are distinguished, respectively denoted as DMD-1 and DMD-2. After registration, the projections of DMD-1 and DMD-2 are on the same target surface. DMD-1 and DMD- 2 When projecting two binary images obtained by splitting the same ternary image, the projection of DMD-1 on the target surface completely coincides with the projection of DMD-2 on the target surface, and in S4-3, S4-4 and During the implementation of step S4-5, DMD-1 and DMD-2 perform synchronous control.

In S4-3, the image decomposition module sends the binary image represented by Fig. 6 (b) and Fig. 6 (c), then the binary image represented by Fig. 6 (b) will be sent to the DMD receiving module in DMD-1 , send the binary image represented by Fig. 6(c) to the DMD receiving module in DMD-2. Since the structure and process of displaying binary images in DMD-1 and DMD-2 are the same, in order to avoid repetition, only the working process and structure of DMD-1 are described in the embodiment of the present application.

There are two kinds of information stored in the DMD storage module in DMD-1, namely: the binary image received by the DMD receiving module and the PWM timing input by the timing input module. In the DMD projection module in DMD-1, there are micromirrors arranged in a periodic array, and each micromirror has two states of "on" and "off", corresponding to "1" and "0" in binary respectively. DMD In the DMD control module in -1, the binary image is sequentially read from the storage module according to the PWM timing, each binary image corresponds to the micromirrors arranged in the array, and each pixel in the binary image corresponds to one of the DMD projection modules Micromirror; if the pixel in the binary image is "1", the DMD control module controls the micromirror corresponding to the pixel to appear in the "on" state; if the pixel in the binary image is "0", the DMD control module controls the micromirror corresponding to the pixel to appear Out of the "off" state.

To sum up, in this embodiment, the high dynamic image is first decomposed into bit planes to obtain ternary bit plane images, and then each ternary bit plane is decomposed into frames in order from high bit to low bit to obtain two Binary images and uploaded to DMD-1 and DMD-2 respectively. The illumination light source (the prior art is not described in this application) is connected with the illumination optical system (the prior art, this application is not described) to continuously and evenly illuminate the target surfaces of the two DMDs, and each DMD controls the incident light beam according to the uploaded binary image. Perform spatial light modulation, that is, change the switch of each micromirror in the micromirror array used for spatial light modulation in the DMD projection module to generate image light with binary image information, which is projected on the target surface; through two The superposition of the binary image results in the ternary image light.

The overlapping of the two binary image lights can be realized in the following way: the two DMD projection modules both send the binary image light into the optical beam combiner, and the optical beam combiner combines the two binary image lights and projects them out from the projection optical system, and Superimposed at the exit pupil of the projection optical system to form image light with ternary bit plane information, and realize projection of ternary images. The DMD control module ensures the projection synchronization of each DMD, and controls the working time period of the DMD projection module according to the PWM sequence, so as to ensure that the embodiment can project ternary images sequentially according to the PWM sequence.

Therefore, in order to ensure that "two binary images are superimposed to obtain ternary image light", this embodiment also performs registration before the use of the two DMDs. The registration scheme of the two DMDs is as follows:

S5-1, two DMDs respectively project two identical checkerboard templates;

S5-2, adjust the position of a DMD so that the two images of the checkerboard approximately coincide on the image surface of the imaging device; take the checkerboard at the top corner position as the reference, and fine-tune the position of the above-mentioned DMD through the image registration verification algorithm, so that The two checkerboards are completely coincident;

Two identical checkerboards are used as projection templates, and the setting of the checkerboards is convenient for the staff to register; the DMD is fine-tuned based on the position of the top corner to improve the accuracy of DMD registration; the two checkerboards in the process of DMD registration Complete coincidence represents the complete fusion of the pixels of the two DMDs. After the DMDs are registered, the projections of the two DMDs are completely overlapped, and the pixels at the corresponding positions are fused into a basic unit. Each basic unit has three states to realize the display of the ternary image.

After the registration of the two DMDs is completed, the embodiment also modulates the incident light and adjusts the spatial layout of the optical system to reduce stray light generated by the diffraction effect during display. The process is: construct a diffraction model according to two different micromirror states and the actual incident direction of the illumination beam to analyze the energy distribution characteristics of the diffraction field, so as to avoid the diffraction energy in the flat state and off state from entering the projection optical system to form stray light.

The step division of the above various methods is only for the sake of clarity of description. During implementation, it can be combined into one step or some steps can be split and decomposed into multiple steps. As long as they include the same logical relationship, they are all within the scope of protection of this patent. ; Adding insignificant modifications or introducing insignificant designs to the algorithm or process, but not changing the core design of the algorithm and process are all within the scope of protection of this patent.

The second embodiment of the present invention relates to an ultra-high dynamic projection display system based on fusion pixel modulation. As shown in FIG. 7, the system includes an image generation input client, a server, and two DMDs; the image generation input client It includes a timing input client and an image generation module; the server includes an image modulation module and an image decomposition module; the DMD includes a DMD receiving module, a DMD storage module, a DMD control module, a DMD projection module and a DMD registration module.

The timing input module adopts FPGA, which is used to optimize and adjust the PWM timing, and send the PWM timing to the DMD memory modules of the two DMDs;

The image generation module adopts relevant simulation software to construct high dynamic images for different hardware-in-the-loop simulation test scenarios, and is used to generate high dynamic images;

The image modulation module is used to decompose the high dynamic image into a ternary bit plane and convert it into a ternary image;

The image decomposition module is used to decompose the ternary image generated by the image modulation module into two binary images, and send the two binary images to two DMDs respectively; the two binary images corresponding to the two binary images In the matrix, superposition of two binary values corresponding to pixels at the same position can obtain the gray value of the ternary image corresponding to the pixel;

The DMD receiving module is used to receive the binary image sent by the image decomposition module, and sends the binary image to the DMD storage module; the DMD storage module is used to store the PWM timing input by the timing input module, and the DMD receiving module the sent binary image;

The DMD control module is used to control the DMD projection module to project the binary image sequentially according to the PWM timing in the DMD storage module;

The DMD registration module is used for registering two DMD projection modules, so as to ensure pixel fusion in an image formed by projection when the two DMD projection modules project the same image.

It is not difficult to find that this embodiment is a system embodiment corresponding to the first embodiment, and this embodiment can be implemented in cooperation with the first embodiment. The relevant technical details mentioned in the first embodiment are still valid in this embodiment, and will not be repeated here to reduce repetition. Correspondingly, the relevant technical details mentioned in this implementation manner can also be applied in the first implementation manner.

It is worth mentioning that all the modules involved in this embodiment are logical modules. In practical applications, a logical unit can be a physical unit, or a part of a physical unit, or multiple physical units. Combination of units. In addition, in order to highlight the innovative part of the present invention, units that are not closely related to solving the technical problems proposed by the present invention are not introduced in this embodiment, but this does not mean that there are no other units in this embodiment.

What is described above is only an embodiment of the present invention, and the common knowledge such as the specific structure and characteristics known in the scheme is not described too much here, and those of ordinary skill in the art know all the common knowledge in the technical field to which the invention belongs before the filing date or the priority date Technical knowledge, being able to know all the existing technologies in this field, and having the ability to apply conventional experimental methods before this date, those of ordinary skill in the art can improve and implement this plan based on their own abilities under the inspiration given by this application, Some typical known structures or known methods should not be obstacles for those of ordinary skill in the art to implement the present application. It should be pointed out that for those skilled in the art, under the premise of not departing from the structure of the present invention, some modifications and improvements can also be made, which should also be regarded as the protection scope of the present invention, and these will not affect the implementation of the present invention. Effects and utility of patents. The scope of protection required by this application shall be based on the content of the claims, and the specific implementation methods and other records in the specification may be used to interpret the content of the claims.

Claims (4)

1. The ultrahigh dynamic projection display method based on the fused pixel modulation is characterized by comprising the following steps of:

setting a PWM time sequence;

acquiring a high dynamic image;

performing ternary bit plane decomposition on the high-dynamic image to obtain a ternary image;

sequentially projecting the ternary images according to the PWM time sequence;

the setting PWM timing includes:

programming a PWM time sequence; adding spare time in two time intervals from the bit plane 0 to the bit plane 2, so that the display time of all the images of the front bit plane is longer than the loading time of the next bit plane;

the free time is added in two time intervals from the bit plane 0 to the bit plane 2, and the free time is added through a block clearing operation in DMD control;

the performing ternary bit plane decomposition on the high dynamic image to obtain a ternary image comprises the following steps:

converting the high dynamic image into a digital image matrix, wherein the gray value of each pixel in the digital image matrix is decimal;

converting the gray value of each pixel from decimal to ternary, and converting the digital image matrix into ternary matrix;

extracting all valid bit data of the ternary gray values of all pixels in the ternary matrix to form a new bit plane image, wherein the bit plane image is a frame of ternary image;

the sequentially projecting the ternary images according to the PWM time sequence comprises the following steps:

decomposing each frame of ternary image into two binary images by adopting a frame decomposition algorithm;

the two binary images are respectively sent to two DMDs which are registered, and pixels between the two DMDs are fused;

the method comprises the steps of decomposing each frame of ternary image into two binary images by adopting a frame decomposition algorithm, wherein the method comprises the following steps of:

acquiring gray values of pixel points in a ternary image, and disassembling the gray values into two binary values;

the binary values split by different pixel points are formed into two binary matrixes, and the two binary matrixes correspond to two binary images; the gray value of the pixel point corresponding to the ternary system can be obtained by superposing two binary values corresponding to the pixels at the same position in the two binary matrixes;

the process of registering the two DMDs is as follows:

the two DMDs respectively project two identical checkerboard templates;

adjusting the position of one DMD so that two checkerboard images are approximately overlapped on the image surface of the imaging device;

and fine-tuning the positions of the DMDs by taking the top angle position checkers as references through an image registration verification algorithm, so that the two checkers are completely overlapped.

2. The ultra-high dynamic projection display method based on fused pixel modulation according to claim 1, wherein sequentially projecting the ternary images according to the PWM timing sequence comprises:

the incident light is modulated, and the spatial layout of the optical system is adjusted to reduce diffraction effect generated by stray light during display.

3. Ultra-high dynamic projection display system based on fused pixel modulation, its characterized in that: the system comprises an image acquisition module, a time sequence input module, an image modulation module and a DMD projection module;

the image generation module is used for acquiring a high-dynamic image;

the time sequence input module is used for setting PWM time sequence and inputting;

the image modulation module is used for carrying out ternary bit plane decomposition on the high-dynamic image and converting the high-dynamic image into a ternary image;

the DMD projection module is used for displaying the ternary image;

wherein, the setting PWM timing includes: programming a PWM time sequence; adding spare time in two time intervals from the bit plane 0 to the bit plane 2, so that the display time of all the images of the front bit plane is longer than the loading time of the next bit plane;

the free time is added in two time intervals from the bit plane 0 to the bit plane 2, and the free time is added through a block clearing operation in DMD control;

performing ternary bit plane decomposition on the high-dynamic image to obtain a ternary image, wherein the ternary image comprises the following steps:

converting the high dynamic image into a digital image matrix, wherein the gray value of each pixel in the digital image matrix is decimal;

converting the gray value of each pixel from decimal to ternary, and converting the digital image matrix into ternary matrix;

extracting all valid bit data of the ternary gray values of all pixels in the ternary matrix to form a new bit plane image, wherein the bit plane image is a frame of ternary image;

sequentially projecting the ternary images according to the PWM time sequence, wherein the method comprises the following steps of:

decomposing each frame of ternary image into two binary images by adopting a frame decomposition algorithm;

the two binary images are respectively sent to two DMDs which are registered, and pixels between the two DMDs are fused;

the method comprises the steps of decomposing each frame of ternary image into two binary images by adopting a frame decomposition algorithm, wherein the method comprises the following steps of:

acquiring gray values of pixel points in a ternary image, and disassembling the gray values into two binary values;

the binary values split by different pixel points are formed into two binary matrixes, and the two binary matrixes correspond to two binary images; the gray value of the pixel point corresponding to the ternary system can be obtained by superposing two binary values corresponding to the pixels at the same position in the two binary matrixes;

the process of registering the two DMDs is as follows:

the two DMDs respectively project two identical checkerboard templates;

adjusting the position of one DMD so that two checkerboard images are approximately overlapped on the image surface of the imaging device;

and fine-tuning the positions of the DMDs by taking the top angle position checkers as references through an image registration verification algorithm, so that the two checkers are completely overlapped.

4. The ultra-high dynamic projection display system based on fused pixel modulation of claim 3, wherein: the system also comprises an image decomposition module, a DMD receiving module, a DMD storage module, a DMD control module, a DMD projection module and a DMD registering module;

the image decomposition module is used for decomposing the ternary image generated by the image modulation module into two binary images, and in the two binary matrixes corresponding to the two binary images, the gray values corresponding to the pixels at the same position can be obtained by superposing the two binary values corresponding to the pixels at the same position;

the DMD receiving module is used for receiving the binary image sent by the image decomposition module and sending the binary image to the DMD storage module;

the DMD storage module is used for storing the PWM time sequence input by the time sequence input module and the binary image sent by the DMD receiving module;

the DMD control module is used for controlling the DMD projection module to sequentially project binary images according to PWM time sequences in the DMD storage module;

the DMD registration module is used for registering the two DMD projection modules so as to ensure that pixels in an image formed by projection are fused when the two DMD projection modules project the same image.