WO2022052921A1 - Projection system and projected image correction method - Google Patents

Abstract

Disclosed are a projection system and a projected image correction method, which belong to the field of projection display, and are used for automatically correcting a projected image in real time.

Description

Projection system and correction method of projected image

CROSS-REFERENCE TO RELATED APPLICATIONS

The present disclosure claims the priority of a Chinese patent application with an application number of 202010936549.7 and an invention titled Projection System filed with the Chinese Patent Office on September 8, 2020, the entire contents of which are incorporated herein by reference.

technical field

The present disclosure relates to the field of projection display, and in particular, to a projection system and a method for calibrating projection images.

Background technique

The projection system may include a projection device, a projection screen and a remote control for projecting and displaying the first projection image onto the projection screen. When the first projected image is deformed, if the projection device receives a correction instruction sent by the user through the remote controller, the projection device will project and display a second projected image, where the second projected image includes feature points. After that, after receiving the adjustment instruction for the feature point sent by the user through the remote control, the projection device can adjust the position of the feature point according to the adjustment instruction until the feature point is located in the projection screen, and the second projected image The size is the standard size. After that, after receiving the display instruction sent by the user through the remote control, the projection device can adjust the position of the pixels in the first projected image according to the moving distance of the feature points during the process of projecting and displaying the first projected image, so that the The first projected image is located in the projection screen, and the size of the first projected image is a standard size.

However, since the user is required to manually correct the first projected image through the remote controller, the efficiency of correcting the first projected image is low.

SUMMARY OF THE INVENTION

The embodiments of the present disclosure provide a projection system and a method for calibrating a projection image, and the technical solutions are as follows:

A projection system includes projection equipment, an infrared camera and a projection screen, the projection equipment includes: a control circuit, a projection light source, an infrared light source, a light modulation component and a projection lens;

The projection light source is used to generate three primary colors of light;

The light modulation component is used to modulate the primary color light of each color into a first image beam according to the first image to be displayed, and transmit the first image beam to the projection lens and project the first projection image on the projection screen;

The infrared light source is used for emitting infrared light, and the light modulation component is also used for modulating the infrared light into a second image beam, transmitting the second image beam to the projection lens and projecting on the projection screen to form a second projection image;

The infrared camera is used for capturing the second projection image to obtain the first captured image, and sending the first captured image to the control circuit;

The control circuit is further configured to determine correction data according to the first captured image and the standard image, and the correction data is used to correct the first projection image;

Wherein, a frame image display period of the first image to be displayed includes a lighting period of the infrared light source.

In another aspect, a method for correcting a projected image is provided, which is applied to a projection device in a projection system, the projection system further comprising: an infrared camera and a projection screen, the projection device comprising: a projection light source and an infrared light source; The methods described include:

The projection light source emits three primary colors of light, and the infrared light source emits infrared light, wherein the lighting period of the infrared light source overlaps the lighting period of one primary color light, or each display period includes the lighting of the infrared light source. the lighting period and the lighting period of the primary color light, and the lighting period of the infrared light source is different from the lighting period of any primary color light;

The light modulation component modulates the primary color light of each color into a first image beam, and transmits the first image beam to the projection lens to display a first projection image on a projection screen; and, converts the infrared modulating light into a second image beam, and projecting the second image beam to the projection screen to display the second projection image on the projection screen;

The control circuit receives the first captured image sent by the infrared camera for the second projection image, and compares it with a standard image to generate correction data;

Correct the display of the first projected image.

In another aspect, a control circuit is provided, comprising: a memory, a processor, and a computer program stored on the memory, the processor implements the method for calibrating a projected image according to the above aspect when the processor executes the computer program in the method performed by the control circuit.

Description of drawings

In order to illustrate the technical solutions in the embodiments of the present disclosure more clearly, the following briefly introduces the accompanying drawings used in the description of the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure. For those of ordinary skill in the art, other drawings can also be obtained from these drawings without creative effort.

FIG. 1 is a schematic structural diagram of a projection system provided by an embodiment of the present disclosure;

2 is a schematic structural diagram of another projection system provided by an embodiment of the present disclosure;

3 is a schematic diagram of projecting and displaying a first projection image on a projection screen by a projection device provided by an embodiment of the present disclosure;

4 is a schematic diagram of projecting and displaying a second projection image on a projection screen by a projection device provided by an embodiment of the present disclosure;

5 is a schematic structural diagram of another projection system provided by an embodiment of the present disclosure;

FIG. 6 is a schematic diagram of displaying one frame of a second projected image every 60 frames of a first projected image by a projection device provided by an embodiment of the present disclosure;

Fig. 7-1 is a kind of projection device that the embodiment of the present disclosure provides projecting and displays a frame of the first projection image and a schematic diagram of the second projection image within a target duration;

7-2 is another schematic diagram of a projection device projecting and displaying a frame of a first projection image and a frame of a second projection image within a target duration according to an embodiment of the present disclosure;

FIG. 8 is a schematic structural diagram of still another projection system provided by an embodiment of the present disclosure;

FIG. 9 is a schematic diagram of displaying one frame of a second projected image every 60 frames of a first projected image by another projection device provided by an embodiment of the present disclosure;

10 is a schematic diagram of another projection device according to an embodiment of the present disclosure projecting and displaying a frame of a first projection image and a frame of a second projection image within a target duration;

11 is a schematic diagram of deformation of a first projection image provided by an embodiment of the present disclosure;

FIG. 12 is a flowchart of another deformation of the first projection image provided by an embodiment of the present disclosure;

FIG. 13 is a flowchart of yet another deformation of the first projection image provided by an embodiment of the present disclosure;

FIG. 14 is a flowchart of still another first projection image deformation provided by an embodiment of the present disclosure;

15-1 is a flowchart of a method for correcting a first projection image provided by an embodiment of the present disclosure;

15-2 is a flowchart of still another method for correcting a first projection image provided by an embodiment of the present disclosure;

16 is a flowchart of another method for correcting a first projection image provided by an embodiment of the present disclosure;

FIG. 17 is a flowchart of still another method for correcting a first projection image provided by an embodiment of the present disclosure;

FIG. 18 is a flowchart of still another first projection image correction method provided by an embodiment of the present disclosure.

detailed description

In order to make the objectives, technical solutions and advantages of the present disclosure clearer, the embodiments of the present disclosure will be further described in detail below with reference to the accompanying drawings.

FIG. 1 is a schematic structural diagram of a projection system provided by an embodiment of the present disclosure. As shown in FIG. 1 , the projection system may include a projection device 10 , an infrared camera 20 and a projection screen 30 .

FIG. 2 is a schematic structural diagram of another projection system provided by an embodiment of the present disclosure. Referring to FIG. 2 , the projection device 10 includes three projection light sources 101 of different colors, an infrared light source 102 a, a control circuit 103 , a light modulation component 104 and a projection lens 105 , wherein the projection light sources 101 of the three different colors may include a red light source 101 a , the blue light source 101b and the green light source 101c are both visible light sources, and are respectively used to generate red primary color light, blue primary color light, and green primary color light.

In a specific implementation, the projection device 10 may be a laser projection device, the red light source 101a may be a red laser, the blue light source 101b may be a blue laser, and the green light source 101c may be a green laser. For example, the projection device 10 may be a laser projection television set or a laser projector. Alternatively, the projection device 10 may be a light emitting diode (LED) projection device, the red light source 101a may be a red LED, the blue light source 101b may be a blue LED, and the green light source 101c may be a green LED.

And, in the projection system, an infrared light source 102a is further included for emitting infrared light, and the infrared light source 102a can be an infrared laser or an LED.

Referring to FIG. 2, the light modulation component 104 is used to modulate the primary color light of each color into a first image light beam according to the first image to be displayed, and transmit the first image light beam to the projection lens 105, and the projection lens 105 is used to The first image beam is projected onto the projection screen 30 , as shown in FIG. 3 , to display the first projection image 40 on the projection screen 30 . The first projection image 40 is an image formed by the projection of the visible light beam and can be observed by the user. The first image to be displayed can be directly output through the TV signal board, or obtained by processing the video image signal on the display panel of the projection system. The first image to be displayed can be decomposed into three primary color component sub-images of R, G, and B, and each component sub-image is composed of It is composed of different grayscale values and is used to specifically drive the primary color light of the corresponding color of the light modulation component to modulate.

It should be noted that the first projection image 40 here is not limited to the current projection image, and may also be the visible light projection image to be displayed in the next frame or frames.

In addition, the light modulation component 104 is also used for modulating the infrared light into a second image beam, and transmitting the second image beam to the projection lens 105, and the projection lens 105 is used for projecting the second image beam to the projection screen 30 for projection The screen 30 displays the second projected image 50 . The second projected image 50 is an image formed by infrared light projection, which is invisible to the user.

The shapes of the first projection image 40 , the second projection image 50 and the projection screen 30 may all be polygons, for example, may be rectangles. In a specific implementation, the sizes of the first projection image 40 and the second projection image 50 are the same, and the sizes of the first projection image 40 and the second projection image 50 are both smaller than or equal to the size of the projection screen 30 .

Referring to FIG. 4 , the second projected image 50 may include one or more feature patterns 51 . The shape of the feature pattern 51 can be a circle or a polygon. For example, referring to FIG. 4 , the second projection image 50 includes a plurality of feature patterns 51 , and each feature pattern 51 is in the shape of a cross.

Referring to FIG. 2 and FIG. 4 , the infrared camera 20 can be used to capture the second projection image 50 to obtain a first captured image 60 , and send the first captured image 60 to the control circuit 103 . In one embodiment, the shape of the first captured image 60 may be a quadrilateral, for example, a rectangle. The shooting range of the infrared camera 20 is larger than the projection range of the projection device 10 , so that it can be ensured that the infrared camera 20 can shoot the second projection image 50 . Correspondingly, the size of the first captured image 60 is larger than the size of the projection screen 30 .

In some embodiments of the present disclosure, the infrared camera 20 may be fixedly disposed on the projection device 10 . In some embodiments, the infrared camera 20 is located on the side of the projection device 10 close to the projection screen 30 , that is, the infrared camera 20 is located on the light-emitting side of the projection device 10 . In this implementation manner, if the projection device 10 is an ultra-short-focus projection device, the lens of the infrared camera 20 may be an ultra-wide-angle lens. If the projection device is a mid-telephoto projection device, the lens of the infrared camera 20 may be a mid-telephoto lens.

In some embodiments of the present disclosure, the infrared camera 20 need not be disposed on the projection device 10 , for example, the infrared camera 20 may be located on a support plane for supporting the projection device 10 . In this implementation, if the distance between the infrared camera 20 and the projection screen 30 is relatively short, the lens of the infrared camera 20 may be an ultra-wide-angle lens. If the distance between the infrared camera 20 and the projection screen 30 is relatively far, the lens of the infrared camera 20 may be a medium telephoto lens. The embodiment of the present disclosure does not limit the installation position of the infrared camera 20 and the lens of the infrared camera, as long as the infrared camera 20 can capture the second projection image 50 .

Referring to FIG. 2 , the control circuit 103 is configured to determine correction data according to the relative position of the feature pattern 51 in the first captured image 60 and the feature pattern in the standard image, and the correction data is used to correct the first projection image, specifically, is Applying the correction data to the correction of the image to be displayed in the subsequent frame of the current first projection image can correct the projection position of the first projection image 40 that subsequently provides illumination light beams through the three projection light sources 101 of different colors.

It should be noted that the above-mentioned display period of one frame of the first image to be displayed is the decomposition of R, G, and B according to the first image to be displayed, and the three primary colors of R, G, and B determined by the system display white balance. duration or proportion.

In the above-mentioned process of realizing the first projected image 40 and the second projected image 50 , the image display period of one frame of the first image to be displayed includes the lighting period of the infrared light source.

In a specific implementation, the lighting period of the infrared light source does not overlap with the lighting period of any primary color light.

The lighting period of the infrared light source does not overlap with the lighting period of the blue primary color light, the red primary color light, and the green primary color light of the first image to be displayed, and the lighting period of the infrared light source is the same as that used to display the first image to be displayed. The durations of the three primary color lights are used together to form an image period of one frame.

Or, in a specific implementation, the lighting period of the infrared light source overlaps with the lighting period of one of the red primary color light, the blue primary color light, and the green primary color light, for example, it can overlap all or part of the time period. . The lighting duration of the infrared light source may be shorter than the lighting duration of the primary color light.

And, the above-mentioned standard image is the second projected image 50 projected and displayed on the projection screen 30, located in the projection screen 30, and when the size of the second projected image 50 is the initial size, the infrared camera 20 is the second projected image 50. 50 to capture an image obtained, at this time, the second projection image 50 displayed on the projection screen 30 is not deformed. The shape of the standard image and the first captured image 60 may be the same, for example, both may be rectangular. The size of the standard image and the first captured image 60 may also be the same. The standard image may be an image pre-stored in the projection device 10 , and the initial size is a fixed size pre-stored in the projection device 10 .

In some embodiments of the present disclosure, after receiving the first captured image 60 sent by the infrared camera 20 , the control circuit 103 can correct the characteristic pattern 51 in the first captured image 60 according to the relative position of the feature pattern in the standard image. The projection position of the first projection image projected by the three different-color projection light sources 101 until the second projection image 50 is located in the projection screen 30, and the size of the second projection image 50 is the initial size. The relative position can be represented by the number of pixels between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image.

In some embodiments, the feature pattern 51 may be a symmetrical pattern, and the center point of the feature pattern 51 may be the geometric center of the feature pattern 51 . For example, each of the feature patterns 51 may be a center-symmetric pattern, and the center point of the feature pattern 51 may be the center of symmetry of the center-symmetric pattern.

And, in the above correction process, correction data is generated by comparing the first captured image with the standard image, and the first projection image is corrected based on the correction data. Specifically, the correction data is used to correct the second image to be displayed. The light modulation component 104 is used to modulate the primary color light of each color emitted by the projection light source into a first image beam according to the second image to be displayed, and transmit the first image beam to the projection lens and project it on the projection screen A first projected image is formed. The first image to be displayed and the second image to be displayed are different image frames. Specifically, the second image to be displayed may be a subsequent frame image of the current projected image (corresponding to the first image to be displayed), such as the next frame, or several frames apart.

In addition, the image signal of the second image to be displayed on which the light modulation component 104 is based is a corrected image signal, so after projection, the correction effect on the visible light projection, that is, the first projected image can be reflected.

To sum up, the embodiments of the present disclosure provide a projection system, in which a projection device in the projection system can acquire a second projection image obtained by shooting a second projection image formed by an infrared camera projection of infrared light during the process of projecting a visible light image. A photographed image, and correction data can be obtained by comparing the first photographed image with the standard image, and the correction data is used to correct the first projection image formed by visible light projection. On the one hand, even if the projected image is distorted, manual correction by the user is not required, and the projection device can automatically correct the projection effect of the first projected image, which improves the efficiency of correcting the projection position of the first projected image.

Moreover, since the projection device projects the second projection image to the projection screen through the infrared light source during the normal viewing process of the user, the user does not see the first projection image displayed on the projection screen during the process of viewing the first projection image. Two projected images. Therefore, it is possible to avoid affecting the normal viewing of the first projected image, ensuring the continuity of viewing the first projected image by the user, and improving the user experience. At the same time, the real-time correction of the first projected image by the projection device during the process of displaying the first projected image is realized.

FIG. 5 is a schematic structural diagram of another projection system provided by an embodiment of the present disclosure. As shown in FIG. 5 , the light modulation component 104 may include a three-color light modulator 1040 . The red light source 101a, the blue light source 101b, the green light source 101c and the infrared light source 102a share a light modulation component.

In some embodiments, the red light source 101a, the blue light source 101b, and the green light source 101c sequentially output red primary color light, blue primary color light, and green primary color light. The control circuit 103 is used for sequentially turning on the red light source 101a, the blue light source 101b and the green light source 101c. Wherein, turning on sequentially refers to turning on only one light source at the same time. Moreover, the embodiments of the present disclosure do not limit the sequence of turning on the plurality of light sources. During the process of irradiating the three-color light modulator 1040 with the three primary color lights emitted by the red light source 101 a , the blue light source 101 b and the green light source 101 c sequentially. The control circuit 103 can control the three-color light modulator 1040 to modulate the three-primary color light into a first image beam according to the primary color gradation values of the pixels in the first projection image 40 , and transmit the first image beam to the projection lens 105 . The projection lens 105 projects the first image beam onto the projection screen 30 to realize the projection and display of the first projection image 40 on the projection screen 30 .

After that, the control circuit 103 can turn off the red light source 101a, the blue light source 101b and the green light source 101c, and turn on the infrared light source 102a. In the process of irradiating the infrared light emitted by the infrared light source 102a to the three-color light modulator 1040, the control circuit 103 can control the three-color light modulator 1040 to modulate the infrared light into a third color light according to the color level value of the pixel in the second projection image 50. Two image beams, and the second image beam is transmitted to the projection lens 105 . The projection lens 105 projects the first image beam onto the projection screen 30 to project the second projection image 50 onto the projection screen 30 .

Wherein, the display duration of one frame of the second projection image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, thereby ensuring that the infrared camera 20 can complete the second projection image 50 during the display process of the second projection image 50 . to obtain the first captured image 60 . Moreover, the display duration of the frame of the second projection image 50 may be less than or equal to the display duration of the frame of the first projection image 40 , thereby preventing the normal viewing of the first projection image from being affected.

In an embodiment of the present disclosure, the projection system may be a DLP projection system, and the three-color light modulator 1040 may be a reflective light valve for reflecting the light irradiated on its surface to the projection lens. The light valve may be a digital micromirror device (DMD), and a plurality of mirrors are integrated in the DMD, and each mirror corresponds to a pixel in the target image.

Alternatively, the three-color light modulator 1040 may also be a liquid crystal display panel (LCD), which is used for transmitting the light irradiated to its surface to the projection lens. The LCD integrates a plurality of liquid crystals, and each liquid crystal corresponds to a pixel in the target image.

Alternatively, the three-color light modulator 1040 may be a liquid crystal on silicon (LCOS) device for reflecting light impinging on its surface to the projection lens. The LCOS device is integrated with a plurality of liquid crystals, and each liquid crystal corresponds to a pixel in the target image.

The above-mentioned different light valve components correspond to different projection structures.

Wherein, the target image refers to the first projection image or the second projection image. The three primary color lights can be red primary color light, blue primary color light and green primary color light. The primary color level value may be a red green blue (red green blue, RGB) level value.

In the embodiment of the present disclosure, the control circuit 103 can project the N frames of the first projection image 40 to the projection screen 30 by controlling the red light source 101 a , the blue light source 101 b , the green light source 101 c and the three-color light modulator 1040 . The red light source 101a, the blue light source 101b and the green light source 101c are turned off, and the infrared light source 102a is turned on. After that, the control circuit 103 projects the M frames of the second projection image 50 onto the projection screen 30 by controlling the infrared light source 102 a and the three-color light modulator 1040 . Wherein, both N and M are positive integers greater than 0, and N may be greater than M.

Since the display duration of one frame of the second projection image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, the infrared camera 20 can capture any frame of the second projection image 50 in the M frames to obtain the first capture image 60. Afterwards, the infrared camera 20 can send the first captured image 60 to the control circuit 103 . The control circuit 103 may correct the projection positions of the N frames of the first projection images 40 displayed after the M frames of the second projection images according to the relative positions of the feature patterns 51 in the first captured image 60 and the standard images. That is, the control circuit 103 may, based on the first captured image 60 obtained by capturing any frame of the second projection image 50 in the M frames of the second projection image 50 , project the N frames of the first projection image displayed on the M frames of the second projection image 50 . The projection position of the image 40 is corrected, thereby realizing real-time correction of the projection position of the first projection image 40 .

In some embodiments, when the control circuit 103 projects and displays the second projection image 50 on the projection screen 30, the infrared camera 20 may be in the exposure state all the time, because the display duration of one frame of the second projection image 50 is greater than or equal to the infrared camera 20. The time required for the camera 20 to capture an image, therefore, the infrared camera 20 can send the first captured image 60 to the control circuit 103 after capturing each frame of the second projected image 50 to obtain the first captured image 60 . Since the infrared camera 20 only collects infrared light, when the projection device 10 projects and displays the first projection image 40 on the projection screen 30 , the infrared camera 20 does not capture the first projection image 40 .

Alternatively, the infrared camera 20 may be periodically in an exposure state. For example, the infrared camera 20 may be in the exposure state every N frames of the first projection image 40 for the display duration, so that the infrared camera 20 may capture the second projection image 50 displayed after the N frames of the first projection image 40, and The captured first captured image 60 is sent to the control circuit 103 .

Alternatively, the control circuit 103 may send a shooting instruction to the infrared camera 20 when the second projection image 50 is projected and displayed on the projection screen 30 through the infrared light source 102a and the three-color light modulator 1040, and the infrared camera 20 may receive the shooting instruction After being in the exposure state, the second projected image 50 displayed by projection is photographed to obtain a first photographed image 60 , and the first photographed image 60 is sent to the control circuit 103 .

Assuming that N is 60 and M is 1, the projection device 10 can display 1 frame of the second projection image every 60 frames of the first projection image, and based on the first captured image 60 captured by the 1 frame of the second projection image 40 The relative positions of the characteristic pattern and the characteristic pattern in the standard image are corrected for the projection positions of the 60 frames of the first projection images 40 projected and displayed after the one frame of the second projection image 50 . 5 and 6, the control circuit 103 is controlling the red light source 101a, the blue light source 101b, the green light source 101c and the three-color light modulator 1040 to sequentially project the first projection image 40 to the 60th frame of the first projection image 40 After being displayed on the projection screen 30 . The control circuit 103 can turn off the red light source 101a, the blue light source 101b and the green light source 101c, and turn on the infrared light source 102a. During the process of irradiating the three-color light modulator 1040 with the infrared light emitted by the infrared light source 102a, the control circuit 103 can control the three-color light modulator 1040 to perform the infrared light adjustment according to the color level value of the pixel in the second projected image 50 of the 61st frame. modulation, so as to project and display the second projection image 50 of the 61st frame on the projection screen 30 . In the process of projecting and displaying the 61st frame of the second projection image 50 on the projection screen 30 , the infrared camera 20 can capture the 61st frame of the second projection image 50 to obtain the first captured image 60 , and use the first captured image 60 is sent to the control circuit 103 .

Afterwards, the control circuit 103 can turn on the red light source 101a, the blue light source 101b, the green light source 101c, and turn off the infrared light source 102a. In the process of controlling the red light source 101a, the blue light source 101b, the green light source 101c and the three-color light modulator 1040 to project the 62nd frame of the first projection image to the 121st frame of the first projection image 40 on the projection screen 30 in sequence, the control circuit 103 According to the relative position of the feature pattern in the first shot image 60 obtained by the 61st frame of the second projection image 50 sent by the received infrared camera 20 and the feature pattern in the standard image, the 62nd frame of the first projected image 40 To the 121st frame, the projection position of the first projection image 40 on the projection screen 30 is corrected. After projecting the 121st frame of the first projection image 40 onto the projection screen 30, the red light source 101a, the blue light source 101b and the green light source 101c are turned off again, and the infrared light source 102a is turned on again, so as to transmit the 122nd frame of the second projection image. The projection display 50 is projected onto the projection screen 30 . At the same time, the infrared camera 20 can capture the 122nd frame of the second projection image 50 projected on the projection screen 30 again to obtain the first captured image 60 , and send the first captured image 60 to the control circuit 103 .

The control circuit 103 may, according to the relative position of the characteristic pattern in the first photographed image 60 obtained by photographing the 122nd frame of the second projection image 50 and the characteristic pattern in the standard image, sent by the infrared camera 20, for the 123rd frame of the first projection image 40. The projection position of the first projection image 40 to the 182nd frame is corrected. Looping in sequence, the control circuit 103 may correct the projection positions of the 60 frames of the first projection images 40 projected and displayed after the second projection image 50 based on the first captured image obtained by capturing one frame of the second projection image 50 . Therefore, real-time correction of the projection positions of the first projection image 40 projected and displayed by the red light source 101a, the blue light source 101b, and the green light source 101c as illumination light beams is realized.

In a specific implementation, as shown in FIG. 7-2 , the turn-on period of the infrared light source may be set after the turn-on period of the blue primary color light. In the DLP projection system, the light modulation component is a DMD light valve device. During the process of projecting and displaying the first projection image 40 on the projection screen 30, the control circuit 103 turns on the red light source 101a, the green light source 101c and the blue light source 101b in turn. , the three primary color lights emitted by the red light source 101a, the blue light source 101b and the green light source 101c are sequentially irradiated on the DMD light valve device, and the DMD light valve modulates the light beams of each primary color to form a first projection light beam, and this The first image beam is reflected to the projection lens 105 and projected onto the projection screen 30 to display the first projection image 40 on the projection screen 30 .

During the process of projecting the second projection image 50 onto the projection screen 30, at this time, after the blue primary color light sequence, the control circuit 102 turns off the red light source 101a, the blue light source 101b and the green light source 101c, and turns on the infrared light source 102a. The infrared light emitted by the infrared light source 102a is irradiated to the DMD light valve device, and the control circuit 103 can control the small mirror on the DMD light valve device to turn over according to the gradation value of the pixel in the infrared image to be displayed. The plurality of small mirrors modulate the infrared light irradiated on the surface into a second image beam, and reflect the second image beam to the projection lens 105 and project it to the projection screen 30 to display the second projection image 50 on the projection screen 30 .

In the above-mentioned projection imaging process, for a frame of 60Hz image to be displayed (used for projection to form the first projection image), the display duration of the three primary colors is fixed, and in order to realize infrared projection, in a specific implementation, the The duration of the blue primary color light is divided into two parts. For example, in the preset light-emitting period of the blue primary color light shown in Figure 7-2, one part of the time period is used to normally realize the modulation of the blue primary color light, which is the blue light source 101b The actual light-emitting period, and another part of the period is divided into the infrared light period, and the blue light source, ie, the blue laser, is turned off at this time. In this way, the infrared light occupies the blue primary color light for a period of time, and the infrared light is modulated and projected by the light modulation component to form the second projection image. This time period is originally allocated to the blue primary color light time period, so it can be considered that the infrared light is modulated by the blue light modulator.

In other embodiments, referring to FIG. 5 , the control circuit 103 turns on the projection light sources 101 and the infrared light sources 102a of three different colors in sequence. And in the process that the three primary colors emitted by the projection light sources 101 of the three different colors and the infrared light emitted by the infrared light source 102a are sequentially irradiated to the tricolor light modulator 1040, according to the primary colors of the pixels in the first projection image 40 The gradation value and the gradation value of the pixels in the second projected image 50 control the three-color light modulator 1040 to modulate the three primary color lights into a first image beam, and reflect the first image beam to the projection lens 105 . and modulate the infrared light into a second image beam, and transmit the second image beam to the projection lens 105 . The projection lens 105 sequentially projects the first image beam and the second image beam onto the projection screen 30 to display the first projection image 40 and the second projection image 50 on the projection screen 30 in sequence.

Wherein, the total display duration of the frame of the first projection image 40 and the frame of the second projection image 50 is equal to the target duration. The target duration is the duration for which the projection device 10 normally projects and displays one frame of the first projection image 40 without projecting and displaying the second projection image. In this way, the light-emitting duration of each of the red light source 101a, the blue light source 101b and the green light source 101c can be shortened, so as to shorten the display duration of normally displaying one frame of the first projection image 40, so as to achieve the target duration within the target duration. The projection displays one frame of the first projected image 40 and one frame of the second projected image 50 .

In the embodiment of the present disclosure, since the total display duration of one frame of first projection image 40 and one frame of second projection image 50 is equal to the target duration, the display duration of one frame of second projection image 50 is shorter. In the process of projecting and displaying the second projection image 50 on the projection screen 30, the infrared camera 20 may capture the second projection image 50, and capture the first captured image 60 within k target durations, that is, During the k target durations, the infrared camera 20 is always in an exposure state. The infrared camera 20 can then send the first captured image 60 to the control circuit 103 . The control circuit 103 may, according to the relative positions of the feature pattern 51 in the first captured image 60 captured within the k target durations and the feature pattern in the standard image, project and display the k target durations after the k target durations. The projection position of the first projection image 40 is corrected in real time. Wherein, the k may be a positive integer, for example, k may be greater than 1.

In one implementation, if the display duration of one frame of the second projection image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, the k can be 1, that is, the infrared camera 20 can capture the image within one target duration. The first captured image 60 . After the infrared camera 20 captures the first captured image 60 , the first captured image 60 may be sent to the control circuit 103 . The control circuit 103 may, according to the relative position of the characteristic pattern in the first captured image 60 and the characteristic pattern in the standard image, determine the projection position of a frame of the first projection image 40 displayed within a target duration after the one target duration. Make corrections.

If the display duration of one frame of the second projection image 50 is shorter than the duration required for the infrared camera 20 to capture the image, k may be greater than 1. Assuming that k is 5, the infrared camera 20 can capture the second projection image 50 projected and displayed within 5 target durations to obtain the first captured image 60 , and send the first captured image 60 to the control circuit 103 . The control circuit 103 can correct the projection position of the first projection image 40 in the 5 target durations displayed after the 5 target durations according to the relative positions of the characteristic pattern in the first captured image 60 and the characteristic pattern in the standard image. .

5 and 7-1, if k is 5 and the three-color light modulator 1040 is a reflective light valve, then within the i-th target duration, the control circuit 103 can turn on the red light source 101a, the blue light source 101a Light source 101b, green light source 101c and infrared light source 102a. The red light source 101a, the blue light source 101b and the green light source 101c emit the three primary colors of light, and the infrared light emitted from the infrared light source 102a irradiates the three-color light modulator 1040 sequentially. In the process of the three primary color light and the infrared light being sequentially transmitted to the three color light modulator 1040, the control circuit 103 can control the small reflection of the three color light modulator 1040 according to the primary color level value of the pixel in the i-th frame of the first projection image 40 The mirror is turned over, and the small mirror of the trichromatic light modulator 1040 is controlled to be turned over according to the gradation value of the pixel in the i-th frame of the second projection image 50 . The flipped three-color light modulator 1040 reflects the three-primary color light and infrared light irradiated to its surface in sequence to the projection lens 105, and then projects onto the projection screen 30 through the projection lens 105, so as to achieve the goal within the i-th target duration. The ith frame of the first projected image 40 and the ith frame of the second projected image 50 are sequentially projected and displayed on the projection screen 30 in sequence. Wherein, the i can be a positive integer.

In the process of projecting the i-th frame of the second projection image 50 to the projection screen 30, the infrared camera 20 captures the second projection image, and then maintains the exposure state to the i+4th target duration. After the i+4th frame of the second projection image 50 is captured, a first captured image 60 is obtained, and the first captured image 60 is sent to the control circuit 103 . The control circuit 103 may, according to the relative positions of the feature pattern 51 in the first captured image 60 and the feature pattern in the standard image, perform the first projection images within i+4 target durations displayed after the i+4 target durations The projection position of 40 is corrected.

In this implementation manner, the infrared camera 20 may be in an exposure state in real time. Alternatively, the infrared camera 20 may be in the exposure state periodically, and shoot the second projection image 50 displayed by projection. For example, the infrared camera 20 may be in the exposure state every K target durations, where K may be an integer multiple of k.

Alternatively, the control circuit 103 may periodically send a photographing instruction to the infrared camera 20, and the infrared camera 20 may be in an exposure state after receiving the photographing instruction, and photograph the projected and displayed second projection image 50. For example, the control circuit 103 may send a shooting instruction to the infrared camera 20 every K target durations.

FIG. 8 is a schematic structural diagram of another projection system provided by an embodiment of the present disclosure. As shown in FIG. 8, the light modulation component 104 may include a red light modulator 1041a, a blue light modulator 1041b and a green light modulator 1041c.

As an implementation manner of the present disclosure, the control circuit 103 may be used to turn on the red light source 101a, the blue light source 101b and the green light source 101c at the same time. And when the red primary color light emitted by the red light source 101a is irradiated to the red light modulator 1041a, according to the red color level value of the pixel in the first projection image 40, the red light modulator 1041a is controlled to modulate the red primary color light to include red light. The first image beam of primary color light is reflected to the projection lens 105 including the first image beam of red primary color light.

During the process of irradiating the blue light modulator 1041b with the blue primary color light emitted by the blue light source 101b, the blue light modulator 1041b is controlled to irradiate the blue primary color light on its surface according to the blue level value of the pixel in the first projection image 40 The first image beam including a blue primary color light is modulated into a first image beam, and the first image beam including a blue primary color light is reflected to the projection lens 105 .

When the green primary color light emitted by the green light source 101c is irradiated to the green light modulator 1041c, the green light modulator 1041c is controlled to modulate the green primary color light to include green primary color light according to the green color gradation value of the pixel in the first projection image 40 and reflect the first image beam including a green primary color light to the projection lens 105 . The projection lens 105 is used for projecting the first image beam including three colors onto the projection screen 30 , so as to project the first projection image 40 onto the projection screen 30 .

After that, the control circuit 103 can turn off the projection light source and turn on the infrared light source 102a. During the process of irradiating the infrared light emitted by the infrared light source 102a to the first target modulator, the first target modulator is controlled to modulate the infrared light irradiated to its surface into a first target modulator according to the color level value of the pixels in the second projection image 50 . Two image beams, and the second image beam is reflected to the projection lens 105 .

The display duration of the frame of the second projected image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, and less than or equal to the display duration of the frame of the first projected image 40 . The projection light source is the red light source 101a, the primary color light emitted by the blue light source 101b and the green light source 101c is irradiated to the light source of the first target modulator, and the first target modulator is the red light modulator 1041a, the blue light modulator 1041b or the green light source Light modulator 1041c.

For example, referring to FIG. 8, the projection light source is a red light source 101a, and the first target modulator may be a red light modulator 1041a. That is, the infrared light source 102a can multiplex the red light modulator 1041a with the red light source 101a.

In the embodiment of the present disclosure, the control circuit 103 can control the red light source 101a, the blue light source 101b, the green light source 101c, the red light modulator 1041a, the blue light modulator 1041b and the green light modulator 1041c to convert N frames of the first projection image 40 After being projected onto the projection screen 30 . The projection light source is turned off, and the infrared light source 102a is turned on. After that, the control circuit 103 projects the M frames of the second projection image 50 onto the projection screen 30 by controlling the infrared light source 102 a and the first target modulator.

Since the display duration of one frame of the second projection image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, the infrared camera 20 captures any one of the M frames of the second projection image 50 to obtain the first captured image 60 Afterwards, the first captured image 60 can be sent to the control circuit 103 . The control circuit 103 may correct the projection positions of the N frames of the first projection images 40 displayed after the M frames of the second projection images according to the relative positions of the feature patterns 51 in the first captured image 60 and the standard images. That is, the control circuit 103 may, based on the first photographed image 60 obtained by photographing any one of the M frames of the second projected image 50 , for the N frames of the first projected image displayed after the M frames of the second projected image 50 . The projection position of the projection image 40 is corrected, thereby realizing real-time correction of the projection position of the first projection image 40 .

Referring to FIG. 9 , if N can be 60, M can be 1, the projection light source is the red light source 101a, and the first target modulator is the red light modulator 1041a. The control circuit 103 can control the red light source 101a, the blue light source 101b, the green light source 101c and the three-color light modulator 1040 to project the 60 frames of the first projection image 40 on the projection screen 30, turn off the red light source 101a, and turn on the infrared light source 102a. Then, the control circuit 103 projects one frame of the second projection image 50 (eg, the 61st frame shown in FIG. 9 ) onto the projection screen 30 by controlling the infrared light source 102 a and the red light modulator 1041 a. After the infrared camera 20 captures the one frame of the second projection image 50 to obtain the first captured image 60 , the first captured image 60 may be sent to the control circuit 103 . The control circuit 103 may, according to the relative position of the characteristic pattern 51 in the first captured image 60 and the characteristic pattern in the standard image, perform the projection position of the 60 frames of the first projection image 40 projected and displayed in the 61st frame of the second projection image 50 . correction, thereby realizing real-time correction of the projection position of the first projection image 40 .

In some embodiments, referring to FIG. 8 , if the red light modulator 1041a is a light valve, during the process of projecting and displaying the first projection image 40 on the projection screen 30 , the control circuit 103 can simultaneously turn on the red light source 101a and the blue light source 101a Light source 101b and green light source 101c. During the process of irradiating the red light modulator 1041a with the red primary color light emitted by the red light source 101a, the control circuit 103 may control the red light modulator 1041a to turn over according to the red level value of the pixel in the first projection image 40 . The red primary color light irradiated on the surface of the inverted red light modulator 1041a is modulated into a first image beam containing red primary color light, and the first image beam containing red primary color light is reflected to the projection lens.

If the blue light modulator 1041b is a reflective light valve, in the process of irradiating the blue primary color light emitted by the blue light source 101b to the blue light modulator 1041b, the control circuit 103 can adjust the blue color level of the pixels in the first projected image 40 according to the blue color level. The value controls the blue light modulator 1041b to toggle. The inverted blue light modulator 1041b modulates the blue primary color light irradiated on its surface into a first image beam containing blue primary color light, and reflects the first image beam containing blue primary color light to the projection lens.

If the green light modulator 1041c is a reflective light valve, during the process of irradiating the green light modulator 1041c with the green primary color light emitted by the green light source 101c, the control circuit 103 can determine the green color gradation value of the pixel in the first projected image 40 according to the The green light modulator 1041c is controlled to flip. The inverted green light modulator 1041c modulates the green primary color light irradiated on its surface into a first image beam containing green primary color light, and reflects the first image beam containing green primary color light to the projection lens.

The projection lens 105 projects the first image beam onto the projection screen 30 , so as to realize the projection and display of the first projection image 40 on the projection screen 30 .

If the projection light source is the red light source 101a, the first target modulator is the red light modulator 1041a, and the red light modulator 1041a is a light valve, then in the process of projecting and displaying the second projection image 50 on the projection screen 30, the control The circuit 103 can turn off the red light source 101a and turn on the infrared light source 102a. During the process of irradiating the red light modulator 1041a with the infrared light emitted by the infrared light source 102a, the control circuit 103 can control the red light modulator 1041a to turn over according to the gradation value of the pixels in the second projected image 50 . The inverted red light modulator 1041a can modulate the infrared light irradiated on its surface into a second image beam, and reflect the second image beam to the projection lens. The projection lens 105 projects the second image beam onto the projection screen 30 , so as to realize the projection and display of the second projection image 50 onto the projection screen 30 .

In some implementations, referring to FIG. 8 , the control circuit 103 can also be used to turn on two visible light sources in the projection light sources 101 of three different colors at the same time, and turn on the infrared light sources in turn when the two visible light sources are in an on state. One visible light source other than the two visible light sources among the light source 102a and the three projection light sources 101 of different colors. 8 shows that the two visible light sources can be blue light sources 101b and green light sources 101c, and one visible light source other than the two visible light sources among the three different color projection light sources 101 is a red light source 101a.

During the process that the red primary color light emitted by the red light source 101a is irradiated to the red light modulator 1041a, the control circuit 103 can control the red light modulator 1041a to modulate the red primary color light according to the red level value of the pixel in the first projection image 40 . When the blue primary color light emitted by the blue light source 101b is irradiated to the blue light modulator 1041b, the control circuit 103 can control the blue light modulator 1041b to modulate the blue primary color light according to the blue color level value of the pixels in the first projection image 40 . During the process of irradiating the green primary color light from the green light source 101c to the green light modulator 1041c, the control circuit 103 can control the green light modulator 1041c to modulate the green primary color light according to the green gradation value of the pixel in the first projection image 40 .

In the process of irradiating the infrared light emitted by the infrared light source 102a to the second target modulator, the control circuit 103 may control the second target modulator to modulate the infrared light according to the gradation value of the pixel in the second projection image 50, so as to modulate the infrared light to the second target modulator. The two projection images 50 are projected and displayed on the projection screen 30 . The second target modulator is the red light modulator 1041a, the light modulator corresponding to the one visible light source among the blue light modulator 1041b and the green light modulator 1041c. FIG. 8 shows that the second target modulator is a red light modulator 1041a.

Wherein, the total display duration of the frame of the first projection image 40 and the frame of the second projection image 50 is equal to the target duration.

Referring to FIG. 10, since the control circuit 103 turns on the blue light source 101b and the green light source 101c at the same time within a target duration, and in the process that the blue light source 101b and the green light source 101c are both turned on, turns on the infrared light source 102a and the green light source 101c in turn. Red light source 101a. Therefore, within the target duration, the blue light source 101b and the green light source 101c are always on, that is, the blue light source 101b and the green light source 101c are on for a duration equal to the target duration. The red light source 101a and the infrared light source 102a are sequentially turned on, that is, the total duration of the red light source 101a and the infrared light source 102a being turned on is equal to the target duration. In this implementation manner, the display duration of one frame of the first projection image 40 is shortened by shortening the light-emitting duration of the red light source 101a, so that one frame of the first projection image 40 and one frame of the second projection image 40 can be projected and displayed within a target duration. Projected image 50 .

In this embodiment of the present disclosure, for the process of obtaining the first captured image by capturing the second projected image by the infrared camera 20, reference may be made to the above-mentioned embodiment in which the total display duration of one frame of first projection image and one frame of second projection image is equal to the target duration In the process, the infrared camera 20 captures the second projected image to obtain the first captured image, which will not be repeated here in this implementation manner.

For example, if k is 1, the two visible light sources are blue light source 101b and green light source 101c, one visible light source is red light source 101a, and the second target modulator is red light modulator 1041a. Referring to FIG. 8 and FIG. 10 , within the i-th target duration, the control circuit 103 can turn on the blue light source 101b and the green light source 101c at the same time. And when the blue light source 101b and the green light source 101c are turned on, the red light source 101a and the infrared light source 102a are turned on in sequence.

If the red light modulator 1041a is a light valve, the control circuit 103 may irradiate the red primary color light emitted by the red light source 101a to the red light modulator 1041a during the emitting duration of the red light source 101a in the i target durations. The red light modulator 1041a is controlled to flip according to the red level value of the pixel in the i-th frame of the first projection image 40 . The red primary color light irradiated on the surface of the inverted red light modulator 1041a is modulated into a first image beam containing red primary color light, and the first image beam containing red primary color light is reflected to the projection lens.

If the blue light modulator 1041b is a reflective light valve, during the i-th target duration, during the process that the blue primary color light emitted by the blue light source 101b is irradiated to the blue-light modulator 1041b, the control circuit 103 can control the The blue tone value of a pixel in a projected image 40 controls the blue light modulator 1041b to flip. The inverted blue light modulator 1041b modulates the blue primary color light irradiated on its surface into a first image beam containing blue primary color light, and reflects the first image beam containing blue primary color light to the projection lens.

If the green light modulator 1041c is a reflective light valve, within the i-th target duration, the green primary color light emitted by the green light source 101c is irradiated to the green light modulator 1041c. The control circuit 103 may control the green light modulator 1041c to flip according to the green level value of the pixel in the i-th frame of the first projection image 40 . The inverted green light modulator 1041c modulates the green primary color light irradiated on its surface into a first image light beam containing green primary color light, and reflects the first image light beam containing only green primary color light to the projection lens.

The projection lens 105 projects the first image beam onto the projection screen 30 , so as to project and display the i-th frame of the first projection image 40 onto the projection screen 30 .

In the i-th target duration, during the emitting duration of the infrared light source 102 a , the control circuit 103 can determine the color level of the pixels in the second projected image 50 according to the process of irradiating the infrared light from the infrared light source 102 a to the red light modulator 1041 a. The value again controls the red light modulator 1041a to flip. The inverted infrared modulator 1041 a modulates the infrared light irradiated on its surface into a second image beam, and reflects the second image beam to the projection lens 105 . The projection lens 105 projects the second image beam onto the projection screen 30 , so as to project and display the i-th frame of the second projection image 50 onto the projection screen 30 .

In the i-th target duration, the infrared camera 20 may capture the second projection image 50 projected and displayed on the projection screen 30 to obtain the first captured image 60, and use the captured image A captured image 60 is sent to the control circuit 103 .

After that, within the i+1 th target duration, the control circuit 103 passes the red light source 101a, blue light source 101b, green light source 101c, red light modulator 101a, blue light modulator 101b and green light modulator 1041c, +1 frame of the first projection image 40 in the process of being displayed on the projection screen 30 . According to the relative position of the characteristic pattern 51 in the first photographed image 60 and the characteristic pattern in the standard image obtained by shooting in the i-th target duration, for the i+1-th frame that is projected and displayed in the i+1-th target duration. The projected position of a projected image 40 is corrected. In this way, the real-time correction of the projection position of the first projection image 40 is realized.

In the embodiment of the present disclosure, after receiving the first captured image 60 sent by the infrared camera 20, the control circuit 103 may determine the distance between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image the number of pixels, and check whether the number of pixels is within the number range. If the number of pixels is within the number range, the control circuit 103 can determine that the second projection image 50 projected onto the projection screen is not deformed, and thus can determine that the first projection image 40 projected onto the projection screen 30 is not deformed. Then the control circuit 103 does not need to correct the projection position of the first projection image 40 . The number range refers to the error range, that is, as long as the number of pixels is within the number range, the control circuit can determine that the projection position of the first projection image has not changed, that is, there is no need to perform the projection position of the first projection image. Correction.

If the number of pixels is outside the number range, the control circuit 103 can determine that the second projected image 50 projected onto the projection screen 30 is deformed, and thus can determine that the first projected image 40 projected onto the projection screen 30 is deformed. Then the control circuit 103 may, according to the number of pixels between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image, perform the first projection projected and displayed after the second projected image 50 . The projection position of the image 40 is corrected until the number of pixels between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image is within the number range. Wherein, the number range is a fixed value range pre-stored in the control circuit 103 .

In the process of correcting the projection position of the first projection image 40, the control circuit 103 may translate the projection position of the first projection image 40 along the diagonal direction of the first projection image 40 until the number of pixels is within the within the range of numbers. Alternatively, the control circuit 103 may first translate the projection position of the first projection image 40 along the first side of the first projection image 40 , and then translate the projection position of the first projection image 40 along the second side of the first projection image 40 , until the number of pixels is within the number range. The first side and the second side are perpendicular to each other, the first side is parallel to the pixel row direction of the first projected image 40 , and the second side is parallel to the pixel column direction of the first projected image 40 .

If the light modulator is a reflective light valve, referring to FIG. 5 , FIG. 8 , FIG. 11 and FIG. 13 , the control circuit 103 may include a syndrome sub-circuit 1030 and a control sub-circuit 1031 . The syndrome circuit 1030 is configured to receive the first captured image 60 sent by the infrared camera 20, determine the number of pixels between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image, and The determined number of pixels is sent to the control sub-circuit 1031 . The control sub-circuit 1031 can detect whether the number of pixels is within the number range, and after determining that the number of pixels is outside the number range, it can adjust the number of pixels in the light modulator for reflecting the number of pixels located in the first projection image 40 The mirrors corresponding to the pixels outside the projection screen 30 are used to adjust the projection position of the first projection image 40 .

For example, if the first projected image 40 needs to be shifted by x rows of pixels along the pixel row direction, the mirror corresponding to the pixels in the M1 row needs to be adjusted to the mirror corresponding to the pixels in the M1-x row. Wherein, the M1 is the number of pixel rows in the first projection image 40 , the M1 is a positive integer greater than 1, and x is a positive integer less than M1 .

In addition, the control sub-circuit 1031 is also used to control the turning on of the infrared light source 102a, the red light source 101a, the blue light source 101b and the green light source 101c.

In the embodiment of the present disclosure, referring to FIGS. 11 and 12 , it can be seen from the projection device 10 and the first projection image 40 marked with solid lines in FIGS. 11 and 12 that when the projection device 10 does not move, the projection device 10 The first projection image 40 projected onto the projection screen 30 is located in the projection screen 30, and the size of the first projection image 40 is the original size. It can be seen from the projection device 10 and the first projection image 30 marked with dotted lines in FIGS. 11 and 12 that when the projection device 10 is displaced, the first projection image 40 projected by the projection device 10 to the projection screen 30 regularly changes Trapezoidal deformation. Then the projection device 10 can perform real-time correction on the projection position of the first projection image 30 based on the relative positions of the characteristic pattern in the first captured image obtained by capturing the second projection image and the characteristic pattern in the standard image, so that the first projection image 30 can be corrected in real time. 40 is located in the projection screen 30, and the size of the first projection image 40 is the original size.

Referring to FIG. 13 , when the distortion of the projection lens 105 in the projection device 10 is small, it can be seen from the first projection image 40 marked with a solid line in FIG. 13 that the first projection image 40 projected by the projection device 10 to the projection screen 30 is located at Inside the projection screen 30, and the size of the first projection image 40 is the initial size. When the distortion of the projection lens in the projection device 10 is relatively large, it can be seen from the first projection image 40 marked with dotted lines in FIG. 13 that the edge of the first projection image 40 projected by the projection device 10 onto the projection screen 30 will occur Irregular geometry. Then the projection device 10 can perform real-time correction on the projection position of the first projection image 40 based on the relative position of the characteristic pattern in the first photographed image obtained by photographing the second projection image and the characteristic pattern in the standard image, so that the first projection image 40 is located in the projection screen 30, and the size of the first projection image 40 is the original size.

Referring to FIG. 14 , the projection screen 30 can be a curtain. If the surface of the projection screen 30 is flat, it can be seen from the first projection image 40 marked with a solid line in FIG. The projected image 40 is located in the projection screen 30, and the size of the first projected image 40 is the original size. If the surface of the projection screen 30 is uneven, it can be seen from the first projection image 40 marked with dotted lines in FIG. Then the projection device 10 can perform real-time correction on the projection position of the first projection image 40 based on the relative position of the characteristic pattern in the first photographed image obtained by photographing the second projection image 50 and the characteristic pattern in the standard image, so that the first projection image 40 can be corrected in real time. The image 40 is located in the projection screen 30, and the size of the first projected image 40 is the original size.

To sum up, the embodiment of the present disclosure provides a projection system, wherein the projection device in the projection system can obtain the first shot image obtained by the infrared camera on the second projected image, and can obtain the first shot image according to the features in the first shot image. The relative position of the pattern and the feature pattern in the standard image corrects the projected position of the first projected image projected by three visible light sources of different colors. Since the projection device can automatically correct the projection position of the first projection image without requiring manual correction by the user, the efficiency of correcting the projection position of the first projection image is improved.

Moreover, since the projection device projects the second projection image onto the projection screen through the infrared light source, the user will not see the second projection image displayed on the projection screen during the process of viewing the first projection image. Therefore, it is possible to avoid affecting the normal viewing of the first projected image, ensuring the continuity of viewing the first projected image by the user, and improving the user experience. At the same time, the real-time correction of the first projected image by the projection device during the process of displaying the first projected image is realized.

15-1 is a flowchart of a method for correcting a projected image provided by an embodiment of the present disclosure. The correction method can be applied to the projection device 10 in the projection system shown in FIGS. 1 , 2 , 5 and 8 . Referring to FIG. 1 , FIG. 2 , FIG. 5 and FIG. 8 , the projection system may further include an infrared camera 20 and a projection screen 30 . The projection device 10 may include three projection light sources 101 of different colors and an infrared light source 102a. As shown in Figure 15-1, the method may include:

Step 1501, the projection light source emits three primary colors of light;

Step 1502, the light modulation component modulates the primary color light of each color into a first image beam, and transmits the first image beam to the projection lens to display the first projection image on the projection screen;

Step 1503: After the first projection image is displayed, the infrared light source emits infrared light, and the light modulation component modulates the infrared light into a second image beam, and transmits the second image beam to the projection lens to display the second projection on the projection screen image.

Step 1504: The control circuit receives the first captured image sent by the infrared camera and captured for the second projected image, and compares it with the standard image to generate correction data.

The first photographed image is an image obtained by photographing the second projected image by the infrared camera.

Step 1505: Correct the display of the first projection image.

And, the standard image is an image obtained by photographing the second projected image by the infrared camera when the second projected image is located in the projection screen and the size of the second projected image is the initial size. The first captured image is an actual infrared projection image, and compared with the standard image, the difference between the standard image and the standard image can be obtained, thereby obtaining correction data, which can be used to correct the subsequent visible light as the illumination beam of the first projection image. show.

And, as another embodiment, as shown in the flowchart of FIG. 15-2, the difference from the above process steps is in step 1503a: while displaying the first projected image, the infrared light source emits infrared light, and the light modulation component converts the infrared The light is modulated into a second image beam, and the second image beam is transmitted to the projection lens to display the second projection image on the projection screen.

In the method for correcting the projected image of the above example, the projection device can obtain the first shot image obtained by the infrared camera on the second projected image, and can generate correction data according to the difference between the first shot image and the standard image, and correct the visible light projection light source as the Projection display effect of the first projected image of the illumination beam. The projection device can automatically correct the projection position of the first projected image without requiring manual correction by the user, thus improving the efficiency of correcting the projection position of the first projected image.

Moreover, since the projection device projects the second projection image onto the projection screen through the infrared light source, the user will not see the second projection image displayed on the projection screen during the process of viewing the first projection image. Therefore, it is possible to avoid affecting the normal viewing of the first projected image, ensuring the continuity of viewing the first projected image by the user, and improving the user experience. At the same time, the real-time correction of the first projected image by the projection device during the process of displaying the first projected image is realized.

And, FIG. 16 is a flowchart of another method for correcting a projected image provided by an embodiment of the present disclosure. As shown in Figure 16, the method may include:

Step 1601: The control circuit turns on three projection light sources of different colors in sequence, and emits three primary colors of light in sequence.

Referring to FIG. 2 , the projection device 10 may include three projection light sources 101 of different colors, an infrared light source 102 a and a control circuit 103 , and the three projection light sources 101 of different colors may include a red light source 101 a , a blue light source 101 b and a green light source 101 c .

The control circuit 103 is used for sequentially turning on the red light source 101a, the blue light source 101b and the green light source 101c. The sequential turn-on means that only one light source is turned on at the same time, but the turn-on sequence of the plurality of light sources is not limited.

Step 1602: The three-color light modulator modulates the three primary colors of light respectively to form a first projection beam and project it onto a projection screen to display a first projection image.

Referring to FIG. 5 , in the process that the three primary colors of light emitted by the red light source 101 a , the blue light source 101 b and the green light source 101 c are sequentially irradiated to the three color light modulator 1040 , the control circuit 103 can be based on the pixel in the first projection image 40 . The gradation value of the primary color controls the three-color light modulator 1040 to modulate the three-primary color light. The three primary color lights can be red primary color light, blue primary color light and green primary color light. The primary color level value may be a red green blue (red green blue, RGB) level value.

Step 1603: The control circuit turns off the three projection light sources of different colors, turns on the infrared light source, and emits infrared light.

After the control circuit 103 projects and displays the first projection image 40 on the projection screen 30, the red light source 101a, the blue light source 101b and the green light source 101c can be turned off, and the infrared light source 102a can be turned on, where only infrared light is emitted.

Step 1604: The three-color light modulator modulates the infrared light to form a second image beam and project it onto the projection screen to display the second projection image.

During the process of irradiating the three-color light modulator 1040 with the infrared light emitted by the infrared light source 102 a , the control circuit 103 can control the three-color light modulator 1040 to modulate the infrared light according to the gradation value of the pixel in the second projection image 50 . The three-color light modulator modulates the infrared light into a second image beam, and transmits the second image beam to the projection lens. The projection lens projects the second image beam to the projection screen to display the second projection image on the projection screen.

Wherein, the display duration of one frame of the second projection image 50 is greater than or equal to the duration required for the infrared camera 20 to capture the image, thereby ensuring that the infrared camera 20 can complete the second projection image 50 during the display process of the second projection image 50 . to obtain the first captured image 60 . Moreover, the display duration of the frame of the second projection image 50 may be less than or equal to the display duration of the frame of the first projection image 40 , thereby preventing the normal viewing of the first projection image from being affected.

Step 1605: The control circuit receives the first captured image sent by the infrared camera and captured for the second projected image, and compares it with the standard image to generate correction data.

In the process of projecting and displaying the second projection image 50 on the projection screen 30 by the control circuit 103, the infrared camera 20 captures the second projection image 50, and captures the second projection image to obtain the first captured image 60 and transmits to the control circuit 103 .

Step 1606: Correct the projected display of the first projected image.

Specifically, the control circuit corrects the projection position of the first projection image projected by the three visible light sources of different colors according to the relative position of the feature pattern in the first captured image and the feature pattern in the standard image.

Wherein, the standard image is an image obtained by photographing the second projected image by the infrared camera when the second projected image is located in the projection screen and the size of the second projected image is the initial size.

In the embodiment of the present disclosure, after receiving the first captured image 60 sent by the infrared camera 20 , the projection device 10 can correct the image through the relative position of the feature pattern 51 in the first captured image 60 and the feature pattern in the standard image. The projection positions of the first projection images projected by the three different-color projection light sources 101 until the second projection images 50 are located in the projection screen 30, and the size of the second projection images 50 is the initial size. The relative position can be represented by the number of pixels between the center point of the feature pattern 51 in the first captured image 60 and the center point of the feature pattern in the standard image.

To sum up, an embodiment of the present disclosure provides a method for correcting a first projected image. The projection of the infrared image is performed after the visible light projection display, the visible light projection and the infrared light projection period do not overlap, and have a sequential order. .

According to the correction method, the projection device can acquire a first shot image obtained by shooting the second projection image by an infrared camera, and can correct the three different colors according to the relative positions of the feature pattern in the first shot image and the feature pattern in the standard image. The projection position of the first projection image projected by the visible light source. Since the projection device can automatically correct the projection position of the first projection image without requiring manual correction by the user, the efficiency of correcting the projection position of the first projection image is improved.

Moreover, since the projection device projects the second projection image onto the projection screen through the infrared light source, the user will not see the second projection image displayed on the projection screen during the process of viewing the first projection image. Therefore, it is possible to avoid affecting the normal viewing of the first projected image, ensuring the continuity of viewing the first projected image by the user, and improving the user experience. At the same time, the real-time correction of the first projected image by the projection device during the process of displaying the first projected image is realized.

FIG. 17 is a flowchart of still another first projection image correction method provided by an embodiment of the present disclosure. As shown in Figure 17, the method may include:

Step 1701: The control circuit turns on the red light source, the blue light source and the green light source at the same time, and simultaneously emits the red primary color light, the blue primary color light and the green primary color light.

For the specific implementation of this step, reference may be made to the foregoing embodiments, and details are not described herein again in the embodiments of the present disclosure.

Step 1702: The light modulation component modulates the primary color light of each color into a first image beam, and projects the first image beam to form a first projection image.

Specifically, in the process of irradiating the red primary color light emitted by the red light source to the red light modulator, the control circuit controls the red light modulator to modulate the red primary color light according to the red gradation value of the pixel in the first projection image. When the blue primary color light emitted by the light source is irradiated to the blue light modulator, the blue light modulator is controlled to modulate the blue primary color light according to the blue gradation value of the pixel in the first projection image, and the green primary color light emitted by the green light source is irradiated to In the process of the green light modulator, the green light modulator is controlled to modulate the green primary color light according to the green gradation value of the pixel in the first projection image.

Wherein, the light modulation component includes a red light modulator, a blue light modulator and a green light modulator.

Step 1703: The control circuit turns off the projection light source and turns on the infrared light source to emit infrared light.

Step 1704: The infrared light is irradiated to the first target modulator, and is adjusted to project a second image beam to form a second projection image, and the first target modulator is a red light modulator, a blue light modulator or a green light modulator.

Specifically, the control circuit controls the first target modulator to modulate the infrared light according to the gradation value of the pixels in the second projection image.

Wherein, the display duration of one frame of the second projected image is greater than or equal to the duration required for the infrared camera to capture the image, and is less than or equal to the display duration of one frame of the first projected image. The projection light source is a red light source, the primary color light emitted from the blue light source and the green light source illuminates the light source on the first target modulator, and the first target modulator is a red light modulator, a blue light modulator or a green light modulator.

For the specific implementation of this step, reference may be made to the foregoing embodiments, and details are not described herein again in the embodiments of the present disclosure.

Step 1705: The control circuit receives the first captured image sent by the infrared camera and captured for the second projected image, and compares it with the standard image to obtain correction data.

Specifically, the control circuit obtains the correction data according to the relative positions of the feature pattern in the first captured image and the feature pattern in the standard image.

Step 1706: Correct the display of the first projection image.

For the specific implementation of this step, reference may be made to the foregoing embodiments, and details are not described herein again in the embodiments of the present disclosure.

And, FIG. 18 shows another method for correcting a projected image, and the specific implementation steps are as follows:

Step 1801: While outputting at least one primary color light, the projection light source controls the lighting of the infrared light source to emit infrared light;

Step 1802: The three-color light modulator modulates the at least one primary color light to form a first image beam, and the first image beam is projected to form a first projection image; at the same time, the second target light modulator modulates the infrared light to form a first image beam. Two image beams, the second image beam is projected to form a second projection image, wherein the second target light modulator is different from the three-color light modulator;

In this embodiment, the projection system includes two light modulators, specifically: a second target light modulator and a three-color light modulator, which are used to modulate infrared light and visible light, respectively.

Step 1803: the control circuit receives the first captured image sent by the infrared camera and captured for the second projected image, and compares it with the standard image to obtain correction data;

Since infrared light can be modulated and projected separately, it is no longer limited by the time-series correlation with the modulation of visible light. Therefore, distortion data such as deformation of the current projected image can be acquired in real time, and then the projection of current visible light can be adjusted in real time.

Step 1804: Correct the projection display of the first projection image.

For the above correction process, reference may be made to the descriptions of the foregoing embodiments, and details are not repeated here.

Of course, after the visible light projection light source is turned off, the infrared light source can also be turned on to perform infrared light projection. For the subsequent calibration process, reference may be made to the process in the foregoing embodiment, and details are not repeated here.

To sum up, the correction method for a projected image provided by the embodiment of the present disclosure, the projection device of the correction method can obtain the first shot image obtained by shooting the second projected image by the infrared camera, and can obtain the first shot image according to the feature pattern in the first shot image. The projected display of the first projected image projected by the visible light source is corrected based on the relative position of the feature pattern in the standard image. Since the projection device can automatically correct the projection position of the first projection image without requiring manual correction by the user, the efficiency of correcting the projection position of the first projection image is improved.

Moreover, since the projection device projects the second projection image onto the projection screen through the infrared light source, the user will not see the second projection image displayed on the projection screen during the process of viewing the first projection image. Therefore, it is possible to avoid affecting the normal viewing of the first projected image, ensuring the continuity of viewing the first projected image by the user, and improving the user experience. At the same time, the real-time correction of the first projected image by the projection device during the process of displaying the first projected image is realized.

An embodiment of the present disclosure provides a control circuit, including: a memory, a processor, and a computer program stored in the memory. When the processor executes the computer program, the first projection image as shown in any one of FIG. 15-1 to FIG. 18 is implemented by the processor. The steps performed by the control circuit in the calibration method.

Claims (13)

A projection system, characterized in that the projection system comprises: projection equipment, an infrared camera and a projection screen, the projection equipment comprises: a control circuit, a projection light source, an infrared light source, a light modulation component and a projection lens; The projection light source is used to generate three primary color lights; The light modulation component is used to modulate the primary color light of each color into a first image beam according to the first image to be displayed, and transmit the first image beam to the projection lens and project it on the projection screen to form a first image beam. a first projected image; The infrared light source is used for emitting infrared light, and the light modulation component is also used for modulating the infrared light into a second image beam, and transmitting the second image beam to the projection lens and on the projection screen. up-projecting to form a second projection image; The infrared camera is used for photographing the second projection image to obtain a first photographed image, and sending the first photographed image to the control circuit; The control circuit is further configured to determine correction data according to the first captured image and the standard image, where the correction data is used to correct the first projection image; Wherein, a frame image display period of the first image to be displayed includes a lighting period of the infrared light source. The projection system according to claim 1, wherein, in a frame image display period of the first image to be displayed, the lighting period of the infrared light source does not overlap with the lighting period of any primary color light. The projection system according to claim 1, characterized in that, in the image display period of one frame of the first image to be displayed, the lighting period of the infrared light source overlaps with the lighting period of one primary color light. The projection system according to claim 1, wherein the correction data used to correct the first projection image specifically comprises: The correction data is used to correct the second image to be displayed, and the light modulation component is used to modulate the primary color light of each color emitted by the projection light source into a first image beam according to the second image to be displayed, and transmitting the first image beam to the projection lens and projecting on the projection screen to form a first projection image; The first image to be displayed and the second image to be displayed are different image frames. The projection system according to claim 2 or 3, wherein the light modulation component comprises a red light modulator, a blue light modulator and a green light modulator; The red light modulator, blue light modulator and green light modulator respectively modulate red primary color light, blue primary color light and green primary color light; During the process of irradiating the infrared light to the first target modulator, controlling the first target modulator to modulate the infrared light according to the image to be displayed by the infrared light; Wherein, the first target modulator is any one or any two or three of the red light modulator, the blue light modulator, and the green light modulator. The projection system according to claim 5, wherein the red light modulator, the blue light modulator, and the green light modulator are each a light modulation component. The projection system according to claim 5, wherein the red light modulator, the blue light modulator and the green light modulator are a common light modulation component. The projection system according to claim 7, wherein the red primary color light, the blue primary color light, and the green primary color light are output in time series, and the blue light modulator is configured to receive the illumination of the blue primary color light and modulate it , and the blue light modulator is also used to modulate the infrared light. The projection system according to claim 1, wherein the projection light source comprises a red light source, a blue light source and a green light source, the red light source is a red laser, the blue light source is a blue laser, and the green light source is a The light source is a green laser. A method for correcting a projected image, characterized in that it is applied to a projection device in a projection system, the projection system further comprising: an infrared camera and a projection screen, the projection device comprising: a projection light source and an infrared light source; the method include: The projection light source emits three primary colors of light, and the infrared light source emits infrared light, wherein the lighting period of the infrared light source overlaps the lighting period of one primary color light, or each display period includes the lighting of the infrared light source. the lighting period and the lighting period of the primary color light, and the lighting period of the infrared light source is different from the lighting period of any primary color light; The light modulation component modulates the primary color light of each color into a first image beam, and transmits the first image beam to the projection lens to display a first projection image on a projection screen; and, converts the infrared modulating light into a second image beam, and projecting the second image beam to the projection screen to display the second projection image on the projection screen; The control circuit receives the first captured image sent by the infrared camera for the second projection image, and compares it with a standard image to generate correction data; Correct the display of the first projected image. The method according to claim 10, wherein the light modulation component comprises a three-color light modulator; the method specifically comprises: The control circuit turns on the projection light source in sequence, and emits three primary color lights in sequence; controlling the three-color light modulator to modulate the three primary color lights to form a first projection beam and project it to a projection screen to display a first projection image; The control circuit turns off the projection light source, turns on the infrared light source, and emits infrared light; The three-color light modulator is controlled to modulate the infrared light according to the second projection image to form a second image beam and project it to the projection screen to display the second projection image; wherein, the display duration of one frame of the corrected image is longer than or equal to the duration required for the infrared camera to capture an image, and less than or equal to the display duration of one frame of the projected image. The method according to claim 10, wherein the light modulation component comprises a three-color light modulator; and the method specifically comprises: The control circuit turns on the projection light source and the infrared light source in sequence; The control circuit sequentially controls the three-color light modulator to modulate the three-color light in the process that the three-primary light and the infrared light are irradiated to the three-color light modulator sequentially, according to the The second projection image controls the three-color light modulator to modulate the infrared light; Wherein, each display period includes the lighting period of the infrared light source and the lighting period of the visible light source of one color, and the lighting period of the infrared light source is different from the lighting period of the visible light source of one color. A control circuit, characterized in that a memory, a processor and a computer program stored on the memory, the processor implements the projection image according to any one of claims 10-12 when the processor executes the computer program. The method performed by the control circuit in the calibration method.

Images