Disclosure of Invention
The invention aims to provide a representation method and a representation system for AR (augmented reality) glasses display brightness perception aiming at the defects of the prior art. In order to represent the perceived brightness condition of AR display in different real scenes, the invention carries out the environmental light simulation experiment of various illumination scenes, an observer carries out perceived brightness grade grading on the display brightness of the AR glasses aiming at different illumination scenes, analyzes the main influencing factors of the perceived brightness through subjective and objective experiments, and visualizes the main influencing factors into a mathematical model, and further quantifies the perceived brightness so as to optimize the design of the display aiming at the perceived brightness of human eyes. On the premise of different application scenes and display contents, the visual perception effect of people is improved, and effective assistance can be provided for development and upgrading of the AR display device. Experiments prove that the space environment illuminance and brightness distribution, the physical brightness of the display and the pupil diameter have direct and obvious influence on the perceived brightness of the tested person.
The technical scheme is as follows:
The invention adopts the following technical scheme for solving the technical problems:
a perceived brightness characterization method for AR glasses display comprises the following steps:
Step 1, performing an ambient light simulation experiment of various lighting scenes, wherein an experiment platform comprises observers, AR (augmented reality) glasses, an eye tracker and lamps capable of realizing various lighting effects, wherein the observers grade the display brightness of the AR glasses according to different lighting scenes and record background brightness, AR display brightness and pupil diameter data corresponding to different sensing brightness;
step 2, fitting a function relation 1 of the perceived brightness, the AR display brightness and the pupil diameter data;
Step 3, taking the AR display brightness corresponding to the intermediate value of the perceived brightness as the optimal AR display brightness, fitting a function relation 2 of the AR display brightness and the background brightness data according to the optimal AR display brightness;
And 4, substituting the actually measured background brightness data into the functional relation 2 to obtain the optimal AR display brightness when the AR glasses are actually used, substituting the optimal AR display brightness and the actually measured pupil diameter into the functional relation 1 to obtain the perceived brightness, judging whether the optimal AR display brightness is reasonable or not according to the perceived brightness, and adjusting the AR display brightness according to the optimal AR display brightness by the AR glasses if the AR display brightness is reasonable.
Preferably, the functional relation 1 is:
wherein a and b are fitting coefficient values, and L r and L, D are perceived brightness, AR display brightness and pupil diameter respectively.
Preferably, a=7.0756 and b= 7.4335.
Preferably, the functional relation 2 is:
Wherein c and d are fitting coefficient values, and L Optimum for 、L background is the optimal AR display brightness and background brightness respectively.
Preferably, c=8.883, d= 0.557.
The invention also provides a perceived brightness characterization system for AR glasses display, which comprises:
an eye movement device for detecting pupil diameter;
a photoreceptor for detecting background brightness;
the optimal AR display brightness module is used for calculating the optimal AR display brightness according to the background brightness and the functional relation 2;
The perceived brightness calculation module is used for calculating perceived brightness according to the optimal AR display brightness, the pupil diameter and the functional relation 1, and judging whether the perceived brightness accords with a preset perceived brightness range;
and the AR display brightness adjusting module is used for adjusting the AR display brightness according to the optimal AR display brightness.
The invention also provides AR glasses, which are used for adjusting AR display brightness by adopting the method. .
Compared with the prior art, the invention has the following advantages that the characteristic scheme is adopted:
Compared with the prior rough single representation of display brightness perception, the invention provides a perception brightness representation method which is more perfect and suitable for AR display, and does not fully consider the influence of ambient light on the perception brightness and lacks subjective and objective comprehensive representation combined with psychological factors and the like. Based on the basic structure of the human eye vision system and the principle of brightness perception, an experimental platform is constructed, an ambient light simulation experiment of various lighting scenes is carried out, human eye perceived brightness is creatively rated through subjective visual comfort of an observer, and functional relation among perceived brightness, AR displayed brightness and pupil diameter is established by combining AR displayed brightness and pupil diameter data measured through the experiment. And determining the optimal AR display brightness according to the most reasonable perceived brightness, and establishing a functional relation between the optimal AR display brightness and the background brightness by combining the background brightness data measured through experiments. According to the method, when the AR glasses are used, the display brightness of the AR glasses can be adjusted by detecting the pupil diameter and the background brightness.
Detailed Description
The invention is further elucidated below in conjunction with the drawings.
The perceived brightness characterization method of the AR glasses display is shown in a figure 1, ① is an observer in the figure, the brightness of an image displayed by the AR glasses is rated, ② is a fixed AR glasses, an actual effect diagram of the AR glasses is shown in a figure 2, namely a visible display picture and a real backlight are combined and overlapped, ③ is an eye tracker which is mainly used for capturing the size of a pupil of human eyes, ④ and ⑤ are different types of illumination lamps, each type of lamp can be independently controlled and can adjust light and color, so that the light environment with various illumination effects can be realized in one scene, experiments of display equipment in different light environments can be realized, and the perceived brightness condition of human eyes on a flat panel display device of the AR display equipment in different light environments can be more comprehensively analyzed.
The invention aims at the perceived brightness characterization method of AR display, finds out the influence rule of the space ambient illuminance and brightness distribution condition on the perceived brightness of a display device, has the objective parameters for influencing the perceived brightness, further designs the objective experimental scene and link of the perceived brightness, invites a plurality of observers to participate in the perceived brightness evaluation experiment, establishes the relation between each influence factor and the perceived brightness, and has the main factors influencing the perception of AR display brightness as shown in figure 3.
The invention firstly utilizes the ambient light simulation of various scenes to obtain the space brightness distribution condition, guides the real light environment with adjustable illumination and design illumination of lighting and display equipment and different screen brightness, sets a specific experimental link to complete the construction of experimental scenes, secondly carries out the evaluation of perceived brightness and records pupil diameter data, further perfects the influence mechanism of the display perceived brightness through the experimental rule analysis, and finally establishes the relation among the background brightness, AR display brightness, pupil diameter and perceived brightness through the experiment, further quantifies the perceived brightness, and visualizes the perceived brightness as a mathematical formula, thereby accurately representing the perceived brightness, namely, constructing the mathematical relation between the perceived brightness displayed by a display device and the parameters through the existing mathematical relation among the parameters and the values of related parameters obtained through the experiment.
According to the imaging angle of view of the observed object and the observer, the observed objects can be divided into two categories, namely, one category is that the object is imaged on the retina at a luminous point smaller than the diameter of a single visual nerve, such as a star in the sky at night, and the other category is that the observed object has a larger visual angle and occupies a plurality of optic nerve cells, so as to form a brightness sensing surface. As shown in fig. 4, when the display visual angle needs to be large, the perceived intensity of luminance by human eyes depends on the received luminous flux per unit area of the optic nerve cells, and when the viewing angle formed by the observed object in the human eye visual system is large, it is assumed that AR displays luminance L, eyeball pupil diameter D, focal length f' of eyes, and eye transmittance τ. At this time, the luminous flux obtained by human eyes is in accordance with the illuminance formula. According to the imaging illuminance formula, the retinal imaging illuminance can be obtained as shown in formula (1):
For an object in air, n=1, n' is the refractive index of the glass body, which is about 1.336. Since the object distance is much larger than the image distance and image Fang Jiaoju, the image distance is approximately equal to the focal length of the image space, so the following relationship holds:
substituting this relationship and constant into equation (1) yields:
Retinal illuminance is proportional to the square of the luminance of the light emitting surface and pupil diameter:
E'=tLD2 (4)
wherein the method comprises the steps of Is constant.
The perceived brightness level score is matched to the retinal imaging illumination because the perceived brightness of the human eye is ultimately obtained by complex vision system processing due to the object brightness stimulus acting on the retina.
As shown in fig. 5,10 different image brightnesses are set in the experiment, brightness measurement is carried out on white images with different gray scales through a near-eye display measurement system, required gray scales are recorded, random ordering treatment is carried out on the images, and 7 groups of playing sequences are generated. In the invention, the perceived brightness grade grading is divided into 13 grades from extremely dark to extremely bright, the experimental space is a room with uniformly distributed dome lamps, and the brightness of the dome lamps is adjustable, so that the change of the ambient light is controlled, the wall surface is a white wall surface, the uniformity of the ambient light is ensured, and the influence of the glare effect on the experiment is reduced. The observer faces the white wall, the head is fixed through the forehead support, the distance between the eye position of the observer and the optical waveguide display module is 15mm, and the distance between the eye position of the observer and the wall surface is 2.3m (virtual image surface). The angle of view of AR glasses is 40 ° (diagonal). The method of the invention uses holographic optical waveguide AR glasses as an example to carry out a brightness perception evaluation experiment.
As shown in fig. 6, the perceived brightness and the AR display brightness and the background brightness exhibit a better monotonic relationship. The perceived brightness and the image brightness of the AR display are in a monotonically increasing relationship, the perceived brightness and the background brightness are in a monotonically decreasing relationship, and the background brightness is the magnitude of the background brightness which is changed by the illumination environment, namely the illumination intensity, in the room. It is further known that the perceived brightness of the target screen by the observer decreases as the ambient illuminance increases. It can also be seen from the figure that as the AR display brightness increases, the range of screen brightness scores for the observer under different ambient light conditions expands, indicating that the effect of the change in ambient illuminance on the tested score is greater when the screen brightness is higher than when the screen brightness is lower. Therefore, the size of the pupil is monotonically decreasing as the ambient illuminance is higher, i.e., the background illuminance is higher, when the AR display luminance is constant, and the perceived brightness score is monotonically decreasing as the ambient illuminance is higher, i.e., the background illuminance is higher, when the AR display luminance is constant.
From the above analysis of the eye imaging laws, it is known that object brightness and pupil diameter play a critical role in imaging. Therefore, the invention defines the relation between the brightness of the object and the pupil diameter, namely 'perceived brightness', and takes (LD 2) in the formula (4) as a whole variable factor to analyze the influence on the perceived brightness score as a whole, wherein the specific function form is shown in the formula (5):
Where a, b are fitting coefficient values, a=7.0756 and b= 7.4335, respectively. It should be noted that there may be some differences in these constant coefficients for different types of AR glasses.
Further, as shown in fig. 7, the relationship between the optimal brightness and the background brightness of the AR display is given, and in the trend graph that the perceived brightness changes with the change of the AR display brightness, the optimal AR display brightness can be found, because AR is a virtual-real fusion display technology, the optimal AR display brightness can be found by means of the perceived brightness, that is, the AR display brightness corresponding to the middle level of the perceived brightness level is the optimal AR display brightness. The invention provides a basic representation formula of the optimal AR display brightness based on background brightness, which is shown as a formula (6):
Where c and d are fitting coefficient values, c=8.883 and d= 0.557, respectively. It should be noted that there may be some differences between these constant coefficients for different types of environments and backgrounds.
In practice, the optimum display luminance is related to factors such as glare conditions, visual clarity, observation time, etc., in addition to perceived luminance, and the present invention sets glare, clarity, observation time, etc. within specific ranges without changing these. The invention focuses on correlating AR display brightness with human eye perception brightness realization under different backgrounds, can simplify evaluation of human eye comfort in visual perception in a certain sense, and has positive significance. Thus, feedback and adjustment of the display device can be realized, and the AR display technology and upgrading iteration of the device can be guided.
When the AR glasses are actually used, the actually measured background brightness data are substituted into a formula (6) to obtain the optimal AR display brightness, then the optimal AR display brightness and the actually measured pupil diameter are substituted into a formula (5) to obtain the perceived brightness, whether the optimal AR display brightness is reasonable or not is judged according to the perceived brightness, and if the AR display brightness is reasonable, the AR glasses adjust the AR display brightness according to the optimal AR display brightness.
The invention also provides a perception brightness characterization system for the AR glasses display, which comprises an eye movement instrument, a photoreceptor (mainly used for monitoring the brightness condition of ambient light), an optimal AR display brightness calculation module, a perception brightness calculation module and an AR display brightness adjustment module which are arranged in the AR glasses (the three modules are three core parts of the perception brightness characterization system for the AR glasses display and are functional modules of hardware and software algorithms). The eye movement instrument is used for detecting pupil diameter, the photoreceptor is used for detecting background brightness, the optimal AR display brightness calculation module is used for calculating optimal AR display brightness according to the background brightness and the formula (6), the perception brightness calculation module is used for calculating perception brightness according to the optimal AR display brightness, the pupil diameter and the formula (5) and judging whether the perception brightness accords with a preset perception brightness range, and the AR display brightness adjustment module is used for adjusting AR display brightness according to the optimal AR display brightness.
The invention also provides AR glasses, and AR display brightness is adjusted by adopting a perceived brightness characterization method of AR glasses display.
The foregoing is merely a preferred embodiment of the present invention and it should be noted that modifications and adaptations to those skilled in the art may be made without departing from the principles of the present invention, which are intended to be comprehended within the scope of the present invention.