CN114286005A - Image display method and device for vehicle skylight - Google Patents
Image display method and device for vehicle skylight Download PDFInfo
- Publication number
- CN114286005A CN114286005A CN202111633869.6A CN202111633869A CN114286005A CN 114286005 A CN114286005 A CN 114286005A CN 202111633869 A CN202111633869 A CN 202111633869A CN 114286005 A CN114286005 A CN 114286005A
- Authority
- CN
- China
- Prior art keywords
- image
- image display
- user
- sky
- display area
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Controls And Circuits For Display Device (AREA)
- Fittings On The Vehicle Exterior For Carrying Loads, And Devices For Holding Or Mounting Articles (AREA)
Abstract
The invention provides an image display method and device for a vehicle skylight, which comprises the following steps: acquiring coordinates of a specific position of a user in the vehicle; calculating the field angle range of the user relative to the skylight image display area according to the specific position coordinates and the shape, the position and the size of the skylight image display area; acquiring a sky image shot by an exterior camera device in a field angle range; and displaying a sky image on the skylight image display area.
Description
Technical Field
The invention relates to the field of vehicle control, in particular to an image display method and device for a vehicle skylight.
Background
The vehicle skylight is usually installed on the roof, so that air in the vehicle can be effectively circulated, the entering of fresh air is increased, and meanwhile, the vehicle skylight can also widen the visual field of a user and meet the shooting requirement of mobile shooting and videoing in a special scene. Vehicle sunroofs can be broadly divided into: the device is mainly installed on commercial SUVs, cars and other vehicle types.
However, in the prior art, the conventional sunroof of the vehicle can only observe external information through the glass disposed thereon, but due to the light transmittance of the glass, the influence of ambient light, and the visual limitation of human eyes, a user cannot well see a sky image, such as a star, through the sunroof of the roof of the vehicle. In such a case, the existence of the vehicle skylight is similar to a dummy, the original viewing and using functions of the vehicle skylight are completely lost, and the user experience is seriously influenced.
In order to overcome the above defects in the prior art, there is an urgent need in the art for an image display method and apparatus for a vehicle sunroof, which are used for displaying a sky image on an existing vehicle sunroof, can well simulate an actual viewing angle of the sky observed by a user in a vehicle, and are not affected by external factors such as weather and ambient light, so that the practical value of the vehicle sunroof is enhanced, and the user experience in using the vehicle is improved.
Disclosure of Invention
The following presents a simplified summary of one or more aspects in order to provide a basic understanding of such aspects. This summary is not an extensive overview of all contemplated aspects, and is intended to neither identify key or critical elements of all aspects nor delineate the scope of any or all aspects. Its sole purpose is to present some concepts of one or more aspects in a simplified form as a prelude to the more detailed description that is presented later.
In order to overcome the above defects in the prior art, the present invention provides an image display method for a sunroof of a vehicle, comprising: acquiring coordinates of a specific position of a user in the vehicle; calculating the field angle range of the user relative to the skylight image display area according to the specific position coordinates and the shape, the position and the size of the skylight image display area; acquiring a sky image shot by an exterior camera device in the field angle range; and displaying the sky image on the skylight image display area.
In an embodiment, optionally, in the image displaying method for a sunroof of a vehicle provided by the present invention, the shape of the sunroof image display area is a rectangle, and the calculating the field angle range of the user with respect to the sunroof image display area according to the specific position coordinates and the shape, the position, and the size of the sunroof image display area includes: and determining the observation angles of the user specific position relative to two opposite sides of the rectangle in the direction respectively in the length direction and the width direction of the rectangle by taking the vertical direction as a reference line according to the height of the skylight image display area relative to the user specific position and the size of the skylight image display area, wherein the difference of the two observation angles is the field angle range of the user in the direction, and the field angle range of the user relative to the skylight image display area is formed by the field angle ranges in the two directions.
In an embodiment, preferably, in the image display method for a sunroof of a vehicle according to the present invention, the field angle range of the image pickup device outside the vehicle is not less than twice the angle corresponding to the user-specific position with respect to the side of the rectangle farther in the direction, in both the length and width directions of the rectangle, respectively.
In an embodiment, it is preferable that, in the image display method for a sunroof for a vehicle according to the present invention, the displaying the sky image on the sunroof image display area includes: and brightening the sky image by using a dark light image enhancement model, wherein the dark light image enhancement model is obtained by training a plurality of groups of photo samples collected by a camera, each group of photo samples are collected by the camera in the same scene, other parameters of the camera are fixed, and the exposure time and the ISO light sensitivity are changed.
In an embodiment, it is preferable that, in the image display method for a sunroof for a vehicle according to the present invention, the displaying the sky image on the sunroof image display area further includes: and displaying the sky image after scaling the sky image to adapt to the size of the display area of the skylight image.
In an embodiment, it is preferable that the method for displaying an image of a sunroof for a vehicle according to the present invention, wherein the acquiring the sky image captured by the vehicle exterior imaging device in the field angle range includes: carrying out image classification processing on the acquired sky image so as to identify the current weather; and acquiring a sky image shot by the camera outside the vehicle at the current geographic position in the field angle range at other moments in response to the current bad weather condition.
In an embodiment, it is preferable that the method for displaying an image of a sunroof for a vehicle according to the present invention further includes: and responding to the poor current weather condition, and acquiring a sky virtual image corresponding to the current geographic position from the cloud server according to the current geographic position.
In an embodiment, optionally, in the image display method for a sunroof of a vehicle provided by the present invention, the specific position includes an eyebrow position of the user.
In an embodiment, preferably, in the image display method for a sunroof of a vehicle according to the present invention, the acquiring coordinates of the specific location of the user in the vehicle includes: acquiring the image coordinates of the eyebrow center of the user through an in-vehicle camera device; and determining the coordinates of the eyebrow center of the user under a world coordinate system according to the image coordinates of the eyebrow center of the user.
In one embodiment, in the image display method of a sunroof for a vehicle according to the present invention, the exterior imaging device is provided at a top end of the vehicle, and the lens is directed to a sky direction in a default state.
Another aspect of the present invention provides an image display device of a sunroof for a vehicle, including: a memory; and a processor coupled to the memory, wherein the processor is configured to: acquiring coordinates of a specific position of a user in the vehicle; calculating the field angle range of the user relative to the skylight image display area according to the specific position coordinates and the shape, the position and the size of the skylight image display area; acquiring a sky image shot by an exterior camera device in the field angle range; and displaying the sky image on the skylight image display area.
In an embodiment, optionally, in the image display device for a sunroof in a vehicle provided in the present invention, the sunroof image display area has a rectangular shape, and the processor is further configured to: and determining the observation angles of the user specific position relative to two opposite sides of the rectangle in the direction respectively in the length direction and the width direction of the rectangle by taking the vertical direction as a reference line according to the height of the skylight image display area relative to the user specific position and the size of the skylight image display area, wherein the difference of the two observation angles is the field angle range of the user in the direction, and the field angle range of the user relative to the skylight image display area is formed by the field angle ranges in the two directions.
In one embodiment, it is preferable that, in the image display device of a sunroof according to the present invention, a field angle range of the image pickup device outside the vehicle is not less than twice an angle corresponding to the user-specified position with respect to a side of the rectangle farther in the direction, in both the length and width directions of the rectangle, respectively.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and brightening the sky image by using a dark light image enhancement model, wherein the dark light image enhancement model is obtained by training a plurality of groups of photo samples collected by a camera, each group of photo samples are collected by the camera in the same scene, other parameters of the camera are fixed, and the exposure time and the ISO light sensitivity are changed.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and displaying the sky image after scaling the sky image to adapt to the size of the display area of the skylight image.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: carrying out image classification processing on the acquired sky image so as to identify the current weather; and acquiring a sky image shot by the camera outside the vehicle at the current geographic position in the field angle range at other moments in response to the current bad weather condition.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and responding to the poor current weather condition, and acquiring a sky virtual image corresponding to the current geographic position from the cloud server according to the current geographic position.
In an embodiment, optionally, in the image display device of a sunroof for a vehicle provided by the present invention, the specific position includes a brow center position of the user.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: acquiring the image coordinates of the eyebrow center of the user through an in-vehicle camera device; and determining the coordinates of the eyebrow center of the user under a world coordinate system according to the image coordinates of the eyebrow center of the user.
In one embodiment, in the image display device for a sunroof of a vehicle according to the present invention, the vehicle exterior image pickup device is provided at a top end of the vehicle, and the lens is preferably directed to a sky direction in a default state.
The invention also provides a computer-readable medium, on which a computer program is stored, characterized in that the computer program, when executed by a processor, carries out the steps of the image display method of a vehicle sunroof described in any one of the above.
Drawings
The above features and advantages of the present disclosure will be better understood upon reading the detailed description of embodiments of the disclosure in conjunction with the following drawings. In the drawings, components are not necessarily drawn to scale, and components having similar relative characteristics or features may have the same or similar reference numerals.
Fig. 1 is a flowchart illustrating a method of displaying an image of a sunroof for a vehicle according to an aspect of the present invention;
FIG. 2 is a flowchart illustrating a method for obtaining coordinates of a specific location of a user according to an embodiment of the present invention;
FIG. 3A is a schematic plan-view angle diagram illustrating the relative positions of the human eye and the sunroof of the vehicle according to one embodiment of the present invention;
fig. 3B is a schematic view illustrating a field angle range determined by the relative positions of human eyes and a sunroof of the vehicle according to the vehicle exterior imaging device according to an embodiment of the invention;
FIG. 4 is a flowchart illustrating a method for acquiring a sky image according to a current weather according to an embodiment of the invention; and
fig. 5 is a schematic device structure diagram of an image display device for a sunroof of a vehicle according to another aspect of the present invention.
For clarity, a brief description of the reference numerals is given below:
301 skylight
302 human eye
303 vehicle exterior camera device
Detailed Description
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure. While the invention will be described in connection with the preferred embodiments, there is no intent to limit its features to those embodiments. On the contrary, the invention is described in connection with the embodiments for the purpose of covering alternatives or modifications that may be extended based on the claims of the present invention. In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present invention. The invention may be practiced without these particulars. Moreover, some of the specific details have been left out of the description in order to avoid obscuring or obscuring the focus of the present invention.
In the description of the present invention, it should be noted that, unless otherwise explicitly specified or limited, the terms "mounted," "connected," and "connected" are to be construed broadly, e.g., as meaning either a fixed connection, a removable connection, or an integral connection; can be mechanically or electrically connected; they may be connected directly or indirectly through intervening media, or they may be interconnected between two elements. The specific meanings of the above terms in the present invention can be understood in specific cases to those skilled in the art.
Additionally, the terms "upper," "lower," "left," "right," "top," "bottom," "horizontal," "vertical" and the like as used in the following description are to be understood as referring to the segment and the associated drawings in the illustrated orientation. The relative terms are used for convenience of description only and do not imply that the described apparatus should be constructed or operated in a particular orientation and therefore should not be construed as limiting the invention.
It will be understood that, although the terms first, second, third, etc. may be used herein to describe various elements, regions, layers and/or sections, these elements, regions, layers and/or sections should not be limited by these terms, but rather are used to distinguish one element, region, layer and/or section from another element, region, layer and/or section. Thus, a first component, region, layer or section discussed below could be termed a second component, region, layer or section without departing from some embodiments of the present invention.
In order to overcome the defects in the prior art, the invention provides an image display method and device for a vehicle skylight, which are used for displaying a sky image on the conventional vehicle skylight, can well simulate the actual viewing angle of the sky observed by a user in a vehicle, are not influenced by external factors such as weather and ambient light, enhance the practical value of the vehicle skylight and improve the vehicle using experience of the user.
Fig. 1 is a method flowchart illustrating an image display method of a sunroof for a vehicle according to an aspect of the present invention.
Referring to fig. 1, an image display method 100 of a sunroof in a vehicle according to the present invention includes:
step 101: coordinates of a user-specific location within the vehicle are obtained.
In an embodiment, the specific location of the user comprises an eyebrow position of the user.
To a certain extent, the eyebrow position of a person can well mark the starting point of the sight line of the user, so the eyebrow position of the user is usually used as the position of the eyes to replace the position of the person to draw a simulated sight line trend. And for the actual distance error between the two eyes and the eyebrow center of the person, the distance error can be almost ignored under the scene of observing the sky, so that the position of the eyebrow center can well replace the position of the eyes of the person.
Fig. 2 is a flowchart illustrating a method for obtaining coordinates of a specific location of a user according to an embodiment of the invention.
Referring to fig. 2, in an embodiment, preferably, in the image display method of a sunroof in a vehicle according to the present invention, the obtaining coordinates of a specific location of a user in the vehicle includes:
step 201: and acquiring the image coordinates of the eyebrow center of the user through the in-vehicle camera device.
The in-vehicle imaging device is, for example, a camera provided in a rear view mirror above the middle of a front seat, and can acquire face images of all users in the vehicle.
It is easily understood by those skilled in the art that the camera of the inside rear view mirror is only an exemplary illustration for more clearly illustrating the steps of the image display method of the sunroof in the vehicle provided by the present invention, and is not intended to limit the scope of the present invention. In fact, other miniature radar or infrared devices, such as those installed in a car, can also well acquire the position of the eyebrow of the user, and all that is considered to be within the scope of the present invention.
Referring back to fig. 2, in this embodiment, in the method for displaying an image of a sunroof in a vehicle according to the present invention, the method for obtaining coordinates of a specific location of a user in the vehicle further includes step 202: and determining the coordinates of the eyebrow center of the user under a world coordinate system according to the image coordinates of the eyebrow center of the user.
In one embodiment, the position coordinates of the eyebrow center of the user can be determined by combining internal reference and external reference of the camera according to the user image acquired by the camera.
The determination of the coordinates can be performed, for example, according to the zhang-scaling method.
Zhang's Calibration method is a practical method for Camera Calibration using planar checkerboard, which was published By Zhang Zhengyou doctor in the paper "Flexible Camera Calibration By way of Viewing a Plane From Unknown Orientations" published in ICCV By International Top-level conference in 1999. The method is between a photographic calibration method and a self-calibration method, not only overcomes the defect of a high-precision three-dimensional calibration object required by the photographic calibration method, but also solves the problem of poor robustness of the self-calibration method. The calibration process only needs to use one printed checkerboard, and can shoot several groups of pictures from different directions, any person can make the calibration pattern by himself, the calibration pattern is not only practical, flexible and convenient, but also has high precision and good robustness.
For example, in the embodiment of the present invention, in the steps of the method, the internal reference and the external reference of the in-vehicle camera are obtained first, and for the user image collected by the in-vehicle camera, the position of the eyebrow center point is obtained by using the key point detection method, so as to obtain the image coordinates of the eyebrow center.
Further, the method of monocular depth estimation or binocular depth estimation is used for the face image of the user to obtain the depth information of the eyebrow center. In another embodiment, the eyebrow center depth information can also be acquired according to a micro radar or an infrared distance measuring device.
After the facial image of a user acquires the depth information of the position of the eyebrow center of the user, the image coordinate of the eyebrow center is converted into a world coordinate system according to the depth information of the eyebrow center and the internal reference and external reference of the camera.
The world coordinate system (world coordinate system) is a user-defined coordinate system of a three-dimensional world, which is introduced to describe the position of an object in the real world. A camera coordinate system (camera coordinate system) is a coordinate system established on the camera, defined for describing the position of an object from the perspective of the camera, as the middle ring communicating the world coordinate system and the image/pixel coordinate system. An image coordinate system (image coordinate system) is introduced for describing a projection transmission relation of an object from a camera coordinate system to the image coordinate system in an imaging process, so that coordinates in a pixel coordinate system can be further obtained conveniently. The pixel coordinate system (pixel coordinate system) is introduced for describing the coordinates of the image point on the digital image (photo) after the object is imaged, and is the coordinate system where the information we really read from the camera is.
For example, in the present embodiment, the world coordinate system coordinates of the eyebrow center are set to (Xw, Yw, Zw), and the conversion between the world coordinate system, the camera coordinate system, the image coordinate system, and the pixel coordinate system can be performed according to the following formula according to the zhang-shi scaling method.
The world coordinate system is represented by Xw, Yw and Zw, the camera coordinate system is represented by Xc, Yc and Zc, the image coordinate system is represented by x and y, and the pixel coordinate system is represented by u and v.
Camera extrinsic parameters are understood to relate only to camera extrinsic parameters, and the extrinsic parameter matrix varies with changes in object position. While
For camera reference, it is understood that each value in the matrix is related to only the camera intrinsic parameters, and it does not change with the object position.
According to the method, the coordinates of the current eyebrow position of the user in the world coordinate system can be determined according to the image of the user in the vehicle, which is acquired by the vehicle camera device.
Meanwhile, because the position of the vehicle skylight is relatively fixed, the world coordinate system coordinates of the boundary point of the vehicle skylight can be obtained in advance.
Referring back to fig. 1, the method 100 for displaying an image of a vehicle sunroof provided by the present invention further includes:
step 102: and calculating the field angle range of the user relative to the skylight image display area according to the specific position coordinates and the shape, the position and the size of the skylight image display area.
In an embodiment, in the method for displaying an image of a sunroof for a vehicle according to the present invention, the sunroof image display area is rectangular, and the method for calculating a field angle range of the user with respect to the sunroof image display area according to the specific position coordinates and the shape, position, and size of the sunroof image display area includes: and determining the observation angles of the user specific position relative to two opposite sides of the rectangle in the direction respectively in the length direction and the width direction of the rectangle by taking the vertical direction as a reference line according to the height of the skylight image display area relative to the user specific position and the size of the skylight image display area, wherein the difference of the two observation angles is the field angle range of the user in the direction, and the field angle range of the user relative to the skylight image display area is formed by the field angle ranges in the two directions.
Fig. 3A is a schematic plan-view angle diagram illustrating relative positions of a human eye and a vehicle sunroof according to an embodiment of the invention.
Referring to fig. 3A, in an embodiment, the area of the skylight 301 that can be used for displaying images is a rectangle, and taking the width direction of the rectangle as an example, it is assumed that the width is w, which is usually on the order of cm. The vertical distance of the human eyes 302 from the vehicle sunroof 301 is h cm.
The human eyes 302 of the user observe the outside sky through the skylight 301, and as can be seen in fig. 3A, the two angles obtained by respectively connecting the human eyes 302 with the two rectangular sides are obtained, that is, the angles of the two rectangular sides opposite to each other in the width direction of the rectangle, which are theta, respectively, of the human eyes 302 of the user are obtained in the observation direction2And theta1+θ2. Since the rectangular boundary points of the skylights 301 and the coordinates of the world coordinate system of the eyebrows of the user are known, the corresponding angle values can be calculated according to the information.
And the angular difference theta of the two angles1It is in this direction that the user can observe the field angle range of the outside world through the skylight. The field angle range is calculated, so that the outdoor scene range in which a user can actually observe the outside sky through the skylight can be well simulated, the simulation degree is high, and the actual impression and the use experience of the user are improved.
It is easy to understand that, in the direction of the length of the rectangular display area, the field angle range of the user in the direction can also be calculated by the above method.
Therefore, the user can obtain the whole field angle range of the external sky observed through the skylight at the position of the user.
It is easy to understand that the field angle range is adaptively adjusted for different users, at different positions and different skylights, and the image display area on the skylight is adaptively adjusted, for example, users with different heights, or the same user sits at different positions in the vehicle, or the external scene range observed through the skylight is different for different vehicle skylights with different heights or sizes. Therefore, the image display method of the vehicle skylight provided by the invention can well meet the use requirements of skylight image display of different users and different vehicle types.
In addition, the shape of the skylight image display area in the embodiment is rectangular, and the description is only made for the purpose of more clearly explaining the implementation steps of the image display method of the vehicle skylight provided by the invention, and is not used for limiting the protection scope of the invention. In fact, for other shapes of skylight image display areas, such as circles or other irregular figures, the calculation method similar to that provided in the present invention can be used to calculate the field angle range of the user, and therefore, other shapes of skylight image display areas displaying images in a similar method should be included in the scope of the present invention.
Referring back to fig. 1, the method 100 for displaying an image of a vehicle sunroof provided by the present invention further includes:
step 103: and acquiring a sky image shot by the vehicle exterior shooting device in the view angle range.
Fig. 3B is a schematic view of a field angle range determined by the relative positions of human eyes and a vehicle sunroof of the vehicle exterior imaging device according to an embodiment of the invention.
Referring to fig. 3B, in the embodiment, taking the width direction of the rectangular skylight as an example, the field angle range θ of the external view that the user can observe through the skylight is calculated1Then, the vehicle exterior image pickup device 303 is acquired in the field angle range θ1And (3) taking a sky image to simulate the sky landscape which can be really observed by the user through the skylight.
In one embodiment, the vehicle exterior image capturing device is arranged at the top end of the vehicle, and the lens faces the sky direction in a default state.
It is easy to understand that the distance between the human eye and the camera outside the vehicle can be typically of the order of cm, while the human eye observes the sky, typically at a distance of the order of km. Therefore, the distance between the human eye and the camera is almost negligible compared to the distance to the sky. Therefore, it can be roughly considered that the sky image observed by the human eye and the vehicle exterior imaging device in the same field angle range is consistent.
In one embodiment, the field angle range of the vehicle exterior camera device is not less than twice the angle corresponding to the user-specific position with respect to the side of the rectangle farther away in the direction, in both the length and width directions of the rectangle, respectively.
The viewing angle range of the vehicle exterior image pickup device is the viewing angle range which can be reached by the image pickup device, and if the viewing angle range can be not less than twice of the angle corresponding to the user specific position relative to the rectangular side far away in the direction, the requirement that the user observes the sky by using the skylight at different positions in the vehicle can be well met.
For example, a user can observe the sky well at a position symmetrical to the central axis of the vehicle through the optimized setting of the field angle range of the camera device outside the vehicle at a certain position in the vehicle, and the viewing requirement of the skylight between the two positions can be well met.
Referring back to fig. 1, the method 100 for displaying an image of a vehicle sunroof provided by the present invention further includes:
step 104: and displaying the sky image on the skylight image display area.
In one embodiment, the displaying the sky image on the skylight image display area includes: and brightening the sky image by using a dark light image enhancement model, wherein the dark light image enhancement model is obtained by training a plurality of groups of photo samples collected by a camera, each group of photo samples are collected by the camera in the same scene, other parameters of the camera are fixed, and the exposure time and the ISO light sensitivity are changed.
For example, a sample is acquired by using a camera, other parameters of the camera are fixed, exposure time and ISO sensitivity are changed, and N pairs of samples are acquired on the same scene, and the two groups of dark light and brightening are called a pair of samples. Then, the samples are taken as a training set and sent into a network for training, then a network is trained, and then the pictures with the brightened dark light can be obtained only by sending the actually collected pictures into the network.
In an embodiment, the displaying the sky image on the skylight image display area further includes: and displaying the sky image after scaling the sky image to adapt to the size of the display area of the skylight image.
The size of the image collected by the camera device is different from camera device to camera device, so that the image is displayed in the preset skylight image display area, and the image can be correspondingly scaled to adapt to the size of the skylight image display area.
It can be understood that the field angle range is set to simulate the sky image observed by the user through the vehicle sunroof more truly, and the image scaling is to adapt to the size of the image display area, so as to provide better viewing experience for the user, without contradiction.
Fig. 4 is a flowchart illustrating a method for acquiring a sky image according to a current weather according to an embodiment of the invention.
Referring to fig. 4, in an embodiment, the acquiring of the sky image according to the current weather further includes:
step 401: and carrying out image classification processing on the acquired sky image so as to identify the current weather.
For example, whether the current weather is rainy or haze can be identified by adopting an image classification method.
Step 402: and acquiring a sky image shot by the camera outside the vehicle at the current geographic position in the field angle range at other moments in response to the current bad weather condition.
For example, the sky image shot at the position on a sunny day is used for replacing real-time shooting, so that the image display of the skylight is not influenced by the current weather, and the user experience is enhanced.
In one embodiment, the acquiring the sky image captured by the vehicle exterior imaging device in the field angle range further includes: and responding to the poor current weather condition, and acquiring a sky virtual image corresponding to the current geographic position from the cloud server according to the current geographic position.
At this time, the vehicle sunroof may be used as an image display curtain, and the image desired by the user is acquired from the cloud server and displayed, so that interference of external factors such as weather and ambient light on image display is completely eliminated.
While, for purposes of simplicity of explanation, the methodologies are shown and described as a series of acts, it is to be understood and appreciated that the methodologies are not limited by the order of acts, as some acts may, in accordance with one or more embodiments, occur in different orders and/or concurrently with other acts from that shown and described herein or not shown and described herein, as would be understood by one skilled in the art.
Another aspect of the present invention provides an image display device of a sunroof for a vehicle, including: a memory; and a processor coupled to the memory, wherein the processor is configured to: acquiring coordinates of a specific position of a user in the vehicle; calculating the field angle range of the user relative to the skylight image display area according to the specific position coordinates and the shape, the position and the size of the skylight image display area; acquiring a sky image shot by an exterior camera device in the field angle range; and displaying the sky image on the skylight image display area.
In an embodiment, optionally, in the image display device for a sunroof in a vehicle provided in the present invention, the sunroof image display area has a rectangular shape, and the processor is further configured to: and determining the observation angles of the user specific position relative to two opposite sides of the rectangle in the direction respectively in the length direction and the width direction of the rectangle by taking the vertical direction as a reference line according to the height of the skylight image display area relative to the user specific position and the size of the skylight image display area, wherein the difference of the two observation angles is the field angle range of the user in the direction, and the field angle range of the user relative to the skylight image display area is formed by the field angle ranges in the two directions.
In one embodiment, it is preferable that, in the image display device of a sunroof according to the present invention, a field angle range of the image pickup device outside the vehicle is not less than twice an angle corresponding to the user-specified position with respect to a side of the rectangle farther in the direction, in both the length and width directions of the rectangle, respectively.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and brightening the sky image by using a dark light image enhancement model, wherein the dark light image enhancement model is obtained by training a plurality of groups of photo samples collected by a camera, each group of photo samples are collected by the camera in the same scene, other parameters of the camera are fixed, and the exposure time and the ISO light sensitivity are changed.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and displaying the sky image after scaling the sky image to adapt to the size of the display area of the skylight image.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: carrying out image classification processing on the acquired sky image so as to identify the current weather; and acquiring a sky image shot by the camera outside the vehicle at the current geographic position in the field angle range at other moments in response to the current bad weather condition.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: and responding to the poor current weather condition, and acquiring a sky virtual image corresponding to the current geographic position from the cloud server according to the current geographic position.
In an embodiment, optionally, in the image display device of a sunroof for a vehicle provided by the present invention, the specific position includes a brow center position of the user.
In an embodiment, preferably, in the image display device for a sunroof of a vehicle provided by the present invention, the processor is further configured to: acquiring the image coordinates of the eyebrow center of the user through an in-vehicle camera device; and determining the coordinates of the eyebrow center of the user under a world coordinate system according to the image coordinates of the eyebrow center of the user.
In one embodiment, in the image display device for a sunroof of a vehicle according to the present invention, the vehicle exterior image pickup device is provided at a top end of the vehicle, and the lens is preferably directed to a sky direction in a default state.
Fig. 5 is a schematic device structure diagram of an image display device for a sunroof of a vehicle according to another aspect of the present invention.
As shown in fig. 5, the computer system/server 500 of the image display device of the sunroof of the vehicle is represented in the form of a general-purpose computer apparatus. The components of the computer system/server 500 may include one or more processors 502, memory 501, and a bus 503 that connects the various system components (including the memory 501 and the processors 502).
The bus 503 includes a data bus, an address bus, and a control bus. The product of the number of bits of the data bus and the operating frequency is proportional to the data transfer rate, the number of bits of the address bus determines the maximum addressable memory space, and the control bus (read/write) indicates the type of bus cycle and the time at which the present I/O operation is completed. The processor 502 is connected to the memory 501 via a bus 503 and is configured to implement the vehicle control method provided by any of the above embodiments.
The processor 502 is a final execution unit for information processing and program execution, which is an operation and control core of the computer system/server 500 of the image display device for the sunroof of the vehicle. The operation of all software layers in the computer system will eventually be mapped to the operation of the processor 502 by the instruction set. The processor 502 has the main functions of processing instructions, executing operations, controlling time and processing data.
The memory 501 is a variety of storage devices for storing programs and data in the computer. Memory 501 may include computer system readable media in the form of storage volatile memory. Such as Random Access Memory (RAM)504 and/or cache memory 505.
A Random Access Memory (RAM)504 is an internal memory that exchanges data directly with the processor 502. It can be read and written at any time (except for refreshing), and is fast, usually used as a temporary data storage medium for an operating system or other programs in operation, and the stored data will be lost when power is off. Cache memory (Cache)505 is a level one memory that exists between main memory and processor 502, and is relatively small in size but much faster than main memory, approaching the speed of processor 502.
The computer system/server 500 may further include other removable/non-removable, volatile/nonvolatile computer system storage media. In this embodiment, the storage system 506 may be used to read from and write to non-removable, nonvolatile magnetic media.
The memory 501 may also include at least one set of program modules 507. Program modules 507 may be stored in memory 501. Program modules 507 include, but are not limited to, an operating system, one or more application programs, other program modules, and program data, each of which, or some combination thereof, may comprise an implementation of a network environment. Program modules 507 generally perform the functions and/or methodologies of embodiments of the invention as described herein.
Computer system/server 500 may also communicate with one or more external devices 508 (e.g., keyboard, pointing device, display 509, etc.), with one or more devices that enable a user to interact with the computer system/server 500, and/or with any devices (e.g., network card, modem, etc.) that enable the computer system/server 500 to communicate with one or more other computing devices. Such communication may occur via input/output (I/O) interfaces 510.
Computer system/server 500 may also communicate with one or more networks (e.g., a Local Area Network (LAN), a Wide Area Network (WAN), and/or a public network such as the internet) through network adapter 511. As shown in FIG. 5, network adapter 511 communicates with the other modules of computer system/server 500 via bus 503. It should be appreciated that although not shown in the figures, other hardware and/or software modules may be used in conjunction with computer system/server 500, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, among others.
According to another aspect of the present invention, there is also provided herein an embodiment of a computer storage medium.
The computer storage medium has a computer program stored thereon. The computer program, when executed by a processor, may implement the steps of any of the above-described image display methods for a sunroof of a vehicle.
Those of skill in the art would understand that information, signals, and data may be represented using any of a variety of different technologies and techniques. For example, data, instructions, commands, information, signals, bits (bits), symbols, and chips that may be referenced throughout the above description may be represented by voltages, currents, electromagnetic waves, magnetic fields or particles, optical fields or particles, or any combination thereof.
Those of skill would further appreciate that the various illustrative logical blocks, modules, circuits, and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both. To clearly illustrate this interchangeability of hardware and software, various illustrative components, blocks, modules, circuits, and steps have been described above generally in terms of their functionality. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the overall system. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present invention.
The processors described herein may be implemented using electronic hardware, computer software, or any combination thereof. Whether such processors are implemented as hardware or software depends upon the particular application and the overall design constraints imposed on the system. As an example, a processor, any portion of a processor, or any combination of processors presented in this disclosure may be implemented with a microprocessor, a microcontroller, a Digital Signal Processor (DSP), a Field Programmable Gate Array (FPGA), a Programmable Logic Device (PLD), a state machine, gated logic, discrete hardware circuitry, and other suitable processing components configured to perform the various functions described throughout this disclosure. The functionality of a processor, any portion of a processor, or any combination of processors presented in this disclosure may be implemented in software executed by a microprocessor, microcontroller, DSP, or other suitable platform.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied directly in hardware, in a software module executed by a processor, or in a combination of the two. A software module may reside in RAM memory, flash memory, ROM memory, EPROM memory, EEPROM memory, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art. An exemplary storage medium is coupled to the processor such the processor can read information from, and write information to, the storage medium. In the alternative, the storage medium may be integral to the processor. The processor and the storage medium may reside in an ASIC. The ASIC may reside in a user terminal. In the alternative, the processor and the storage medium may reside as discrete components in a user terminal.
In one or more exemplary embodiments, the functions described may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software as a computer program product, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a computer.
By way of example, and not limitation, such computer-readable media can comprise RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to carry or store desired program code in the form of instructions or data structures and that can be accessed by a computer. Any connection is properly termed a computer-readable medium.
For example, if the software is transmitted from a web site, server, or other remote source using a coaxial cable, fiber optic cable, twisted pair, Digital Subscriber Line (DSL), or wireless technologies such as infrared, radio, and microwave, then the coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies such as infrared, radio, and microwave are included in the definition of medium. Disk (disk) and disc (disc), as used herein, includes Compact Disc (CD), laser disc, optical disc, Digital Versatile Disc (DVD), floppy disk and blu-ray disc where disks (disks) usually reproduce data magnetically, while discs (discs) reproduce data optically with lasers. Combinations of the above should also be included within the scope of computer-readable media.
The previous description of the disclosure is provided to enable any person skilled in the art to make or use the disclosure. Various modifications to the disclosure will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other variations without departing from the spirit or scope of the disclosure. Thus, the disclosure is not intended to be limited to the examples and designs described herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.
Claims (21)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111633869.6A CN114286005A (en) | 2021-12-29 | 2021-12-29 | Image display method and device for vehicle skylight |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202111633869.6A CN114286005A (en) | 2021-12-29 | 2021-12-29 | Image display method and device for vehicle skylight |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN114286005A true CN114286005A (en) | 2022-04-05 |
Family
ID=80877638
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202111633869.6A Pending CN114286005A (en) | 2021-12-29 | 2021-12-29 | Image display method and device for vehicle skylight |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN114286005A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115220673A (en) * | 2022-04-07 | 2022-10-21 | 广州汽车集团股份有限公司 | Astral projection method for vehicle, projection apparatus and vehicle |
Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN106791385A (en) * | 2016-12-09 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | A kind of view method, apparatus and system based on virtual reality technology |
| US20180050636A1 (en) * | 2015-04-13 | 2018-02-22 | SEs Solutions GmbH | Virtual panoramic roof or sunroof assembly |
| CN108944682A (en) * | 2018-05-30 | 2018-12-07 | 东莞市路帆电子科技有限公司 | Automobile blind area imaging system and using method |
| CN208484510U (en) * | 2018-05-23 | 2019-02-12 | 重庆普斯德电子有限公司 | Automotive window display system |
| CN110610463A (en) * | 2019-08-07 | 2019-12-24 | 深圳大学 | A method and device for image enhancement |
| CN110835950A (en) * | 2019-11-27 | 2020-02-25 | 湖南海得利网络科技有限公司 | Method for realizing electronic landscape intelligent balcony by utilizing LED spliced screen |
| CN110944163A (en) * | 2019-11-21 | 2020-03-31 | 维沃移动通信有限公司 | An image processing method and electronic device |
| CN110956063A (en) * | 2018-09-27 | 2020-04-03 | 北京小米移动软件有限公司 | Image processing method, device, equipment and storage medium |
| WO2020108835A1 (en) * | 2018-11-27 | 2020-06-04 | Bayerische Motoren Werke Aktiengesellschaft | Displaying image data in a motor vehicle with a roof-mounted display |
| CN111831371A (en) * | 2020-06-05 | 2020-10-27 | 北京百度网讯科技有限公司 | Vehicle window and display control method and system thereof, server, device, storage medium |
| CN113071429A (en) * | 2020-01-06 | 2021-07-06 | 惠州市德赛西威汽车电子股份有限公司 | Method and system for displaying starry sky image based on geographical position |
| CN113284054A (en) * | 2020-02-19 | 2021-08-20 | 华为技术有限公司 | Image enhancement method and image enhancement device |
-
2021
- 2021-12-29 CN CN202111633869.6A patent/CN114286005A/en active Pending
Patent Citations (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20180050636A1 (en) * | 2015-04-13 | 2018-02-22 | SEs Solutions GmbH | Virtual panoramic roof or sunroof assembly |
| CN106791385A (en) * | 2016-12-09 | 2017-05-31 | 深圳创维－Rgb电子有限公司 | A kind of view method, apparatus and system based on virtual reality technology |
| CN208484510U (en) * | 2018-05-23 | 2019-02-12 | 重庆普斯德电子有限公司 | Automotive window display system |
| CN108944682A (en) * | 2018-05-30 | 2018-12-07 | 东莞市路帆电子科技有限公司 | Automobile blind area imaging system and using method |
| CN110956063A (en) * | 2018-09-27 | 2020-04-03 | 北京小米移动软件有限公司 | Image processing method, device, equipment and storage medium |
| WO2020108835A1 (en) * | 2018-11-27 | 2020-06-04 | Bayerische Motoren Werke Aktiengesellschaft | Displaying image data in a motor vehicle with a roof-mounted display |
| CN110610463A (en) * | 2019-08-07 | 2019-12-24 | 深圳大学 | A method and device for image enhancement |
| CN110944163A (en) * | 2019-11-21 | 2020-03-31 | 维沃移动通信有限公司 | An image processing method and electronic device |
| CN110835950A (en) * | 2019-11-27 | 2020-02-25 | 湖南海得利网络科技有限公司 | Method for realizing electronic landscape intelligent balcony by utilizing LED spliced screen |
| CN113071429A (en) * | 2020-01-06 | 2021-07-06 | 惠州市德赛西威汽车电子股份有限公司 | Method and system for displaying starry sky image based on geographical position |
| CN113284054A (en) * | 2020-02-19 | 2021-08-20 | 华为技术有限公司 | Image enhancement method and image enhancement device |
| CN111831371A (en) * | 2020-06-05 | 2020-10-27 | 北京百度网讯科技有限公司 | Vehicle window and display control method and system thereof, server, device, storage medium |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN115220673A (en) * | 2022-04-07 | 2022-10-21 | 广州汽车集团股份有限公司 | Astral projection method for vehicle, projection apparatus and vehicle |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11748906B2 (en) | Gaze point calculation method, apparatus and device | |
| CN108171673B (en) | Image processing method, device, vehicle head-up display system and vehicle | |
| TWI712918B (en) | Method, device and equipment for displaying images of augmented reality | |
| CN113518996B (en) | Damage detection from multi-view visual data | |
| US20220319130A1 (en) | Method for simulating natural perception in virtual and augmented reality scenes | |
| CN109685913B (en) | Augmented Reality Realization Method Based on Computer Vision Positioning | |
| US20230033956A1 (en) | Estimating depth based on iris size | |
| WO2019042216A1 (en) | Image blurring processing method and device, and photographing terminal | |
| US8917317B1 (en) | System and method for camera calibration | |
| CN107452031B (en) | Virtual ray tracking method and light field dynamic refocusing display system | |
| CN107911621A (en) | A kind of image pickup method of panoramic picture, terminal device and storage medium | |
| CN109214350A (en) | A kind of determination method, apparatus, equipment and the storage medium of illumination parameter | |
| CN110213491A (en) | Focal length adjusting method and device and storage medium | |
| WO2023226370A1 (en) | Three-dimensional reproduction method and system for target object | |
| CN113744361B (en) | A method and device for constructing three-dimensional high-precision maps based on trinocular vision | |
| CN118411398A (en) | Method and device for reconstructing three-dimensional geometry and optical materials of small porcelain | |
| CN114286005A (en) | Image display method and device for vehicle skylight | |
| CN114296239B (en) | Image display method and device for vehicle window | |
| CN114494457A (en) | Camera calibration system, method, device and storage medium based on stereo target | |
| CN116977449B (en) | An active calibration method for compound eye event cameras based on flickering checkerboard | |
| CN115033998B (en) | Personalized 2D data set construction method for mechanical parts | |
| CN106023723A (en) | Educational toy set and convex mirror imaging correction method | |
| CN116681689A (en) | Occlusion image generation method and device, electronic equipment and storage medium | |
| CN115660959A (en) | Image generation method and device, electronic equipment and storage medium | |
| CN114549627A (en) | Method and device for measuring distance of target, image acquisition equipment and medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Address after: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant after: United New Energy Automobile Co.,Ltd. Address before: 314500 988 Tong Tong Road, Wu Tong Street, Tongxiang, Jiaxing, Zhejiang Applicant before: Hozon New Energy Automobile Co., Ltd. |
|
| CB02 | Change of applicant information | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20220405 |
|
| RJ01 | Rejection of invention patent application after publication |