CN115904079A - Display equipment adjusting method, device, terminal and storage medium - Google Patents

Abstract

The embodiment of the present application discloses a display device adjustment method, device, terminal and storage medium, which belong to the field of computer technology. The method includes: based on a plurality of face key points of the target object, determining an intersection point between the line of sight of the target object and a display screen of a display device; and adjusting the intersection point based on a vertical distance between the intersection point and a center point of the display screen. The height of the display device, so that the center point of the display screen and the intersection point are at the same horizontal height; based on the angle between the line of sight and the perpendicular line of the display screen at the center point, adjust The orientation of the display device is such that the included angle between the line of sight and the mid-perpendicular line is smaller than an angle threshold. The method can automatically adjust the position and angle of the display device according to the user's line of sight, without the need for manual adjustment by the user, thereby improving the adjustment efficiency.

Description

Display device adjustment method, device, terminal and storage medium

technical field

The embodiments of the present application relate to the field of computer technologies, and in particular to a display device adjustment method, device, terminal, and storage medium.

Background technique

With the development of computer technology, various electronic devices have gradually become popular. When using a terminal with a display device such as a desktop computer or a notebook computer, a user often needs to maintain the same posture for a long time to watch the display device. If the display device is placed in an inappropriate position, users can easily feel fatigued. Therefore, how to alleviate the user's fatigue is a problem that needs to be solved.

At present, a height-adjustable bracket is usually configured for the display device. Users can adjust the height of the display device by manually adjusting the bracket according to their sitting posture and habits, so that the height of the display device is within the user's best line of sight, thereby relieving The fatigue of the user watching the display device for a long time. However, with this method, manual adjustment is required by the user, the operation is relatively cumbersome, and the adjustment efficiency is low.

Contents of the invention

Embodiments of the present application provide a display device adjustment method, device, terminal, and storage medium, which can automatically adjust the position and angle of the display device according to the user's line of sight. Described technical scheme is as follows:

In one aspect, a method for adjusting a display device is provided, the method comprising:

Based on a plurality of face key points of the target object, determine the intersection of the line of sight of the target object and the display screen of the display device;

adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen is at the same level as the intersection point;

Adjusting the orientation of the display device based on the angle between the line of sight and the vertical line of the display screen at the center point, so that the angle between the line of sight and the vertical line is smaller than an angle threshold .

In some embodiments, the height of the display device is adjusted based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen is at the same level as the intersection point height, including:

If the vertical distance is not greater than the distance threshold, the display device is adjusted in a first adjustment manner, and the first adjustment manner is used to indicate that the height of the display device is adjusted at a first speed.

In some embodiments, the method also includes:

When the vertical distance is greater than the distance threshold, a prompt message is displayed on the display screen, the prompt message is used to prompt the target object to suspend using the display device, and the target object will be adjusted the height of the display device;

In response to the confirmation operation of the prompt information by the target object, the display device is adjusted in a second adjustment manner, and the second adjustment manner is used to indicate that the target object suspends the use of the display device Next, adjust the height of the display device at a second speed, where the second speed is greater than the first speed.

In some embodiments, the method also includes:

Based on the horizontal distance between the intersection point and the center point of the display screen, horizontally adjust the display device so that the intersection point is located at the center point of the display screen.

In some embodiments, the method also includes:

Determining an angle between the line of sight of the target object and the plane where the display screen is located based on a plurality of face key points of the target object;

Based on the included angle between the line of sight of the target object and the plane where the display screen is located, adjust the pitch angle of the display device so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

In some embodiments, before determining the intersection of the line of sight of the target object and the display screen of the display device based on the multiple face key points of the target object, the method further includes: performing face recognition on the target object , determining a plurality of face key points of the target object.

In some embodiments, the method also includes:

performing gesture recognition on the target object, and determining a plurality of skeletal key points of the target object;

Determine the distance between the target object and the display device based on the ratio of the size of the skeletal key point to the size of a standard skeletal key point, where the size of the standard skeletal key point is used to indicate the distance between the target object and the display device. the preset distance between the display devices;

At least one of display brightness, display content size, and screen resolution of the display screen is adjusted based on the distance between the target object and the display device.

In another aspect, an apparatus for adjusting a display device is provided, the apparatus comprising:

The first determination module is used to determine the intersection of the line of sight of the target object and the display screen of the display device based on a plurality of face key points of the target object;

A first adjustment module, configured to adjust the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen is at the same level as the intersection point ;

The second adjustment module is configured to adjust the orientation of the display device based on the angle between the line of sight and the vertical line of the display screen at the center point, so that the distance between the line of sight and the vertical line The angle between them is smaller than the angle threshold.

In some embodiments, the first adjustment module is configured to adjust the display device in a first adjustment mode when the vertical distance is not greater than a distance threshold, and the first adjustment mode is used to indicate Adjusting the height of the display device with a first speed.

In some embodiments, the first adjustment module is configured to display prompt information on the display screen when the vertical distance is greater than the distance threshold, and the prompt information is used to prompt the target object Suspending the use of the display device, the height of the display device will be adjusted for the target object; in response to the confirmation operation of the target object on the prompt information, the second adjustment method is used to adjust the display device, so The second adjustment manner is used to indicate that when the target object suspends using the display device, adjust the height of the display device at a second speed, where the second speed is greater than the first speed.

In some embodiments, the first adjustment module is configured to horizontally adjust the display device based on the horizontal distance between the intersection point and the center point of the display screen, so that the intersection point is located on the display screen the center point of .

In some embodiments, the second adjustment module is configured to determine the included angle between the line of sight of the target object and the plane on which the display screen is located based on a plurality of facial key points of the target object; adjusting the pitch angle of the display device so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

In some embodiments, the device also includes:

The second determining module is configured to perform face recognition on the target object, and determine a plurality of face key points of the target object.

In some embodiments, the device also includes:

The third determining module is configured to perform gesture recognition on the target object, and determine a plurality of skeletal key points of the target object;

A fourth determination module, configured to determine the distance between the target object and the display device based on the ratio of the size of the key point of the bone to the size of the key point of the standard bone, the size of the key point of the standard bone is used for Indicating a preset distance between the target object and the display device;

A third adjustment module, configured to adjust at least one of display brightness, display content size, and screen resolution of the display screen based on the distance between the target object and the display device.

In another aspect, a terminal is provided, the terminal includes a processor and a memory, at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor, so as to realize the above aspects The display device adjustment method.

In another aspect, a computer-readable storage medium is provided, wherein at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor, so as to realize the above-mentioned Displays the device adjustment method.

In another aspect, a computer program product is provided, including a computer program, the computer program is loaded and executed by a processor, so as to implement the method for adjusting a display device as described in the above aspects.

The embodiment of the present application provides a display device adjustment solution, which can determine the direction of the target object's line of sight and the intersection point of the target object's line of sight and the display screen of the display device through multiple face key points of the target object. The height of the display device is adjusted according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point of the line of sight on the display screen are at the same horizontal height. When the display screen is not directly facing the target object, there is a certain angle between the vertical line of the display screen at the center point and the line of sight of the target object. Adjusting the orientation of the display device based on the angle can make the line of sight and the vertical line The angle between them is smaller than the angle threshold, so that the display screen is adjusted to face the orientation of the target object. Therefore, by adjusting the height and orientation of the display device through multiple face key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's line of sight, without manual adjustment by the user, and the adjustment efficiency is improved.

Description of drawings

In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the description of the embodiments. Obviously, the drawings in the following description are only some implementations of the embodiments of the present application For example, those of ordinary skill in the art can also obtain other drawings based on these drawings on the premise of not paying creative efforts.

FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application;

FIG. 2 is a flowchart of a method for adjusting a display device provided by an embodiment of the present application;

Fig. 3 is a flow chart of another method for adjusting a display device provided by an embodiment of the present application;

FIG. 4 is a schematic diagram of a display device provided by an embodiment of the present application;

Fig. 5 is a schematic structural diagram of a device for adjusting a display device provided by an embodiment of the present application;

Fig. 6 is a schematic structural diagram of another display device adjustment device provided by an embodiment of the present application;

FIG. 7 is a schematic structural diagram of a terminal provided by an embodiment of the present application.

Detailed ways

In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the following will further describe the embodiments of the present application in detail in conjunction with the accompanying drawings.

In this application, the terms "first" and "second" are used to distinguish the same or similar items with basically the same function and function. It should be understood that "first", "second" and "nth" There are no logical or timing dependencies, nor are there restrictions on quantity or order of execution.

In this application, the term "at least one" means one or more, and the meaning of "multiple" means two or more.

It should be noted that the information (including but not limited to user equipment information, user personal information, etc.), data (including but not limited to data used for analysis, stored data, displayed data, etc.) and signals involved in this application, All are authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of the relevant countries and regions. For example, the multiple face key points of the target object involved in this application are obtained under sufficient authorization.

FIG. 1 is a schematic diagram of an implementation environment provided by an embodiment of the present application. Referring to FIG. 1 , the implementation environment includes: a display device 101 , a photographing device 102 and a three-axis rotating support 103 .

The display device 101 and the photographing device 102 can be connected directly or indirectly through wired or wireless communication, which is not limited in this application.

In some embodiments, the display device 101 is a desktop computer with a display screen, a notebook computer, a tablet computer, a smart phone, an intelligent voice interaction device, and VR (Virtual Reality, virtual reality), AR (Augmented Reality, augmented reality) and other virtual realities. equipment, etc., but not limited thereto. The display device 101 is installed and runs an application program that supports adjustment of the display device 101 . Schematically, by using this application program, the height of the display device 101 can be automatically adjusted based on the user's line of sight.

In some embodiments, the display device 101 is configured with a three-axis rotating stand 103 . The adjustment direction of the three-axis rotating bracket 103 includes three axes of X-axis, Y-axis and Z-axis, which can provide multi-dimensional adjustment of height, orientation and pitch for the display device 101 .

In some embodiments, the shooting device 102 is a device with a shooting function such as a camera, a still camera, a video camera, and a 3D somatosensory camera. The photographing device 102 is used to perform face recognition and gesture recognition on the user, and determine multiple face key points and multiple bone key points of the user, thereby determining the user's line of sight and the distance between the user and the display device 101 . Schematically, the application program installed on the display device 101 can determine the height, orientation, and pitch angle of the display device 101 that need to be adjusted based on the user's line of sight determined by the shooting device 102, so as to control the three-axis rotating bracket 103 to perform corresponding adjustments on the display device 101. Adjustment.

In some embodiments, the implementation environment also includes a server. The server is an independent physical server, or it can be a server cluster or distributed system composed of multiple physical servers, and it can also provide cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communications, middleware Cloud servers for basic cloud computing services such as domain name services, security services, CDN (ContentDelivery Network, content distribution network), and big data and artificial intelligence platforms. The server is used by the application to provide background services. In some embodiments, the server undertakes the main calculation work, and the display device 101 undertakes the secondary calculation work; or, the server undertakes the secondary calculation work, and the display device 101 undertakes the main calculation work; or, the server and the display device 101 adopt Distributed computing architecture for collaborative computing.

Those skilled in the art may know that the number of the above display devices may be more or less. For example, there may be only one display device, or there may be dozens or hundreds of display devices, or more. The embodiment of the present application does not limit the number and type of display devices.

Fig. 2 is a flowchart of a method for adjusting a display device provided by an embodiment of the present application. The embodiment of the present application is executed by a display device, and the display device may be a terminal or a device external to the terminal for displaying images. Referring to Figure 2, the method includes:

201. Based on multiple face key points of a target object, determine an intersection point between a line of sight of the target object and a display screen of a display device.

In the embodiment of the present application, the target object is a user using a display device. The display device is equipped with a display screen and a shooting device. When the target object watches the display screen of the display device, the photographing device can capture the face information of the target object in real time to determine multiple face key points of the target object. Among them, the key points of the face include key points such as eyebrows, eyes, pupils, nose and mouth.

Based on multiple face key points captured by the shooting device, it is possible to determine the movement direction of the pupil key point of the target object relative to other face key points, that is, determine the eye movement direction of the target object, and then determine the line of sight direction of the target object. When the target object watches a certain position of the display screen for a long time, the pixel point corresponding to the line of sight direction on the display screen can be determined according to the line of sight direction of the target object, and the pixel point can be used as the line of sight of the target object and the display screen intersection point.

202. Based on the vertical distance between the intersection point and the center point of the display screen, adjust the height of the display device, so that the center point of the display screen and the intersection point are at the same horizontal height.

In the embodiment of the present application, based on the size of the display screen, the pixel point at the center of the display screen can be determined, and this pixel point can be used as the center point of the display screen. If there is a certain distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point in the vertical direction, the height of the display device does not meet the optimum viewing height of the target object, and the height of the display device needs to be adjusted. Wherein, the optimal viewing height is a height at which the user is not likely to feel tired when watching the display screen. The optimum viewing height can be set according to experience when the display device leaves the factory, or can be set by the user according to requirements.

In the embodiment of the present application, the display device is installed with a three-axis rotating bracket. The three-axis rotating bracket can support adjustments in three different axes, thereby providing multi-dimensional adjustments of height, orientation and pitch for the display device. The display device uses the vertical distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point as the vertical distance between the intersection point and the center point of the display screen. Based on the vertical distance, the display device adjusts the height of the display device in the vertical direction by controlling the three-axis rotating bracket until the center point of the display screen and the intersection point are at the same horizontal height. At this time, the vertical distance is 0, and the height of the display device conforms to Optimal viewing height for the target object.

203. Based on the angle between the line of sight and the vertical line at the center point of the display screen, adjust the orientation of the display device, so that the angle between the line of sight and the vertical line is smaller than an angle threshold.

In the embodiment of the present application, the vertical line at the central point of the display screen is perpendicular to the plane where the display screen is located, and can reflect the orientation of the display screen. When there is a certain angle between the line of sight of the target object and the vertical line, the direction of the display screen is not directly facing the target object. Based on the angle between the line of sight of the target object and the perpendicular, the display device adjusts the orientation of the display device by controlling the three-axis rotating bracket until the angle between the line of sight of the target object and the perpendicular is smaller than the angle threshold. When the display screen is facing the target object. Wherein, the angle threshold may be a preset angle, such as 5°, 7° or 10°, and the embodiment of the present application does not limit the angle threshold.

The embodiment of the present application provides a method for adjusting a display device, which can determine the direction of the target object's line of sight and the intersection point of the target object's line of sight and the display screen of the display device through multiple key points of the target object's face. The height of the display device is adjusted according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point of the line of sight on the display screen are at the same horizontal height. When the display screen is not directly facing the target object, there is a certain angle between the vertical line of the display screen at the center point and the line of sight of the target object. Adjusting the orientation of the display device based on the angle can make the line of sight and the vertical line The angle between them is smaller than the angle threshold, so that the display screen is adjusted to face the orientation of the target object. Therefore, by adjusting the height and orientation of the display device through multiple face key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's line of sight, without manual adjustment by the user, and the adjustment efficiency is improved.

Fig. 3 is a flow chart of another method for adjusting a display device provided by an embodiment of the present application. The embodiment of the present application is executed by a display device, and the display device may be a terminal or a device external to the terminal for displaying images. Referring to Figure 3, the method includes:

301. Perform face recognition on the target object, and determine multiple face key points of the target object.

In the embodiment of the present application, the target object is a user using a display device. The display device is equipped with a display screen and a shooting device. When the target object watches the display screen of the display device, the photographing device can capture the face information of the target object in real time to determine multiple face key points of the target object. Among them, the key points of the face include key points such as eyebrows, eyes, pupils, nose and mouth.

In some embodiments, the display device can determine a plurality of facial key points of the target object based on the facial information of the target object through a face recognition model. Correspondingly, based on the face recognition model, face key point recognition is performed on the facial information of the target object captured by the shooting device, and multiple face key points such as eyebrows, eyes, pupils, nose, and mouth of the target object are determined. Wherein, the face recognition model is used to determine multiple key points of the face of the target object and the position of each key point of the face based on the input facial information of the target object. Because the face recognition model has self-learning ability, that is, the more times the face recognition model performs face recognition, the stronger the self-learning ability of the model, and then the key points of the face obtained based on facial information are more accurate, thus A plurality of facial key points of a target object and the position of each facial key point can be determined more accurately.

302. Based on the multiple face key points of the target object, determine an intersection point between the line of sight of the target object and the display screen of the display device.

In the embodiment of the present application, based on the multiple face key points of the target object and the position of each face key point, it is possible to determine the movement direction of the pupil key point of the target object relative to other face key points, that is, to determine the target object eye movement direction, and then determine the gaze direction of the target object. When the target object watches a certain position of the display screen for a long time, the pixel point corresponding to the line of sight direction on the display screen can be determined according to the line of sight direction of the target object, and the pixel point can be used as the line of sight of the target object and the display screen intersection point.

In some embodiments, the photographing device is a camera with an infrared function. The photographing device can project controllable infrared light spots, infrared rays or infrared light surfaces to the target object through the infrared light source, so as to collect reflection images generated by the target object to the projected infrared light. Then, based on the collected reflection images and the positions of multiple face key points, the reflection of infrared light on the pupil key points of the target object is identified, and the eye movement direction of the target object is determined. Based on the eye movement direction of the target object relative to the movement directions of other facial key points, the gaze direction of the target object can be determined.

303. Based on the vertical distance between the intersection point and the center point of the display screen, adjust the height of the display device, so that the center point of the display screen and the intersection point are at the same horizontal height.

In the embodiment of the present application, based on the size of the display screen, the pixel point at the center of the display screen can be determined, and this pixel point can be used as the center point of the display screen. If there is a certain distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point in the vertical direction, the height of the display device does not meet the optimum viewing height of the target object, and the height of the display device needs to be adjusted. Wherein, the optimal viewing height refers to a height at which the user is not likely to feel tired when watching the display screen. The optimum viewing height can be set according to experience when the display device leaves the factory, or can be set by the user according to requirements.

In the embodiment of the present application, the display device is installed with a three-axis rotating bracket. The three-axis rotating bracket can support adjustments in three different axes, thereby providing multi-dimensional adjustments of height, orientation and pitch for the display device. The display device uses the vertical distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point as the vertical distance between the intersection point and the center point of the display screen. Based on the vertical distance, the display device adjusts the height of the display device in the vertical direction by controlling the three-axis rotating bracket until the center point of the display screen and the intersection point are at the same horizontal height. At this time, the vertical distance is 0, and the height of the display device is Matches the optimum viewing height for the target audience.

In some embodiments, the display device is equipped with a telescopic and adjustable rocker. As shown in FIG. 4, the display device 401 can determine the intersection point between the line of sight of the target object and the display screen based on the facial information of the target object collected by the shooting device 402, and according to the vertical distance between the intersection point and the center point of the display screen, The height of the display device is adjusted by controlling the telescopic and adjustable rocker 403 so that the center point of the display screen and the intersection point are at the same level.

It should be noted that, based on the vertical distance between the intersection point and the center point of the display screen, the display device can use the following two adjustment methods to adjust the display device respectively.

Mode 1: In the case where the vertical distance is not greater than the distance threshold, the display device needs to be adjusted in a relatively small range, so the display device is adjusted in the first adjustment mode. Wherein, the distance threshold may be a preset distance, such as 3 centimeters, 5 centimeters or 7 centimeters, and the embodiment of the present application does not limit the distance threshold. The first adjustment mode is used to indicate that the height of the display device is adjusted at a first speed. Wherein, the first speed is a relatively slow speed. Correspondingly, the display device controls the three-axis rotating bracket to slowly fine-tune the height of the display device using the first adjustment method, and can adjust the center point of the display screen to be at the same position as the intersection point without affecting the use of the display device by the target user. Horizontal height. At this time, the vertical distance is 0, indicating that the height of the display device meets the best viewing height of the target object.

Method 2. When the vertical distance is greater than the distance threshold, the display device needs to be adjusted to a large extent. Therefore, when the target object suspends using the display device, it is necessary to adjust the height of the display device at a faster speed to improve the adjustment. efficiency. Correspondingly, when the vertical distance is greater than the distance threshold, prompt information is displayed on the display screen. Wherein, the prompt information is used to prompt the target object to suspend the use of the display device, and the target object will adjust the height of the display device at a faster speed. In response to the confirmation operation of the target object on the prompt information, the display device controls the three-axis rotating bracket to adjust the display device in a second adjustment mode, and the second adjustment mode is used to indicate that when the target object suspends using the display device, through the second Adjust the height of the display device until the center point of the display screen and the intersection point are at the same horizontal height. At this time, the vertical distance is 0, and the height of the display device conforms to the optimal viewing height of the target object. Wherein, the second speed is a relatively fast speed, and the second speed is greater than the first speed.

In some embodiments, a horizontal adjustment of the display device is also enabled. If there is a certain distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point in the horizontal direction, the line of sight of the target object is not directly facing the center point of the display screen, so the display device is adjusted in the horizontal direction. The display device uses the horizontal distance between the pixel point corresponding to the center point of the display screen and the pixel point corresponding to the intersection point as the horizontal distance between the intersection point and the center point of the display screen. Based on the horizontal distance between the intersection point and the center point of the display screen, the display device controls the three-axis rotating bracket to adjust the display device horizontally until the intersection point is at the center point of the display screen. At this time, the horizontal distance is 0, and the center point of the display device is facing The line of sight of the target object, even if the target object watches the display screen for a long time, it is not easy to feel tired.

304. Based on the included angle between the line of sight and the vertical line at the center point of the display screen, adjust the orientation of the display device, so that the angle between the line of sight and the vertical line is smaller than an angle threshold.

In the embodiment of the present application, the vertical line at the central point of the display screen is perpendicular to the plane where the display screen is located, and can reflect the orientation of the display screen. When there is a certain angle between the line of sight of the target object and the vertical line, the direction of the display screen is not directly facing the target object. Based on the angle between the line of sight of the target object and the perpendicular, the display device adjusts the orientation of the display device by controlling the three-axis rotating bracket until the angle between the line of sight of the target object and the perpendicular is smaller than the angle threshold. When the display screen is facing the target object. Wherein, the angle threshold may be a preset angle, such as 5°, 7° or 10°, and the embodiment of the present application does not limit the angle threshold.

In some embodiments, the pitch angle of the display device can be adjusted based on the line of sight of the target object. The display device determines the gaze direction of the target object based on the multiple face key points of the target object. When the target object watches a certain position of the display screen, the included angle between the line of sight of the target object and the plane where the display screen is located can be determined according to the line of sight direction of the target object and the plane where the display screen is located. If the included angle is not 90°, the pitch angle of the display screen does not meet the user's optimum viewing angle, and the user will easily feel tired when viewing the display screen at a non-optimum viewing angle. Therefore, it is necessary to adjust the pitch angle of the display device based on the angle between the line of sight of the target object and the plane where the display screen is located, so that the line of sight of the target object is perpendicular to the plane where the display screen is located. The best viewing angle, when the user watches the display screen through the best viewing angle, it is not easy to feel tired.

In some embodiments, parameters of the display screen can be adjusted based on the distance between the target object and the display device. The photographing device can determine a plurality of bone key points of the target object by performing gesture recognition on the target object. The display device determines the distance between the target object and the display device based on the ratio of the size of the bone key point of the target object to the size of the standard bone key point. The size of the standard bone key point is used to indicate the expected distance between the target object and the display device. Set distance. Wherein, the preset distance is a distance at which the user is not likely to feel tired when watching the display screen. The preset distance can be set according to experience when the display device leaves the factory, or can be set by the user according to requirements. Based on the distance between the target object and the display device, at least one of display brightness, display content size, and screen resolution of the display screen is adjusted.

For example, when the distance between the target object and the display device is greater than the preset distance, and the distance between the target object and the display device is relatively large, the content displayed on the display screen will be enlarged; between the target object and the display device When the distance is less than the preset distance, and the distance between the target object and the display device is small, the display brightness of the display screen is lowered to avoid visual fatigue caused by the target object watching a brighter display screen for a long time.

In some embodiments, the display device can detect the fatigue degree of the target object based on the key points of the face or the key points of the skeleton collected by the shooting device. Furthermore, according to the fatigue degree of the target object, the display device is adjusted to reduce the fatigue feeling of the target object. For example, if the size of the eye key points of the target object is smaller than the preset size, or the similarity between the key points of the bones of the target object and the corresponding bone key points in the fatigue state is high, the fatigue degree of the target object is high. Wherein, the preset size is the size of key points of the eyes when the target object is in a non-fatigue state. Correspondingly, the display device increases the content displayed on the display screen, or increases the brightness of the display screen, or decreases the distance between the display device and the target object. It can enable the target object to watch the content of the display screen more clearly, thereby alleviating the fatigue of the target object to a certain extent.

The embodiment of the present application provides a method for adjusting a display device, which can determine the direction of the target object's line of sight and the intersection point of the target object's line of sight and the display screen of the display device through multiple key points of the target object's face. The height of the display device is adjusted according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point of the line of sight on the display screen are at the same horizontal height. When the display screen is not directly facing the target object, there is a certain angle between the vertical line of the display screen at the center point and the line of sight of the target object. Adjusting the orientation of the display device based on the angle can make the line of sight and the vertical line The angle between them is smaller than the angle threshold, so that the display screen is adjusted to face the orientation of the target object. Therefore, by adjusting the height and orientation of the display device through multiple face key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's line of sight, without manual adjustment by the user, and the adjustment efficiency is improved.

FIG. 5 is a schematic structural diagram of an apparatus for adjusting a display device provided by an embodiment of the present application. Referring to FIG. 5 , the device includes: a first determination module 501 , a first adjustment module 502 and a second adjustment module 503 .

The first determination module 501 is configured to determine the intersection of the line of sight of the target object and the display screen of the display device based on a plurality of face key points of the target object;

The first adjustment module 502 is configured to adjust the height of the display device based on the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point are at the same horizontal height;

The second adjustment module 503 is configured to adjust the orientation of the display device based on the angle between the line of sight and the vertical line at the center point of the display screen, so that the angle between the line of sight and the vertical line is smaller than an angle threshold.

In some embodiments, the first adjustment module 502 is configured to adjust the display device in a first adjustment mode when the vertical distance is not greater than the distance threshold, and the first adjustment mode is used to indicate that the display device is adjusted in a first speed the height of.

In some embodiments, the first adjustment module 502 is configured to display prompt information on the display screen when the vertical distance is greater than the distance threshold, the prompt information is used to prompt the target object to suspend using the display device, and to adjust the display for the target object The height of the device; in response to the confirmation operation of the target object on the prompt information, the display device is adjusted in a second adjustment mode, and the second adjustment mode is used to indicate that when the target object suspends using the display device, the display device is adjusted at a second speed The height of the device, the second speed is greater than the first speed.

In some embodiments, the first adjustment module 502 is configured to horizontally adjust the display device based on the horizontal distance between the intersection point and the center point of the display screen, so that the intersection point is located at the center point of the display screen.

In some embodiments, the second adjustment module 503 is configured to determine the angle between the line of sight of the target object and the plane where the display screen is located based on multiple key points of the target object; Adjust the pitch angle of the display device so that the line of sight of the target object is perpendicular to the plane where the display screen is located.

In some embodiments, FIG. 6 is a schematic structural diagram of another display device adjustment device provided in the embodiment of the present application. As shown in FIG. 6 , the device further includes:

The second determination module 504 is configured to perform face recognition on the target object, and determine multiple key points of the target object's face.

In some embodiments, as shown in Figure 6, the device further includes:

The third determination module 505 is used to perform gesture recognition on the target object, and determine a plurality of skeletal key points of the target object;

The fourth determination module 506 is used to determine the distance between the target object and the display device based on the ratio of the size of the key point of the skeleton to the size of the key point of the standard bone, and the size of the key point of the standard bone is used to indicate the distance between the target object and the display device. preset distance between

The third adjustment module 507 is configured to adjust at least one of display brightness, display content size and screen resolution of the display screen based on the distance between the target object and the display device.

An embodiment of the present application provides an apparatus for adjusting a display device, which can determine the direction of the target object's line of sight and the intersection point of the target object's line of sight and the display screen of the display device through multiple key points of the target object's face. The height of the display device is adjusted according to the vertical distance between the intersection point and the center point of the display screen, so that the center point of the display screen and the intersection point of the line of sight on the display screen are at the same horizontal height. When the display screen is not directly facing the target object, there is a certain angle between the vertical line of the display screen at the center point and the line of sight of the target object. Adjusting the orientation of the display device based on the angle can make the line of sight and the vertical line The angle between them is smaller than the angle threshold, so that the display screen is adjusted to face the orientation of the target object. Therefore, by adjusting the height and orientation of the display device through multiple face key points of the target object, the position and angle of the display device can be automatically adjusted according to the user's line of sight, without manual adjustment by the user, and the adjustment efficiency is improved.

It should be noted that the display device adjustment device provided in the above embodiment is only illustrated by dividing the above functional modules. The structure is divided into different functional modules to complete all or part of the functions described above. In addition, the device for adjusting the display device provided by the above embodiment is based on the same idea as the embodiment of the method for adjusting the display device, and its specific implementation process can be found in the method embodiment, and will not be repeated here.

An embodiment of the present application also provides a terminal, the terminal includes a processor and a memory, at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor, so as to implement the method for adjusting the display device in the above embodiment .

FIG. 7 is a schematic structural diagram of a terminal provided by an embodiment of the present application.

The terminal 700 includes: a processor 701 and a memory 702 .

The processor 701 may include one or more processing cores, such as a 4-core processor, an 8-core processor, and the like. The processor 701 can be realized by at least one hardware form of DSP (Digital Signal Processing, digital signal processing), FPGA (Field Programmable Gate Array, field programmable gate array), and PLA (Programmable Logic Array, programmable logic array). Processor 701 may also include a main processor and a coprocessor, and the main processor is a processor for processing data in a wake-up state, also known as a CPU (Central Processing Unit, central processing unit); Low-power processor for processing data in standby state. In some embodiments, the processor 701 may be integrated with a GPU (Graphics Processing Unit, image processing interactor), and the GPU is used for rendering and drawing the content that needs to be displayed on the display screen. In some embodiments, the processor 701 may also include an AI (Artificial Intelligence, artificial intelligence) processor, where the AI processor is configured to process computing operations related to machine learning.

Memory 702 may include one or more computer-readable storage media, which may be non-transitory. The memory 702 may also include high-speed random access memory, and non-volatile memory, such as one or more magnetic disk storage devices and flash memory storage devices. In some embodiments, the non-transitory computer-readable storage medium in the memory 702 is used to store at least one computer program, and the at least one computer program is used to be possessed by the processor 701 to implement the methods provided by the method embodiments in this application. Displays the device adjustment method.

In some embodiments, the terminal 700 may optionally further include: a peripheral device interface 703 and at least one peripheral device. The processor 701, the memory 702, and the peripheral device interface 703 may be connected through buses or signal lines. Each peripheral device can be connected to the peripheral device interface 703 through a bus, a signal line or a circuit board. Optionally, the peripheral device includes: at least one of a radio frequency circuit 704 , a display screen 705 , a camera assembly 706 , an audio circuit 707 and a power supply 708 .

The peripheral device interface 703 may be used to connect at least one peripheral device related to I/O (Input/Output, input/output) to the processor 701 and the memory 702 . In some embodiments, the processor 701, memory 702 and peripheral device interface 703 are integrated on the same chip or circuit board; in some other embodiments, any one of the processor 701, memory 702 and peripheral device interface 703 or The two can be implemented on a separate chip or circuit board, which is not limited in this embodiment.

The radio frequency circuit 704 is used to receive and transmit RF (Radio Frequency, radio frequency) signals, also called electromagnetic signals. The radio frequency circuit 704 communicates with the communication network and other communication devices through electromagnetic signals. The radio frequency circuit 704 converts electrical signals into electromagnetic signals for transmission, or converts received electromagnetic signals into electrical signals. Optionally, the radio frequency circuit 704 includes: an antenna system, an RF transceiver, one or more amplifiers, a tuner, an oscillator, a digital signal processor, a codec chipset, a subscriber identity module card, and the like. The radio frequency circuit 704 can communicate with other devices through at least one wireless communication protocol. The wireless communication protocol includes but is not limited to: metropolitan area network, mobile communication networks of various generations (2G, 3G, 4G and 5G), wireless local area network and/or WiFi (Wireless Fidelity, wireless fidelity) network. In some embodiments, the radio frequency circuit 704 may also include circuits related to NFC (Near Field Communication, short-range wireless communication), which is not limited in this application.

The display screen 705 is used to display a UI (User Interface, user interface). The UI can include graphics, text, icons, video, and any combination thereof. When the display screen 705 is a touch display screen, the display screen 705 also has the ability to collect touch signals on or above the surface of the display screen 705 . The touch signal can be input to the processor 701 as a control signal for processing. At this time, the display screen 705 can also be used to provide virtual buttons and/or virtual keyboards, also called soft buttons and/or soft keyboards. In some embodiments, there may be one display screen 705, which is arranged on the front panel of the terminal 700; in other embodiments, there may be at least two display screens 705, which are respectively arranged on different surfaces of the terminal 700 or in a folding design; In some other embodiments, the display screen 705 may be a flexible display screen, which is arranged on a curved surface or a folded surface of the terminal 700 . Even, the display screen 705 can also be set as a non-rectangular irregular figure, that is, a special-shaped screen. The display screen 705 can be made of LCD (Liquid Crystal Display, liquid crystal display), OLED (Organic Light-Emitting Diode, organic light-emitting diode) and other materials.

The camera assembly 706 is used to capture images or videos. Optionally, the camera component 706 includes a front camera and a rear camera. The front camera is set on the front panel of the terminal 700 , and the rear camera is set on the back of the terminal 700 . In some embodiments, there are at least two rear cameras, which are any one of the main camera, depth-of-field camera, wide-angle camera, and telephoto camera, so as to realize the fusion of the main camera and the depth-of-field camera to realize the background blur function. Combined with the wide-angle camera to achieve panoramic shooting and VR (Virtual Reality, virtual reality) shooting functions or other fusion shooting functions. In some embodiments, camera assembly 706 may also include a flash. The flash can be a single-color temperature flash or a dual-color temperature flash. Dual color temperature flash refers to the combination of warm light flash and cold light flash, which can be used for light compensation under different color temperatures.

Audio circuitry 707 may include a microphone and speakers. The microphone is used to collect sound waves of the user and the environment, and convert the sound waves into electrical signals and input them to the processor 701 for processing, or input them to the radio frequency circuit 704 to realize voice communication. For the purpose of stereo acquisition or noise reduction, there may be multiple microphones, which are respectively arranged at different parts of the terminal 700 . The microphone can also be an array microphone or an omnidirectional collection microphone. The speaker is used to convert the electrical signal from the processor 701 or the radio frequency circuit 704 into sound waves. The loudspeaker can be a conventional membrane loudspeaker or a piezoelectric ceramic loudspeaker. When the speaker is a piezoelectric ceramic speaker, it is possible not only to convert electrical signals into sound waves audible to humans, but also to convert electrical signals into sound waves inaudible to humans for purposes such as distance measurement. In some embodiments, the audio circuit 707 may also include a headphone jack.

The power supply 708 is used to supply power to various components in the terminal 700 . Power source 708 may be alternating current, direct current, disposable batteries, or rechargeable batteries. When the power source 708 includes a rechargeable battery, the rechargeable battery can support wired charging or wireless charging. The rechargeable battery can also be used to support fast charging technology.

In some embodiments, the terminal 700 also includes one or more sensors 709 . The one or more sensors 709 include, but are not limited to: an acceleration sensor 710 , a gyro sensor 711 , a pressure sensor 712 , an optical sensor 713 and a proximity sensor 714 .

The acceleration sensor 710 can detect the acceleration on the three coordinate axes of the coordinate system established by the terminal 700 . For example, the acceleration sensor 710 can be used to detect the components of the acceleration of gravity on the three coordinate axes. The processor 701 may control the display screen 705 to display a user interface in a landscape view or a portrait view according to the gravitational acceleration signal collected by the acceleration sensor 710 . The acceleration sensor 710 can also be used for collecting game or user's motion data.

The gyro sensor 711 can detect the body direction and rotation angle of the terminal 700 , and the gyro sensor 711 can cooperate with the acceleration sensor 710 to collect 3D actions of the user on the terminal 700 . According to the data collected by the gyroscope sensor 711, the processor 701 can realize the following functions: motion sensing (such as changing the UI according to the user's tilt operation), image stabilization during shooting, game control and inertial navigation.

The pressure sensor 712 may be disposed on a side frame of the terminal 700 and/or a lower layer of the display screen 705 . When the pressure sensor 712 is installed on the side frame of the terminal 700 , it can detect the user's grip signal on the terminal 700 , and the processor 701 performs left and right hand recognition or shortcut operation according to the grip signal collected by the pressure sensor 712 . When the pressure sensor 712 is disposed on the lower layer of the display screen 705, the processor 701 controls operable controls on the UI interface according to the user's pressure operation on the display screen 705. The operable controls include at least one of button controls, scroll bar controls, icon controls, and menu controls.

The optical sensor 713 is used to collect ambient light intensity. In one embodiment, the processor 701 may control the display brightness of the display screen 705 according to the ambient light intensity collected by the optical sensor 713 . Optionally, when the ambient light intensity is high, the display brightness of the display screen 705 is increased; when the ambient light intensity is low, the display brightness of the display screen 705 is decreased. In another embodiment, the processor 701 may also dynamically adjust shooting parameters of the camera assembly 706 according to the ambient light intensity collected by the optical sensor 713 .

A proximity sensor 714 , also called a distance sensor, is disposed on the front panel of the terminal 700 . The proximity sensor 714 is used to collect the distance between the user and the front of the terminal 700 . In one embodiment, when the proximity sensor 714 detects that the distance between the user and the front of the terminal 700 gradually decreases, the processor 701 controls the display screen 705 to switch from the bright screen state to the off screen state; when the proximity sensor 714 detects When the distance between the user and the front of the terminal 700 gradually increases, the processor 701 controls the display screen 705 to switch from the off-screen state to the on-screen state.

Those skilled in the art can understand that the structure shown in FIG. 7 does not constitute a limitation on the terminal 700, and may include more or less components than shown in the figure, or combine certain components, or adopt different component arrangements.

The embodiment of the present application also provides a computer-readable storage medium, at least one computer program is stored in the computer-readable storage medium, and the at least one computer program is loaded and executed by a processor, so as to realize the display device provided by the above-mentioned embodiment Adjustment method.

An embodiment of the present application further provides a computer program product, including a computer program, the computer program is loaded and executed by a processor, so as to implement the method for adjusting a display device as provided in the foregoing embodiments.

Those of ordinary skill in the art can understand that all or part of the steps for implementing the above-mentioned embodiments can be completed by hardware, and can also be completed by instructing related hardware through a program. The above-mentioned program can be stored in a computer-readable storage medium. The above-mentioned The storage medium can be a read-only memory, a magnetic disk or an optical disk, etc.

The above descriptions are only optional embodiments of the embodiments of the present application, and are not intended to limit the embodiments of the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the embodiments of the present application shall be Included within the scope of protection of this application.

Claims (10)

1. A method for adjusting a display device, the method comprising:

determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;

adjusting the height of the display device based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height;

based on the sight with the display screen is in the contained angle between the perpendicular bisector of central point department, adjust display device's orientation, so that the contained angle between sight and the perpendicular bisector is less than the angle threshold value.

2. The method of claim 1, wherein the adjusting the height of the display device based on the vertical distance between the intersection point and the center point of the display screen so that the center point of the display screen and the intersection point are located at the same horizontal height comprises:

and under the condition that the vertical distance is not greater than the distance threshold, adjusting the display equipment by adopting a first adjusting mode, wherein the first adjusting mode is used for indicating that the height of the display equipment is adjusted by adopting a first speed.

3. The method of claim 2, further comprising:

displaying prompt information on the display screen when the vertical distance is greater than the distance threshold, wherein the prompt information is used for prompting the target object to suspend using the display device, and the height of the display device is to be adjusted for the target object;

and responding to the confirmation operation of the target object on the prompt message, and adjusting the display equipment by adopting a second adjustment mode, wherein the second adjustment mode is used for indicating that the height of the display equipment is adjusted by a second speed under the condition that the target object suspends the use of the display equipment, and the second speed is greater than the first speed.

4. The method of claim 1, further comprising:

and horizontally adjusting the display equipment based on the horizontal distance between the intersection point and the central point of the display screen, so that the intersection point is positioned at the central point of the display screen.

5. The method of claim 1, further comprising:

determining an included angle between the sight of the target object and a plane where the display screen is located based on the plurality of face key points of the target object;

and adjusting the pitching angle of the display equipment based on the included angle between the sight line of the target object and the plane where the display screen is located, so that the sight line of the target object is perpendicular to the plane where the display screen is located.

6. The method of claim 1, further comprising:

performing gesture recognition on the target object, and determining a plurality of bone key points of the target object;

determining a distance between the target object and the display device based on a ratio of a size of the skeletal keypoints to a size of standard skeletal keypoints, the size of the standard skeletal keypoints being indicative of a preset distance between the target object and the display device;

adjusting at least one of a display brightness, a display content size, and a screen resolution of the display screen based on a distance between the target object and the display device.

7. An apparatus for adjusting a display device, the apparatus comprising:

the device comprises a first determination module, a second determination module and a display module, wherein the first determination module is used for determining an intersection point of a sight line of a target object and a display screen of display equipment based on a plurality of face key points of the target object;

the first adjusting module is used for adjusting the height of the display equipment based on the vertical distance between the intersection point and the central point of the display screen, so that the central point of the display screen and the intersection point are positioned at the same horizontal height;

and the second adjusting module is used for adjusting the orientation of the display equipment based on the included angle between the sight line and the perpendicular bisector of the central point on the basis of the included angle between the sight line and the perpendicular bisector, so that the included angle between the sight line and the perpendicular bisector is smaller than an angle threshold value.

8. A terminal, characterized in that the terminal comprises a processor and a memory, wherein at least one computer program is stored in the memory, and the at least one computer program is loaded and executed by the processor to implement the display device adjustment method according to any one of claims 1 to 6.

9. A computer-readable storage medium, in which at least one computer program is stored, the at least one computer program being loaded and executed by a processor to implement the display device adjustment method according to any one of claims 1 to 6.

10. A computer program product comprising a computer program, wherein the computer program is loaded and executed by a processor to implement a display device adjustment method according to any one of claims 1 to 6.

Images