KR20180090961A - A user tracking display system and control method - Google Patents

Abstract

The present invention relates to a user follow-up display system and a control method thereof, and more particularly, to a user follow-up display system and a control method thereof, A direction switching processor for generating a command, and a direction switching mechanism operating on the basis of the control command. According to the present invention, the direction of the display screen can be automatically switched in the direction of the user's eyes using the remote display at any place in the home or industrial field, thereby enabling a more convenient display viewing environment.

Description

[0001] The present invention relates to a user tracking display system and a control method thereof,

The present invention relates to a user follow-up display system and a control method thereof, and more particularly, to a user follow-up display system and a control method thereof, To a user-following display system and control method thereof.

A display which is widely used not only at home but also in an industrial field has a disadvantage that the user has to manually move the display screen to change the direction of the display screen in order to adjust the direction of the display screen at a distance from the user, More and more devices are being used to adjust the orientation of the display screen remotely.

As a representative example, Korean Unexamined Patent Publication No. 10-2009-0119040 (published on November 11, 2009) discloses a display stand rotation system that is remote from a user and is capable of freely adjusting the angle in the vertical and horizontal directions .

However, such a display cradle rotation system has a problem that it is difficult to control an angle suitable for a plurality of users because the manipulator such as a remote controller must be carried at all times in order to adjust the angle.

Korean Patent Publication No. 10-2009-0119040 (published on November 19, 2009)

SUMMARY OF THE INVENTION The present invention has been made in order to solve the above-mentioned problems, and aims to provide three or more purposes below.

First, the present invention provides a user follow-up display system and a control method thereof that enable a more convenient display viewing environment by allowing the direction of the display screen to be automatically switched in the direction of sight of users using the display even at a long distance .

Second, the present invention computes a display screen direction that can satisfy an optimal viewing condition when there are a plurality of users, and adjusts a display screen direction accordingly, thereby allowing an optimal viewing condition to be satisfied even when there are a plurality of users A user following display system and a control method thereof.

In addition, the present invention provides an optimal driving means for rotating the display screen in the direction calculated by calculation, thereby remarkably reducing manufacturing and maintenance costs, Display system and a control method thereof.

According to an aspect of the present invention, there is provided a user location based display device and a control method thereof, including a camera module for extracting user information based on a display image recognition and transmitting the user information, A direction switching processor for generating a control command based on the received user information, and a desk-top type and wall-mounted type switching device operating on the basis of the control command.

The table-shaped redirection mechanism may further include: a DC motor for rotating based on the control command generated by the redirection processor; a spur gear for transmitting the rotational motion of the DC motor; And a ball castor installed in the lower end of the display lifting plate 4 for smoothly rotating the display lifting plate.

In addition, the wall-mounted type direction changing mechanism may include four linear motors for performing linear motion based on the control command generated by the direction switching processor, a connection for smoothly moving the front plate, A support means, and the display mounting front plate for mounting the display.

In addition, the control _{command, {n, (x 1 -m} x, y 1 -m y) 1, (x 2 -m x, y 2 -m y) 2, ..., (x n -m x , y _n -m _y ) _n }. (Where n = number of persons, x = x coordinate value, y = y coordinate value, m _x = x coordinate mean value, m _y = y coordinate mean value)

In addition, the camera operation step, the camera angle-of-view face detection step, the image recognition coordinate value conversion step, the user information extraction step, the display target coordinate setting step, the display rotation step to the target coordinate point, And a step of turning off the power of the display device if the face is not detected during a predetermined period of time.

According to the present invention, the user location based display device and the control method thereof can automatically switch the direction of the display screen in the direction of the line of sight of users using the display even at a long distance, Make environment possible. In addition, when there are a plurality of users, the display screen direction that can satisfy the optimal viewing condition is calculated and the display screen direction is adjusted accordingly, so that the optimal viewing condition can be satisfied even when there are a plurality of users. In addition, by providing an optimal driving means for rotating the display screen in the direction calculated by calculation, it is possible not only to remarkably reduce manufacturing and maintenance costs, but also to provide sufficient structural stability in addition to durability have.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1A is a diagram illustrating a tabletop type display apparatus according to an embodiment of the present invention. FIG.
1B is a view illustrating a wall-mounted type display apparatus according to an embodiment of the present invention.
2 is a view showing connection diagrams of major components of the present invention.
Fig. 3A shows a table-shaped redirection mechanism. Fig.
Fig. 3B is a view showing a tabular redirecting mechanism perspective view. Fig.
4A is a view showing a wall-mounted type direction changing mechanism.
4B is a perspective view of a wall-mounted type direction changing mechanism.
Fig. 5 is a view showing a turning radius and a driving example of the desk-top redirection mechanism; Fig.
FIG. 6 is a diagram showing a coordinate system range appearing by converting an image of a camera sensor attached to a desk-top redirection mechanism into coordinates. FIG.
7 is a view showing a rotation radius and a driving example of the wall-mounted type direction switching mechanism.
8 is a view showing a coordinate system range appearing by converting an image of a camera sensor attached to a wall-mounted type direction switching mechanism into coordinates.
Figure 9 is a flowchart of an overall operation algorithm of the present invention.

Hereinafter, a user location based display apparatus and a control method thereof according to an embodiment of the present invention will be described in detail with reference to the accompanying drawings.

1B is a view illustrating a wall-mounted type display apparatus according to an embodiment of the present invention. FIG. 2 is a view showing connection of major components of the present invention 4A is a view showing a wall-mounted type direction changing mechanism, and FIG. 4B is a view showing a wall-mounted type direction changing mechanism perspective view. FIG. 6 is a view showing a coordinate system range appearing by converting an image of a camera sensor attached to a desk-top directional switching mechanism into coordinates, and FIG. Fig. 7 is a view showing a rotation radius and a driving example of the wall-mounted type direction switching mechanism, A diagram showing a coordinate system range that appears to transform the image to the coordinates, and FIG. 9 is a flowchart illustrating overall operation algorithm of the present invention.

As shown in FIGS. 1A and 1B, the major components of the user location based display device according to the present invention include a display 200 for visually displaying an image, a display 200 for extracting user information based on image recognition, A direction switching processor 300 for generating a control command based on the user information received from the camera module 100, and a direction switching mechanism 400 or 500 operating based on the control command .

The camera module 100 is installed on the display 200 so as to face the front and the direction switching mechanisms 400 and 500 are installed on the lower or rear surface of the display 200 according to the format.

Specifically, the camera module 100 extracts information on a user based on image recognition, and then transmits information about the user to the redirection processor 300. The redirection processor 300 receives information about the user Generates a control command for the operation of the redirection mechanism (400, 500), and the redirection mechanism (400, 500) operates on the control command.

Figure 2 shows the connections and information flow between each component.

The camera module 100 continuously captures a photograph to grasp the position of a user, extracts a face shape of a person from the photographed photograph, and grasps the location and the user of the user based on the extracted face shape.

Specifically, the camera module 100 transmits the data including the two-dimensional (x, y) positional coordinates and the number of persons n corresponding to the position to the direction conversion processor, and the positional coordinate combination of (x, y) Value. That is, the control command of the redirecting processor becomes {n, (x ₁ , y ₁ ) ₁ , (x ₂ , y ₂ ) ₂ , ..., (x _n , y _n ) _n }.

Control commands _{{n, (x 1, y} 1) 1, (x 2, y 2) 2, ..., (x n, y n) n} , the user information data, if n = 1, the location of the user in the Control the direction switching mechanisms 400 and 500 so that the control command is {1, (0, 0) ₁ } since it is the ideal target direction for the display 200 when it coincides with the front of the display 200.

If n is greater than or equal to 2, more than one user views the display 200, so that the user faces the display 200 in the average direction of the entire user position rather than in a specific one direction.

Thus, the direction changing mechanism (400 500) control commands for the drive is _{{n, (x 1 -m x} , y 1 -m y) 1, (x 2 -m x, y 2 -m y) 2, ... , (x _n -m _x , y _n -m _y ) _n }.

Here, m _x and m _y are an average value of x coordinate and a y coordinate, respectively, and m _x = (x ₁ + x ₂ + .... + x _n ) / n and m _y = (y ₁ + y ₂ +. ... + y _n ) / n.

For example, if the user is two, and when the user's face is detected from the coordinates of each (40, 0) and (60, 0), transmission data is {2, 40 (0) ₁ (60, 0) ₂ }, And the direction switching mechanisms 400 and 500 target data are {2, (-10,0) ₁ , (10,0) ₂ } because m _x = (40 + 60) / 2 = 50 and m _y = 0 . Therefore, it controls the direction switching mechanisms 400 and 500 to the position where the control command is {2, (-10,0), (10,0)}.

3, the desk-top type includes a DC motor 1 fixedly mounted on a table, a monitor shelf, a desk or the like as a driving means, A spur gear 2 which is fixed to a rotary shaft of a drive spur gear DC motor 1 that transmits a rotational force from a spur gear 2 and which is fixed to a rotation shaft of a display lifting plate 4 A plurality of ball casters 3 spaced radially from the display lifting plate 4 and fixed to the lower surface of the display lifting plate 4 to reduce frictional force and a display lifting plate 4 provided to mount the display 200 .

Due to such a direction switching mechanism 400, the DC motor 1 outputs the control command {n, (x ₁ -m _x , y ₁ -m _y ) ₁ , (x ₂ -m _x , -m _{2 y} y) _2, ..., (x _n -m _x, y _{y n} -m) a rotational motion based on a _n}, and wherein the spur gear (2) is a rotary motion of the DC motor (1) To the display up plate (4). At this time, if the display device is placed on the display lifting plate 4, the display device rotates together with the rotation of the display lifting plate 4. [ At this time, the ball caster 3 is mounted to the lower end of the display lifting plate 4 in four directions to reduce the rotational friction of the display lifting plate 4 and prevent the tilting of the display lifting plate 4, thereby stabilizing the operation of the display lifting plate 4.

As shown in FIG. 5, the screen of the display 200 of the display device is adjusted so as to face the face of the user while rotating left and right.

FIG. 6 shows an area in which the direction can be changed according to the coordinate value of the front surface of the display device when the position of the user is recognized through the camera.

For example, when the user is in the first quadrant and the fourth quadrant, the direction of the screen of the display 200 is rotated to the right by the clockwise rotation of the DC motor 1 and the counterclockwise rotation of the display lifting plate 4 . Conversely, if the user is in quadrant 2 and quadrant 3, he / she will operate in reverse.

4, a wall-mounted type, which is another embodiment of the direction switching mechanism 500 according to the present invention, includes a plurality of A linear motor 5, a connection support means 6 having one end fixed to a fixed portion of a wall or the like and having a hinge portion rotatable at the center, and the other end fixed to the front plate 7 so as to be relatively rotatable, And a front plate 7. It is preferable that three linear motors 5 are provided, but the present invention is not limited thereto.

Control commands _{{n, (x 1 -m x} , y 1 -m y) 1, (x 2 -m x, y 2 -m y) 2, ..., (x n -m x, y n -m _y ) _n }, the linear movement distances of the plurality of linear motors 5 are respectively set. Thus, the respective linear motors 5 linearly move to adjust the inclination of the front plate 7 up, down, left, and right.

The connection support means (6) supports the front plate (7) for mounting the display (200) and smoothly moves.

Since the display 200 is attached to the front plate 7, the direction of the front plate 7 is the same as that of the display device.

That is, as shown in FIG. 7, the four-axis operation in the upper, lower, left, and right directions is possible.

Referring to FIG. 8, when the position of the user is recognized through the camera module 100, an area that can be redirected according to the coordinate value on the front surface of the display 200 is shown.

For example, when the user is positioned in the first quadrant, the right linear motor 5 among the three linear motors 5 linearly moves to the back of the front plate 7 and the left linear motor 5 reversely The display device screen is turned upside down.

Referring to FIG. 9, the entire operation algorithm of the present invention operates when the user turns on the power. At this time, the direction change processor 300 is position information about the user's Based on this, when the user's face is detected within the camera field of view camera module (100), (x, y) and in accordance with the number of persons n {n, (x ₁ , y ₁ ) ₁ , (x ₂ , y ₂ ) ₂ , ..., (x _n , y _n ) _n }. Here, (x, y) is the two-dimensional coordinate position of the user.

Also, the redirection processor 300 may determine an ideal target direction for the display 200, {n, (x ₁ -m _x , y ₁ -m _y ) ₁ , (x ₂ -m _x , y ₂ -m _y ) ₂ , ..., (x _n -m _x , y _n -m _y ) _n } and controls the direction switching mechanisms 400 and 500 in the target direction. Here, m _x and m _y are the x-coordinate average value and the y-coordinate average value, respectively.

(1, (0, 0)}, and if {1, (x, y)} information is different from {1, (0, 0)} information The switching mechanisms 400 and 500 start to operate. This operation is controlled until the user's information becomes {1, (0, 0)}.

For example, when the face of the user is recognized in the coordinates of (40, 0), the operation commands of the direction switching mechanisms 400 and 500 are set to 40 in the x direction and 0 in the y direction, The direction of the screen of the display 200 is switched in the direction in which the user is recognized.

That is, the direction switching mechanisms 400 and 500 operate continuously until the x coordinate value 40 becomes 0, and when the coordinate value becomes (0,0), the direction switching mechanisms 400 and 500 stop and the display screen faces the front of the user do. Thereafter, if the face is not detected for a predetermined time within the angle of view of the camera, the power of the display device is turned off.

Through the above-described structure, the user location-based display device and the control method thereof according to the present invention can automatically change the direction of the display screen in the direction of the user's eyes, . Accordingly, when there are a plurality of users, the display screen direction that can satisfy the optimal viewing condition is calculated and the display screen direction is adjusted accordingly, so that the optimal viewing condition can be satisfied even when there are a plurality of users. In addition, since the optimal driving means for rotating the display screen in the direction calculated by the calculation is provided, the manufacturing and maintenance costs can be remarkably reduced, and besides the durability, sufficient structural stability can be provided .

1: DC motor 100: Camera module
2: spur gear 200: display
3: Ball caster 300: Redirect process
4: Display lift plate 400: Direction switching mechanism
5: Linear motor 500: Direction switching mechanism
6: Connection support means
7: Front plate

Claims (1)

A display for visually displaying an image,
A camera module for extracting user information based on image recognition and transmitting the user information,
A direction switching processor for generating a control command based on the user information received from the camera module,
And a direction switching mechanism that operates based on the control command.
User following display system.

Images