KR101667731B1 - Vehicle image display device and control method thereof - Google Patents

Abstract

The present invention relates to an in-vehicle video display device capable of outputting visual information and a control method thereof. An in-vehicle video display device according to an embodiment of the present invention includes a communication unit for receiving status information on a passenger from a terminal located in the vehicle; And a controller for controlling the display unit so that the object corresponding to the status information on the occupant is output in a predetermined manner corresponding to the running state of the vehicle.

Description

[0001] VEHICLE IMAGE DISPLAY DEVICE AND CONTROL METHOD THEREOF [0002]

The present invention relates to an in-vehicle video display device capable of outputting visual information and a control method thereof.

The video display device includes both a device for receiving and outputting a broadcast, a device for recording and reproducing video, and a device for recording and reproducing audio. Such a video display device includes, for example, a television, a monitor, a projector, a tablet, and the like.

As the functions of the video display device are diversified, the video display device is implemented in the form of a multimedia player having multiple functions such as photographing, video shooting, game, and broadcast reception in addition to the output of the broadcast and the playback of the video .

Further, the video display device is installed inside the vehicle, so that the convenience of the driver can be improved. In order to support and enhance the function of the in-vehicle image display device, it may be considered to improve the structural and / or software portion of the in-vehicle image display device.

The present invention is directed to solving the above-mentioned problems and other problems. It is another object of the present invention to provide an in-vehicle image display apparatus and a control method thereof that can receive status information on a passenger in a vehicle and output an object corresponding thereto in a predetermined manner according to the running state of the vehicle .

According to an aspect of the present invention, there is provided a communication system comprising: a communication unit for receiving status information on a passenger from a terminal located in a vehicle; And a control unit for controlling the display unit such that an object corresponding to the status information of the passenger is output in a predetermined manner corresponding to the running state of the vehicle.

In an embodiment, the communication unit may receive status information on the passenger at a predetermined interval.

In an embodiment, the communication unit may receive, as status information on the passenger, information obtained by analyzing a situation of the occupant based on the image of the occupant and the captured image.

In an embodiment, the control unit may control the display unit such that an image photographed by the occupant is outputted in a predetermined manner corresponding to at least one of a traveling speed and a driving place of the vehicle.

In an exemplary embodiment, the controller may transmit status information about the passenger to an external server different from the terminal when a predetermined emergency situation is detected from the vehicle.

According to another aspect of the present invention, there is also provided a method for controlling a vehicle, comprising: (a) receiving status information on a passenger from a terminal located in the vehicle; And (b) controlling the display unit so that the object corresponding to the occupant status information is output in a predetermined manner corresponding to the running state of the vehicle. .

In one embodiment, the step (a) may include receiving status information on the occupant at a predetermined interval.

In the embodiment, the step (a) may include receiving, as state information for the occupant, information obtained by analyzing a situation of the occupant based on the image of the occupant and the captured image have.

In the embodiment, the step (b) may include controlling the display unit such that an image of the occupant is output in a predetermined manner corresponding to at least one of a traveling speed and a driving place of the vehicle have.

The step (b) may include transmitting status information on the occupant to an external server different from the terminal when a predetermined emergency situation is detected from the vehicle.

Effects of the in-vehicle video display device and the control method thereof according to the present invention are as follows.

According to at least one of the embodiments of the present invention, it is possible to prevent the driver's line of sight from being dispersed in order to observe the state of the child, especially when the child is riding in the back seat of the vehicle.

In addition, according to at least one of the embodiments of the present invention, there is an advantage that a driver may lose consciousness in case of an accident, thereby preventing a case in which the child can not be rescued because he or she does not know whether or not the child is boarded.

According to another embodiment, when the vehicle eCall does not operate, the function of the vehicle eCall can be supplementarily performed in the in-vehicle image display apparatus or the mobile terminal.

Further scope of applicability of the present invention will become apparent from the following detailed description. It should be understood, however, that the detailed description and specific examples, such as the preferred embodiments of the invention, are given by way of illustration only, since various changes and modifications within the spirit and scope of the invention will become apparent to those skilled in the art.

1 is a conceptual diagram for explaining an embodiment in which an in-vehicle video display device according to the present invention is implemented.
2 is a flowchart illustrating an in-vehicle video display apparatus according to an embodiment of the present invention.
3 is a conceptual diagram for explaining an embodiment of an in-vehicle video display device and a terminal located in a vehicle according to the present invention.
FIGS. 4, 5, and 6 are conceptual diagrams for explaining an embodiment in which an object corresponding to status information of a passenger is output according to the running state of the vehicle.
7 and 8 are conceptual diagrams for explaining an embodiment in which, when the vehicle is traveling at a speed higher than a predetermined speed, an object corresponding to the status information on the passenger is outputted.
FIG. 9 is a conceptual diagram for explaining an embodiment in which an object corresponding to status information on a passenger is output when a predetermined very urgent situation is detected.

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings, wherein like reference numerals are used to designate identical or similar elements, and redundant description thereof will be omitted. The suffix "module" and " part "for the components used in the following description are given or mixed in consideration of ease of specification, and do not have their own meaning or role. In the following description of the embodiments of the present invention, a detailed description of related arts will be omitted when it is determined that the gist of the embodiments disclosed herein may be blurred. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are intended to provide further explanation of the invention as claimed. , ≪ / RTI > equivalents, and alternatives.

1 is a conceptual diagram for explaining an embodiment in which an in-vehicle video display device according to the present invention is implemented.

The in-vehicle image display apparatus 100 according to the present invention can be arranged at an arbitrary position in the vehicle and can output image information (time information).

As an example, it may be located in the center of a vehicle dashboard and in a center fascia, which is a control panel board between the driver's seat and the passenger's seat.

In addition, a control screen for controlling the air conditioner, the heater, and the like can be displayed on the screen, such as a route guidance screen, the location of the vehicle during parking, the speed of the vehicle, time and weather information, schedule information, (Air conditioning control screen) and the like can be output to the display unit.

Meanwhile, the in-vehicle image display apparatus 100 according to the present invention can exchange data with a terminal disposed at an arbitrary position in the vehicle, and can output the corresponding time information (object) to the display unit .

Specifically, the communication unit of the in-vehicle video display device 100 according to the present invention can receive status information on the passenger from a terminal located in the vehicle.

The terminal may be a mobile phone, a smart phone, a laptop computer, a digital broadcasting terminal, a personal digital assistant (PDA), a portable multimedia player (PMP), a navigation device, a slate PC, a mobile terminal such as a tablet PC, an ultrabook, a wearable device (e.g., a smartwatch, a glass glass, a head mounted display (HMD) A fixed terminal such as a TV, a desktop computer, a digital signage, and the like.

The control unit of the in-vehicle video display apparatus 100 according to the present invention can control the display unit such that the object corresponding to the status information of the occupant is output in a predetermined manner corresponding to the traveling state of the vehicle .

Hereinafter, specific details related to this will be described.

2 is a flowchart illustrating an in-vehicle video display apparatus according to an embodiment of the present invention.

Referring to FIG. 2, a step S210 of receiving status information on a passenger from a terminal located in the vehicle is performed.

Specifically, the terminal may be disposed at any position in the vehicle. For example, it can be placed on the head of the seat in front of the vehicle, the rear part of the back, the rearview mirror, the center fascia, and the like.

In addition, the passenger refers to passengers other than drivers in the vehicle, and the status information on the passengers may be defined as the current status of the passenger to inform the driver of the vehicle.

As an embodiment, the communication unit of the in-vehicle video display device 100 according to the present invention can receive status information on the passenger at predetermined intervals.

In another embodiment, the communication unit of the in-vehicle image display apparatus 100 according to the present invention may transmit information obtained by analyzing the situation of the occupant based on the captured image of the occupant and the captured image, Information can be received.

Specifically, the terminal may be disposed at a rear portion of the back of the driver's seat so as to photograph a passenger in the rear seat. Further, it is possible to detect that the occupant of the rear seat is in an emergency situation based on the facial expression or movement of the rear seat passenger derived from the photographed image.

Accordingly, the communication unit of the in-vehicle video display device 100 according to the present invention can transmit a control signal indicating that the occupant of the rear seat is presently in an emergency state together with the image of the rear seat occupant photographed from the terminal Information) can be received.

Next, control proceeds to step S220 in which the display unit is controlled so that the object corresponding to the status information of the occupant is output in a predetermined manner corresponding to the running state of the vehicle.

The object corresponding to the status information of the passenger means time information such as emoticons, texts, icons, and video images for informing the driver of the vehicle of the current status of the passenger.

Further, the running state of the vehicle means a situation that can be defined in relation to the running of the vehicle. For example, it may include whether the vehicle is stopped or parked, a traveling speed at the time of vehicle operation, a driving location, and the like.

The predetermined method is a method in which an object corresponding to the state information is output in accordance with the traveling state of the vehicle, for example, the size and shape of the output object, the output duration of the object, and the like.

The control unit of the in-vehicle video display apparatus 100 according to the present invention controls the display unit such that the video image of the occupant is outputted in a preset manner corresponding to at least one of the traveling speed and the driving position of the vehicle Can be controlled.

Specifically, the communication unit of the in-vehicle video display device 100 according to the present invention may receive a control signal indicating that the occupant of the rear seat is in an urgent situation together with the image of the occupant of the rear seat taken from the terminal.

In response to this, a message (text) or an icon indicating that the occupant of the rear seat is currently in an emergency can be displayed on the display unit. At this time, a warning sound may be output together, and a predetermined degree of vibration may be output to the seat of the driver or the driver.

At this time, when the vehicle is stopped or traveling at a speed lower than a predetermined speed, an image of the occupant of the rear seat can be output to the entire display unit. If the vehicle is traveling at a speed higher than a predetermined speed, the image of the occupant of the rear seat can be output to one area of the display unit. Accordingly, it is possible to avoid the driver's line of sight being dispersed during the vehicle's quick operation.

In another embodiment, the control unit of the in-vehicle video display device 100 according to the present invention may transmit status information on the passenger to an external server different from the terminal when a predetermined emergency situation is detected from the vehicle .

Specifically, the emergency situation may include a case where a vehicle is severely damaged, a traffic accident such as a collision or an overturning accident occurs, and the like. Also, the external server different from the terminal may be a server such as a traffic management center, a medical institution, an emergency rescue center, an eCall center, or the like. For example, in the event of a traffic accident, status information about the occupant of the rear seat can be transmitted to the server of the emergency rescue center.

According to the in-vehicle image display apparatus 100 according to the present invention described above, it is possible to prevent the driver's line of sight from being dispersed in order to check the state of the child, especially when the child is riding in the back seat of the vehicle. In addition, it is possible to prevent cases where the driver loses consciousness in case of an accident and can not be rescued because he does not know whether or not the child is boarded. When the vehicle eCall does not operate, the function of the vehicle eCall can be performed supplementarily in the in-vehicle video display device 100 or the mobile terminal.

Hereinafter, embodiments related to a control method that can be implemented in an in-vehicle video display device constructed as above will be described with reference to the accompanying drawings. It will be apparent to those skilled in the art that the present invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof.

In the following drawings, an in-vehicle video display device 100 according to the present invention is arranged in a center pace, and a mobile terminal for transmitting status information on a passenger to an in-vehicle video display device 100 according to the present invention, But the present invention is not limited to such an embodiment.

3 is a conceptual diagram for explaining an embodiment of an in-vehicle video display device and a terminal located in a vehicle according to the present invention.

3, the mobile terminal 200 is disposed at the rear of the front seat back, and can be connected to the vehicle network. For example, it may be connected to a wireless network such as Wi-Fi, Bluetooth, 3G or LTE, or may be connected to a wired network via a USB connection.

As an embodiment, when the mobile terminal 200 is connected to the vehicle AP, a mode in which in-vehicle video display device 100 can receive status information on the rear seat occupant can be activated. Alternatively, when the in-vehicle video display device 100 determines whether or not the mode can be activated at the time of USB connection, the mode can be activated.

When the mode is activated, the in-vehicle image display apparatus 100 can request the mobile terminal 200 to transmit status information on the rear seat occupant through a wireless or wired network.

In response to the request, the mobile terminal 200 may photograph the rear seat passenger with at least one camera 210 and transmit the photographed image to the in-vehicle image display device 100. As a result, the photographed image 110 can be output in real time on the display unit (screen) of the in-vehicle image display apparatus 100. [

As another embodiment, the mobile terminal 200 may photograph a passenger of the rear seat with the camera 210 at predetermined intervals and transmit the photographed image to the in-vehicle image display apparatus 100. [ As a result, the photographed image 110 can be output to the display unit (screen) of the in-vehicle image display apparatus 100 at predetermined intervals.

As another embodiment, the mobile terminal 200 may photograph a passenger in the rear seat in real time and notify the image display device 100 of a predetermined situation such as an emergency situation.

Specifically, the mobile terminal 200 may store the steady state image photographed first in the rear seat occupant in the memory, and may transmit the steady state image to the in-vehicle image display apparatus 100. The steady-state image means an image that can be used as a reference in determining the status information of the passenger in the rear seat.

That is, the steady state image is an image showing a general state in which an emergency situation does not occur in the rear seat occupant, and the face position and expression of the rear seat passenger as a reference from the steady state image can be calculated.

Subsequently, the mobile terminal 200 continuously photographs the face of the occupant of the rear seat. Various facial recognition algorithms can be applied to the captured image to determine whether the face position of the rear seat occupant has moved up or down or left or right from the reference position.

For example, when a situation occurs in which the face of the occupant of the rear seat is out of the predetermined range from the reference position, or when the face is not detected outside the photographing range, a control signal for notifying the control signal to the image display device 100).

In addition, the mobile terminal 200 applies a facial expression recognition algorithm to the image of the face of the occupant of the rear row continuously, and transmits a control signal to the image display apparatus 100 to notify the user of the change of the facial expression . As a specific example, when a child is riding in the rear seat of the vehicle, a control signal indicating the change in expression such as a child's crying or hungry may be transmitted to the image display apparatus 100. [

Hereinafter, an embodiment will be described in which an object corresponding to the status information on the passenger is outputted to the in-vehicle video display device 100 according to the present invention.

As described above, the communication unit of the in-vehicle video display device 100 according to the present invention transmits information obtained by analyzing the situation of the occupant based on the captured image of the occupant and the captured image, As shown in FIG.

In addition, the control unit of the in-vehicle video display device 100 according to the present invention controls the display unit such that the image photographed by the occupant is output in a predetermined manner corresponding to at least one of the traveling speed and the traveling place of the vehicle .

That is, the object corresponding to the state information can be output according to whether the vehicle is stopped or parked, the traveling speed of the vehicle, the driving location, the road condition, the distance from the nearby vehicle, and the like.

FIGS. 4, 5, and 6 are conceptual diagrams for explaining an embodiment in which an object corresponding to status information of a passenger is output according to the running state of the vehicle.

4, when a guidance screen 400 is displayed on the display unit (screen) of the in-vehicle image display apparatus 100, a photographed image from the mobile terminal 200 and a message informing that it is in an emergency state Lt; / RTI >

In response to this, if the current vehicle is in a stop, a low speed running at a speed lower than a predetermined speed, or a proper interval with a nearby vehicle, And can be output to the display unit.

As a result, the condition of the occupant in the rear seat can be accurately confirmed by a large image. At this time, a message 420 indicating that the emergency is present may also be output.

As another example, the route guidance screen 400 may be switched to the image 410 of the image of the rear-seat passenger and output.

5, in a state in which the route guidance screen 400 is outputted to the display unit (screen) of the in-vehicle video display device 100, A message may be received informing of the situation.

In response to this, if the present vehicle is in the middle of running at a predetermined safe speed range, or if the appropriate interval with the surrounding vehicle is maintained, the image 510 of the photograph of the passenger in the rear seat displays a part of the route guidance screen 400 And can be output in a pop-up manner to one area of the display unit.

At this time, the photographed image 510 may be outputted to a size not to interfere with the operation, and a message 520 indicating that it is in an emergency may also be output.

6, in a state in which the route guidance screen 400 is displayed on the display unit (screen) of the in-vehicle video display device 100, A message may be received informing of the situation.

Corresponding to this, when the current vehicle is traveling at a high speed over a predetermined speed, traveling on a high speed road, etc., the image 610 of the photograph of the passenger of the rear seat can be output to one area of the display unit with a very small size have. At this time, a message informing that it is an emergency can also be output.

On the other hand, when the vehicle is traveling at a very high speed, if a video image of a passenger is displayed on the in-vehicle video display device 100, there is a risk of leading to an accident by stealing the driver's attention. Accordingly, when the vehicle is traveling at a very high speed, it is possible to output a voice notification or display a small icon to inform the emergency situation.

7 and 8 are conceptual diagrams for explaining an embodiment in which, when the vehicle is traveling at a speed higher than a predetermined speed, an object corresponding to the status information on the passenger is outputted.

Referring to FIG. 7, an icon 700 indicating that the current emergency is present may be output to one area of the display unit. As another example, referring to FIG. 8, a screen 800 in which a color is changed may be output together with an alarm sound indicating that the current emergency is present. Subsequently, when the speed of the vehicle is reduced or when the vehicle travels on a shoulder, an image of the occupant of the rear seat can be output.

FIG. 9 is a conceptual diagram for explaining an embodiment in which an object corresponding to status information on a passenger is output when a predetermined very urgent situation is detected.

9, in a state in which the route guidance screen 400 is outputted on the display unit (screen) of the in-vehicle video display device 100, a video image from the mobile terminal 200 and a message indicating a very emergency situation Can be received.

In response to this, a message pop-up window 900 may be displayed to indicate that the vehicle is in an emergency, regardless of the current speed of the vehicle, the driving position, or the like.

Meanwhile, the controller of the in-vehicle video display device 100 according to the present invention can transmit status information on the passenger to an external server different from the terminal 200 when a predetermined emergency situation is detected from the vehicle.

As described above, the emergency situation may include a case where a vehicle is severely damaged, a traffic accident such as a collision or a rollover occurs. Also, the external server different from the terminal may be a server such as a traffic management center, a medical institution, an emergency rescue center, an eCall center, or the like.

For example, in the event of a traffic accident, status information about the occupant of the rear seat can be sent to the emergency rescue center or eCall center server. As a result, it is possible to prevent cases where the driver loses consciousness in case of an accident and can not be rescued because he does not know whether or not the child is boarded.

As another embodiment, when the vehicle eCall does not operate, the functions of the vehicle eCall can be supplementarily executed in the in-vehicle video display device 100 or the mobile terminal 200. [

Effects of the in-vehicle video display device and the control method thereof according to the present invention are as follows.

According to at least one of the embodiments of the present invention, it is possible to prevent the driver's line of sight from being dispersed in order to observe the state of the child, especially when the child is riding in the back seat of the vehicle.

In addition, according to at least one of the embodiments of the present invention, there is an advantage that a driver may lose consciousness in case of an accident, thereby preventing a case in which the child can not be rescued because he or she does not know whether or not the child is boarded.

According to another embodiment, when the vehicle eCall does not operate, the function of the vehicle eCall can be supplementarily performed in the in-vehicle image display apparatus or the mobile terminal.

The present invention described above can be embodied as computer-readable codes on a medium on which a program is recorded. The computer readable medium includes all kinds of recording devices in which data that can be read by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, , And may also be implemented in the form of a carrier wave (e.g., transmission over the Internet). Also, the computer may include a control unit 180 of the terminal. Accordingly, the above description should not be construed in a limiting sense in all respects and should be considered illustrative. The scope of the present invention should be determined by rational interpretation of the appended claims, and all changes within the scope of equivalents of the present invention are included in the scope of the present invention.

Claims (10)

A communication unit for receiving status information on a passenger from a terminal located in the vehicle; And
The object corresponding to the status information on the occupant corresponds to at least one of whether the vehicle is stopped or parked, the traveling speed of the vehicle, the driving location, the road condition, the distance from the surrounding vehicle, And controlling the display unit to output the video signal in a preset manner. The method according to claim 1,
Wherein,
And receives status information on the passenger at every predetermined period. The method according to claim 1,
Wherein,
Wherein the information on the condition of the occupant is received as status information on the occupant based on the image of the occupant and the captured image. The method of claim 3,
Wherein,
Wherein the control unit controls the display unit so that the image photographed by the occupant is outputted in a preset manner corresponding to at least one of the traveling speed and the driving position of the vehicle. The method according to claim 1,
Wherein,
And transmits status information on the occupant to an external server different from the terminal when a predetermined emergency situation is detected from the vehicle. (a) receiving status information on a passenger from a terminal located in the vehicle; And
(b) an object corresponding to the status information of the occupant is at least one of at least one of whether the vehicle is stopped or parked, a traveling speed of the vehicle, a driving location, a road condition, And controlling the display unit so that one of the first and second output signals is output in a predetermined manner corresponding to the driving state of the vehicle. The method according to claim 6,
The step (a)
And receiving status information on the passenger at every predetermined period. ≪ Desc / Clms Page number 19 > The method according to claim 6,
The step (a)
And receiving information on the status of the passenger based on the captured image of the passenger and the captured image as status information on the passenger. 9. The method of claim 8,
The step (b)
And controlling the display unit such that an image of the occupant is output in a predetermined manner corresponding to at least one of a running speed and a driving position of the vehicle. The method according to claim 6,
The step (b)
And transmitting status information on the occupant to an external server different from the terminal when a predetermined emergency situation is detected from the vehicle.

Images