JP2019101755A - On-vehicle user interface device - Google Patents

Abstract

Provided is an in-vehicle user interface device which is convenient for a vehicle user and includes a plurality of display devices which can intuitively obtain contents. SOLUTION: A storage device that stores contents, a shared display device 30 that displays a plurality of contents as a stereoscopic image I1 so that all passengers can view them, and a plurality of contents that can be viewed only by each passenger are stereoscopic images I2. , I3, individual display device 40, motion detection means for detecting motion of the user's hand, motion for selecting stereoscopic images I1 to I3, and motion for moving stereoscopic images I1 to I3 are selected. A display control unit that moves the generated stereoscopic image to follow the operation, and the display control unit is one of a sharing mode using the shared display device 30 and the individual display device 40, and an individual mode using the individual display device 40. To display the content as a stereoscopic image. [Selection diagram] Fig. 4

Description

  The present invention relates to an on-vehicle user interface device that displays various contents as a stereoscopic video in space and changes the stereoscopic video according to the movement of the user's hand around the stereoscopic video.

  BACKGROUND Conventionally, an on-vehicle display device using a display device such as a liquid crystal panel is known (see, for example, Patent Document 1). Such an on-vehicle display device can not only display information on various devices provided in the vehicle such as an air conditioner, but can also display information on facilities around the vehicle.

  As described above, the information presented to the user of the vehicle is diverse and various ideas have been made to display the information in an easy-to-understand manner for the user. For example, a plurality of pieces of information are three-dimensionally displayed on the screen, and the display position or the like is changed based on the user's operation.

  However, the display range of the display device is limited for displaying a large amount of information, which makes it difficult for the user to see. Further, even if the information is displayed at a position where the information can be easily viewed by the operation of the user, the operation necessary for the operation is complicated, for example, it is necessary to take a plurality of steps. Furthermore, a plurality of display devices may be mounted on a vehicle instead of one. Simply listing various types of information on a plurality of display devices makes it difficult for the user to find whereabouts of the necessary information, and it is also difficult to understand the operation for obtaining the desired information.

JP, 2013-84070, A

  The present invention has been made in view of such circumstances, and it is an object of the present invention to provide an on-vehicle user interface device including a plurality of display devices which are easy to use for a vehicle user and can intuitively obtain content. I assume.

  According to a first aspect of the present invention for solving the above problems, there is provided a storage device storing a predetermined content, and a shared display for displaying a plurality of the content as a stereoscopic image so as to be visible to all users seated in a seat of a vehicle compartment A display device, an individual display device for displaying a plurality of the contents as a stereoscopic image so as to be visible only to each user seated in a seat in a vehicle compartment, an operation detection means for detecting an operation of the user's hand, and the stereoscopic image And a display control unit for moving the selected three-dimensional image to follow the operation when detecting the operation of selecting the image and the operation of moving the three-dimensional image, the display control unit including the shared display The content is displayed as a stereoscopic image by switching between the device and the shared mode using the individual display device, or the individual mode using the individual display device In-vehicle user interface unit according to claim Rukoto.

  In the first aspect, the motion of the user's hand can be detected, and the content can be displayed as a stereoscopic image on the common display device and the individual display device so as to follow the motion. As a display mode for displaying a stereoscopic image on the common display device and the individual display device, there are an individual mode and a sharing mode, which can be switched according to the number of users and the purpose of use. Thereby, the user can easily obtain desired information by intuitive operation according to the purpose of use.

  A second aspect of the present invention is the on-vehicle user interface device according to the first aspect, wherein the display control unit performs the individual display of the stereoscopic image displayed on the individual display device in the sharing mode. The on-vehicle user interface device is characterized in that when the movement of the hand moved out of the display area of the device is detected, the individual display device hides the stereoscopic image and the shared display device displays the stereoscopic image.

  In the second aspect, content can be shared from one passenger to another by intuitive operation.

  According to a third aspect of the present invention, in the in-vehicle user interface device according to the first or second aspect, the display control unit performs the individual three-dimensional image displayed on the shared display device in the shared mode. When the movement of the hand moved to the display device side is detected, the three-dimensional image is not displayed from the shared display device and displayed on the individual display device.

  In the third aspect, it is possible to move a stereoscopic image to one's hand and view details by intuitive operation.

  A fourth aspect of the present invention is the on-vehicle user interface device according to any one of the first to third aspects, wherein the display control unit is configured to display the three-dimensional display displayed on the individual display device in the sharing mode. According to another aspect of the present invention, there is provided an on-vehicle user interface device characterized by displaying another three-dimensional image related to the three-dimensional image on the shared display device when a hand movement on the image is detected.

  In the fourth aspect, one user can perform an operation on the content without being disturbed by the other occupants, without confusion, and the other user can view the resulting content on the shared display device .

  According to a fifth aspect of the present invention, in the on-vehicle user interface device according to any one of the first to fourth aspects, the storage device is provided in a server device capable of communicating with a vehicle, and the content is Classification information for classifying content is added, and the display control unit acquires the content to which classification information specified by the user of the vehicle is added from the server device, and in the individual mode, the content is displayed on the individual display device In the sharing mode, the content is displayed on the sharing display device.

  In a fifth aspect, content can be exchanged with like users riding on other vehicles.

  A sixth aspect of the present invention is the on-vehicle user interface device according to any one of the first to fifth aspects, wherein the storage device is provided in a server device capable of communicating with a vehicle, and the content is a user The display control unit acquires from the server device user information whose attribute of a user other than the user of the vehicle matches the attribute of the user of the vehicle, and the individual display in the individual mode In the on-vehicle user interface device, the user information is displayed on a device, and the user information is displayed on the shared display device in the sharing mode.

  In the sixth aspect, it is possible to get on another vehicle and exchange content with other users who are close to user attributes such as hobbies and lifestyle patterns, and to get acquainted.

  According to the present invention, there is provided an on-vehicle user interface device including a plurality of display devices which are easy to use for the user of the vehicle and can obtain content intuitively.

It is a schematic plan view of an in-vehicle user interface device. It is a perspective view showing a display and a motion sensor. It is a perspective view and a top view showing an individual display and a motion sensor. It is a perspective view showing a common display and an individual display. It is a block diagram of a vehicle-mounted user interface apparatus. It is a figure which shows the example of the three-dimensional image which represented the content. It is a perspective view of the three-dimensional image of the content displayed by a common display apparatus. It is a top view which shows the three-dimensional image for setting a vehicle-mounted apparatus. It is a side view of an in-vehicle user interface device. It is a side view of an in-vehicle user interface device. It is a figure which shows the display mode of the three-dimensional image displayed by a share display apparatus and an individual display apparatus. It is a figure which shows the display mode of the three-dimensional image displayed by a share display apparatus and an individual display apparatus. It is the schematic of a vehicle-mounted user interface apparatus for demonstrating circle mode, and a stereo image. It is the schematic of the stereo image displayed on the vehicle-mounted user interface apparatus for demonstrating connected mode.

  Hereinafter, modes for carrying out the present invention will be described. The description of the embodiment is an exemplification, and the present invention is not limited to the following description.

Embodiment 1
1 is a schematic plan view of the in-vehicle user interface device, FIG. 2 is a perspective view showing a common display device and a motion sensor, and FIG. 3 is a perspective view and a plan view showing an individual display device and a motion sensor. 4 is a perspective view showing a common display device and an individual display device. Ru. The longitudinal direction of the vehicle 1 is taken as the X direction, the vehicle width direction as the Y direction, and the height direction as the Z direction. The same applies to the subsequent figures.

  As shown in FIG. 1, in a compartment 4 of the vehicle 1, there are two front seats 2 (2A, 2B) which constitute a front seat (driver's seat and front passenger seat) and two rear seats which constitute a rear seat. Sheets 3 (3A, 3B) are arranged.

  The front seat 2 is rotatably provided about a vertical axis (Z axis). That is, the front seat 2 is rotatably provided between a forward position facing the front of the vehicle and a rearward position facing the rear seat 3 facing the rear of the vehicle.

  The front seat 2 and the rear seat 3 are so-called motorized seats, and are provided with slide devices (not shown) that slide and move the seats in the front-rear direction of the vehicle 1 by an electric motor or the like. Further, the front seat 2 is provided with a rotation device (not shown) for rotating the seat by an electric motor or the like. The configurations of the slide device and the rotation device are not particularly limited, and an existing configuration may be adopted. Therefore, detailed description of the slide device and the rotation device is omitted.

  A user (hereinafter referred to as an occupant) seated on the front seat 2 can operate the slide device and the rotation device appropriately by operating a predetermined switch, and the front seat 2 can be arranged as desired. Further, an occupant seated on the rear seat 3 can operate the slide device appropriately by operating a predetermined switch to slide the rear seat 3 to a desired position in the longitudinal direction of the vehicle.

  The vehicle 1 is capable of completely automatic driving which does not require a driver. For this reason, not only the front seat 2B on the passenger seat side, but also the front seat 2A on the driver seat side is configured to be pivoted between the forward position and the facing position by the pivoting device.

  In the passenger compartment 4, an on-vehicle user interface device 10 including a shared display device 30, an individual display device 40, and a motion sensor 50 is mounted.

  As shown in FIGS. 2 and 4, the shared display device 30 is a device that displays a stereoscopic image in space. As such a shared display device 30, a known device for displaying a stereoscopic image in space can be adopted.

  For example, it is possible to use a display device that displays an image in the air by spraying fog and using it as a screen and projecting an image on the screen.

Besides, it is possible to use a display device which forms a stereoscopic image in the air by using a lens or a concave mirror. In addition, a display capable of displaying a two-dimensional image and a lens array in which microlenses are arranged in front of the display can be arranged, and a display device in which an image is formed in the air by the lens array can be used. In addition, a display capable of displaying a two-dimensional image, and a transmission type mirror array imaging element that realizes an imaging action by treating light incident on a minute mirror as one light beam and controlling those light beams by many mirrors A display device using a child can be used. Furthermore, it is possible to use a volume-type three-dimensional display in which light spots can be three-dimensionally arranged by scanning based on screen rotation and the like.
In any display device, a stereoscopic image displayed in the air can be observed from all around.

  The shared display device 30 as described above is arranged to be surrounded by the front seat 2 and the rear seat 3 substantially at the center of the passenger compartment 4. The shared display device 30 is arranged to display a stereoscopic image in the upper space. An area in which the shared display device 30 can display a stereoscopic image is referred to as a shared display area 31. Further, in the shared display area 31, three-dimensional coordinates of (X, Y, Z) are defined, and three-dimensional coordinates can be designated to display a stereoscopic image.

  In the present embodiment, a rectangular parallelepiped area is a shared display area 31 between the seats of the vehicle compartment 4 (between the front seat 2 and the rear seat 3). Therefore, the 3D image displayed in the shared display area 31 can be viewed regardless of whether the front seat 2 or the rear seat 3 is seated.

  As shown in FIG. 3 and FIG. 4, the individual display device 40 is a device that displays a stereoscopic image in space so as to be visible only to each occupant seated in each seat of the vehicle compartment 4. The individual display devices 40 are disposed around the shared display device 30, and a plurality of individual display devices 40 are provided for each seat. In the present embodiment, four individual display devices 40A to 40D are provided corresponding to the respective sheets. In addition, when these are not distinguished, it calls the separate display apparatus 40. FIG.

  Specifically, the individual display device 40 considers a liquid crystal display 42 capable of displaying a two-dimensional image, light incident on a minute mirror as one light beam, and controls these light beams by many mirrors to combine them. And an imaging plate 43 having a transmission type mirror array imaging element for realizing an image action. The image displayed on the liquid crystal display 42 is displayed (formed) as a stereoscopic image in space by the imaging plate 43.

  A space in which a three-dimensional image displayed by the imaging plate 43 is displayed is referred to as an individual display area 41. The imaging plate 43 is disposed such that the individual display area 41 is located in the space between each seat and each individual display device 40. The three-dimensional image displayed by each individual display device 40 can be viewed only by the occupant of the seat corresponding to each individual display device 40, and can not be viewed by the other occupants. In the present invention, “visible only from the occupant” means an aspect in which the stereoscopic image itself can not be seen from other occupants, or an aspect in which the stereoscopic image can not be recognized as characters or figures.

  In the present embodiment, for example, the individual display device 40A displays a stereoscopic image toward the occupant of the front seat 2A. Even if the occupants of the front seat 2B, the rear seat 3A and the rear seat 3B try to view the stereoscopic image displayed by the individual display device 40A, they are blocked by the imaging plate 43 of the individual display device 40A Characters and figures can not be recognized clearly and are viewed unsharply.

  As shown in FIG. 4, the occupant of each seat (the occupant of the front seat is not shown) can visually recognize the stereoscopic image I1 displayed by the shared display device 30. On the other hand, only the occupant can view the stereoscopic image I2 displayed for the occupant of the rear seat 3A, and the occupants of the front seat 2A, 2B (not shown) or the rear seat 3B can not view visually. The same applies to the stereoscopic image I3 displayed for the occupant of the rear seat 3B, the front seat 2A, and the stereoscopic image displayed for the occupant of the front seat 2B.

  The motion sensor 50 is a device for detecting the motion of the hand of the occupant, and specifically, is a device that emits infrared light and captures the reflected light reflected by the object to be detected to form an image. is there. An area where the motion sensor 50 can detect the hand of the occupant is referred to as a detection area. The motion sensor 50 according to the present embodiment uses a first detection area 51 including the shared display area 31 and a second detection area 52 including the individual display area 41 as a detection area. The motion sensor 50 captures the first detection area 51 and the second detection area 52 as an image. Note that the motion sensor 50 does not have to image the first detection area 51 and the second detection area 52 by one unit, and images the first detection area 51 and the second detection area 52 with a plurality of units. It is also good.

  FIG. 5 is a block diagram of the on-vehicle user interface device 10. As shown in the figure, the on-vehicle user interface device 10 includes a storage device 11, a control device 20, and a microphone 60.

  The storage device 11 stores predetermined content. The content is various information related to the vehicle 1. For example, the names of on-vehicle devices, setting items related to the on-vehicle devices, and information on facilities around the vehicle 1 and on a route on which the vehicle 1 tries to travel.

  Examples of on-vehicle devices include navigation systems, radios, audio devices, and air conditioners. In the case of a navigation system, examples of setting items related to in-vehicle devices include a route and a destination. Similarly, in the case of a radio, it is a volume or a radio station, and in the case of an air conditioner, it is an operation mode (heating, cooling, blowing, etc.), temperature and air volume. is there.

  As described above, the storage device 11 stores various information on in-vehicle devices and contents on peripheral facilities.

  The contents are not limited to those stored in the storage device 11 mounted on the vehicle 1. The content may be stored on a remote storage device. In this case, a server device provided with a storage device storing content is provided, and wireless communication is enabled between the in-vehicle user interface device 10 and the server device. Then, when a keyword is transmitted from the vehicle 1 to the server device via wireless communication, the server device searches the storage device for content corresponding to the keyword, and transmits the content to the vehicle 1. Thus, the vehicle 1 may obtain content from the remote storage device 11.

  The control device 20 is an ECU (Electronic Control Unit), and includes a CPU, a ROM for storing and storing control programs, a RAM as an operation area of the control programs, an EEPROM for rewritably holding various data, peripheral circuits, and the like. It is configured to include an interface unit that takes an interface. The control device 20 is connected to each part of the vehicle 1 via an interface part, exchanges information with the respective parts, and controls each part.

  The control device 20 further includes a detection unit 21, a voice recognition unit 22, and a display control unit 23. These units are realized by the CPU of the control device 20 executing a control program.

  The detection unit 21 analyzes the image acquired from the motion sensor 50, and detects the position and operation of the occupant's hand. The position of the hand is, for example, three-dimensional coordinates based on the origin of the shared display area 31. The motion sensor 50 and the detection unit 21 correspond to motion detection means described in the claims.

  Since the detection of the position and movement of the hand based on the analysis of the image is a known technique, the detailed description is omitted, but the detection unit 21 can detect the following movement of the hand.

  For example, the detection unit 21 can detect the shape of a hand such as a hand in a held state, a hand in an open state, or a hand in a pointed state. In addition, it is possible to detect the orientation of a hand such as a horizontal hand or a vertical hand. Besides, the distance and the position from the motion sensor 50 can also be detected. Then, the detection unit 21 detects the movement of the hand from such a change in the state of the hand. For example, a flick operation, a slide operation, a point operation, and a pinch operation are determined as hand movements.

The flicking motion is a motion in which the fingertip is swung left and right or up and down around the wrist.
The sliding motion is a motion for moving the entire hand vertically and horizontally.
The point motion is a motion in which a part of the finger, for example, a forefinger is extended and the other finger is bent and the hand is moved vertically or horizontally.
The pinching motion is a motion in which the two fingertips approach or separate in a state where two fingers are stretched. The pinching operation in which two fingertips are close to each other is referred to as pinching-in operation, and the pinching operation in which two fingertips are separated from each other is also referred to as pinch-out operation.

  The voice recognition unit 22 analyzes the voice acquired from the microphone 60 and recognizes words and the like of the voice emitted by the occupant. Furthermore, the voice recognition unit 22 analyzes the voice acquired from the microphone 60, and detects the position of the source of the voice, that is, the position of the occupant. Such voice recognition and detection of the position of the occupant can be performed by a known voice analysis technology. The microphone 60 and the voice recognition unit 22 correspond to an occupant position detection unit described in the claims.

  The display control unit 23 controls the content to be displayed on the shared display device 30 or the individual display device 40 as a stereoscopic image. The display control unit 23 reads the content from the storage device 11 and displays the content on the shared display device 30 and the individual display device 40 in a data format that can be displayed by the shared display device 30 and the individual display device 40.

  FIG. 6 is a diagram illustrating an example of a stereoscopic image representing content. 6 (a) is a perspective view of the stereoscopic image A as viewed from one side, and FIG. 6 (b) is a perspective view of the stereoscopic image A as viewed from the opposite side (the stereoscopic image A of FIG. 6 (c) is a perspective view of the stereoscopic image B. FIG. The stereoscopic image A is an opaque (invisible on the opposite side) cube-shaped stereoscopic image, and the stereoscopic image B is a translucent (invisible on the opposite side) spherical stereoscopic image.

  Content is displayed on the stereoscopic image A and the stereoscopic image B. For example, as shown in FIG. 6A, on each surface on one side of the three-dimensional image A, new arrival information on a facility "OO land" and a peripheral map of the facility are displayed. Further, as shown in FIG. 6B, on each surface on the opposite side of the stereoscopic image B, the weather around the facility and the SHOP information (merchandise information) of the facility are displayed.

  As shown in FIG. 6C, along the spherical surface of the stereoscopic image B, new arrival information (a part of the characters wrap around on the back side and can be seen through from the front side) regarding the facility "○ ラ ン ド land" is displayed ing.

  As described above, although the content is displayed on the stereoscopic image A and the stereoscopic image B, another content (such as a thumbnail image) for calling the content may be displayed. For example, although details will be described later, when the occupant touches the surface displayed as “map” of the stereoscopic image A, another shared image 30 is displayed on the shared display device 30 with the map “○○ land” displayed. May be

  Furthermore, the stereoscopic image may represent content for operating the in-vehicle device. For example, as such content, an upward / downward arrow for adjusting the temperature of the air conditioner, a plus / minus symbol or the like may be displayed as a stereoscopic image. As described later, when such a stereoscopic image is moved upward by the occupant, control is performed to raise the temperature of the air conditioning. A stereoscopic image may be used as a user interface for such control.

The position, orientation, and movement of displaying the stereoscopic image illustrated in FIG. 6 will be described. Here, although the shared display device 30 is described, the same applies to the individual display device 40.
The display control unit 23 reads the content from the storage device 11 and causes the shared display device 30 to display the content. For example, the display control unit 23 causes the shared display device 30 to display a plurality of contents as stereoscopic images A to G.

  The display control unit 23 first determines the content to be displayed. For example, predetermined content is read from the storage device 11. Alternatively, the display control unit 23 searches the storage device 11 for content related to the keyword, using the voice of the occupant recognized by the microphone 60 and the voice recognition unit 22 as a keyword.

  For example, the display control unit 23 may use, as predetermined content, a navigation system, a radio, a television, an audio device, an air conditioner, vehicle information such as speed and remaining amount of fuel, and contents related to facilities around the vehicle from the storage device 11 Read

FIG. 7 is a perspective view of a stereoscopic image of content displayed by the common display device.
As shown to Fig.7 (a), the display control part 23 displays the content read from the memory | storage device 11 as each three-dimensional image AG. For example, on each surface of the three-dimensional image A, content related to the navigation system, for example, a current position or a destination on a certain surface, and a peripheral map on another surface are displayed. Also for the other stereoscopic images B to G, various contents are displayed on each surface.

  In addition, the display control unit 23 determines coordinates in the shared display area 31 so that the individual stereoscopic images A to G do not overlap, and causes the stereoscopic images A to G to be displayed on the coordinates. These three-dimensional images A to G may always be displayed at a fixed position, or may be changed in position based on the operation of the occupant.

  For example, the display control unit 23 causes a plurality of three-dimensional images A to G to be evenly arranged on one ring 32 at predetermined intervals, and causes the shared display area 31 to display the three-dimensional images.

  In addition, it is preferable that stereoscopic images A to G do not overlap on the line of sight L of the occupant. Such a line of sight L can be determined based on the front seat 2, the rear seat 3, the position of the average passenger's eyes, and the position of the shared display area 31.

The line of sight L of the occupant is virtually formed in the three-dimensional space, and the three-dimensional coordinates of each three-dimensional image are calculated so that two or more three-dimensional images are not arranged on the line of sight L. In the present embodiment, since there are four occupants, four lines of sight L are virtually formed, and three-dimensional coordinates of each three-dimensional image are set so that two or more three-dimensional images are not arranged in each line of sight L. calculate.
As a result, for the occupant, the stereoscopic images do not overlap, and the visibility of the plurality of stereoscopic images is improved.

  The three-dimensional images A to G displayed in the shared display area 31 may be rotated. For example, the display control unit 23 rotates the three-dimensional images A to G around the Z axis. Thus, the occupant can visually recognize the side surfaces of the three-dimensional images A to G in the seated state. Furthermore, the stereoscopic images A to G may move along the circumference of the ring 32. Since each of the three-dimensional images A to G comes to move closer to the occupant with the passage of time, the visibility of the three-dimensional images is improved. Of course, the modes of rotation and movement of the stereoscopic image are not limited to those described above.

  Furthermore, the display control unit 23 causes the shared display device 30 to display the stereoscopic image selected by the operation of the occupant among the plurality of stereoscopic images, following the operation of the occupant.

  The display control unit 23 determines whether there is a stereoscopic image within a certain range from the coordinates of the hand of the occupant obtained by the detection unit 21. If it is determined that there is a stereoscopic image within a certain range from the coordinates of the hand, it is assumed that the stereoscopic image is selected by the occupant. In the example of FIG. 7A, it is determined that the stereoscopic image A has been selected by the occupant. Alternatively, it may be determined that a stereoscopic image is selected when a point motion is detected within a certain range from the stereoscopic image.

  In addition, when a specific operation (for example, an operation in which the hand is separated from the stereoscopic image A at a predetermined speed or higher) is detected in the state where the stereoscopic image is selected, it is determined that the selection of the stereoscopic image is cancelled.

  Displaying a stereoscopic image by following the operation of the occupant means changing the coordinate position, size, and direction of the stereoscopic image corresponding to the flick operation, slide operation, point operation, and pinch operation described above, or changing to a stereoscopic image. To change the content to be displayed.

  For example, as shown in FIG. 7 (a), when a pinch out operation is detected from a state in which the hand pinches the stereoscopic image A, the stereoscopic image A is enlarged and displayed as shown in FIG. 7 (b). The stereoscopic image A is enlarged in response to such an operation as enlarging the object of pinch-out operation. As a result, it is possible to realize the request of “want to see the stereoscopic image A in an enlarged manner” with an intuitive operation.

In addition, although not particularly illustrated, it is possible to display a stereoscopic image corresponding to each operation.
For example, when a pinch-in operation is detected in a state in which the hand pinches a stereoscopic image, the stereoscopic image is displayed in a reduced size. In this way, the stereoscopic image is reduced in response to an operation such as a pinch-in operation that reduces the object. As a result, it is possible to realize the requirement of “reduce the stereoscopic image and make it easy to view another stereoscopic image” by an intuitive operation.

  In addition, when a slide operation or a flick operation is detected from a state in which a hand selects a stereoscopic image, the stereoscopic image is moved according to the position of the hand. The three-dimensional image is moved in response to such an operation as moving the object of the slide operation. This makes it possible to realize the request "want to move a stereoscopic image" by an intuitive operation.

  Furthermore, when the hand detects a point motion on a stereoscopic image, the content related to the stereoscopic image may be searched and the content may be displayed as another stereoscopic image. For example, when a point operation is detected with respect to the side of the stereoscopic image A in which the “new arrival information” is displayed as shown in FIG. 6A, the content regarding the details of the new arrival information is displayed as another stereoscopic image. May be As a result, it is possible to realize the request “I want to know the details of the content displayed in the stereoscopic image” by an intuitive operation.

  When displaying a stereoscopic image in accordance with such an operation of the passenger's hand, predetermined processing may be executed according to the content.

FIG. 8 is a plan view showing a stereoscopic image for setting the in-vehicle apparatus.
In FIG. 8A, for example, content related to temperature setting of the air conditioner is displayed in the shared display area 31 as a stereoscopic image H. When the upward flick operation is detected, the display control unit 23 moves the stereoscopic image H upward and performs control to raise the temperature by, for example, 1 ° C. in the air conditioner. Similarly, when a downward flick operation is detected, the display control unit 23 moves the stereoscopic image H downward and performs control to lower the temperature by, for example, 1 ° C. in the air conditioner. After setting the temperature, the display control unit 23 returns the stereoscopic image H to the original position. In this way, the requirement of "raising or lowering the temperature of the air conditioning" can be realized by an intuitive operation.

  Further, in FIG. 8B, for example, the content related to the tuning setting of the radio is displayed in the shared display area 31 as a stereoscopic image I. When a flick operation in the left direction is detected, the display control unit 23 moves the stereoscopic image I in the left direction and changes it to a broadcasting station that uses a lower frequency than the currently selected broadcasting station. Similarly, when a flicking operation in the right direction is detected, the display control unit 23 moves the stereoscopic image I in the right direction and changes it to a broadcasting station that uses a higher frequency than the currently selected broadcasting station. Do. In this way, the request "to select a radio station" can be realized by an intuitive operation.

  Besides, 3D images, operation of car navigation system, air volume of air conditioner, switching of operation mode of air conditioner (heating, cooling, air flow etc), sound volume selection of TV, sound volume reproduction of audio equipment, stop A user interface for fast-forwarding may be used to control each device when a specific action is detected on a stereoscopic image.

  As described above, the shared display device 30 for displaying a stereoscopic image and the individual display device 40 function as an output device for displaying the content to the occupant, and the motion sensor 50 and the detection unit 21 are inputs for inputting an operation on the content Act as a device.

  As mentioned above, the aspect which displays a three-dimensional image in each of the shared display apparatus 30 and the separate display apparatus 40 was demonstrated. Furthermore, the on-vehicle user interface device 10 of the present invention has an individual mode and a sharing mode as modes for displaying a stereoscopic image on the shared display device 30 and the individual display device 40.

  The display control unit 23 automatically performs switching of the plurality of modes. For example, switching is performed according to the number of occupants in the vehicle compartment. Specifically, the display control unit 23 switches the mode to the individual mode if there is one occupant, and switches to the sharing mode if there are a plurality of occupants.

  Further, switching of a plurality of modes may be performed manually by the occupant. For example, a menu for causing the shared display device 30 or the individual display device 40 to select a plurality of modes may be displayed as a stereoscopic image, and each mode may be selected by the operation of the hand of the occupant. Of course, a plurality of modes may be switched by a button provided on the instrumental panel or the like.

  The individual mode is a display mode in which a stereoscopic image is displayed for each occupant. Specifically, the content requiring the privacy of the occupant is displayed only on the individual display device 40 for the occupant, and can not be viewed on the individual display devices 40 for other occupants. As a means to display content only to a specific passenger | crew, the separate display apparatus 40 which displays a stereo image so that it may be visible only to each passenger | crew as above-mentioned can be applied. When displaying content requiring privacy, the display control unit 23 automatically switches to the individual mode, and displays the content only on the individual display device 40.

  Content requiring privacy includes, for example, information handled by a call application (calling party, call content (text information)), search keywords used when accessing a search engine via a browser, browsing history of web pages, etc. is there.

  Whether such privacy is required is set in advance for each content, or set by an occupant and stored in the storage device 11. When the content specified by the occupant is read from the storage device 11 and the privacy setting is made for the content, the display control unit 23 does not cause the shared display device 30 to display the content, and the display control unit 23 Is displayed on the individual display device 40 of

  FIG. 9 is a side view of the in-vehicle user interface device. The figure shows the occupants of the front seat 2A and the rear seat 3B, the individual display device 40A and the individual display device 40D, and the shared display device 30.

  For example, a stereoscopic image B (a stereoscopic image B displayed by the individual display device 40D) requiring privacy for an occupant of the rear seat 3B can not be viewed or is difficult to see from the occupant of the front seat 2A. What can be visually recognized by the occupant of the front seat 2A is the stereoscopic image A displayed by the individual display device 40A for the occupant. Therefore, even if the content relating to the privacy of the occupant of the rear seat 3B is displayed on the individual display device 40D as the stereoscopic image B, the privacy of the occupant can be protected. Of course, the same applies to the occupants of other seats.

  Next, the sharing mode will be described. The sharing mode is a mode in which a stereoscopic image is displayed on both the sharing display device 30 and the individual display device 40. Specifically, there are a multi-person mode and a pioneer mode as the sharing mode.

  The multiplayer mode will be described with reference to FIGS. 10 and 11. FIG. 10 is a side view of the in-vehicle user interface device, and FIG. 11 is a view showing a display mode of a stereoscopic image displayed by the shared display device and the individual display device.

  The multi-person mode is a display mode in which content is displayed on the shared display device 30 and the individual display device 40 based on the movement of the occupant's hand for a stereoscopic image. The display control unit 23 switches to a multi-person mode when a plurality of occupants board the cabin and the plurality of occupants display various contents in parallel or operate on the contents.

  As shown in FIGS. 10 and 11A, the display control unit 23 detects an operation of a hand for moving the stereoscopic image B displayed on the individual display device 40D to the outside of the individual display area 41 of the individual display device 40D. When this is done, the stereoscopic image B is not displayed from the individual display device 40D and is displayed on the shared display device 30 (shared display area 31).

  Here, when the movement of the hand moving the stereoscopic image B upward to the outer edge of the individual display area 41 is detected, the stereoscopic image B is not displayed in the individual display area 41 and is displayed in the shared display area 31. That is, when the occupant of the rear seat 3B operates to manually select and move the stereoscopic image B displayed on the individual display device 40D upward, the stereoscopic image B can be displayed on the shared display device 30. It can be moved. The stereoscopic image B is not limited to the case of moving upward, and when the movement of the hand moved to a specific area (for example, a corner portion) of the individual display area 41 is detected, The stereoscopic image B may be hidden and displayed in the shared display area 31.

  Next, a display mode in which the shared display device 30 is moved to the individual display device 40 in the multi-person mode will be described.

  As shown in FIGS. 10 and 11B, when the display control unit 23 detects an operation of a hand moving the stereoscopic image B displayed on the shared display device 30 to the individual display device 40 side, the shared display device Starting from 30, the stereoscopic image B is not displayed and displayed on the individual display device 40A.

  Here, when the movement of the hand moving the stereoscopic image B in the horizontal direction (the direction toward the front panel 2A's individual display device 40A side) to the outer edge of the shared display area 31 is detected, the stereoscopic image B is shared It is not displayed in the display area 31 and is displayed in the individual display area 41. That is, when the occupant of the front seat 2A operates to manually select and move the stereoscopic image B displayed on the shared display device 30 to the front, the stereoscopic image B can be displayed on the individual display device 40A. It can be moved. The stereoscopic image B is not limited to the case of moving it to the front, and when the movement of the hand moved to a specific area (for example, a corner portion) of the shared display area 31 is detected, The stereoscopic image B may be hidden and displayed in the individual display area 41.

  In the multi-person mode described above, the occupant can move the stereoscopic image displayed on the individual display device 40 to the shared display device 30, and the other occupant can view it. According to such a multi-person mode, each occupant can share the stereoscopic image displayed on his / her individual display device 40 by showing it to other occupants. Furthermore, according to the multi-person mode, each occupant can move the stereoscopic image displayed on the shared display device 30 to the individual display device 40 for viewing. In this manner, in the multi-person mode, the content can be exchanged as a stereoscopic image between the occupants in an intuitive operation, and the content can be easily shared.

  Next, the Pioneer mode will be described with reference to FIG. FIG. 12 is a view showing a display mode of a stereoscopic image displayed by the shared display device and the individual display device.

  The Pioneer mode is a display mode in which only one occupant can operate the individual display device 40, and the other occupant can perform operations such as viewing or moving a stereoscopic image of the shared display device 30. The display control unit 23 switches to the Pioneer mode when a plurality of occupants are in the vehicle compartment and one occupant actively displays the content and performs an operation on the content. Here, a case where the occupant of the rear seat 3B can operate the individual display device 40D will be described.

  In the Pioneer mode, when the hand control on the stereoscopic image of the individual display device 40 is detected, the display control unit 23 displays another stereoscopic image associated with the stereoscopic image on the shared display device. Here, a search screen, which is content related to a car navigation system, is displayed as a stereoscopic image A, and a search result screen related to the stereoscopic image A is displayed as a stereoscopic image B.

  In the Pioneer mode, the motion of the hand is detected with respect to the stereoscopic image A displayed on one individual display device 40D. Then, a predetermined process is performed based on the motion of the hand on the stereoscopic image A. For example, when detecting an operation in which the user touches the "departure place" portion, the occupant of the rear seat 3B displays a three-dimensional image prompting input of the departure place, or outputs sound from a speaker (not shown) Do.

  For example, the control device 20 recognizes an occupant's voice collected by the microphone 60 using a known voice recognition technology, and acquires the recognized voice as a departure point. Alternatively, a virtual keyboard may be displayed as a three-dimensional image, and an operation of touching the keyboard may be detected to perform character input. Such character input is the same as character input by a graphical user interface (GUI) using a conventional flat display except that it is a stereoscopic image. Of course, the present invention is not limited to the keyboard, and a plurality of departure places may be arranged and displayed as a stereoscopic image, and the departure place may be selected by selecting one of them.

The control device 20 acquires “destination” as well as “departure”. The display control unit 23 displays the destination (here, "home") and the departure place (here, "OO land") acquired in this manner on the individual display device 40D as a stereoscopic image A.
After completing the input of the "place of departure" and the "destination", the occupant of the rear seat 3B performs an operation of touching the "search" button displayed as the stereoscopic image A by hand. When the display control unit 23 detects the motion of the hand touching the “search” button in the stereoscopic image A, the display control unit 23 causes the car navigation system (not shown) to perform a route search.

  The display control unit 23 displays the search result by the car navigation system as the stereoscopic image B on the shared display device 30. Here, the map and the route from the departure place (S to O) to the destination (O to G) are displayed as a stereoscopic image B. A planar three-dimensional image B, such as a map, may be rotated about the Z axis to be visible to all occupants.

  In the Pioneer mode described above, contents requiring operation are displayed as a stereoscopic image on one individual display device 40D. Then, only the movement of the hand on the stereoscopic image displayed on one individual display device 40D is detected. That is, only a specific occupant can perform an operation on a stereoscopic image. On the other hand, the stereoscopic image B related to the stereoscopic image A is displayed on the shared display device 30 that can be viewed by all the occupants.

  According to such Pioneer mode, since one car occupant operates the car navigation system in the individual display device 40, the route can be searched without confusion, and all members can share the search results. it can.

  Of course, the Pioneer mode is not limited to the car navigation system, and can be applied to the operation of any on-vehicle device. For example, the setting regarding the air conditioner of a vehicle may be performed by operation of the three-dimensional image which displayed the separate display apparatus 40, and you may display the confirmation screen on the shared display apparatus 30. FIG.

  Furthermore, a Pioneer mode may be used in which content search (collection) is performed in the individual display device 40 and the result is displayed on the shared display device 30. For example, the display control unit 23 displays a search interface of an application (for example, a browser) for searching for content on the individual display device 40 as a stereoscopic image. When the display control unit 23 detects the movement of the hand of the occupant with respect to the stereoscopic image, the display control unit 23 causes the application to search for and collect content. The display control unit 23 displays the collected contents as, for example, a travel plan and displays the same on the shared display device 30 as a stereoscopic image.

  According to such Pioneer mode, one passenger can collect content (for example, create a travel plan) using the individual display device 40 without being interfered with another passenger, and the content ( The travel plan etc. can be shared with all the members by the shared display device 30.

  As described above, although the individual mode and the sharing mode (multiplayer mode and Pioneer mode) have been described as the display mode of the stereoscopic image, the circle mode and the connected mode will be described as an example of other display modes.

  FIG. 13 is a schematic view of an on-vehicle user interface device and a stereoscopic image for explaining the circle mode. A circle is a group of people with the same hobbies and preferences in the real world. The circle mode is a mode for displaying content related to a circle in which the occupant participates. The display control unit 23 switches to the circle mode when the occupant selects the circle mode.

  Here, as an example, it is assumed that two persons belonging to a circle related to a car (name is "car circle") are on different vehicles 1A and 1B. An on-vehicle user interface device 10 is mounted on each of the vehicle 1A and the vehicle 1B.

  The server device 70 identifies information related to the attributes of a person (hereinafter, member) belonging to a car circle, such as a name or a nickname, an ID (identification code) for identifying the member, a password, or a circle to which the member belongs. Information (circle name "car circle") and the like are stored.

  Content related to various circles is stored in a server device 70 capable of wireless communication with the on-vehicle user interface device 10. The content of the circle is given the circle name. The circle name given to the content in this manner corresponds to classification information for classifying the content.

  In order to access the content, such as adding or acquiring the content stored in the server device 70, the server device 70 authenticates the member. A known authentication technique can be applied to the authentication of such an individual, so the details will be omitted.

  When a member is authenticated by the server device 70, the member can obtain or add information on a circle to which the member belongs.

  Here, it is assumed that the occupants of the vehicle 1A and the vehicle 1B are authenticated as members of the automobile circle. After authentication, the display control unit 23 acquires, from the server device 70, the content related to the automobile circle to which the authenticated occupant belongs. The server device 70 searches for the content to which the classification information of the car circle is added, and transmits it to the display control unit 23.

  In the individual mode, the display control unit 23 displays the content related to the car circle on the individual display device 40 as a stereoscopic image, and displays the content on the shared display device 30 in the sharing mode. For example, as shown in FIG. 13, the vehicle 1A is in the sharing mode (multiplayer mode or Pioneer mode) in this case, and in this case, the display control unit 23 causes the shared display device 30 to Display as.

  In addition, the display control unit 23 has a function of adding content from the vehicle occupant to the automobile circle. Although not particularly illustrated, the display control unit 23 displays, on the shared display device 30, a button for the passenger to add content to the vehicle circle. When the operation of the hand selecting the button is detected, the display control unit 23 causes the shared display device 30 to display a stereoscopic image prompting the passenger to input a voice. Then, the voice of the occupant is recognized, and the recognition result is used as characters to create content about the car circle. Next, the display control unit 23 transmits the content to the server device 70.

  Here, it is assumed that an occupant (member) of the vehicle 1A utters "I will have an event on the day of O moon △ day". As a result, the content of “A month △ day event will be performed” is stored in the storage device 11 of the server device 70 as the event information on the car circle.

  On the other hand, as described above, the on-vehicle user interface device 10 in the vehicle 1B acquires the content related to the automobile circle from the server device 70. It is assumed that the vehicle 1B is in the individual mode. In this case, the display control unit 23 displays the content on the individual display device 40 as a stereoscopic image B.

  Thus, according to the circle mode, content can be generated and shared among members belonging to the same car circle. Of course, the circle mode is applicable not only to the car-related circle but also to any circle. Moreover, if classification information is added not only to a circle, content having the same classification information can be shared among the on-vehicle user interface devices 10.

  FIG. 14 is a schematic view of a stereoscopic image displayed on the in-vehicle user interface device for explaining the connected mode.

  The connected mode is a display mode for displaying content that provides an automatic matching function between members with similar hobbies and lifestyle patterns. Here, a person who is provided with the automatic matching function is called a member. The display control unit 23 switches to the connected mode when the member (passenger) selects the connected mode.

  Although not particularly illustrated, in the connected mode as well as in the circle mode, the vehicle can wirelessly communicate with the server device 70, and the content is stored in the storage device 11 of the server device 70.

  The server device 70 stores user information consisting of member attributes as content. The user information is, for example, information representing the member's hobbies and lifestyle patterns. Such user information is created in advance by the member himself and transmitted to the server device 70. To create specific user information, the user is made to input user information using the shared display device 30 or the individual display device 40 of the in-vehicle user interface device 10, and the user information is transmitted to the server device 70. . Alternatively, the member may create user information and transmit it to the server device 70 using a smartphone, a personal computer, or the like.

  Next, the display control unit 23 authenticates whether the vehicle occupant is a member of the connected mode. The authentication is performed in the same manner as in the circle mode. When the vehicle occupant is authenticated as a member, the server device 70 searches the storage device 11 for user information regarding other members. Other members are members other than certified members. User information is retrieved from the storage device 11 such that the attributes of the other members match or approximate the attributes of the member who boarded the vehicle. For example, the server device 70 searches for user information on members whose interests match or approximate as attributes. Whether or not the attributes are similar is previously set on the server device 70 side.

  The display control unit 23 acquires, from the server device 70, user information that matches or approximates a passenger on board the vehicle with a hobby or the like. Then, in the individual mode, the display control unit 23 displays, as a stereoscopic image, user information on members having the same hobby on the individual display device 40, and displays user information on the shared display device 30 in the sharing mode. For example, as shown in FIG. 14, in the individual mode, the display control unit 23 causes the individual display device 40 to display, as a stereoscopic image A, user information regarding a member whose taste is close to that of the vehicle member.

  Thus, according to the connected mode, among the members using the in-vehicle user interface device 10, for example, user information on other members having the same taste is displayed on the in-vehicle user interface device 10 as a stereoscopic image. By using the connected mode in this way, members with the same hobbies and lifestyle patterns are automatically matched (introduced), allowing friends, acquaintances to increase, and the excitement and new experiences that have never been seen before. It can be given to the occupants of a vehicle equipped with the user interface device 10.

  As described above, the on-vehicle user interface device 10 can detect the motion of the occupant's hand, and can display the content as a stereoscopic image on the shared display device 30 and the individual display device 40 so as to follow the motion. . As a display mode for displaying a stereoscopic image on the shared display device 30 and the individual display device 40, there are an individual mode and a sharing mode, which are switched according to the number of occupants and the purpose of use. As a result, the occupant can easily obtain desired information through intuitive operation according to the purpose of use.

  The on-vehicle user interface device 10 can move the stereoscopic image displayed on the individual display device 40 to the shared display device 30 by the operation of the hand in the multi-person mode. In this way, it is possible to share content from one occupant to another by intuitive operation.

  The on-vehicle user interface device 10 can move the stereoscopic image displayed on the shared display device 30 to the individual display device 40 by the operation of the hand in the multi-person mode. In this way, it is possible to move the stereoscopic image to one's own hand and view details by intuitive operation.

  Also, in the on-board user interface device 10, in the Pioneer mode, one passenger can perform an operation on the content without being disturbed by another passenger and can perform without confusion, and the other passenger shares the content obtained as a result thereof be able to.

  Also, in the circle mode, the on-vehicle user interface device 10 can exchange content with like members who are on other vehicles.

  Further, in the connected mode, the on-vehicle user interface device 10 can get on another vehicle, exchange contents with members who have similar hobbies and lifestyle patterns, and get acquainted.

  Although the embodiment of the present invention has been described, of course, the present invention is not limited to the above-described embodiment, and additions, omissions, replacements, and additions of configurations can be made without departing from the spirit of the present invention. Other modifications are possible.

DESCRIPTION OF SYMBOLS 1 ... Vehicle, 4 ... Car room, 10 ... Vehicle-mounted user interface apparatus, 11 ... Storage apparatus, 20 ... Control apparatus, 21 ... Detection part, 22 ... Speech recognition part, 23 ... Display control part, 30 ... Shared display apparatus, 40 ... Individual display device, 50 ... Motion sensor, 51 ... First detection area, 52 ... Second detection area, 70 ... Server device

Claims (6)

A storage device storing predetermined content;
A shared display device for displaying a plurality of the contents as a stereoscopic image so as to be visible to all users seated in a seat of a vehicle compartment;
An individual display device for displaying a plurality of the contents as a stereoscopic image so as to be visible only to each user seated in a seat of a vehicle compartment;
Motion detection means for detecting user's hand motion;
And an operation of selecting the stereoscopic image, and a display control unit moving the selected stereoscopic image following the operation when detecting the operation of moving the stereoscopic image.
The display control unit is switched to any one of a shared mode using the shared display device and the individual display device, and an individual mode using the individual display device to display the content as a stereoscopic image. apparatus. The on-vehicle user interface device according to claim 1, wherein
In the sharing mode, the display control unit
When the movement of the hand moving the stereoscopic image displayed on the individual display device out of the display area of the individual display device is detected, the stereoscopic image is not displayed from the individual display device and the shared display device An on-vehicle user interface device characterized in that The in-vehicle user interface device according to claim 1 or 2,
In the sharing mode, the display control unit
When the motion of the hand moving the three-dimensional image displayed on the shared display device to the individual display device is detected, the three-dimensional image is not displayed from the shared display device and displayed on the individual display device. An in-vehicle user interface device characterized by The in-vehicle user interface device according to any one of claims 1 to 3.
In the sharing mode, the display control unit
An on-vehicle user interface device that displays another three-dimensional image related to the three-dimensional image on the shared display device when detecting an action of a hand on the three-dimensional image displayed on the individual display device. The in-vehicle user interface device according to any one of claims 1 to 4,
The storage device is provided in a server device capable of communicating with a vehicle.
The content is provided with classification information for classifying the content,
The display control unit acquires, from the server device, the content to which classification information designated by the user of the vehicle is added, and displays the content on the individual display device in the individual mode, and the sharing in the sharing mode An on-vehicle user interface device displaying the content on a display device. The in-vehicle user interface device according to any one of claims 1 to 5,
The storage device is provided in a server device capable of communicating with a vehicle.
The content includes user information consisting of user attributes,
The display control unit acquires, from the server device, user information whose attribute of a user other than the user of the vehicle matches the attribute of the user of the vehicle, and displays the user information on the individual display device in the individual mode. In the sharing mode, the user information is displayed on the sharing display device.