JP2021068001A - Control device, program, and control system - Google Patents

Abstract

To provide a control device, program, and control system, which allow for appropriately configuring a target for receiving input.SOLUTION: A control device is provided, comprising an acquisition unit configured to acquire input to a target displayed on at least one display device, and a control unit configured to control execution of a function associated with the target according to information acquired by the acquisition unit. The control unit configures the target for receiving input that instructs execution of the function according to given conditions.SELECTED DRAWING: Figure 1

Description

The present invention relates to control devices, programs, and control systems.

Conventionally, various methods have been proposed for input for moving a pointer or the like displayed on a display device. For example, Patent Document 1 below discloses an input device that enables input by an operating body such as an operator's finger. Further, Patent Document 1 below discloses a technique of applying an input device to a remote control device for operating a navigation device mounted on a vehicle.

Japanese Unexamined Patent Publication No. 2019-12351

However, the state in which input can always be made to the object displayed on the display device may not be appropriate depending on changes in the situation.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is a new and improved control device, program, and a control device, a program, and an object capable of appropriately setting an object for receiving an input. It is to provide a control system.

In order to solve the above problems, according to a certain viewpoint of the present invention, an acquisition unit that acquires an input for an object displayed on at least one display device is associated with the object according to the information acquired by the acquisition unit. A control device is provided that includes a control unit that controls the execution of a function, and the control unit sets the target that receives an input instructing the execution of the function according to a predetermined condition.

Further, in order to solve the above problems, according to another viewpoint of the present invention, the computer is subjected to an acquisition unit that acquires an input to an object displayed on at least one display device, and an acquisition unit according to the information acquired by the acquisition unit. A program is provided that functions as a control unit that controls the execution of a function associated with the target, and the control unit receives an input instructing the execution of the function according to a predetermined condition to set the target. To.

Further, in order to solve the above problems, according to another viewpoint of the present invention, an input device for detecting an input to an object displayed on at least one display device and information based on the input detected by the input device. The control unit includes an acquisition unit for acquiring the above and a control unit for controlling the execution of the function associated with the target according to the information acquired by the acquisition unit, and the control unit executes the function according to a predetermined condition. A control system is provided that sets the target that accepts the input to be instructed.

As described above, according to the present invention, it is possible to appropriately set a target for accepting input.

It is a figure explaining the outline of the control system which concerns on one Embodiment of this invention. It is a figure which shows an example of the structure of the control system which concerns on this embodiment. It is a figure which shows an example of the display screen at the time of setting the image which can accept the input by this embodiment. It is a flowchart which shows an example of the flow of operation processing of the control system which concerns on this embodiment.

Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In the present specification and the drawings, components having substantially the same functional configuration are designated by the same reference numerals, so that duplicate description will be omitted.

<1. Overview>
FIG. 1 is a diagram illustrating an outline of a control system 1 according to an embodiment of the present invention. As shown in FIG. 1, the control system 1 according to the present embodiment is mounted on a vehicle. A vehicle is an example of a mobile body to be used by a user.

As shown in FIG. 1, the control system 1 according to the present embodiment includes an input device 20 and a display device 30 mounted on a vehicle. The input device 20 and the display device 30 are provided at different positions from each other. The control system 1 may be a remote input system that enables input to the display device 30 using the input device 20.

The display device 30 may be provided, for example, in front of the driver's seat 2 (between the steering wheel 6 and the windshield) on which the driver sits, and may be used as a so-called instrument panel. In this case, the display device 30 has, for example, meters (speedometer, fuel gauge, tachometer (engine tachometer), odometer (total mileage), trip meter (section mileage), fuel consumption meter, etc.), fuel remaining amount. A warning light, a direction indicator light, etc. are displayed.

Further, as shown in FIG. 1, the display device 30 may be a large display extending to the front of the passenger seat 3. By using a large display, the display area is expanded and various information can be displayed on one screen. For example, along with meters and the like, a navigation screen for guiding the route of the vehicle, an air conditioning screen for showing information on the air conditioning control of the vehicle, an audio screen showing information on controlling the audio output from the speaker mounted on the vehicle, and the like are displayed on one screen. It is possible to display with. Although the case where the display device 30 is formed by one large display is described here as an example of expanding the display area, the present invention is not limited to this. For example, a plurality of display devices 30 may be provided on the vehicle to expand the display area. Further, the display screen of the display device 30 may be formed by a flat surface or a curved surface.

(Arrangement of issues)
In recent years, as an input method for a display device mounted on a vehicle, so-called touch input has been used in which an image such as an icon or a button displayed on a display screen is touched for input. With touch input, images such as icons and buttons can be directly touched for input, which enables more intuitive operation.

However, depending on the size and location of the display device, the sitting position and posture of the driver, etc., the driver may not be able to reach the display device, and touch input may be difficult.

On the other hand, in the present embodiment, as shown in FIG. 1, the input device 20 is provided at a position different from that of the display device 30, and remote input to the display device 30 using the input device 20 is possible. As a result, the degree of freedom in the size and arrangement of the display device 30 is increased, and it is possible to improve both the design and functionality and the operability. The input device 20 is provided within the reach of the driver, for example, on the upper surface of the center console 4 or near the armrest 5. The input device 20 may be, for example, a touch pad that detects contact of a finger or the like with the operation surface. The driver can input to the object displayed on the display device 30 while looking at the display device 30 without gazing at his / her hand.

Here, it is assumed that a large number of objects (here, images) that can be input using the input device 20 are displayed on the display device 30 having a wide display area (large display screen) to improve the functionality. However, the state in which input can always be performed for all of a large number of objects may not be appropriate depending on changes in the situation. For example, especially in a situation where it is necessary to concentrate on some matter such as driving a vehicle, it is not preferable that the input to the display device 30 mounted on the vehicle takes time or is distracted.

The control system 1 according to the embodiment of the present invention was conceived by paying attention to the above points, and makes it possible to appropriately set a target for receiving input.

Hereinafter, the configuration of the control system 1 according to the present embodiment will be described in detail.

<2. Configuration example>
FIG. 2 is a diagram showing an example of the configuration of the control system 1 according to the present embodiment. As shown in FIG. 2, the control system 1 includes a control device 10, an input device 20, a display device 30, a speaker 40, an air conditioning control device 50, and a navigation device 60. The speaker 40, the air conditioning control device 50, and the navigation device 60 are examples of in-vehicle devices mounted on the vehicle. In the present embodiment, since the control of the in-vehicle device by the control device 10 is also referred to, a specific example is shown in FIG. 2 as an example, and the control system 1 does not necessarily have to include these in-vehicle devices.

The control device 10, the input device 20, the display device 30, the speaker 40, the air conditioning control device 50, and the navigation device 60 are all mounted on the vehicle as an example. The control device 10 is connected to the input device 20, the display device 30, the speaker 40, the air conditioning control device 50, and the navigation device 60 by, for example, a communication network. The communication network may be, for example, an in-vehicle communication network compliant with any standard such as CAN (Controller Area Network), LIN (Local Interconnect Network), or LAN (Local Area Network).

In the present embodiment, the case where the control device 10 is configured as a device different from the input device 20 and the display device 30 will be described, but the present invention is not limited thereto. For example, the control device 10 may be a device integrated with the input device 20 or a device integrated with the display device 30.

(2-1. Input device 20)
The input device 20 is used for remote input to images displayed on display devices 30 provided at different positions. The input device 20 is also referred to as a remote input device. Specifically, the input device 20 detects an input by a vehicle occupant (for example, a driver) and transmits information (input information) based on the detected input to the control device 10.

The input device 20 can be realized by a touch pad as an example. Specifically, the input device 20 includes an operation surface formed by a flat surface or a curved surface, and a touch sensor that detects contact of an operation body such as a finger with the operation surface. As the contact detection method, for example, a capacitance method, a resistance film method, an electromagnetic induction method, an infrared method, or the like is used. The input device 20 can detect one or more contact position coordinates on the operation surface, a moving direction of the contact position, a moving distance, a moving speed, a contact area, a contact time, a pressure at the time of contact (pressing pressure), and the like. The input device 20 transmits these detection results to the control device 10.

Further, the input device 20 may determine what kind of input is performed on the operation surface based on the detection result. For example, for touch input, tap (short touch the operation surface once), double tap (touch the operation surface twice short), swipe (slide your finger up, down, left and right while touching the operation surface), long tap (operation). Pinch in (touch the operation surface with two fingers and move your fingers to narrow the space between them), pinch out (touch the operation surface with two fingers and widen the space between them). Move your finger) etc. The input device 20 may determine which type of input has been made, and may transmit the determination result to the control device 10 together with the detection result.

The input device 20 according to the present embodiment is not limited to the touch pad, and may be realized by a switch having a physical structure such as a push button or a lever. Further, the input device 20 may be realized by both a touch pad and a switch having a physical structure.

The input device 20 is mounted within the reach of the driver, for example. Specifically, as shown in FIG. 1, it may be provided on the center console 4 installed between the driver's seat 2 and the passenger seat 3. Further, the input device 20 may be provided on the center console 4 and near the armrest 5 on which the driver rests his / her arm. The position where the input device 20 is provided is not limited to the example shown in FIG. For example, an input device is attached to a steering wheel 6 which is a component for the driver to grasp and adjust (steer) the traveling direction of the vehicle, or a housing (called a steering column) that supports the steering wheel 6. 20 may be provided. Further, the input device 20 may be provided on the end or side surface of the seat surface of the driver's seat 2, or may be provided on the indoor surface of the front door arranged next to the driver's seat 2.

(2-2. Display device 30)
The display device 30 is a device that presents various information. The display device 30 can be realized by, for example, a liquid crystal display (LCD: Liquid Crystal Display) device, an OLED (Organic Light Emitting Display) device, a projection type display, or the like. The type, size, number, and position of the display device 30 are not particularly limited. For example, the display device 30 may be one large display extending from the front surface of the driver's seat 2 to the front surface of the passenger seat 3. Further, a plurality of display devices 30 may be arranged side by side.

The display device 30 performs various displays using the information regarding the display image provided by the control device 10. The image displayed on the display device 30 includes an image to be input using the input device 20. A GUI (Graphical User Interface) such as a window, a widget icon, a button, a menu, or a tab is used as an image to be input.

(2-3. Control device 10)
The control device 10 is a device that controls the display of the display device 30 based on the input from the input device 20. Further, the control device 10 is a device that executes a function associated with the target displayed on the display device 30 based on the input from the input device 20.

The control device 10 is mounted on a vehicle, which is an example of a user's usage target. For example, the control device 10 can be realized by an ECU (Electronic Control Unit) or the like mounted on a vehicle. The device that realizes the control device 10 is not necessarily limited to the ECU. For example, the control device 10 may be realized by a microcomputer or the like mounted on the ECU. Further, the vehicle and the control device 10 may be configured as separate bodies. For example, the control device 10 may be realized by an external device (for example, a cloud server, a smartphone, or another vehicle) that is not mounted on the vehicle.

As shown in FIG. 2, the control device 10 includes a communication I / F (interface) 110, a control unit 120, a status detection unit 130, and a storage unit 140.

(Communication I / F110)
The communication I / F 110 has a function of transmitting and receiving data with various in-vehicle devices existing inside the vehicle.

Data can be transmitted and received to and from the in-vehicle device using an in-vehicle communication network conforming to any standard such as CAN, LIN, or LAN. The communication I / F 110 also functions as an acquisition unit (reception unit) that acquires an input for an object displayed on at least one display device 30 from the input device 20. The communication I / F 110 also functions as a communication unit that transmits and receives data to and from in-vehicle devices such as the display device 30, the speaker 40, the air conditioning control device 50, and the navigation device 60.

Further, the communication I / F 110 may have a function of transmitting and receiving data with a device existing outside the vehicle (hereinafter, also referred to as an external device). The communication I / F 110 has a function of transmitting / receiving data to / from an external device, for example, a cellular communication protocol such as WiMAX or LTE (Long Term Evolution), or a wireless LAN (Wi-Fi (registered trademark)). Other wireless communication protocols such as Bluetooth® may be implemented. The communication I / F 110 may connect to a server on an external network (eg, the Internet) via a base station or access point. Further, the communication I / F 110 may implement a communication protocol designed for communication with a device mounted on the vehicle. For example, the communication I / F 110 includes vehicle-to-vehicle communication (Vehicle-to-Vehicle), which is communication between vehicles (specifically, control devices mounted on each vehicle), and vehicle (specifically, mounted on a vehicle). Vehicle-to-roadside-Infrastructure in which communication between the control device and the equipment installed on the road (Vehicle-to-roadside-Infrastructure), pedestrians and vehicles (specifically, vehicles) carrying communication equipment such as smartphones V2X communication may be performed including at least one of communication (Vehicle-to-Pedestrian) with the control device mounted on the vehicle.

As a result, the control device 10 can display the information acquired from the device existing outside the vehicle on the display device 30 and present it to the driver. Specifically, for example, the communication I / F110 can be used for schedule information, e-mail information, photos / videos, SNS (Social Networking Service) information, etc. associated with the driver, as well as traffic information, weather information, news, etc. from the Internet. It is possible to receive Web pages and the like.

(Control unit 120)
The control unit 120 has a configuration that comprehensively controls all the processes performed by the control device 10. For example, the control unit 120 executes a process for realizing various functions by using a program, a parameter, or the like stored in the storage unit 140. The control unit 120 can be realized by a processor such as a CPU (Central Processing Unit) or an MCU (Micro Controller Unit), for example. The control content of the control unit 120 is not particularly limited.

For example, the control unit 120 controls the equipment mounted on the vehicle. As an example, the control unit 120 may perform control related to display in the display device 30, control to output voice from the speaker 40, control of air conditioning in the vehicle interior by the air conditioning control device 50, and control related to vehicle route guidance by the navigation device 60. ..

Here, the control related to the display by the control unit 120 will be described in detail. The control unit 120 functions as a display control unit that controls the display of the display device 30. For example, the control unit 120 controls to generate an image displayed on the display device 30 and transmit it from the communication I / F 110 to the display device 30.

For example, the control unit 120 generates a screen for presenting the information to the driver based on the information acquired from the in-vehicle device, and transmits the screen to the display device 30. Specifically, the control unit 120 controls to acquire information such as meters, a fuel level warning light, a direction indicator light, and the like, and display the information on the display device 30. Further, the control unit 120 generates a screen for displaying information acquired from the Internet (schedule information associated with the driver, e-mail information, traffic information, weather information, news, etc.) and transmits the screen to the display device 30. ..

Further, the control unit 120 generates an image that receives an input for controlling the in-vehicle device and transmits it to the display device 30. Specifically, for example, the control unit 120 has an audio control screen for controlling the voice output from the speaker 40, an air conditioning control screen for controlling the adjustment of the temperature and humidity inside the vehicle by the air conditioning control device 50, and a navigation device 60. A navigation screen for controlling the route guidance of the vehicle may be generated and transmitted to the display device 30.

The control unit 120 may generate each screen by an application installed in the control device 10. Further, each screen may be generated in each in-vehicle device. Further, each screen may be generated by an image processing device (for example, which can be realized by a GPU (Graphics Processing Unit) mounted on a vehicle) provided separately from the control device 10. In this case, screen information generated by a device other than the control device 10 is transmitted to the control device 10 via the vehicle-mounted communication network. The control device 10 controls to transmit the received screen to the display device 30.

The image generated by the control unit 120 and displayed on the display device 30 includes an image to be input by the input device 20 (for example, a GUI such as a window, a widget, an icon, a button, a menu, or a tab). The driver can use the input device 20 to select an image to be input and perform an input (input for confirming the selection) instructing the execution of the function associated with the image.

A function is associated with the image to be input, and the control unit 120 controls to execute the function associated with the target whose selection is confirmed. Examples of the function associated with the image include functions related to display on the display device 30, such as transition to a predetermined screen, display of detailed information, menu display, and enlarged display. Another function associated with the image is control over other in-vehicle devices. For example, a function for controlling the audio output of the speaker 40 (for example, selecting and playing music to be played, playing the next song, changing the radio channel, and executing each function such as adjusting the volume) can be mentioned. Be done. Further, the function of controlling the air conditioning control device 50 regarding air conditioning for adjusting the temperature and humidity inside the vehicle (for example, executing each function such as temperature setting, humidity setting, and ventilation direction and strength setting). However, it can be mentioned. Further, the navigation device 60 is controlled for vehicle route guidance (for example, destination search, destination setting, waypoint setting, route search, movement speed setting, traffic information acquisition, current position acquisition). , Execution of each function such as acquisition of map information around the current position).

Here, the selection of the image displayed on the display device 30 will be described. The display device 30 displays the selected position, which is a display indicating the currently selected position. The selected position display is a display that emphasizes the selected image. Thereby, the driver can recognize which image is currently selected on the display device 30 (where the selected position is). The selected position display may be, for example, a display of a frame (also referred to as a cursor) surrounding the selected image. Further, the selected position display may be realized by changing the color (hue, lightness, saturation) and shape of the selected image.

In the initial state in which the screen is newly displayed on the display device 30, the control unit 120 (for example, the first stage when the power of the display device 30 is turned on and the screen is displayed, or the screen is changed and a new screen is displayed. When it is displayed, etc.), the selected position may be displayed on the image displayed at the specified position such as the upper left corner. Then, the control unit 120 controls to move the selected position display (that is, to switch the selection target) according to the input performed by using the input device 20. The driver can grasp that the selection target has been switched by the input from the input device 20 by moving the selection position display (for example, the display of the frame) on the display device 30.

The movement of the selected position display will be described. For example, input from the input device 20 to the right (swipe to the right on the touchpad, tap in the right area of the touchpad, press a button to input movement to the right, tilt the lever to the right, etc. ) Is performed, the control unit 120 moves the selected position display to the right. Specifically, the control unit 120 determines that the image located to the right of the image on which the selected position is displayed is newly selected (it can be said that the selection target has been switched), and to the right of the selected position. Controls to display the selected position for the image to be located. The control unit 120 may move the selected position display when the input exceeds a predetermined threshold value. For example, in the case of a swipe operation, the control unit 120 may move the selected position display when the moving distance of the contact position exceeds a predetermined threshold value.

Further, the control unit 120 may determine the selected image based on the positional relationship between the input position, which is the position designated by the input using the input device 20, and the image. As an example, the input position uses the form of coordinates (for example, two-dimensional Cartesian coordinates). When the input position is located within the display area of the image (or within the area including the range defined from the edge (boundary line) of the image), the control unit 120 determines that the image is selected. .. Further, the control unit 120 may display an image (for example, a pointer or the like) indicating an input position, and when the pointer is located in the display area of the image, display the selected position on the image.

Then, when a predetermined input (for example, tapping, double tapping, long pressing, pressing a confirmation input button, etc.) for confirming the selection (that is, instructing the execution of the function) is performed in the input device 20, the control unit 120 Controls to perform the functions associated with the selected image.

Next, the setting of the target for accepting input will be described. The control unit 120 according to the present embodiment has a function of setting a target for receiving an input instructing execution of a function according to a predetermined condition. Specifically, the control unit 120 sets a predetermined image among the one or more images displayed on the display device 30 as a target for receiving an input instructing the execution of the function according to a predetermined condition. In this case, the control unit 120 controls so that it cannot select another image that is an image other than the predetermined image set as the target for receiving the input instructing the execution of the function. Depending on the situation, one image may not be set as a target, and all one or more images displayed on the display device 30 may be other images.

In this way, it is possible to improve the operability by appropriately setting the target that can be selected according to the predetermined conditions. That is, while the display device 30 is widely used without limiting the number and areas of the selectable objects to realize comfortable use, by limiting the selectable targets, the time for selecting the target is reduced. Operability can be improved. The restrictions on the objects that can be selected include reducing the number of objects that can be selected, narrowing the area in which the objects that can be selected are displayed, and the like. Further, the time for selecting the target specifically includes the time required for input to move the selected position display to the target target. Selection cannot be accepted except in the area where the selectable target is displayed, but it can be used for presenting some information.

In addition, by limiting the targets that can be selected, it is possible to prevent the user's attention from being directed too much from other things. For example, in a situation where the user needs to concentrate on driving and raise his / her attention, such as during manual driving in which the user drives himself / herself, the display device 30 can be displayed by controlling so as to limit the targets that can be selected. It is possible to prevent distraction and improve safety. On the other hand, in situations where the user does not have to concentrate on driving as much as in manual driving, such as during automatic driving where safe driving is performed autonomously by the control system mounted on the vehicle, the selectable targets are limited. Without this, it is possible to make full use of various functions by making extensive use of the display area of the display device 30.

The control unit 120 determines which target is an input-acceptable target based on a predetermined condition specified in advance. Predetermined conditions specify what kind of setting should be made in what kind of situation (which function is associated with the target that can accept input). For example, the control unit 120 tells the situation detection unit 130, which will be described later, the user's situation (for example, the driver's state), the state of the usage target used by the user (for example, the state of the vehicle), and the surrounding environment (for example, information outside the vehicle). To determine whether or not the situation is stipulated in the prescribed conditions. Then, in the specified situation, the control unit 120 sets the target specified in the predetermined condition (the image associated with the predetermined function) as the target capable of accepting input. Information about a predetermined condition is stored in, for example, a storage unit 140.

The user's situation is about the user. One example is whether or not the user is driving. For example, if the vehicle is running during manual driving that requires steering by the user, it can be said that the user is driving. On the other hand, when the vehicle is stopped or when the control system autonomously controls the vehicle to drive safely, it can be said that the user is not driving. The situation such as whether the vehicle is manually driven or automatically driven can be said to be the state of the vehicle. Under certain conditions, the target to be set to accept input when the user is driving (for example, manual driving and running), or when the user is not driving (for example, stopped or automatic driving) ) Can specify the target to be set as acceptable input. When the user is driving, it is necessary to concentrate on driving, so it is preferable as an example that the number of objects to be set as input acceptable is smaller than when the user is not driving. ..

Further, when the user is driving, a target capable of accepting input may be set in consideration of the ability of the user's driving skill (hereinafter referred to as driving skill). The driving skill may be pre-registered in the control device 10, may be determined from pre-registered information (driver's driving frequency, total mileage, sight, personality, etc.), or the driver's driving. (Frequency of sudden braking, driving characteristics extracted from accelerator / brake operation and steering wheel operation, etc.) and biometric information during driving (heart rate, pulse, sweating, body temperature, breathing, blood pressure, eye condition, line of sight, etc. It may be determined from brain waves, etc.), body movements, speech content, etc. Driving skill can be said to be the skill level of the driver. Under the predetermined conditions, when the user is driving, the target to be set as input acceptable can be defined in association with the driving skill. When the driving skill is low, it is necessary to concentrate more attention on driving. Therefore, as an example, it is preferable that the number of objects to be set as input acceptable is smaller than that when the driving skill is high. Further, when the user is driving, a target that can accept input may be set in consideration of the wakefulness of the user. The wakefulness may be determined from the biometric information of the user. Under the predetermined conditions, when the user is driving, the target to be set to be able to accept input can be defined in association with the wakefulness state.

Further, in the case of automatic operation, a target that can accept input may be set in consideration of the level of automatic operation. The level of autonomous driving is the level of driving support, such as how much driver operation and monitoring are required. The level of automatic driving can be defined in advance, for example, in the control system of automatic driving. The higher the level of automatic driving, the less the user needs to concentrate on driving. Therefore, it is stipulated in the predetermined conditions that the number of objects to be set as input acceptable is larger than when the level of automatic driving is low. Is preferable as an example.

Further, when the user is driving, a target that can accept input may be set in consideration of the traveling speed of the vehicle. As the speed is higher, the user needs to concentrate on driving. Therefore, as an example, it is stipulated in a predetermined condition that the number of objects to be set to accept input is smaller than that when the speed is low. preferable.

In addition, when the user is driving, the condition of the road on which the user is driving (on the highway (highway national highway, motorway), at an intersection, at a curve, or in a tunnel Whether there is an obstacle on the road, whether road construction is being carried out, etc.), driving environment such as weather, time zone, brightness, presence or absence of pedestrians around, presence or absence of surrounding vehicles, etc. A target that can accept input may be set in consideration of information outside the vehicle such as the state. It is preferable that the number of objects to be set as input acceptable is reduced as the environment requires more attention based on the information outside the vehicle.

In addition, under predetermined conditions, the target to be set to accept input when the vehicle is in a predetermined state (manual driving or automatic driving, whether the traveling speed exceeds the specified value, etc.) and the surrounding environment (for example, on the road) Information acquired from the outside of the vehicle, such as the situation, weather, and the presence or absence of pedestrians) can be specified as the target to be set as input acceptable when the situation is specified.

In addition, the target for accepting input specified by predetermined conditions does not have to be fixed. For example, the control unit 120 may set a target displayed at a predetermined position defined by a predetermined condition as a target capable of accepting input. As a predetermined position defined by a predetermined condition, for example, a predetermined area (right half, left half, center, etc.) on the display screen may be defined. As an example, in a predetermined situation, an object displayed in an area close to the driver's seat may be set as an input-acceptable object. Further, when there are a plurality of display devices 30, the control unit 120 may set a target displayed on a predetermined display device defined by a predetermined condition as an acceptable target. Further, when there are a plurality of display devices 30, the control unit 120 may set a target displayed in a predetermined area of a predetermined display device defined by a predetermined condition as an acceptable target.

Further, the control unit 120 may set a predetermined number or less of targets defined in association with the situation as targets for which input can be accepted according to the priority. The priority may be determined based on the display position (for example, the priority of the object displayed in the position close to the driver's seat is high, and the priority of the object displayed in the position close to the predetermined display position is high. It may be judged based on the frequency of use of the function associated with the target, the situation of the user, etc. In addition, priority may be set for the function associated with each target. The priority of each function may be arbitrarily changed by the user.

Further, the control unit 120 applies the contents defined by the predetermined conditions described above to the user's situation, the vehicle's condition (speed, accelerator and brake operation amount, steering wheel steering angle, etc.), information outside the vehicle, and the like. It may be changed at any time based on the above. Further, the control unit 120 may change the contents defined by the predetermined conditions described above at any time by using machine learning.

The setting of the target that accepts the input instructing the execution of the associated function (the target that can accept the input, that is, the target that can be selected), which is performed by the control unit 120, has been described above.

Further, the control unit 120 disallows (invalidates, accepts) input to a target (here, another image) other than the predetermined target set as a target for receiving the input instructing the execution of the associated function. It can be said that there is no such thing), so it has a function to prevent selection of other images. The “disapproval” includes, for example, a control that prevents the input device 20 from accepting the input itself. Specifically, for example, when the input device 20 is a capacitance type touch pad, the control unit 120 stops the detection of the capacitance in the input device 20 (for example, stops the sampling of the electrostatic electrode itself). Control.

Further, "disapprove" means that the input itself in the input device 20 is accepted (for example, sampling to the electrostatic electrode is executed), but the input itself is discarded or the process according to the input is not executed. Can be mentioned. For example, the control unit 120 discards the input for moving the selected position display to another image, that is, sets the process according to the moved input to the non-execution state so that the selected position display is not moved to the other image. can do. The "non-execution state" means that the input itself is accepted (for example, sampling is performed on the electrostatic electrode), but the processing according to the input is not executed.

Further, the control unit 120 may change the display screen of the display device 30 when setting an image that can accept input.

Specifically, for example, the control unit 120 makes the display mode (color (hue, lightness, saturation) and shape of the image) of an image that can accept input and an image that does not accept input (that is, another image) different. Take control. This makes it easier for the user to distinguish which image is an input-acceptable image. Further, the control unit 120 controls the background color and pattern of the display area in which the image that can accept input is displayed and the background color and pattern in the display area in which the image that does not accept input (that is, another image) is displayed. You may go. This also makes it easier for the user to distinguish which image is an input-acceptable image.

Further, the control unit 120 may change an image that does not accept input (that is, another image) into a display mode for a case where input is not accepted. The display-only mode is, for example, a mode in which the GUI such as icons, buttons, and menus is hidden, or a mode in which the GUI is so-called grayed out. As a result, it is possible to explicitly express that input cannot be performed on another image.

Further, when the input-acceptable image is set, the control unit 120 may change the arrangement or size of at least one of the input-acceptable image and the other image.

Here, FIG. 3 shows an example of a display screen when an image that can accept input according to the present embodiment is set. In FIG. 3, various information is presented on the display screen of the display device 30 mounted on the vehicle, which is an example of the moving body.

The upper part of FIG. 3 is an example of a display screen of the display device 30 during manual operation. As an example, the display device 30 includes a schedule display image 81 showing the driver's schedule, a weather information image 82 showing the weather information of the current location, an audio information image 83 showing information such as music being played from the speaker 40, and air conditioning. An air-conditioning information image 84 showing information on air-conditioning control by the control device 50, a fuel consumption meter image 85 showing instantaneous fuel consumption, average fuel consumption, cruising distance (distance that can be run with the remaining fuel), etc., a speed meter image 86 showing running speed, and , A navigation image 87 showing information regarding vehicle route guidance by the navigation device 60 is displayed. These images (windows, widgets) are examples of objects displayed on the display device 30.

In addition, each image may further include images such as buttons, menus, and tabs. In the example shown in FIG. 3, button images 831, 832, 833, 841, and 842 are displayed. These images are also examples of objects displayed on the display device 30. Further, as an example of the object displayed on the display device 30, an icon can also be mentioned. A list of icons may be displayed on the display device 30.

The control unit 120 has each image displayed on the display device 30 (here, schedule display image 81, weather information image 82, audio information image 83, air conditioning information image 84, fuel consumption meter image 85, speed meter image 86, and Among the navigation images 87), an image (selectable image) that accepts an input instructing the execution of the associated function is set according to a predetermined condition.

For example, when the control unit 120 is driving in manual operation (a situation in which the user is driving), the control unit 120 displays the schedule display image 81, the weather information image 82, the audio information image 83, and the air conditioning information image 84 according to predetermined conditions. , Set as an image that can accept input. The content of the predetermined conditions is not particularly limited, but for example, the control unit 120 has an image displayed on the left half of the display screen (schedule display image 81, weather information image 82, audio information image 83, and air conditioning information image 84). May be set to a selectable image. Further, the control unit 120 may set an image other than a predetermined image (for example, an image of meters (fuel consumption meter image 85, speedometer image 86) and a navigation image 87) as a selectable image.

The control unit 120 uses the schedule display image 81, the weather information image 82, the audio information image 83, and the air conditioning information image 84, which are set to accept input, as other images that do not accept input, such as a fuel consumption meter image 85 and a speed meter image. It may be displayed in a display mode (color, shape, etc.) different from that of the 86 and the navigation image 87.

Further, the control unit 120 may control the display so that the display mode 310 on which each image set to accept input is displayed and the display area 320 on which other images are displayed are different (for example). , Different background colors and patterns). Further, display control may be performed in which the display area 310 is surrounded by a frame. Further, the fuel consumption meter image 85, the speedometer image 86, and the navigation image 87, which are other images, may be changed to a predetermined display for when input is not accepted. Specifically, the control unit 120 may display other images that do not include images such as buttons, menus, and tabs that induce input.

Further, in the upper part of FIG. 3, the selected position display 330, which is a display showing the currently selected position, is displayed. By displaying the selection position display 330, it is possible to explicitly indicate which target is currently selected. In the upper part of FIG. 3, the driver can see that the air conditioning information image 84 is currently selected. The user can move the selection position display 330 (switch the selection target) using the input device 20.

Here, the control unit 120 controls the selected position display 330 so as not to move it to the fuel consumption meter image 85, the speedometer image 86, and the navigation image 87, which are images other than the images set to accept input. With, it is possible to prevent the selection of other images.

Specifically, the control unit 120 ignores the input of moving the selected position display 330 to another image. That is, as shown in the upper part of FIG. 3, when the selected position display 330 is displayed on the air conditioning information image 84, even if the input device 20 makes an input to move the selected position display 330 to the right. Since the selection is switched to the fuel consumption meter image 85, the input is ignored (invalidated). Since the selected position display 330 does not move even if the input device 20 inputs to move the selected position display 330 to the right, the driver selects the fuel consumption meter image 85, the navigation image 87, and the speedometer image 86. Can recognize that it cannot.

Alternatively, the control unit 120 is displayed at a position defined as the beginning of the schedule display image 81 (the beginning of the display area 310) when an input is made to move the selected position display 330 displayed on the air conditioning information image 84 to the right. It may be moved to (an example of the image).

The control unit 120 may move the selected position display 330 to the button image 841 when an input is made to move the selected position display 330 displayed on the air conditioning information image 84 downward. Further, when an input is made to move the selected position display 330 moved to the button image 841 to the right, the control unit 120 may move the selected position display 330 to the button image 842. When the control unit 120 makes an input to move the selection position display 330 displayed on the button image 842 further to the right, the fuel consumption meter image 85 located to the right cannot be selected, so that the input is input. ignore. Alternatively, as described above, the control unit 120 may move the selected position display 330 to the schedule display image 81 (an example of an image displayed at a position defined as the head of the display area 310).

Subsequently, the control unit 120 executes a function associated with the target when an input for confirming the selection of the target is made. The input for confirming the selection of the target can be said to be the input for instructing the execution of the function associated with the target.

For example, the air conditioning information image 84 is associated with a function of displaying a screen related to air conditioning control performed by the air conditioning control device 50. When the selection of the air conditioning information image 84 is confirmed, the control unit 120 controls to display the screen related to the air conditioning control. The control unit 120 may shift the screen so that the screen related to the air conditioning control is displayed in the entire display area 310. Further, the control unit 120 may superimpose the screen related to the air conditioning control on each image of the display area 310 and display it (so-called pop-up display). Further, the control unit 120 may switch the air conditioning information image 84 to a screen related to air conditioning control and display it. The screens related to air conditioning control include, for example, a temperature setting screen for setting the temperature inside the vehicle, a humidity setting screen for setting the humidity inside the vehicle, an air volume setting screen for setting the strength and direction of the output of cold air and hot air, and the like. On each screen, a button image associated with the function of performing a predetermined control on the air conditioning control device 50 is displayed. When the selection of the button image is confirmed, the control unit 120 executes the function associated with the selected and confirmed button image. For example, the air conditioning control device 50 may be controlled to raise the temperature inside the vehicle to a predetermined value, or the air conditioning control device 50 may be controlled to lower the temperature inside the vehicle to a predetermined value.

Further, the button image associated with the function of performing a predetermined control on such a device may be displayed in the audio information image 83 and the air conditioning information image 84. For example, the air conditioning control device 50 is controlled so that the air volume is lowered when the selection of the button image 841 is confirmed, and the air volume is increased when the selection of the button image 842 is confirmed. Further, when the selection of the button image 831 is confirmed, the playing music is fast-forwarded, when the selection of the button image 832 is confirmed, the playing music is paused, and the selection of the button image 832 is confirmed. If this is the case, the playback of the music output from the speaker 40 is controlled so that the music being played is reverted quickly.

Next, the figure shown in the lower part of FIG. 3 will be described. The figure shown in the lower part of FIG. 3 is an example of the display screen of the display device 30 during automatic operation. For example, when the manual operation is switched to the automatic operation, the figure shown in the upper part of FIG. 3 is switched to the figure shown in the lower part of FIG.

In the case of automatic driving (a situation in which the user is not driving), the control unit 120, for example, schedule display image 81, weather information image 82, audio information image 83, air conditioning information image 84, and navigation image 87a according to predetermined conditions. Is set as an image that can accept input. At this time, the control unit 120 displays the item images 871, 872, 873 (selectable images) associated with the function of displaying the detailed information of the waypoints (parking area, service area, etc.) in the navigation image 87a, for example. You may. The content of the predetermined conditions is not particularly specified, but for example, in the case of automatic driving, it may be specified that all images other than the automatic driving image 88 showing information on automatic driving can be input.

Similarly, during automatic operation, the control unit 120 controls the display so that the display area 310a on which each image set to accept input is displayed and the display area 320b on which other images are displayed are displayed differently. It may be (for example, different background colors and patterns).

The automatic operation image 88 is an example of an image other than the image set to accept input (that is, a display-only image). For example, the current traveling speed, speed limit, fuel consumption information, and the like can be displayed on the automatic driving image 88. The control unit 120 does not move the selected position display 330 to the automatic operation image 88, which is an image other than the image set to accept input, as in the case described with reference to the figure shown in the upper part of FIG. By controlling the image, it is possible to prevent the selection of other images.

As described above, the setting of the image that can accept the input according to the present embodiment has been specifically described with reference to FIG.

(Situation detection unit 130)
The situation detection unit 130 has a function of detecting various situations from various sensors mounted on the vehicle. For example, the situation detection unit 130 detects the driver's condition.

Specifically, the situation detection unit 130 acquires sensing data from various sensors such as a camera that captures the driver, a biosensor that detects the driver's biological information, and a microphone that collects the sound inside the vehicle, and the driver. The state of can be detected. The situation detection unit 130 may calculate the degree of concentration and the arousal level of the driver based on the sensing data.

In addition, the situation detection unit 130 detects the state of the vehicle. Specifically, the situation detection unit 130 includes various sensors such as an acceleration sensor that detects the acceleration of the vehicle, a sensor that detects the operation amount of the accelerator pedal, a sensor that detects the operation amount of the brake pedal, and a sensor that detects the amount of fuel. The sensing data is acquired from and the state of the vehicle is detected. Further, the situation detection unit 130 is a drive system control device that controls the operation of a device related to the drive system of the vehicle (for example, a generator that generates the driving force of the vehicle, a mechanism that transmits the driving force to the wheels, or an automatic operation. Information may be acquired from (such as an automatic driving control device for driving) to detect the state of the vehicle.

In addition, the situation detection unit 130 detects information outside the vehicle. Specifically, the situation detection unit 130 includes a camera that images the surroundings of the vehicle, an environmental sensor that detects rain, fog, and snow, and an environment sensor that detects pedestrians, other vehicles, and obstacles around the vehicle. Sensing data is acquired from various sensors such as sensors that detect objects, etc., and information outside the vehicle is detected. The information outside the vehicle is not limited to that detected by the situation detection unit 130, and can be acquired by the communication I / F 110 from other vehicles existing in the vicinity, road devices, and the Internet.

(Memory unit 140)
The storage unit 140 has a configuration for storing various types of information. For example, the storage unit 140 stores programs, parameters, and the like used by the control unit 120, the communication I / F 110, and the status detection unit 130. Further, the storage unit 140 may store the processing result by the control unit 120, information received from the outside by the communication I / F 110, and the like. The content of the information stored in the storage unit 140 is not particularly limited. Further, the storage unit 140 can be realized by, for example, a ROM (Read Only Memory), a RAM (Random Access Memory), or the like. Further, for the storage unit 140, for example, a magnetic storage device such as a hard disk drive (HDD), a semiconductor storage device, an optical storage device, an optical magnetic storage device, or the like may be used.

The configuration example when the control system 1 according to the present embodiment is mounted on the vehicle has been described above. The configuration according to this embodiment is not limited to the example shown in FIG. For example, the control device 10 according to the present embodiment may be realized by a device provided separately from the vehicle. Specifically, it may be realized by a smartphone, a tablet terminal, or the like possessed by the driver.

<3. Operation processing>
FIG. 4 is a flowchart showing an example of the flow of operation processing of the control system 1 according to the present embodiment. FIG. 4 shows the operation processing of the control device 10 included in the control system 1.

As shown in FIG. 4, first, the control unit 120 of the control device 10 acquires the status (step S103). The situation may be detected by the situation detection unit 130 or may be received by the communication I / F 110. Further, the control unit 120 may be acquired from the storage unit 140.

Next, the control unit 120 of the control device 10 sets an input-acceptable image among the images displayed on the display device 30 according to the acquired situation according to a predetermined condition (step S106). The control unit 120 changes the display of the set image and other images other than the set image as necessary.

Then, the control unit 120 controls so that an image other than the image that can accept the input cannot be selected (step S109). Specifically, the control unit 120 controls to ignore the input for selecting another image (input for moving the selected position display to another image, etc.).

<4. Supplement>
In the above, the case of a vehicle is described as an example of a moving body as a main example, but the moving body according to the present embodiment is not limited to a vehicle, and a ship (for example, a passenger ship, a cargo ship, a submarine, etc.) or an aircraft (for example, a passenger ship, a cargo ship, a submarine, etc.) For example, an airplane, a helicopter, a glider, an airship, etc.). Further, the vehicle is not limited to an automobile, and may be a bus, a motorcycle, a locomotive, a train, or the like. Further, the moving body is not necessarily limited to the above example, and may be a movable object. The fact that the control system 1 is mounted on a moving body is only an example, and the present invention may be mounted on other than the above. Further, at least a part of the configuration of the control system may be mounted on the mobile body, and other configurations may be mounted on the mobile body other than the mobile body.

Further, the input by the input device 20 is not limited to the input using the touch pad or the physical switch. For example, the input device 20 may perform gesture input, line-of-sight input, voice input, or the like.

Further, in the present embodiment, the case where the input device 20 is used for remote input to the display device 30 has been described. However, the display device 30 can be realized by a touch panel display, and the display device 30 can be directly touched for input. It may be possible. As a result, the driver can input by any method as appropriate.

<5. Summary>
Although the preferred embodiments of the present invention have been described in detail with reference to the accompanying drawings, the present invention is not limited to such examples. It is clear that a person having ordinary knowledge in the field of technology to which the present invention belongs can come up with various modifications or modifications within the scope of the technical idea described in the claims. , These are also naturally understood to belong to the technical scope of the present invention.

In addition, the effects described herein are merely explanatory or exemplary and are not limited. That is, the techniques according to the present disclosure may exhibit other effects apparent to those skilled in the art from the description herein, in addition to or in place of the above effects.

In addition, each step related to the processing of the determination device of the present specification does not necessarily have to be processed in chronological order in the order described in the flowchart. For example, each step related to the processing of the determination device may be processed in an order different from the order described in the flowchart, or may be processed in parallel.

In addition, it is possible to create a program for making the hardware such as the CPU, ROM, and RAM built in the computer exhibit the same function as the configuration of the determination device, and the program can be read by the computer in which the program is recorded. Recording media may also be provided.

1: Control system, 10: Control device, 20: Input device, 30: Display device, 40: Speaker, 50: Air conditioning control device, 60: Navigation device, 110: Communication I / F, 120: Control unit, 130: Status Detection unit, 140: Storage unit

Claims (15)

An acquisition unit that acquires an input for an object displayed on at least one display device,
A control unit that controls execution of a function associated with the target according to the information acquired by the acquisition unit is provided.
The control unit is a control device that sets the target that receives an input instructing execution of the function according to a predetermined condition. The control unit sets a predetermined image among one or more images displayed on the display device as a target for receiving an input instructing execution of the function according to the predetermined condition. The control device described in. The second aspect of the present invention, wherein the control unit controls so that the other image, which is an image other than the predetermined image set as the target, cannot be selected from the one or more images displayed on the display device. Control device. The control device according to claim 3, wherein the control unit controls to disallow the input for selecting the other image. As the disapproval control, the control unit moves on the display screen of the display device based on the information, and displays the selected position, which is a display indicating the selected position, on the display screen of the display device. The control device according to claim 4, wherein the process according to the input of the movement is controlled to be in the non-execution state. The control unit has a display mode of a region in which one or more predetermined images set as the target for receiving an input instructing execution of the function are displayed, and a display mode of a region in which the other image is displayed. The control device according to any one of claims 3 to 5, which is controlled so as to be different. The control unit controls all of one or more images to be displayed on the display device as the other images according to the predetermined conditions so that selection cannot be performed for all the images. The control device according to any one item. The control device according to any one of claims 1 to 7, wherein the control unit controls a device associated with the target as an execution of the function. The control device according to any one of claims 1 to 8, wherein the control unit determines whether or not the user's situation is a situation defined as the predetermined condition. The user is a person who uses a mobile body.
The control according to claim 9, wherein the control unit sets the target that receives an input instructing execution of the function according to the predetermined condition depending on whether or not the user is driving the moving body. apparatus. The control unit further functions as long as at least one of the information regarding the driving skill of the user, the situation of the moving body, and the situation outside the moving body is defined as the predetermined condition. The control device according to claim 10, wherein the target that receives an input instructing the execution of the above is set. The control unit is in a manual operation in which the state of the moving body is defined as the predetermined condition and is operated by the user, or in an automatic operation in which the moving body autonomously travels without requiring the operation by the user. The control device according to claim 11, wherein the target that receives an input instructing the execution of the function is set. 11. The control unit sets the target that accepts an input instructing execution of the function when the external situation of the moving body is a predetermined environment defined as the predetermined condition. The control device described. Computer,
An acquisition unit that acquires an input for an object displayed on at least one display device,
It functions as a control unit that controls the execution of the function associated with the target according to the information acquired by the acquisition unit.
The control unit is a program that sets the target that receives an input instructing execution of the function according to a predetermined condition. An input device that detects an input to an object displayed on at least one display device, an acquisition unit that acquires information based on the input detected by the input device, and an association with the object according to the information acquired by the acquisition unit. It is equipped with a control unit that controls the execution of functions.
The control unit is a control system that sets the target that receives an input instructing execution of the function according to a predetermined condition.

Images