DE19920162A1 - Controlling audio-visual equipment by remote control with contact sensitive actuators has menu function that appears for touched actuator up to the elapse of a defined time interval - Google Patents

Abstract

When an actuator (6) is contacted and menu function appears for that actuator (6) up to the elapse of a defined time interval on the display and/or outputted as an acoustic signal. The transmission unit (2) of the remote control (1) is activated and clocked contact signals are transmitted. The touched actuator is represented in an emphasized way and/or an acoustic signal for the pertinent function is output in each case. All possible control procedures possible for the audio-visual equipment are stored in the user interface program (14) and the events transmitted by the command interpreter (13). An Independent claim is also included for In which case device for controlling devices by means of a remote control.

Description

The invention relates to a method for controlling devices by means of a Remote control and a device for performing this method.

Remote controls for controlling devices, especially of Audiovisual equipment from remote locations has found a wide range for years Application. In the known remote controls to trigger the desired functions knowledge of the arrangement of the buttons on the Remote control required and a constant exchange of views between the controlling device and the remote control is common. They are too Remote controls have been introduced, in which the each Touch point corresponding functionality is displayed on the screen becomes. Such a remote control is for example in US 005327160 A. described. There is a remote control system for a TV set presented, in which the remote control has a touch-sensitive surface that has individual points of contact. The data that is on this Surface arranged individual touch points correspond transmitted to the external device, creating a visible on the screen Menu system is controlled. The operation is such that the touch-sensitive surface with a translatory movement is scanned and when the desired point of contact is reached Touch is ended, causing the touch point corresponding function is performed.

However, the handling of this remote control requires unusual ones motor skills from the user, so to activate a  Menu item of the thumb on the touch-sensitive surface corresponding place, touching the surface. A direct one Activation of functions via an easy-to-feel button is not direct possible.

The task is to operate devices using a Allow remote control even in dark surroundings without Prior knowledge of the arrangement and functionality of the controls on the Remote control and ergonomically operated can be.

This object is achieved by the features of Claims 1 and 8 solved.

In the method according to claim 1 when touching a Control element activated a transmitter unit of the remote control, the clocked Touch signals sends. These touch signals are from a Receive the receiving unit of the device to be controlled; the transmitted Data is then transmitted to a computer system, which results from Taking into account the respective operating status Derives control commands and transmits them to the device to be controlled as well on a display. When you touch a control element, A defined time interval expires a menu for that of the touched Control corresponding function shown on the display and / or output as an acoustic signal. This menu is in the further description referred to as a simple display. At a Subsequent presses of this control element will assign the Function carried out. Until the end of a defined time interval that Touched control element is not released, the full remote control including all controls and their associated functions are shown, the touched control element is highlighted and / or an acoustic signal for the  associated function is output. This menu is in the further Description referred to as an expanded ad. If during the no control element is touched within the defined time interval, takes place after expiration deactivation of the remote control with a preset time delay, and the menu shown on the display disappears.

Advantageous refinements and variants of the method can be found in subclaims 2 to 7.

When you touch a control element on the remote control, in one Command interpreter in an assigned for this control element Save a count list and the current value changes from 0 to 1 set. This value is increased by the value 1 at defined time intervals elevated. When touching the control element ends, the current one Value set to 0. The command interpreter sends an event to Computer system user interface program to create a to signal the corresponding change in state when there is a change in the The value of the counting list is changed from 0 to 1, or to 0 or when one is reached set value. If a control element is pressed, the Remote control sent a clocked push signal. Because of this When the signal is pressed, the count list is set to 1 in the command interpreter set; it will send an event to the user interface program sent to signal a corresponding change in status. The User interface program developed taking into account the respective state of the device to be controlled and that of Command interpreters transmitted the corresponding events Control commands that are transmitted to the device to be controlled and that The menu corresponding to the respective status is shown on the display and / or output acoustically. With each change of the counting list in the Command interpreter starts a timer that is on a given Signal repetition time is set, the count list in the memory of the corresponding control element is increased by the value 1 if  a touch signal from within the set signal repetition time same control element arrives. The count list in the command interpreter is set to 0 if none within the set signal repetition time Touch signal arrives from the same control element.

Is the state interpreted by the command interpreter Change the current value in the counting list from 0 to 1 User interface program sent, this causes the Menus in the simple display on the display.

Is the state interpreted by the command interpreter If the current value in the counting list is sent to 0, this will result User interface program after a predetermined one Delay hiding the menu on the display, if all Values in the count list have the value 0 or during the specified one Time delay no change of state by changing the current one Value in the counting list from 0 to 1 by the command interpreter is signaled.

If a specified value is reached in the counting list, the Command interpreter sent a corresponding change of state and the user interface program will display the full remote control, in the expanded display, on the display causes.

In the user interface program are all for the control of the device possible operating procedures saved; that of the command interpreter sent events and the current operating state of the to be controlled Devices are analyzed in order to derive the graphical user interface for them to generate the display and to work out the control commands to the device to be controlled.  

A video overlay system between the User interface program and the display is arranged, superimposed the video stream of the device to be controlled and the data stream for the graphical user interface such that in addition to the current display on the The corresponding menu of the respective operating procedure is shown on the display becomes.

All visual representations on the display can also be used as acoustic Signals are alternatively or additionally output. The acoustic signals also generated by the video overlay system.

The device according to claim 8 consists of a remote control is coupled to a transmitter unit. The transmitted signals are from received by a receiving unit and to a subordinate Computer system, at least consisting of a command interpreter and a user interface program. The computer system is a video overlay system downstream that the video streams and the Data streams processed in such a way that on the display and / or Loudspeaker the relevant information is output.

The controls are arranged on the remote control in two levels, where switch buttons are arranged in a lower level, above which in the Upper level touch-sensitive buttons are arranged. The the superimposed buttons and buttons are the assigned the same functions.

Because the remote control has discrete controls that on the display including the arrangement of the controls on the Remote control and its functionality in the respective context as well the "touched" control elements and their functionality in particular highlighted (e.g. highlighted in color, enlarged or lightened) this remote control is particularly user-friendly. Through this The user receives information about the position of the thumb on display  the remote control without looking at the remote control. Changes in position of the thumb on the remote control are indicated by the special representation of the touched control element displayed. To this The desired menu can be displayed on the display Controls can be felt without looking at the remote control. At the same time, the context-sensitive can be in any state of the overall system Functionality of the controls are displayed.

Since two different menu displays are used, namely the simple display and the expanded display, will be an optimal and universal use of the remote control possible. In the simple display only the functionality of the control element just touched displayed. This display is suitable for knowledgeable users, since only a part of it of the screen is covered by the display and a quick Operation is made possible. In the expanded display, for the unskilled users additional information regarding the touched Control element displayed. Unused controls can be used as such also be represented. It can also perform certain actions when touched are triggered, e.g. B. an acoustic feedback about the functionality of the touched control element.

The invention will be explained in more detail below using an exemplary embodiment become. The associated drawings show:

Fig. 1 representation of the remote control and the display in the expanded display;

Fig. 2 screen display in simple display (1st step);

Fig. 3 screen display in simple display (2nd step);

Fig. 4 screen display in expanded display (1st step);

Fig. 5 screen display in expanded display (2nd step);

Fig. 6 schematic representation of the device;

Fig. 7 representation of the remote control with the controls.

In this exemplary embodiment, the invention for controlling a device 5 is described, the method being illustrated on the basis of the operation of a TV receiver.

If an operating element 6 is touched on the remote control 1 , the transmitter unit 2 sends a clocked touch signal. If, on the other hand, an operating element 6 is pressed on the remote control 1 , the transmitter unit 2 sends a clocked pressure signal. The receiving unit 3 converts the signals sent by the transmitter of the remote control 1 into byte code commands, which in turn are forwarded to the command interpreter 13 . The command interpreter 13 evaluates the touch or the pressed signals and generates corresponding events, which it forwards to the user interface program 14 . The events are generated when the touch of an operating element 6 begins, when it is ended, when the duration of the touch exceeds a certain period of time or when an operating element 6 is pressed. For this purpose, the command interpreter 13 manages a counting list which lists the number of touch signals arriving in succession for each control element 6 . In the untouched state, the counter value for this control element 6 in the count list is 0. When a touch signal arrives, the state changes to "touched". A timer is started (T = 0) and the counter value in the count list is increased by 1 to the value 1. When the next touch signal arrives from the same control element within the signal repetition period, which is, for example, 100 ms, the counter is increased again by 1 to the value 2 and the timer is started again (T = 0). If the counter reaches a predetermined value, for example 20, a corresponding event is sent. If the timer exceeds the selected signal repetition time of 100 ms, the status changes to "not touched" and the counter in the count list is set to 0. If a pressed signal arrives in the "touched" state, the counter in the counting list is set to 1 and the timer is started again.

The values in the counting list indicate how long an operating element 6 is touched continuously. If a control element is pressed, resetting the counter to the value 1 indicates that the control element is still being touched (counter not equal to 0), but the exclusive touching of the control element was interrupted by pressing it.

In order to ensure that only one control element 6 is detected as "touched" by the computer system 12 , the command interpreter 13 sets the current value in the count list for this control element to the value 1 when the second control element 6 is touched, and the current value is set to 0 in the count list for the first touched control element 6 . The command interpreter 13 generates events as a function of the change in the values in the counting list, which events are forwarded to the user interface program 14 and are converted by the latter into corresponding control commands. The command interpreter 13 evaluates the count list each time one of its values changes as follows:

• a) a counter changes from 0 to 1, ie an operating element 6 is touched,
• b) a counter changes to 0, ie an operating element 6 is released,
• c) a counter becomes larger than a certain value, e.g. B. 20, ie an operating element 6 is continuously touched for at least 2 s without being pressed,
• d) a counter changes from <1 to 1, ie an operating element 6 is pressed.

In case a), an event, the start of touching an operating element 6 , is sent to the user interface program in order to mark the corresponding operating element 6 as touched.

In case b), an event is sent to the user interface program, the end of the touch, in order to mark the corresponding control element 6 as not touched.

In case c), the user touches an operating element 6 for a defined period of time (for example 2 s) without pressing it, a corresponding event is forwarded.

In the case d) that the control element 6 is pressed, it is still marked as touched, therefore the corresponding counter is set to 1, that is not equal to 0, and a corresponding event is forwarded.

The user interface program 14 manages the entire system, which means that all possible operating procedures for the control of the device 5 are stored and managed. An operating procedure begins when a control element 6 is touched and ends when the last menu shown is hidden from the display 4 , irrespective of the operating actions or control commands carried out in between. The user interface program 14 analyzes the current status of the device 5 to be controlled by evaluating the status information 17 transmitted by the device 5 , detects the events sent by the command interpreter 13 and generates the graphical user interface in accordance with the overall status of the system and sends the corresponding control commands 18 to the device 5 and transmits the data stream for the graphic surface 19 to the video overlay system 15 . This superimposes the data stream for the graphic surface 19 on the video stream 20 of the device 5 and transmits the superimposed video stream 21 to the device 5 to be controlled. The user interface program 14 also manages two different menu displays, the simple display and the expanded display. The simple display only shows the functionality corresponding to the touched control element 6 on the display 4. In the expanded display, on the other hand, the complete remote control including all control elements and their associated functionalities is shown on the display, the touched control element 6 being highlighted. When a control element 6 is touched, the simple display on the display 4 causes the command interpreter 13 to transmit this event to the user interface program 14 . If this control element 6 is touched beyond the defined period of time, the user interface program 14 receives a corresponding event from the command interpreter 13 and switches to the extended display. This display remains until the operating procedure is finished. When an operating element 6 is pressed, the corresponding control command 18 for executing the function is transmitted to the device 5 to be controlled by the command interpreter 13 by transmitting the corresponding event from the command interpreter 13 to the user interface program 14 .

The method for controlling a device 5 by means of the remote control 1 is presented using the example of an operating procedure for the image adjustment of the TV set. It is to be shown how the information regarding the touched control element 6 on the remote control 1 is processed by the device in order to support the user. This is described for both variants of the menu display, the simple display and the extended display. It shows the call of the corresponding menu for the TV receiver and especially for the setting of the image parameter brightness.

First, the operating procedure is described in the simple Display because this is also shown first.

A knowledgeable user who knows the assignment of the remote control 1 and thus the specific position of the control element 6 for the image settings on the remote control 1 and immediately touches this control element 6 is first shown on the display 4 the simple display 11.1 according to FIG. 2. This enables him to check that he has touched the correct control element. Is now before the end of the specified period, z. B. 2 s this control element 6 , a next display 11.2 is gem. Fig. 3 shown on the display 4 . If the user touches the control element 6 with the "number 3", which is assigned the functionality "increase in brightness" in this menu, to increase the brightness, the corresponding control element 9 of the brightness controller is shown on the graphic surface in a particularly prominent manner. Pressing this control element 6 increases the brightness. After releasing this control element 6 , τ, which, for. B. 3 s, the simple display 11.2 is hidden, unless another control element 6 is already touched or is touched during the time delay τ.

By touching one or more control elements 6 , the display of the remote control 1 together with a description of the functionality of the control elements 6 appears in the extended display 8.1 according to FIG. Fig. 4. In FIG. 4, the graphical user interface to the touch of the operating member "Image Settings" is shown, which is particularly emphasized as such. 9 The unoccupied operating elements 10 are shown as such, with a dotted edge. The functionality of the assigned control elements is clearly indicated by text on the screen 4 . If the user moves his thumb over the control elements 6 , the highlighting moves with the control elements 9 that are touched. As a result, the user sees the position of his thumb on the remote control 1 on the screen 4 , a close look at the remote control 1 is not necessary and the navigation of the thumb via the remote control 1 is made possible, the view on the screen 4 remaining constant Changing the view between remote control 1 and screen 4 is not necessary.

Pressing the "Image Settings" control element leads to a new graphical user interface in the expanded display 8.2 acc. Fig. 5. In the expanded display 8.2 , in addition to the image parameters and their setting, the remote control 1 with the functionality of the control elements 6 and the control element 9 “number 3” that has just been touched are particularly highlighted on the screen 4 . The corresponding graphic display "+" of the brightness control is also highlighted. Pressing the control element 6 "number 3" just touched increases the brightness in accordance with the duration of pressing this control element 6 "number 3". After the setting has been ended, that is to say after this control element 6 has been released, the display 8.2 is hidden with a specific time delay τ, for example 3 s. Only a TV picture is again shown on the screen 4 .

The inventive device for controlling a device 5 by means of a remote control 1 will be described with reference to FIG. 6 and FIG. 7. Here a TV receiver is controlled via remote control 1 .

The essential elements of the device are shown in FIG. 6 and consist of the remote control 1 with the operating elements 6 , the touch or pressed signals being transmitted by means of the transmitting unit 2 to a receiving unit 3 which is coupled to the device 5 to be controlled. The TV receiver described in the exemplary embodiment has a receiving unit 3 for the remote control signals, which are forwarded as touch or pressed signals to the computer system 12 , which consists of the command interpreter 13 and the user interface program 14 . The computer system 12 is used to interpret the remote control signals, to generate the graphical user interface and to control the entire system. The computer system 12 is followed by a video overlay system 15 , which may have an acoustic signal generator for acoustic display. The video overlay system 15 superimposes the video stream 20 of the TV receiver 5 and the data stream 19 for the graphic surface for the output units of the TV receiver 5, such as loudspeaker 16 and screen 4 .

The remote control 1 acc. Fig. 7 contains a predetermined set of control elements 1.6 to 7.6, which are combined into different groups, and a rocker switch 7. The groups of control elements are a number pad 6.1 and two additional characters (preamble 6.2 and postamble 6.3 ). There is also a block of cursor keys 6.4 and a confirmation key 6.5 , a block of color keys 6.6 (teletext keys, red, green, yellow, blue) and a set of function keys 6.7 , which are located at the upper end of the remote control 1 . All control elements 6 of the remote control 1 are touch-sensitive, ie a clocked touch signal is triggered when touched or light pressure, the clock frequency being approximately 10 Hz. These touch signals are sent out by the transmitter unit 2 of the remote control 1 , these signals also containing the information about the touched control element 6 itself. If the previously touched control element 6 is pressed, a clocked pressure signal is sent. The control elements 6 are preferably implemented as a combination of an ordinary push button with a touch-sensitive sensor button arranged above it. The rocker switch 7 has a function similar to two buttons, one labeled "-" and the other labeled "+", both of which are mechanically connected so that only one of the two buttons can have the "pressed" state.

An advantageous embodiment can consist in that the remote control 1 is only partially or transparently shown, or only the occupied control elements 6 are displayed.

If an exclusively acoustic representation of the touched or pressed controls 6 is selected, pure audio devices, such as. B. radio, CD player, etc. can be controlled with this remote control 1 . Touching an operating element 6 on the remote control 1 causes an acoustic signal which informs the user of the functionality.

This remote control 1 can also be used for devices 5 with fixed operating elements, for. B. in a washing machine. If a key is touched, e.g. B. the button for the economy cycle, an acoustic signal (spoken word "economy cycle") informs about the functionality.

Of course, all industrial processes can also be done with the inventive methods using the described Control facility where the technical parameters are on display are shown and their influence via corresponding Controls are carried out.

Claims (8)

1.Procedure for controlling devices by means of a remote control with touch-sensitive control elements, wherein when a control element is touched, a transmitter unit of the remote control is activated and clocked touch signals are transmitted which are received by a receiver unit of the device to be controlled and transmitted to a command interpreter who interprets them and in turn transmits the determined events to a computer system which derives the corresponding control commands from them, taking into account the respective operating state, transmits them to the device to be controlled and displays them on a display, characterized in that
when a control element ( 6 ) is touched until a defined time interval has elapsed, a menu ( 11.1 , 11.2 ) for which the function corresponding to the touched control element ( 9 ) is shown on the display ( 4 ) (simple display) and / or is output as an acoustic signal ,
After the defined time interval has elapsed, the complete remote control including the operating elements and the associated functions ( 8.1 , 8.2 ) is shown on the display ( 4 ), the touched operating element ( 9 ) being highlighted (expanded display) and / or an acoustic signal for the associated function is issued,
when a control element ( 6 ) is subsequently pressed by the remote control ( 1 ), a clocked pressure signal is sent and the assigned function is triggered by a computer system ( 12 ),
after a specified time interval in which no control element ( 6 ) is touched, the remote control ( 1 ) is deactivated after a preset time delay (τ) and the currently displayed ( 8.1 , 8.2 , 11.1 , 11.2 ) is shown on the display ( 4 ) hidden. 2. The method according to claim 1, characterized in that
when a control element ( 6 ) of the remote control ( 1 ) is touched in a command interpreter ( 13 ), a count list is created in a memory associated with this control element ( 6 ) and the current value is set from 0 to 1 and at defined time intervals by the value 1 is increased
when touching the control element ( 6 ) the current value is set to 0,
when the value of the count list changes from 0 to 1 or to 0 or when a defined value is reached by the command interpreter ( 13 ), an event is sent to a user interface program ( 14 ) in order to signal a corresponding change in status,
when a control element ( 6 ) is pressed by the push signal from the command interpreter ( 13 ) an event is sent to the user interface program ( 14 ) in order to signal a corresponding change in status and the counting list is set to the value 1. 3. The method according to claim 2, characterized in that the current value in the count list for the first touched control element ( 6 ) is set to 0 by the command interpreter ( 13 ) when touching a second control element ( 6 ). 4. The method according to any one of claims 1 to 3, characterized in that with each change in the count list in the command interpreter ( 13 ) a timer is started, which is set to a predetermined signal repetition time, the count list in the memory of the corresponding control element ( 6 ) the value 1 is increased if a touch signal arrives from the same control element ( 6 ) within the set signal repeat duration and the value is set to 0 if no touch signal arrives from the same control element within the set signal repeat duration. 5. The method according to any one of claims 1 to 4, characterized in that
in the event of a change in state by changing the current value in the counting list from 0 to 1, the user interface program ( 14 ) causes the menu to be shown in the simple display ( 11.1 , 11.2 ) on the display ( 4 ),
in the event of a change in state by reaching a defined value in the counting list, the user interface program ( 14 ) causes the complete remote control to be shown in the expanded display ( 8.1 , 8.2 ) on the display ( 4 ),
the user interface program ( 14 ), taking into account the respective state of the device ( 5 ) to be controlled and the events transmitted by the command interpreter ( 13 ), prepares the corresponding control commands ( 18 ), transmits them to the device ( 5 ) to be controlled and displays the corresponding state ( 8.1 , 8.2 , 11.1 , 11.2 ) is shown on the display ( 4 ) and / or is output acoustically via a loudspeaker ( 16 ),
in the event of a change in state by changing the current value in the counting list to 0 by the user interface program ( 14 ), the currently displayed display ( 8.1 , 8.2 , 11.1 , 11.2 ) is hidden on the display ( 4 ) after an adjustable time delay (τ) has elapsed If all values in the counting list of the command interpreter ( 13 ) have the value 0 or no change in status is signaled by the command interpreter ( 13 ) changing the current value in the counting list to 1 during the duration of the time delay (τ). 6. The method according to any one of claims 1 to 5, characterized in that all possible operating procedures for the control of the device ( 5 ) are stored in the user interface program ( 14 ) and the events sent by the command interpreter ( 13 ) and the current operating state of the device to be controlled ( 5 ) are analyzed in order to derive the graphical user interface for the display ( 4 ) and to develop the control commands ( 18 ) and to transmit them to the device ( 5 ) to be controlled. 7. The method according to any one of claims 1 to 6, characterized in that by means of a video overlay system ( 15 ) which is arranged between the user interface program ( 14 ) and the display ( 4 ), the video stream ( 20 ) to be controlled Device ( 5 ) and the data stream for the graphical user interface ( 19 ) are superimposed such that in addition to the current representation on the display, the corresponding display ( 8.1 , 8.2 , 11.1 , 11.2 ) of the respective operating procedure is shown. 8. Device for controlling devices by means of a remote control, the remote control having control elements and a transmitter unit and the device to be controlled is equipped with a receiver unit, which is followed by a command interpreter and a computer system for deriving control commands, the device for optical and / or acoustic representation of the control commands is equipped with a display and / or playback devices for acoustic signals, characterized in that the control elements ( 6 ) are arranged in two levels on the remote control ( 1 ), switching keys being arranged in a lower level, via which are arranged in the upper level touch-sensitive buttons, the respective functions of the superimposed buttons and buttons being assigned the same functions, and a computer system ( 12 ) and a video overlay system ( 15 ) for generating the graphical interface, which can include a signal generator for generating the acoustic signals.