[go: up one dir, main page]

EP2952661B1 - Procédé et dispositif d'ouverture sans contact d'un accès et/ou d'une sortie dans un véhicule de transport de passagers et véhicule de transport de passagers muni d'un tel dispositif - Google Patents

Procédé et dispositif d'ouverture sans contact d'un accès et/ou d'une sortie dans un véhicule de transport de passagers et véhicule de transport de passagers muni d'un tel dispositif Download PDF

Info

Publication number
EP2952661B1
EP2952661B1 EP15001202.9A EP15001202A EP2952661B1 EP 2952661 B1 EP2952661 B1 EP 2952661B1 EP 15001202 A EP15001202 A EP 15001202A EP 2952661 B1 EP2952661 B1 EP 2952661B1
Authority
EP
European Patent Office
Prior art keywords
exit
entrance
information
unit
dialogue
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP15001202.9A
Other languages
German (de)
English (en)
Other versions
EP2952661A1 (fr
Inventor
Karlheinz Dörner
Andreas Zimmermann
Laura Ann Walter
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MAN Truck and Bus SE
Original Assignee
MAN Truck and Bus SE
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MAN Truck and Bus SE filed Critical MAN Truck and Bus SE
Publication of EP2952661A1 publication Critical patent/EP2952661A1/fr
Application granted granted Critical
Publication of EP2952661B1 publication Critical patent/EP2952661B1/fr
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • EFIXED CONSTRUCTIONS
    • E05LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05FDEVICES FOR MOVING WINGS INTO OPEN OR CLOSED POSITION; CHECKS FOR WINGS; WING FITTINGS NOT OTHERWISE PROVIDED FOR, CONCERNED WITH THE FUNCTIONING OF THE WING
    • E05F15/00Power-operated mechanisms for wings
    • E05F15/70Power-operated mechanisms for wings with automatic actuation
    • E05F15/73Power-operated mechanisms for wings with automatic actuation responsive to movement or presence of persons or objects
    • EFIXED CONSTRUCTIONS
    • E05LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05YINDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF
    • E05Y2400/00Electronic control; Electrical power; Power supply; Power or signal transmission; User interfaces
    • E05Y2400/80User interfaces
    • E05Y2400/85User input means
    • E05Y2400/856Actuation thereof
    • E05Y2400/858Actuation thereof by body parts, e.g. by feet
    • EFIXED CONSTRUCTIONS
    • E05LOCKS; KEYS; WINDOW OR DOOR FITTINGS; SAFES
    • E05YINDEXING SCHEME ASSOCIATED WITH SUBCLASSES E05D AND E05F, RELATING TO CONSTRUCTION ELEMENTS, ELECTRIC CONTROL, POWER SUPPLY, POWER SIGNAL OR TRANSMISSION, USER INTERFACES, MOUNTING OR COUPLING, DETAILS, ACCESSORIES, AUXILIARY OPERATIONS NOT OTHERWISE PROVIDED FOR, APPLICATION THEREOF
    • E05Y2900/00Application of doors, windows, wings or fittings thereof
    • E05Y2900/50Application of doors, windows, wings or fittings thereof for vehicles
    • E05Y2900/506Application of doors, windows, wings or fittings thereof for vehicles for buses

Definitions

  • the invention relates to a method for the contactless opening of an access and / or exit on a vehicle, wherein a sensor unit is provided on the vehicle, which is the approaching of an object to the entrance and / or exit and / or the presence of an object in the surrounding area the access and / or output detected. It further belongs to the invention to provide an arrangement for carrying out the method.
  • FR 2979873 A a method for contactless opening of an access and / or exit on a vehicle, wherein a sensor unit is provided on the vehicle, which is the approach of an object to the entrance and / or exit and / or the presence of an object in the surrounding area of the access and / or detected output, wherein the reaction of the object is registered and transmitted to the evaluation unit by means of a responsive to gesture and associated with an evaluation unit for transmitting information detection unit, wherein the evaluation unit compares the transmitted reaction information with a stored information and wherein in accordance within a predetermined bandwidth, the evaluation unit generates an opening signal and thus activates an actuator which opens the access and / or output.
  • a method for contactless gesture-based opening of an entrance and / or exit on a vehicle which has no prior knowledge of the nature of the gestures, the place where they are to perform and the effect the gestures are tied. It is also an object to propose an arrangement for carrying out the method.
  • the problem is solved by the features of the independent claims.
  • Advantageous embodiments are the subject of the respective subclaims. According to the invention, a method is provided which is carried out when a vehicle is stationary, wherein a sensor unit is provided on the vehicle, which is the approaching of an object to the entrance and / or exit and / or the presence of an object in the surrounding area of the access and / or Output detected.
  • a dialogue unit initiates a dialogue, such that information about the possibility of contactless opening of the access and / or exit and a Information about how to perform the opening, acoustically and / or visually perceptible, is presented via an output unit in the direction of the object.
  • an evaluation unit is provided, which is connected to a responsive to gesture detection unit for the purpose of information transmission.
  • the detection unit detects the reaction of the object to the dialogue offer and transmits the information to the evaluation unit. This compares the transmitted reaction information with stored information for consistency. If a match is detected within a predefinable bandwidth, the evaluation unit concludes the presence of a person who wants to get on or off and controls an actuator that opens the entrance and / or exit.
  • a method is achieved that an opening by passers who happen to happen the scanning area, is advantageously prevented.
  • an instruction manual is supplied in an advantageous manner to persons who are willing and / or willing to leave, as they can open the door without contact.
  • the instructions for use may advantageously be linguistic, alphanumeric or pictorial information on the procedure. It is particularly advantageous to output information by means of generally understandable pictograms, which are displayed visually via a corresponding display device. It goes without saying that a voice output via loudspeaker or alphanumeric information about a display can be used in parallel support.
  • a display on display devices that is volatile, can be advantageously ensured that opening attempts are only made when the information appears, with permanently printed information that would not be the case.
  • a timer which is started in time with the initiation of the dialogue , is checked after its expiration by means of a query routine, if the evaluation has detected a match and that, if no match was found, after the expiration of the timer, the dialogue is initiated again.
  • it makes sense to set the repeatedly initiating the dialogue after a predetermined number of attempts and only resume when the sensor unit detects a change in the detected objects, such that they approach the entrance and / or exit or change their position. This is advantageously achieved that particularly located in the vehicle passengers, but also persons who wait for example at a stop, are not bothered by the constant repetition.
  • a further development of the method provides that the information about how to perform the opening includes a gaze guide instruction.
  • a change of sight is comparatively easy to detect, for example by measuring the viewing angle of a person relative to the camera position by means of a camera-based face recognition available on the market.
  • the presentation of the information is designed in such a way that the person pursuing the presentation of the information must make a forced change of sight from a first fixation point to at least a second fixation point, for example by placing pictograms consecutively on spatially separated ones Positions are displayed.
  • the detection unit registers the at least one viewing direction change and forwards the information to the evaluation unit.
  • the evaluation unit for its part closes from the registered change of sight direction to the presence of a person wishing to open the entry or exit and controls the corresponding actuator (s).
  • the information about how to perform the opening describes a gesture change, such that a gesture is predetermined by a first attitude to at least a second attitude and that the detection unit registers the at least one gesture change ,
  • the detection unit registers the at least one gesture change and forwards the information to the evaluation unit.
  • the evaluation unit carries out the comparison with the stored information and, if it matches within a predefinable bandwidth, concludes an opening request and controls the corresponding actuator or actuators.
  • An advantageous development therefore provides that, when detecting the simultaneous approach of several objects to the entrance and / or exit and / or when detecting the simultaneous presence of several objects in the surrounding area of the entrance and / or exit, the method for contactless access opening and / or or exit and the access and / or exit is opened.
  • a delay timer is started which delays the initiation of the dialogue. If the time specified by the delay timer has elapsed and the object is still in the vicinity of the entrance and / or exit, a dialog is initiated. In such a case, there is a high probability that an opening request will be made in response to the dialogue. By doing so, initiating a dialog can be advantageously limited to the necessary level.
  • the information contains a description of the area in which the given gesture is to be performed prior to access and / or exit.
  • this specification can be associated with the fact that by means of a light-emitting device, for example by means of a light projection, the area to be used at a predetermined time, for example, when the corresponding information is output via the output unit, identified for a predetermined time becomes. In this case, the extinction of the light projection can signal, for example, the end of the opening possibility.
  • the evaluation unit compares the information provided by the detection unit, which in fact includes the reaction of a person to the display on the display, with stored information and, if it matches within a predetermined bandwidth, controls those actuators which are associated with the detected gesture. In this way, can advantageously access boarding aids and exit aids for strollers, wheelchair users, etc.
  • the gesture detection areas 12, 13 are respectively made visible by light projections, which are generated by means of a corresponding projection device, on the floor before the entrance or exit for access or exit. More about this is Fig. 2 to remove, where only the outdoor area of the scene according to Fig. 1 is shown. It should be noted at this point that arrangement and procedure for persons who want to get into the city bus 1 and passengers who want to leave the city bus1, are analogously the same, so that in order to avoid repetition, only the approach side is considered in the further description ,
  • Fig. 2 shows in a first partial representation (representation in a large circle) a section of the scene according to Fig. 1 , schematically, from a second angle.
  • the second point of view is in the Fig. 1 indicated by the arrow 14. Since it is the same scene, the same reference numerals are used for the same objects.
  • a display unit 15 is arranged above the doors 7 on the city bus 1. Further, the city bus 1, respectively below the doors 7, extendable boarding aids 16, which serve to facilitate boarding, or getting out, for example, for wheelchair users or for persons with prams.
  • Fig. 2 in a further partial view (representation in a small circle), a section of the scene from a third angle, which is indicated by the arrow 17 ( Fig. 2 ) is indicated.
  • the boarding aids 16, and a projection device 18 can be seen, wherein the projection device 18, the ready in connection with Fig. 1 raised light projection on the ground generated before the access, which features the first gesture detection area 12.
  • FIG. 3 shows Fig. 3 the functional units in a block diagram, which, as already stated above, not necessarily be designed as hardware components, or in which hardware components, such as sensors or actuators, may be subject to multiple uses.
  • the above-mentioned sensor unit 20 and the detection unit 23 have different tasks, but, as in the Figures 1 and 2 indicated, forming a structural unit. It is even possible that only once existing sensors for both purposes be used and, where appropriate, use even more functional units of these sensors. Thus, it is conceivable, for example, for both the sensor unit 20 and the detection unit 23 to use an image sensor in order, on the one hand, to detect objects and convert them into binary information and, on the other hand, to record gestures and convert them into binary information. In such a case, the image sensor could be used in a third-party use for a panoramic view arrangement and could take over the image of the right in the direction of travel of the city bus vehicle environment.
  • the above-mentioned actuators 26, 26 ' can also be used by processes other than the above-mentioned method for non-contact opening, namely whenever an opening of the input or output is to be made.
  • the display 22' can be used in a secondary benefit to indicate the destination of the journey of the city bus 1 or the loudspeaker can be used for warning messages of the driver of the city bus 1 acoustically.
  • dialog unit 21 and evaluation unit 24 are software-based processes which are executed on one or more arithmetic units, wherein these arithmetic units assume in parallel many other control and regulating tasks which are to be performed in a vehicle.
  • these arithmetic units assume in parallel many other control and regulating tasks which are to be performed in a vehicle.
  • a query is made whether the non-contact door open has been activated and whether the speed of the vehicle is zero. If the query does not match, the query is retried.
  • a control step 31 is a query whether the access / exit is closed. If this is not the case, the method continues with control step 30.
  • control step 31 a query is made in a control step 32 as to whether an object has been detected which is located in a predetermined region monitored by sensors. If no object was detected, the method continues with control step 30.
  • a dialog is initiated.
  • a dialogue is to be understood here as meaning, for example, that a representation appears on a display, as it appears in the text FIGS. 5a to 5c or in the FIG. 6 is shown. Reference is made to the description below.
  • control step 35 a query is then made as to whether a gesture was detected in response to the initiated dialogue, this is not the case, control step 36 follows, the query in control step 35 applies, control step 38 follows.
  • the query in control step 36 causes the dialog offer in control step 34 is repeated only "X" times, where "X" is the output value of the count.
  • control step 35 a query is made in a control step 38 as to whether there is a match with a stored gesture. For this purpose, it is assumed that in a subroutine, not shown, a binary information obtained from a sensor query is compared with a stored binary information. If a match has been found, control step 41 is continued; if no match is found, control step 39 follows.
  • control step 41 In a determined in control step 38 match are actuated in control step 41 actuators that open the inlet and outlet and extend if necessary boarding aids.
  • control step 41 After carrying out the control step 41 we proceeded with control step 30, the closing of the entrance and exit, and the retraction of exit aids does not occur automatically in the example chosen, but is a triggered by the driver process, because there are special security risks.
  • corresponding safety devices are provided which prevent a person-endangering closing of the entry or exit, or retraction of exit aids, of course, an automatic closing or retraction can be provided by, for example, in a control step 41 downstream query ( in Fig. 4 not shown) determines whether an object is in the scanning range of the above-mentioned sensors. If this is not the case, the entrance or exit is closed.
  • an extension can be provided in the method sequence described above such that, as in FIG Fig. 4 indicated by dashed connecting lines, after control step 32, in a control step 42, a delay element VZ started and queried after its expiry in control step 43, if an object was detected, which is located in the predetermined area monitored by the sensors. If no object was detected, the method continues with control step 30. If an object has been detected, control step 33 follows.
  • the method described above by way of example can be expanded in many ways, supplemented or adapted to particular circumstances, without changing the basic procedure.
  • the core of the procedure is a detected object from which one initially does not know whether it is a person to offer a dialogue by giving information in the direction of the object and detecting whether the object reacts in a manner corresponding to the information. If the response occurs, it is interpreted as confirmation that a person is present who wishes the procedure offered in the dialogue (for example, opening access).
  • a dynamic, time-varying information is shown, which is displayed on a run display 50.
  • the reaction to the information offered is queried simultaneously with the provision of the dynamic information via a detection unit (not shown here), which uses a camera 51 to scan.
  • the camera 51 is, as indicated by an arrow 60 symbolizing the recording direction, aligned such that an object 52 located in front of the running display 50 is detected. It is assumed in this example that in a previous method step, the object 52 has been detected, to which the opening of the access is now offered by initiating the dialog.
  • on the run display 50 at the right edge, first of all the representation of a dynamic icon 53, which shows a closed door, to which an arrow is directed.
  • the object 52 If the object 52 is a person willing to join, it will look at the representation and thus assume a specific first viewing angle which is indicated by the arrow 54. This first viewing angle is registered by the detection unit via the camera 51.
  • the dynamic presentation of the information is now designed so that the representation of the dynamic icon 53, as in Fig. 5b shown, on the run indicator moves to the left.
  • the eyes of an addicted person, directed at the pictogram, will follow this movement and thus assume in turn the viewing angles indicated by the arrows 56, 57 and 58, the change of the viewing angle being registered by the detection unit via the camera 51.
  • the viewing angle of a viewing person has a change from right to left completed, this change of the viewing angle was registered via the camera 51 by the detection unit.
  • the detected viewing angle change is now interpreted by the evaluation unit as the opening request of a person wishing to board and, as shown in FIG Fig. 5c , on the left edge of the run display 50 for confirmation a modified icon 59 is shown flashing an open door.
  • the opening of the access or exit is accomplished by actuation of corresponding actuators.
  • the changed pictogram 59 is not displayed flashing and the access remains closed.
  • the gesture to be carried out by a person who is to be admitted is already embedded in the dialog guidance, so that the deliberate implementation of a gesture displayed on a display is omitted because it has already been unconsciously performed.
  • FIG. 6 A second way of information that a non-contact opening is possible and how to initiate the opening shows Fig. 6 ,
  • a static display 61 at the left edge of a first icon 62, which in turn represents a closed door symbolically.
  • the static display 61 shows a second icon 63, which shows a stick figure with lowered arms, on whose chest the numeral "1" is to be read.
  • a third pictogram 64 which shows a stick figure with laterally, horizontally raised arms and wearing the number "2" on the chest.
  • a fourth pictogram 65 which shows a stick figure with lowered arms, on the chest of which the figure "3" is shown.
  • the static indicator 61 shows a fifth icon 66 representing an opened door.
  • the above-described display on the static display 61 gives a person who views them the information that opening by gesture is possible by raising the arms laterally, horizontally, and then lowering them again, starting from a lowered arms posture , If a person completes this gesture, this is registered by means of a detection unit, digitized and compared by an evaluation unit with a stored digital information. If a match is found, the opening is made by activating appropriate actuators.
  • the above-described display on the static display 61 can be made dynamic by displaying the icons 62 to 66 consecutively starting from the left, so that the action required to open becomes even more noticeable.
  • the representations on the displays 50, 61 may be accompanied by explanatory acoustic instructions or information reproduced via loudspeakers, so that the necessary gesture for opening the entrance or exit is conveyed even more clearly.
  • the display according to the examples can be used according to the FIGS. 5a to 5c respectively.
  • 6 be accompanied by a light projection, as in connection with the Figures 1 and 2 is described.
  • a light projection can also be designed dynamically, for example, by successively decreasing concentric circles being projected in rapid succession. This dynamically points to the area where gestures are to be performed.
  • a selection of different gestures can be presented on ads and attentively made aware of what different effects the different gestures have. For example, a first gesture that opens the entrance or exit and a second gesture that opens the entrance or exit and additionally provides an entry or exit help.

Landscapes

  • User Interface Of Digital Computer (AREA)

Claims (16)

  1. Procédé d'ouverture sans contact d'un accès et/ou d'une sortie sur un véhicule, une unité à capteur (20) étant présente sur le véhicule, laquelle détecte l'approche d'un objet de l'accès et/ou de la sortie et/ou la présence d'un objet dans la zone environnante de l'accès et/ou de la sortie, une unité de dialogue (21) étant présente qui, lors de la reconnaissance d'une approche d'au moins un objet de l'accès et/ou de la sortie et/ou lors de la reconnaissance de la présence d'au moins un objet dans la zone de l'accès et/ou de la sortie, initie un dialogue de telle sorte qu'une information à propos de la possibilité de l'ouverture sans contact de l'accès et/ou de la sortie et une information à propos de la manière d'effectuer l'ouverture est présentée sous une forme perceptible de manière sonore et/ou visuelle par le biais d'une unité de diffusion (22) en direction de l'objet, la réaction de l'objet à la proposition de dialogue étant enregistrée au moyen d'une unité de détection (23) qui réagit aux gestes et qui est reliée à une unité d'interprétation (24) servant à la transmission d'informations, puis transmise à l'unité d'interprétation (24), l'unité d'interprétation (24) comparant l'information de réaction transmise avec une information mise en mémoire et, en cas de concordance à l'intérieur d'une largeur de bande pouvant être prédéfinie, l'unité d'interprétation (24) génère un signal d'ouverture et commande ainsi un actionneur (26, 26') qui ouvre l'accès et/ou la sortie.
  2. Procédé selon la revendication 1, caractérisé en ce que l'information à propos de la possibilité de l'ouverture sans contact de l'accès et/ou de la sortie est une information verbale et/ou alphanumérique et/ou figurative.
  3. Procédé selon la revendication 1 ou 2, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture contient une représentation sonore et/ou alphanumérique et/ou figurative du geste à accomplir pour l'ouverture.
  4. Procédé selon l'une des revendications précédentes, caractérisé en ce qu'il existe un temporisateur qui est démarré simultanément avec l'initiation du dialogue, un contrôle au moyen d'une routine d'interrogation étant effectué après son écoulement afin de vérifier si l'unité d'interprétation (24) a constaté une concordance et en ce que si aucune concordance n'a été constatée, le dialogue est une nouvelle fois initié en prévoyant de préférence que l'initiation du dialogue est arrêtée après un nombre d'essais pouvant être prédéfini et ne reprend que lorsque l'unité à capteur (20) constate une modification au niveau des objets détectés, de sorte que ceux-ci se rapproche de l'accès et/ou de la sortie ou change leur position.
  5. Procédé selon l'une des revendications précédentes, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture contient une instruction de guidage du regard de telle sorte qu'un changement de direction du regard d'un premier point de fixation vers au moins un deuxième est prédéfini, et en ce que l'unité de détection (23), en association avec l'unité d'interprétation (24), enregistre l'au moins un changement de direction du regard et l'unité d'interprétation (24), lors de l'enregistrement du changement de direction du regard, génère un signal d'ouverture en prévoyant de préférence que le changement de direction du regard est commandé de force par la manière de présenter l'information de telle sorte que l'information est présentée de telle manière que le changement de direction du regard est accompli automatiquement par une personne lors du suivi de la présentation de l'information.
  6. Procédé selon l'une des revendications précédentes, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture décrit au moins un changement de geste de telle sorte qu'un geste doit être exécuté depuis une première posture vers au moins une deuxième posture et en ce que l'unité de détection (23), en association avec l'unité d'interprétation (24), enregistre l'au moins un changement de geste et l'unité d'interprétation (24), lors de l'enregistrement du changement de geste, génère un signal d'ouverture.
  7. Procédé selon l'une des revendications précédentes, caractérisé en ce que lors de la détection de l'approche simultanée de plusieurs objets vers l'accès et/ou la sortie et/ou lors de la détection de la présence simultanée de plusieurs objets dans la zone environnante de l'accès et/ou de la sortie, le procédé d'ouverture sans contact de l'accès et/ou de la sortie est inhibé et l'accès et/ou de la sortie sont ouverts.
  8. Procédé selon l'une des revendications précédentes, caractérisé en ce qu'un temporisateur de retard est démarré simultanément avec la détection d'un objet qui s'approche de l'accès et/ou de la sortie ou qui se trouve dans sa zone environnante, et en ce que l'initiation du dialogue n'a lieu que lorsque le temps prédéfini par le temporisateur de retard est écoulé et que l'objet se trouve toujours dans la zone environnante de l'accès et/ou de la sortie.
  9. Procédé selon l'une des revendications précédentes, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture désigne une zone devant l'accès et/ou la sortie au niveau de laquelle doivent être accomplis des gestes et en ce que l'unité de détection (23) est configurée de telle sorte qu'elle n'enregistre que les gestes accomplis dans ladite zone, en prévoyant de préférence qu'il existe un dispositif émetteur de lumière et en ce que la zone au niveau de laquelle doivent être accomplis des gestes est rendue reconnaissable au moyen d'un repère lumineux à un instant pouvant être prédéfini pendant un temps pouvant être prédéfini.
  10. Procédé selon l'une des revendications précédentes, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture contient une sélection d'alternatives et en ce que pour l'invocation des alternatives, des informations à propos de gestes différents sont à chaque fois représentées sur le dispositif d'affichage (22) et en ce que l'unité d'interprétation (24) compare l'information délivrée par l'unité de détection (23) avec des informations mises en mémoire et, en cas de concordance à l'intérieur d'une largeur de bande prédéfinie, commande les actionneurs (26, 26') qui sont associés au geste reconnu.
  11. Procédé selon l'une des revendications précédentes, caractérisé en ce que l'information à propos de la manière d'effectuer l'ouverture, outre la représentation d'un geste donné à accomplir, contient également une description de la réalisation d'une expression sonore donnée, en ce que l'unité de détection (23) est configurée pour enregistrer une expression sonore et en ce que l'unité d'interprétation (24) compare l'information communiquée par l'unité de détection (23) concernant le geste détecté et l'expression sonore détectée respectivement séparément avec une information mise en mémoire et en ce que déjà en présence d'une seule concordance à l'intérieur d'une largeur de bande prédéfinie, l'unité d'interprétation (24) génère un signal d'ouverture et commande ainsi un actionneur (26, 26') qui ouvre l'accès et/ou la sortie.
  12. Arrangement pour mettre en oeuvre le procédé selon l'une des revendications 1 à 11, lequel contient les éléments suivants :
    - une unité à capteur (20) qui détecte l'approche d'un objet de l'accès et/ou de la sortie et/ou la présence d'un objet dans la zone environnante de l'accès et/ou de la sortie,
    - une unité de dialogue (21) qui, lors de la reconnaissance d'une approche d'au moins un objet de l'accès et/ou de la sortie et/ou lors de la reconnaissance de la présence d'au moins un objet dans la zone de l'accès et/ou de la sortie, initie un dialogue de telle sorte que l'unité de dialogue (21) génère une information à propos de la possibilité de l'ouverture sans contact de l'accès et/ou de la sortie et une information à propos de la manière d'effectuer l'ouverture,
    - une unité de diffusion (22) qui présente l'information générée par l'unité de dialogue (21) sous une forme perceptible de manière sonore et/ou visuelle en direction de l'objet,
    - une unité de détection (23) qui réagit aux gestes ou aux gestes et aux sons et qui enregistre la réaction de l'objet à la proposition de dialogue,
    - une unité d'interprétation (24) reliée à l'unité de détection (23), laquelle compare l'information de réaction transmise par l'unité de détection (23) avec une information mise en mémoire et, en cas de concordance à l'intérieur d'une largeur de bande pouvant être prédéfinie, délivre un signal d'ouverture,
    - un actionneur (26, 26') qui est relié à l'unité d'interprétation (24) et qui, en présence du signal d'ouverture, ouvre l'accès et/ou la sortie.
  13. Arrangement selon la revendication 12, caractérisé en ce que l'unité à capteur (20) contient, pour la détection d'objet, un dispositif radar et/ou lidar et/ou à ultrasons et/ou de capture d'images et/ou en ce que l'unité de détection (23) contient, pour la détection de la réaction de l'objet, au moins une caméra et/ou un système de balayage à laser et/ou un détecteur d'approche capacitif.
  14. Arrangement selon la revendication 12 ou 13, caractérisé en ce que l'unité de diffusion (22) et /ou l'unité à capteur (20) et/ou l'unité de détection (23) sont disposées dans la zone de l'accès et/ou de la sortie, de préférence au-dessus de ceux-ci, et/ou en ce qu'un dispositif émetteur de lumière est disposé dans la zone de l'accès et/ou de la sortie, le dispositif émetteur de lumière étant commandé par l'unité de dialogue (21) pour projeter un repère lumineux.
  15. Arrangement selon l'une des revendications 12 à 14, caractérisé en ce que l'unité de diffusion (22) est utilisée dans au moins un deuxième usage pour la délivrance d'autres informations et/ou en ce que l'unité à capteur (20) est utilisée dans un deuxième usage comme unité de détection (23).
  16. Véhicule, notamment véhicule utilitaire, équipé d'un arrangement selon l'une des revendications 12 à 15.
EP15001202.9A 2014-06-06 2015-04-22 Procédé et dispositif d'ouverture sans contact d'un accès et/ou d'une sortie dans un véhicule de transport de passagers et véhicule de transport de passagers muni d'un tel dispositif Active EP2952661B1 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
DE102014008430.2A DE102014008430A1 (de) 2014-06-06 2014-06-06 Verfahren zum berührungslosen Öffnen eines Zugangs und/oder Ausgangs an einem Fahrzeug

Publications (2)

Publication Number Publication Date
EP2952661A1 EP2952661A1 (fr) 2015-12-09
EP2952661B1 true EP2952661B1 (fr) 2018-01-03

Family

ID=53039159

Family Applications (1)

Application Number Title Priority Date Filing Date
EP15001202.9A Active EP2952661B1 (fr) 2014-06-06 2015-04-22 Procédé et dispositif d'ouverture sans contact d'un accès et/ou d'une sortie dans un véhicule de transport de passagers et véhicule de transport de passagers muni d'un tel dispositif

Country Status (2)

Country Link
EP (1) EP2952661B1 (fr)
DE (1) DE102014008430A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4114692B1 (fr) * 2020-03-02 2023-08-16 emotion3D GmbH Procédé et dispositif de réglage ou de commande d'un composant de véhicule

Families Citing this family (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016002368A1 (de) 2016-02-26 2016-09-22 Daimler Ag Verfahren zum Öffnen und Schließen einer Fahrzeugtür eines Fahrzeuges
DE102019210912A1 (de) 2019-07-23 2021-01-28 Brose Fahrzeugteile Se & Co. Kommanditgesellschaft, Bamberg Verstellvorrichtung und Verfahren für die fremdkraftbetätigte Verstellung eines Verstellteils an einem Fahrzeug auf Basis wenigstens eines Bedienereignisses
AT523670B1 (de) 2020-03-24 2023-07-15 Emotion3D Gmbh Vorrichtung und Verfahren zur Kalibrierung eines Lichtprojektors
EP4009526A1 (fr) * 2020-12-04 2022-06-08 Captron Electronic GmbH Bouton de capteur avec commande de gestes
AT524733A1 (de) * 2021-01-20 2022-08-15 Siemens Mobility Austria Gmbh Türbetätigung
US12410653B2 (en) * 2021-11-05 2025-09-09 Transportation Ip Holdings, Llc Touchless control system
DE102022132403A1 (de) 2022-12-06 2024-06-06 Brose Fahrzeugteile Se & Co. Kommanditgesellschaft, Bamberg Verstellvorrichtung und Verfahren zur Steuerung einer Zustiegshilfe in Abhängigkeit vom Grad einer Mobilitätseinschränkung

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2740501B1 (fr) * 1995-10-26 1998-06-19 Valeo Securite Habitacle Systeme mains libres de deverrouillage et/ou d'ouverture d'ouvrant de vehicule automobile
US6498970B2 (en) * 2001-04-17 2002-12-24 Koninklijke Phillips Electronics N.V. Automatic access to an automobile via biometrics
DE102005032402B3 (de) * 2005-07-12 2006-09-28 Daimlerchrysler Ag Verfahren zum Nachweis einer Berechtigung zum Ver- oder Entriegeln eines Objekts sowie Sicherheitsvorrichtung
US20100185341A1 (en) 2009-01-16 2010-07-22 Gm Global Technology Operations, Inc. Vehicle mode activation by gesture recognition
DE102011111208A1 (de) 2011-08-20 2013-02-21 Brose Fahrzeugteile Gmbh & Co. Kommanditgesellschaft, Hallstadt Berührungslose Betätigung eines Aktors in einem Fahrzeug
FR2979873B1 (fr) * 2011-09-12 2013-10-04 Valeo Securite Habitacle Procede d'ouverture d'un ouvrant de vehicule automobile
DE102011115760A1 (de) 2011-10-12 2013-04-18 Volkswagen Ag Verfahren zur automatischen Betätigung eines Schließelements eines Fahrzeugs sowie entsprechende Vorrichtung und Fahrzeug
DE102012102060A1 (de) 2012-03-12 2013-09-12 Huf Hülsbeck & Fürst Gmbh & Co. Kg Kapazitive Sensoranordnung an einem Kraftfahrzeug zur Erfassung von Bewegungsgesten
DE202012104940U1 (de) * 2012-05-07 2013-08-13 Gebr. Bode Gmbh & Co. Kg Magnetische Zusatzverriegelung
EP2860704B1 (fr) * 2013-10-10 2016-04-27 U-Shin France SAS Procédé d'ouverture d'un panneau mobile de véhicule automobile et dispositif de commande d'ouverture correspondant

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4114692B1 (fr) * 2020-03-02 2023-08-16 emotion3D GmbH Procédé et dispositif de réglage ou de commande d'un composant de véhicule

Also Published As

Publication number Publication date
EP2952661A1 (fr) 2015-12-09
DE102014008430A1 (de) 2015-12-17

Similar Documents

Publication Publication Date Title
EP2952661B1 (fr) Procédé et dispositif d'ouverture sans contact d'un accès et/ou d'une sortie dans un véhicule de transport de passagers et véhicule de transport de passagers muni d'un tel dispositif
EP3478535B1 (fr) Procédé permettant de faire fonctionner un véhicule automobile
DE112015002948B4 (de) Vorrichtung zum erfassen eines fahrunvermögenzustands eines fahrers
DE102014113569B4 (de) Türsystem mit Sensoreinheit und Kommunikationselement
DE112015002934B4 (de) Vorrichtung zum Erfassen eines Fahrunvermögenzustands eines Fahrers
DE102017216837A1 (de) Gestik- und Mimiksteuerung für ein Fahrzeug
DE112012002381T5 (de) Fahrerassistenzerkennungssystem
DE102017213177A1 (de) Verfahren zum Betreiben eines Bildschirms eines Kraftfahrzeugs sowie Kraftfahrzeug
DE102021213132B4 (de) Vorrichtung zur unterstützung des sicheren ausstiegs von fahrgästen und verfahren dafür
DE102017215650A1 (de) Benutzeranzeige der Aktivierung eines angetriebenen Systems während berührungsloser menschlicher Aktivierung
DE102013219038A1 (de) Verfahren zur Erkennung eines Verkehrspolizisten durch ein Fahrerassistenzsystem eines Kraftfahrzeugs sowie ein Fahrerassistenzsystem
DE102014116854A1 (de) Verfahren zum Durchführen eines autonomen Parkvorgangs, Fahrerassistenzsystem und Kraftfahrzeug
DE102015004605A1 (de) Verfahren zum Betrieb eines Steuersystems einer Mobileinheit und Mobileinheit
DE102014207637B4 (de) Gesteninteraktion mit einem Fahrerinformationssystem eines Fahrzeuges
DE102017206876B4 (de) Verfahren zum Betreiben eines Sprachsteuerungssystems in einem Kraftfahrzeug undSprachsteuerungssystem
WO2019048623A1 (fr) Système d'aide à la conduite pour véhicule
WO2020099368A1 (fr) Unité de commande pour commander un éclairage d'habitacle de véhicule
DE102013013869B4 (de) Verfahren zum Betrieb eines Fahrerassistenzsystems zur Warnung vor zu großer Ablenkung und Kraftfahrzeug
WO2014111241A1 (fr) Procédé et système de commande d'au moins une unité fonctionnelle, et automobile et terminal mobile équipés d'un tel système
DE102022132718A1 (de) Verfahren zur Unterstützung eines Passanten in einer Paniksituation mittels einer Hilfsfunktion eines Kraftfahrzeuges, sowie zugehöriges System
DE102017007155A1 (de) Verfahren und System zur Fahrerunterstützung
DE102017219066A1 (de) Verfahren zum sensorischen Erkennen einer Entführungssituation, System und Fortbewegungsmittel
DE102017206585B4 (de) Insassenunterstützungsverfahren, Insassenunterstützungssystem und Fahrzeug
EP4313826B1 (fr) Procédé permettant de faire un appel pour une installation d'ascenseur
DE102015225082A1 (de) Verfahren zum Betreiben eines Kraftfahrzeugs in einem vollautomatisierten Fahrmodus und Kraftfahrzeug mit einem vollautomatisierten Fahrmodus

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

17P Request for examination filed

Effective date: 20160609

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20170526

GRAJ Information related to disapproval of communication of intention to grant by the applicant or resumption of examination proceedings by the epo deleted

Free format text: ORIGINAL CODE: EPIDOSDIGR1

INTC Intention to grant announced (deleted)
GRAR Information related to intention to grant a patent recorded

Free format text: ORIGINAL CODE: EPIDOSNIGR71

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

INTG Intention to grant announced

Effective date: 20171127

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 960428

Country of ref document: AT

Kind code of ref document: T

Effective date: 20180115

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: GERMAN

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 502015002725

Country of ref document: DE

REG Reference to a national code

Ref country code: SE

Ref legal event code: TRGR

REG Reference to a national code

Ref country code: FR

Ref legal event code: PLFP

Year of fee payment: 4

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180403

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180503

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180404

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180403

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 502015002725

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

26N No opposition filed

Effective date: 20181005

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20180430

REG Reference to a national code

Ref country code: IE

Ref legal event code: MM4A

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180430

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180422

REG Reference to a national code

Ref country code: DE

Ref legal event code: R081

Ref document number: 502015002725

Country of ref document: DE

Owner name: MAN TRUCK & BUS SE, DE

Free format text: FORMER OWNER: MAN TRUCK & BUS AG, 80995 MUENCHEN, DE

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20190422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20180103

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20150422

Ref country code: MK

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20180103

REG Reference to a national code

Ref country code: AT

Ref legal event code: MM01

Ref document number: 960428

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200422

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AT

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200422

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20250424

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20250428

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20250422

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20250424

Year of fee payment: 11

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: SE

Payment date: 20250424

Year of fee payment: 11