DE102023004841A1 - Device and method for jointly representing physical and digital elements, associated computer program product and method for manufacturing the device - Google Patents

Abstract

The invention provides a device for the joint presentation of at least one physical element with at least one digital element to a user, as can be implemented, for example, in a pinball machine. Furthermore, a method for the joint presentation of physical and digital elements, a computer program product, and a manufacturing method for the device are described.

Description

The invention relates to a method for jointly displaying at least one physical element with at least one digital element for a user, a device for implementing such a method, a computer program product, and a manufacturing method for a corresponding device. In particular, the invention relates to applications in which stationary and movable elements interact with each other.

A key application is in gaming machines, such as pinball machines, where stationary and moving elements interact. In conventional, fully analog machines, this is achieved through significant technical complexity, which is associated with high wear and tear and high maintenance costs. In addition to fully analog devices, purely digital devices are also known. Instead of a physical playing field (the essentially stationary, analog elements that the player immediately perceives in their three-dimensionality and color as part of the real world), digital pinball machines have a screen on which a computer simulation of the game action is displayed.

Attempts have already been made to lighten the load on the mechanics with digital means without completely replacing them (as in a digital slot machine). Since the 1990s, digital grid displays have been installed in mechanical machines in the so-called backbox behind the playing field. They replace the alphanumeric displays of older models, which only serve to display the score, and are also used to show short, sometimes interactive cutscenes. Because viewing such a screen requires looking away from the playing field, ball play must be paused during these cutscenes.

Other devices feature a CRT (cathode ray tube) screen mounted at an acute angle above the playing surface, making it invisible to the user. Instead, the screen content is reflected by the glass pane above the playing field so that it appears to float on an inclined plane in the upper third of the playing field. Independently of this application, this process has been known since the 19th century as the "Pepper's ghost" illusion. This setup allows for simultaneous perception of the digital content of the screen and the physical, analog playing field.

The solutions mentioned above are not capable of displaying screen content anywhere on the playing field. The display is limited to a two-dimensional plane.

Visual displays for advertising, entertainment, or information purposes are state-of-the-art. The most common displays are those that present a two-dimensional image on a surface in such a way that it is equally visible from all viewing points in front of the screen. The display of arbitrary images and image sequences using immutable hardware is usually achieved by representing the images in grids of monochrome pixels.

The invention is based on the problem of overcoming the high mechanical and technical complexity in conventional pinball machines in order to minimize wear and maintenance costs.

Furthermore, the invention is based on the object of enabling an augmented reality experience without user-side accessories or preparation and thus increasing the degree of immersion.

For this purpose, the invention provides a device according to claim 1, a display method according to claim 3, a computer program product in claim 4 and a manufacturing method for the device according to claim 5.

According to the invention, the at least one digital element is displayed on the screen in such a way that the user experiences a spatial impression of the digital element. Furthermore, an interaction between the at least one physical element and the at least one digital element is simulated based on the location of the digital element and the physical element, and the location of the digital element is adjusted depending on the simulated interaction.

Beyond gaming machines, other applications are also conceivable and possible, e.g., in furnishings or devices for training manual skills. The simulated interaction can include the movement of a simulated object within an enclosed space, similar to a digital lava lamp, or the simulation of the impact of surgical instruments on simulated tissue.

• - einen Bildschirm (Haupt-Display), der mindestens partiell lichtdurchlässig und zur Erzeugung eines räumlichen Bildeindrucks aus dem mindestens einen digitalen Element (virtuelles Element/Objekt) eingerichtet ist,
• - ein flächiges Beleuchtungselement (Backlight) zum Durchleuchten des Bildschirmes, wobei das Beleuchtungselement derart zu dem Bildschirm angeordnet ist, dass der Bildschirm und das Beleuchtungselement einen Zwischenraum definieren, in dem das mindestens eine physische Element (Echtes Element/Objekt) angeordnet ist,
• - eine mit dem Bildschirm gekoppelte elektronische Regelungs- und/oder Steuerungseinheit, die eingerichtet ist:
  • • das mindestens eine digitale Element derart über den Bildschirm wiederzugeben, dass für den Benutzer ein räumlicher Eindruck entsteht,
  • • eine Wechselwirkung zwischen dem mindestens einen physischen Element und dem mindestens einen digitalen Element basierend auf dem Ort des digitalen Elements und dem physischen Element zu simulieren, und
  • • den Ort des digitalen Elementes in Abhängigkeit von der simulierten Wechselwirkung anzupassen.

The device for jointly displaying at least one physical element with at least one digital element for a user has the following features:

• - a screen (main display) which is at least partially translucent and designed to generate a spatial image impression from the at least one digital element (virtual element/object),
• - a planar lighting element (backlight) for illuminating the screen, wherein the lighting element is arranged relative to the screen in such a way that the screen and the lighting element define a space in which the at least one physical element (real element/object) is arranged,
• - an electronic control and/or regulation unit coupled to the screen, which is configured:
  • • to display at least one digital element on the screen in such a way that a spatial impression is created for the user,
  • • to simulate an interaction between the at least one physical element and the at least one digital element based on the location of the digital element and the physical element, and
  • • adjust the location of the digital element depending on the simulated interaction.

1 shows a basic structure of the device.

The view of the gap with the at least one physical element arranged therein is at least partially (partially, in sections, etc.) exposed. To the extent technically necessary or desired by the user, the translucency of the screen and thus the visibility of the gap and the elements arranged therein can be controlled or regulated [where only control or regulation is referred to below, this is to be understood as meaning that the alternative is equally possible].

Furthermore, spatial impressions can be generated based on the at least one digital element. In particular, it is possible to create for the user an impression of an interaction between the spatially represented at least one digital element and the at least one actual element. A special viewing device such as VR (virtual reality) glasses, 3D glasses, or the like may be unnecessary. This can increase the degree of immersion.

In a pinball machine, the digital simulation of the ball can eliminate the complex mechanics that move the moving elements (e.g., metal balls) in a mechanical machine. Unlike a purely digital version, a large portion of the physical game components remain intact. This can enhance the gaming experience.

• - Eine Steuerungs- oder Regelungseinheit ist eingerichtet, eine digitale Abbildung des physischen Elementes zu erzeugen.
• - Die Steuerungs- oder Regelungseinheit ist eingerichtet, digitale Elemente auszublenden, wenn das mindestens eine physische Element auf einer Sichtachse zwischen dem Benutzer und dem Ort des digitalen Elementes liegt.
• - Der Bildschirm ist ein stereoskopisches Display.
• - Das stereoskopische Display ist mit einer Parallaxbarriere ausgebildet.
• - Das stereoskopische Display ist mit einem LCD (LCD=liquid crystal display) ausgebildet.
• - Die Lichtdurchlässigkeit des Bildschirms ist steuerbar beziehungsweise kann regelungstechnisch verändert werden.
• - Bildschirm und Beleuchtungselement sind parallel angeordnet.
• - Die Vorrichtung weist ein Trackingsystem zur Erfassung einer Kopfposition und/oder einer Blickrichtung des Benutzers als zeitaufgelöste Variable auf.
• - Die Vorrichtung ist eingerichtet, den räumlichen Bildeindruck des mindestens einen digitalen Elementes in Abhängigkeit von der zeitlichen Variable zu erzeugen, um eine Bewegungsparallaxe zu simulieren.
• - Die Vorrichtung ist eingerichtet, das digitale Element derart über den Bildschirm wiederzugeben, dass für den Benutzer der Eindruck entsteht, das digitale Element sei an einem Ort innerhalb des Zwischenraumes angeordnet.
• - Die Vorrichtung weist einen weiteren Bildschirm auf, der auf der dem Zwischenraum zugewandten Seite an dem Beleuchtungselement angeordnet ist.
• - Die Steuereinheit ist mit dem weiteren Bildschirm gekoppelt und eingerichtet, Bildinformationen über den weiteren Bildschirm wiederzugeben.
• - Die Vorrichtung weist ein weiteres Beleuchtungselement zur Ausleuchtung des Zwischenraumes auf.
• - Das mindestens eine physische Element ist innerhalb des Zwischenraumes beweglich angeordnet.
• - Das mindestens eine bewegliche physische Element ist zur Bewegung in Abhängigkeit von der simulierten Wechselwirkung mit der Steuereinheit gekoppelt.
• - Das mindestens eine physische Element ist mit einem Aktuator ausgebildet.
• - Das mindestens eine physische Elemente umfasst eine geneigte Ebene.
• - Das mindestens eine digitale Element umfasst eine Kugel.
• - Ein Flipperautomat ist mit der vorgeschlagene Vorrichtung ausgebildet.
• - Die Vorrichtung ist als Übungsvorrichtung zum Üben eines medizinisches Eingriffs gestaltet.

Optionally, the device may be designed with one or more of the following features:

• - A control or regulation unit is configured to generate a digital representation of the physical element.
• - The control or regulation unit is configured to hide digital elements if the at least one physical element is located on a line of sight between the user and the location of the digital element.
• - The screen is a stereoscopic display.
• - The stereoscopic display is designed with a parallax barrier.
• - The stereoscopic display is designed with an LCD (LCD=liquid crystal display).
• - The light transmittance of the screen is controllable or can be changed using control technology.
• - Screen and lighting element are arranged parallel.
• - The device has a tracking system for detecting a head position and/or a gaze direction of the user as a time-resolved variable.
• - The device is configured to generate the spatial image impression of the at least one digital element as a function of the temporal variable in order to simulate a motion parallax.
• - The device is designed to display the digital element on the screen in such a way that the user has the impression that the digital element is located at a location within the intermediate space.
• - The device has a further screen which is arranged on the side of the lighting element facing the intermediate space.
• - The control unit is coupled to the additional screen and configured to display image information on the additional screen.
• - The device has a further lighting element for illuminating the intermediate space.
• - The at least one physical element is arranged to be movable within the intermediate space.
• - The at least one movable physical element is coupled to the control unit for movement depending on the simulated interaction.
• - The at least one physical element is formed with an actuator.
• - The at least one physical element comprises an inclined plane.
• - The at least one digital element comprises a sphere.
• - A pinball machine is constructed with the proposed device.
• - The device is designed as a training device for practicing a medical procedure.

The device can use LCD screens that can change the polarization of light from a uniformly white illuminated surface (backlight) using a layer of grid-like liquid crystal capsules. To translate these changes in polarization into brightness and thus make it visible, polarizing filters are located in front of and behind the liquid crystal layer (LCD glass layer). The first filter, between the backlight and the LCD glass layer, ensures uniform polarization before the light enters the LCD glass layer. Different voltages applied to the transistor-controlled liquid crystal capsules then change the polarization separately in each pixel. When the light exits through the second polarizing filter above the LCD glass layer, these changes in polarization result in different brightness levels per pixel. The combination of subpixels with red, green, and blue color filters enables the display of colored images.

Due to its design, LCD technology is particularly well-suited as a basis for transparent screens. The LCD glass layer in a conventional LCD screen must be translucent anyway because it relies on illumination from the backlight. Thus, any commercially available LCD screen can be converted into a transparent screen by creating a gap between the LCD glass layer and the backlight.

Various solutions are available for the problem of spatial and perspective-correct display regardless of the viewing point. These can be divided into multiscopic, volumetric, and holographic displays.

Multiscopic displays display multiple images on one screen. This is achieved by either spatially, temporally, or spectrally dividing the display. With spatial division, the individual pixels display different images depending on their position on the screen. For example, in two images, every other row of pixels could display the same image. With temporal division, the individual images are displayed in rapid succession. Spectral division is only possible with color displays. In this case, the individual images are assigned to the different color channels. In color images, this process limits color reproduction.

In order to use the possibility of displaying multiple images on one screen to ensure that digital content is spatially and perspectively correct, it must be ensured that multiple images are never visible to one viewer's eye at the same time.

According to one embodiment of the invention, this is solved by a so-called parallax barrier. Opaque (usually black) stripes at a short distance from the image surface obscure parts of the image surface. Depending on the viewing angle, different parts of the image surface become visible. In conjunction with a corresponding spatial division of the image surface between the simultaneously displayed images, a different image becomes visible depending on the viewing angle.

If only two images need to be separated, special 3D glasses can be used that use filters to make the unwanted image invisible to the respective eye.

2D displays or multiscopic displays, which only display a pair of images, have the disadvantage that their images are only perspectively correct at a specific viewing point. If the images are generated in real time and the display is designed for only one viewer at a time, the viewer's head position can be detected by a tracking system and the image perspective adjusted accordingly.

• - über einen mindestens partiell lichtdurchlässigen Bildschirm wird ein räumlicher Bildeindruck des mindestens einen digitalen Elementes erzeugt,
• - mit einem flächigen Beleuchtungselement wird der Bildschirm durchleuchtet, wobei das Beleuchtungselement derart zu dem Bildschirm angeordnet ist, dass der Bildschirm und das Beleuchtungselement einen Zwischenraum definieren, in dem das mindestens eine physische Element angeordnet ist, und
• - über eine mit dem Bildschirm gekoppelte elektronische Steuerungs- und/oder Regelungseinheit wird:
  • • das mindestens eine digitale Element derart über den Bildschirm wiedergegeben, dass für den Benutzer ein räumlicher Eindruck entsteht,
  • • eine Wechselwirkung zwischen dem mindestens einen physischen Element und dem mindestens einen digitalen Element basierend auf dem Ort des digitalen Elements und dem physischen Element simuliert, und
  • • der Ort des digitalen Elementes in Abhängigkeit von der simulierten Wechselwirkung angepasst.

In addition to the device, the stated object is achieved by a corresponding method for the joint representation of at least one physical element with at least one digital element for a user, which method has the following features:

• - a spatial image impression of the at least one digital element is generated via an at least partially translucent screen,
• - the screen is illuminated with a planar lighting element, wherein the lighting element is arranged relative to the screen in such a way that the screen and the lighting element define a space in which the at least one physical element is arranged, and
• - via an electronic control and/or regulation unit coupled to the screen:
  • • the at least one digital element is displayed on the screen in such a way that a spatial impression is created for the user,
  • • simulates an interaction between the at least one physical element and the at least one digital element based on the location of the digital element and the physical element, and
  • • the location of the digital element is adjusted depending on the simulated interaction.

The advantages, adaptations, and embodiments mentioned for the device apply analogously to the method. If necessary, the control and/or regulation unit can adjust the light transmittance of the screen to a desired level to provide a view of the at least one physical element.

• - einem Bildschirm, der mindestens partiell lichtdurchlässig und zum Erzeugen eines räumlichen Bildeindrucks eingerichtet ist, und einem
• - flächigen Beleuchtungselement, das derart zu dem Bildschirm angeordnet ist, dass der Bildschirm und das Beleuchtungselement einen Zwischenraum definieren, in dem das mindestens eine physische Element angeordnet ist,

eingerichtet sein, die Verfahrensschritte des vorgeschlagenen Verfahrens auszuführen.In particular, the proposed method can also be implemented as a computer-implemented method. Accordingly, a computer coupled to:

• - a screen which is at least partially transparent and designed to produce a three-dimensional image impression, and a
• - planar lighting element arranged relative to the screen such that the screen and the lighting element define a space in which the at least one physical element is arranged,

be equipped to carry out the procedural steps of the proposed procedure.

The problem can also be solved by any set of machine-readable instructions which, when executed by a suitably configured computing unit, causes the computing unit to perform the proposed method. Thus, the invention encompasses a computer program product for an electronic control and/or regulation unit of the proposed device, wherein the computer program product contains instructions which, upon execution of the instructions, cause at least one processor of the electronic control and/or regulation unit to perform the proposed method (according to claim 3).

• • einen mindestens partiell lichtdurchlässigen Bildschirm zur Erzeugung eines räumlichen Bildeindrucks aus mindestens einem digitalen Element,
• • ein flächiges Beleuchtungselement zum Durchleuchten des Bildschirmes, wobei das Beleuchtungselement derart zu dem Bildschirm angeordnet ist, dass der Bildschirm und das Beleuchtungselement einen Zwischenraum definieren, und
• • eine mit dem Bildschirm gekoppelte elektronische Regelungs- und/oder Steuerungseinheit, die eingerichtet ist:
  • • mindestens ein digitales Element derart über den Bildschirm wiederzugeben, dass für den Benutzer ein räumlicher Eindruck entsteht,
  • • eine Wechselwirkung zwischen einem physischen innerhalb des Zwischenraumes angeordneten weiteren Element und dem digitalen Element basierend auf dem Ort des digitalen Elements und dem physischen Element zu simulieren, und
  • • den Ort des digitalen Elementes in Abhängigkeit von der simulierten Wechselwirkung anzupassen, wobei
  • • zur Herstellung der Vorrichtung digitale Abbildungen einer Mehrzahl von in dem Zwischenraum angeordneten Elementen bereitgestellt werden,
  • • mindestens eine der digitalen Abbildungen als Abbildung eines physischen Elementes identifiziert wird,
  • • in Reaktion auf die Identifizierung über die digitale Abbildung des physischen Elementes eine physische Form des physischen Elementes hergestellt wird, und
  • • die physische Form entsprechend dem digitalen Model innerhalb des Zwischenraumes angeordnet wird.

The invention also includes a method for producing a device for jointly displaying at least one physical element with at least one digital element for a user. A device precursor is initially provided, which has the following features:

• • an at least partially translucent screen for generating a spatial image impression from at least one digital element,
• • a planar lighting element for illuminating the screen, wherein the lighting element is arranged relative to the screen such that the screen and the lighting element define a space, and
• • an electronic control and/or control unit coupled to the screen, which is set up:
  • • to display at least one digital element on the screen in such a way that a spatial impression is created for the user,
  • • to simulate an interaction between a physical element located within the gap and the digital element based on the location of the digital element and the physical element, and
  • • adjust the location of the digital element depending on the simulated interaction, whereby
  • • to produce the device, digital images of a plurality of elements arranged in the intermediate space are provided,
  • • at least one of the digital images is identified as an image of a physical element,
  • • in response to the identification, a physical form of the physical element is produced via the digital image of the physical element, and
  • • the physical form is arranged within the space according to the digital model.

This allows for a high degree of customization of the manufactured fixture, starting from a general fixture pre-stage with minimal manufacturing effort. This can facilitate adaptation to specific customer requirements. and/or reduce manufacturing costs for small series.

• - Alle nicht beweglichen Elemente werden als physische Elemente identifiziert.
• - Herstellung der physischen Elemente durch ein Computergesteuertes Fertigungsverfahren.
• - Das Fertigungsverfahren ist ein additives Verfahren.
• - Das additive Verfahren ist ein 3D-Druck Verfahren.
• - Bildschirm und Beleuchtungselement sind parallel angeordnet.

In addition to the general solutions mentioned above, numerous design variants are conceivable and possible, through which the invention can be advantageously further developed and adapted to specific application scenarios, for example:

• - All non-movable elements are identified as physical elements.
• - Production of the physical elements through a computer-controlled manufacturing process.
• - The manufacturing process is an additive process.
• - The additive process is a 3D printing process.
• - Screen and lighting element are arranged parallel.

Some design variants are explained in more detail below.

The interaction between digital and physical elements occurs only visually. According to one embodiment, all physical elements have a digital counterpart in the digital simulation. In 2 The real playing field and its digital representation are displayed. However, only those elements that are not physically present are visible on the screen. In the case of a pinball machine, for example, this creates the impression for the user that the digitally simulated ball is colliding with the real elements, even though these interactions actually take place between the digital ball and the digital representation of the playing field.

Real elements cannot normally visually overlay digital elements because the digital elements are displayed on top of the real elements on the screen, even if they appear behind them due to the stereoscopic display. Therefore, according to another embodiment with selectively controllable translucency of the screen, digital placeholders can be incorporated into the digital image using the same digital image that is used to simulate mechanical interactions. These placeholders appear completely white on the image sent from the computer to the screen, but are displayed as transparent due to the functionality of a transparent LCD glass layer. If a virtual object in the computer simulation comes behind such a real object placeholder, this digital object is obscured by the white placeholder in the image and ultimately appears to disappear behind the real object below the screen. For this to happen, the screen in the device must be located between the physical elements and the viewer.

For example, the spatial impression of the reproduced at least one digital element can be created using a parallax barrier. The viewer is given the impression of spatial depth simply by using a parallax barrier with two views. This allows a spatial impression to be realized cost-effectively.

In a supplementary embodiment, the device can have a tracking system for detecting the user's eye position. To reduce dependence on a predetermined viewing position, the two views can then be continuously adjusted to the user's eye positions detected by a tracking system to ensure a perspectively correct display from any viewing angle.

For example, the tracking system can be designed with a stereo camera. 3 illustrates the process of position detection for a single eye A. The process is identical for both eyes. The images from two camera sensors (K1 and K2) are first rectified taking into account the optical properties of the camera lens. A machine learning model recognizes an observer's eye in both images and determines its coordinates (X1 and X2), measured in pixels relative to the lower left corner of the images. From these pixel coordinates, three-dimensional direction vectors (V1 and V2) are then calculated, taking into account the focal length of the lens, the size of the camera sensor, and the resolution of the camera image. These three-dimensional direction vectors point from the camera sensors (K1 and K2) in the direction of the desired eye position A. Ideally, two straight lines with direction vectors V1 and V2 through points K1 and K2 (distance S) in a common coordinate system would intersect at point A. In practice, this intersection point does not exist due to numerous minor inaccuracies. Therefore, the point where the straight lines are closest is chosen as point A instead. This process is repeated several times per second for each eye, depending on the system's performance. To ensure approximately accurate eye positions at all times, the previously measured positions can be processed through a filter (e.g., a Kalman filter) before use.

Alternatively or additionally, it is also possible to display more than two views, whereby an optical device ensures that that each view is only visible from an approximately suitable angle.

4 shows an embodiment of a device with tracking system and parallax barrier or the structure of the screen technology used.

At its core, the device consists of a total of three LCD glass layers and an illuminated space in between, in which physical elements are located. The bottommost LCD glass layer forms the back wall of the space and displays a two-dimensional background graphic. At the same time, it provides a white background mask for the content on the main display where necessary. The main display shows all virtual elements that are intended to appear spatially in front of or behind the back wall. Unlike the rear wall display, its position also allows it to display content above the physical elements in the space. With the help of an additional display, which displays a parallax barrier at a certain distance, these elements are given a stereoscopic depth effect. The perspective on the main display and the stripe pattern on the upper display are adjusted to the eye positions detected by the tracking system.

Since the LCD glass layers act as a kind of light filter and cannot generate their own light, all of the brightness must be generated by the backlight and the illumination of the space between them. To avoid excessive power consumption and waste heat from the illumination, the device should be made as transparent as possible. Cooling devices such as cooling fins on the backlight are advantageous.

Therefore, according to a further embodiment, the middle LCD glass layer is installed in reverse, i.e. the polarization of the upper layer of the middle LCD glass layer corresponds to the polarization of the lower layer of the upper LCD glass layer. Otherwise, the upper polarizing filter of the lower layer and the lower layer of the upper layer would block each other because the lower and upper polarizing filters in an LCD are conventionally rotated 90° to each other. Light can only penetrate because its polarization is changed by the liquid crystals between the filters. If two identical LCD glass layers lie on top of each other with their upper sides, the polarizing filters between the LCD glass layers are always aligned identically and therefore transparent to light.

In addition to the backlight present in every LCD screen, it may also be necessary to illuminate the space inwards with an additional lighting element so that the elements inside are clearly visible.

The use of transparent LCDs imposes a restriction on the color design of the underlying elements, because their functionality requires a bright background. To at least partially circumvent this restriction, a further embodiment can incorporate an LCD glass layer into the back panel. This allows the background of the upper screen to be illuminated only where something is actually to be displayed at a given time. This can improve control over the appearance of the back panel. However, all physical elements above must still be kept in bright colors if something is to be displayed on the screen above.

To enable interactions such as the collision between a virtual pinball and a physical playfield element, the shapes of the physical elements must be stored in the digital simulation. This can be done either by creating a digital model of the physical elements below the screen using a 3D scan, or by creating them based on a manually created digital model.

In the current state of augmented reality technology, interaction between real and virtual elements is a one-way street. Reality can affect virtual elements, but conversely, the computer simulation cannot directly influence reality. According to another study in 5 In the embodiment shown, this limitation can be circumvented by incorporating actuators into the real environment. The computer simulation can thus allow virtual elements to influence the digital model of reality and implement the resulting changes in reality using these actuators. In the case of a pinball machine, this could create the impression that a digitally simulated ball causes a physical target in the playfield to rotate when hit.

As mentioned above, the invention can also be used beyond gaming machines. In a further embodiment, the proposed device is designed as a piece of furniture, e.g., a display case or a table. The piece of furniture includes, among other things, the screen, which, in the at least partially transparent mode, can allow a view of the interior of the piece of furniture. The piece of furniture can be configured to accommodate physical objects such as dishes or the like. The interior of the piece of furniture can also be the space between the proposed device. Accordingly, the piece of furniture can be configured to display at least one digital element for a user via the screen in such a way that the spatial impression evoked by the display interacts with physical objects located inside the piece of furniture and/or the piece of furniture itself.

It would be conceivable, for example, for the at least one digital element to serve to reproduce an object seemingly moving within the interior of the piece of furniture. For example, a deformable or rigid body could appear to move through the interior of the piece of furniture and bounce off the physical objects located inside, particularly the outer walls of the interior wall. This could serve to create a decorative impression, such as a lava lamp. Likewise, it could serve to specifically showcase objects located within the interior of the piece of furniture. Thus, for example, the proposed piece of furniture could be used to present and advertise objects.

Likewise conceivable and possible is the realization of a device for practicing manual processes. This can particularly relate to practicing a medical procedure. In this case, spatial impressions relating to a part of the human body can be generated using the digital elements. These impressions can, for example, rest on a physical surface fixedly arranged in the space between the device and interact with it. Furthermore, it is conceivable and possible for physical elements to be inserted laterally into the space and for an interaction between these movable physical elements and the digital elements to be simulated and displayed. It is also conceivable and possible for a user to insert medical instruments, such as scalpels, into the space between the proposed device in order to perform a medical procedure on the simulated part of the human body.

With regard to all of the embodiments discussed, the at least one physical element can be connected to the lighting element and/or the display. A connection is conceivable both indirectly and directly. Indirect means that two elements are not adjacent to one another but are connected via another element.

By way of example, the device can have a body on which the at least one physical element and the lighting element are arranged. Alternatively, the at least one physical element and the display can also be arranged on the body. Further alternatively, the at least one physical element and the lighting element and the display can also be arranged on the body.

Claims (5)

A device for the joint display of at least one physical element with at least one digital element for a user, comprising the following features: 1.1 a screen that is at least partially translucent and configured to generate a spatial image impression from the at least one digital element, 1.2 a planar illumination element for illuminating the screen, wherein the illumination element is arranged relative to the screen such that the screen and the illumination element define a space in which the at least one physical element is arranged, and 1.3 an electronic control and/or regulation unit coupled to the screen, which is configured to: 1.3.1 display the at least one digital element on the screen such that a spatial impression is created for the user, 1.3.2 simulate an interaction between the at least one physical element and the at least one digital element based on the location of the digital element and the physical element, and 1.3.3 adjust the location of the digital element depending on the simulated interaction. Device according to Claim 1 , in which the electronic control and/or regulation device determines the light transmittance of the screen. Method for the joint presentation of at least one physical element with at least one digital element for a user, wherein: 3.1 a spatial image impression of the at least one digital element is generated via an at least partially translucent screen, 3.2 the screen is illuminated with a planar lighting element, wherein the lighting element is arranged in relation to the screen such that the screen and the lighting element define an intermediate space in which the at least one physical element is arranged and 3.3 via an electronic control and/or regulating unit coupled to the screen: 3.3.1 the at least one digital element is displayed on the screen in such a way that a spatial impression is created for the user, 3.3.2 an interaction between the at least one physical element and the at least one digital element is simulated based on the location of the digital element and the physical element, and 3.3.3 the location of the digital element is adjusted depending on the simulated interaction. Computer program product for an electronic control and/or regulating unit of a device according to Claim 1 , wherein the computer program product contains instructions which cause at least one processor of the electronic control and/or regulating unit, upon execution of the instructions, to carry out a method according to Claim 3 to carry out. A method for producing a device for the joint display of at least one physical element with at least one digital element for a user, wherein a device precursor is provided, having the following features: 5.1 an at least partially translucent screen for generating a spatial image impression from at least one digital element, 5.2 a planar illumination element for illuminating the screen, wherein the illumination element is arranged relative to the screen such that the screen and the illumination element define a gap, and 5.3 an electronic control and/or regulation unit coupled to the screen, which is configured to: 5.3.1 display the at least one digital element on the screen such that a spatial impression is created for the user, 5.3.2 simulate an interaction between a further physical element arranged within the gap and the digital element based on the location of the digital element and the physical element, and 5.3.3 adapt the location of the digital element depending on the simulated interaction, wherein 5.3.4 digital images of a A plurality of elements arranged in the gap are provided, 5.3.5 at least one of the digital images is identified as an image of a physical element, 5.3.6 in response to the identification, a physical form of the physical element is produced via the digital image of the physical element, and 5.3.7 the physical form is arranged within the gap according to the digital model.

Images