DE102004046144A1 - Augmented reality system used for planning a production plant layout has camera system to enter units into a central controller where they are combined and then stored in data base - Google Patents

Abstract

An augmented reality system is used for planning of a production environment (1) and this uses a camera system (10) to enter units into a central controller (2) where they are combined and then installed in a data base (8). The objects (20) are represented as 3D elements that can be manipulated and organised for output to a display (4).

Description

The The invention relates to a system, in particular an augmented reality System for planning a production environment, in the preamble of the Claim 1 features and a method for planning a Production environment with the features mentioned in the preamble of claim 7.

From the DE 101 28 015 A1 A method and system for planning a changed production environment, in particular a manufacturing environment for vehicle components, is known. The system is an augmented reality system that can superimpose planning results, such as planned plants or robots, on a real environment. For this purpose, the system has a head-mounted display, which can be worn in use by a user who can perform with the system a collision analysis of planned production facilities with a real environment, such as a production room.

This System has the disadvantage that such a system for planning Manufacturing equipment used in the real manufacturing environment got to. Required mobile computers are correspondingly underachieving and cause limitations for example, in the resolution or ergonomics of a visualization system, for example a monitor or a head-mounted display. The user must be in front Be and take place the visualization device as well as the mobile computer with you.

Of the Invention is therefore the object of a system for planning specify a production environment, which provides easier control positioning of planned production facilities in a room or allows a collision analysis.

These The object is achieved by a system of the type mentioned, wherein the system one with the overlay unit having operatively connected determination unit, which is designed for Perspective overlay of the object record from the image record a detection direction and position to determine from which by the image record represented Figure has been captured.

Thereby Advantageously, a planning of a production plant with a stationary planning system allows. The capture of a two-dimensional image of a room, for example a factory floor, can be beneficial with a camera, for example a CCD camera (CCD = Charge Coupled Device), done. A record, which represents a two-dimensional map has a plurality of pixels, each pixel for example a Brightness value or in addition represents a color value.

In a preferred embodiment the system has a determination unit, which is formed is, the detection direction and position based on in the figure To determine the spatial geometries shown.

In this embodiment are, for example, dimensions of a space to be detected predetermined. In this embodiment For example, the determination unit can be advantageously designed be, the detection direction and position using one in the figure to determine the angle of inclination of spatial geometries.

Prefers the determination unit is formed, as shown in the figure To capture spatial geometries and the detection direction and position, from the the through the image record represented Figure has been recorded, based on at least one of in the Figure space geometry to determine. This can be the Determining unit have a space geometry detection unit, which is formed, spatial geometries, such as edges of a Room, through a contrast detection and subsequent education of spline curves or Bezier curves. This needs advantageously no marking for calibrating the determination unit be installed in the room.

Independent of the above-described embodiment with a detection of spatial geometries, is in a preferred embodiment the determination unit is formed, one included in the figure to detect predetermined mark and the detection direction and position depending on to determine the mark.

Thereby can be advantageous in known dimensions of the mark Distance value from a detection device, preferably one for Capture trained camera, to be designated for marking.

Further Preferably, the determination unit is formed, a mark to capture with a predetermined geometric pattern. This can advantageously at least one detection angle of the camera and the mark extending axis and one to an example Plan marker parallel plane to be determined.

To For example, the determination unit can be designed, one perspective distortion of a predetermined geometric pattern capture.

One For example, the system of the type described above can be used with the camera be operatively connected, the camera is formed by a Object emitted or reflected electromagnetic radiation to capture, and the camera is further formed, the one picture representing two-dimensional Create image record.

A such camera is for example a CCD camera. In an advantageous variant the camera is a 3D camera, for example a radiation pulse transit time camera or a stereoscopic camera. The 3D camera is trained, a an illustration representing two-dimensional data set with a variety of pixels too generate, each pixel represents a distance value. A radiation pulse transit time camera has a transmitter for electromagnetic Radiation, in particular at least one electromagnetic radiation pulse, and a plurality of receiver elements having a recipient for electromagnetic Radiation, each receiver element represents a pixel of an image. The radiation pulse transit time camera is trained for each receiver element a distance from the camera to the object based on a pulse duration to detect the electromagnetic transmission pulse. Because of the engagement For a 3D camera, the number of markings to be attached may be advantageous be reduced.

• – Erzeugen eines Objekt-Datensatzes, welcher ein zu planendes, insbesondere dreidimensionales Objekt repräsentiert,
• – Überlagern des Objekt-Datensatzes mit einem Bild-Datensatz in einer räumlichen Darstellung, wobei der Bild-Datensatz eine zweidimensionale Abbildung, insbesondere eine zweidimensionalen Abbildung eines Raumes repräsentiert,
• – Ermitteln einer Erfassungsrichtung und -position aus dem Bild-Datensatz, aus welcher die durch den Bild-Datensatz repräsentierte Abbildung erfasst worden ist, zum perspektivischen Überlagern des Objektes.

The invention also relates to a method for planning a production environment, in particular a production environment for automobile parts or for automobiles, which comprises the following method steps:

• Generating an object data record which represents an object to be planned, in particular a three-dimensional object,
• Superposition of the object data record with a picture data record in a spatial representation, wherein the picture data record represents a two-dimensional picture, in particular a two-dimensional picture of a room,
• - Determining a detection direction and position from the image data set, from which the image represented by the image data record has been detected, for perspective superimposition of the object.

Thereby can the object to be planned advantageously in perspective correctly the illustration of a room.

• – Sichtbares Darstellen des Objektes, beispielsweise durch eine Bildwiedergabeeinheit, insbesondere durch einen Monitor, ein TFT-Display oder einen Bildprojektor.

Preferably, the method comprises the step:

• - Visible presentation of the object, for example by an image display unit, in particular by a monitor, a TFT display or an image projector.

• – Ermitteln der Erfassungsrichtung und -position anhand von in der Abbildung enthaltenen Raumgeometrien.

More preferably, the method comprises the following method step:

• - Determining the detection direction and position based on the room geometries shown in the figure.

Thereby can advantageously a detection direction and position based on a Figure to be determined, which contains no mark.

• – Erfassen einer in der Abbildung enthaltenen vorbestimmten Markierung,
• – Ermitteln der Erfassungsrichtung und -position in Abhängigkeit der erfassten Markierung.

Regardless of determining a detection direction and position based on spatial geometries shown in the figure, a method may comprise the following method steps:

• Detecting a predetermined mark included in the figure,
• - Determining the detection direction and position depending on the detected marking.

• – Erfassen einer Markierung, welche ein vorbestimmtes geometrisches Muster repräsentiert.

Preferably, a method of the type described above has the following method step:

• - detecting a mark representing a predetermined geometric pattern.

• – Erfassen einer perspektivischen Verzeichnung eines vorbestimmten geometrischen Musters.

Further advantageously, a method can include the step:

• - Detecting a perspective distortion of a predetermined geometric pattern.

The Invention will now be described below with reference to embodiments and a FIGURE, which is an embodiment a system designed as an augmented reality system for planning a production environment shows, explained in more detail.

The system 1 has a central control unit 2 , an image display unit 4 , a user interface 6 , a storage unit 8th , a camera 10 , an entrance 12 for a camera signal from the camera 10 , an overlay unit 14 and a determination unit 16 on.

The overlay unit 14 and the discovery unit 16 can each be in the central control unit 2 be included. The central control unit 2 may have a control program which the overlay unit 14 and the discovery unit 16 forms.

The camera 10 is configured to detect reflected electromagnetic radiation emitted by a space and to generate a two-dimensional image data record representing an image of the object and on the output side output a camera signal corresponding to the image data set. The camera 10 is on the output side via a connecting line 32 with an entrance 12 of the system 1 connected for the camera signal.

The determination unit 16 is on the input side via a connecting line 30 with the entrance 12 connected for the camera signal. This is possible, the pictures of the camera 10 either directly or not directly into the system to load. If the images are not directly loaded, they can first be stored on a storage unit or database. For this purpose, for example, the memory unit 8th serve.

The determination unit 16 is configured to receive on the input side the camera signal corresponding to the image data set and to determine from the image data set a detection direction and position from which the image represented by the image data record has been detected. This is the determination unit 16 formed, one shown in the figure, and thus at least partially represented by the image data set, predetermined mark 34 to detect which contains a predetermined geometric pattern.

1a shows the mark 34 which has a geometric pattern, in this embodiment, a cross. The cross is designed to at least partially absorb electromagnetic radiation having a predetermined wavelength range, whereas a background of the mark 34 is formed to at least partially reflect the electromagnetic radiation having a predetermined wavelength range.

The central control unit 2 can be formed, an object record 20 which represents a three-dimensional object to be positioned. The central control unit 2 is over a data bus 18 with the storage unit 8th connected. The central control unit 2 can the generated object record 20 over the data bus 18 in the storage unit 8th save. Shown in the memory unit 8th stored object records 20 , The central control unit 2 can one, for example from the control unit 2 generated and stored object record 20 from the storage unit 8th over the data bus 18 read out and over a connecting line 28 to the overlay unit 14 send.

The overlay unit 14 is on the input side via the connecting line 28 and the data bus 18 with the storage unit 8th and over the connection line 26 with the investigative unit 16 connected.

The overlay unit 14 can one over the connecting line 28 received object record with a via the connection line 26 superimpose a received image data set to a perspective two-dimensional representation and generate an image signal representing the perspective two-dimensional representation. The overlay unit 14 is on the output side via a connecting line 24 with the image display unit 4 connected and formed, the image signal to the image display unit 4 to send.

The image playback unit 4 has an input for the image signal and can visually represent the represented by the image signal two-dimensional perspective view, for example, the representation of an image of a room. The two-dimensional perspective view may be overlaid with an image of an object.

The central control unit 2 is on the input side via a connecting line 22 with a user interface 6 connected.

The user interface 6 may generate a user interaction signal depending on user interaction. Exemplary Embodiments for a User Interface 6 are a keyboard or touch-sensitive surface configured to generate a user interaction signal corresponding to a touch location of the touch-sensitive surface in response to a touch. Other exemplary embodiments for a user interface unit 6 are a voice input unit or a joystick.

The central control unit 2 is formed, the object data set in dependence on one over the connecting line 22 received user interaction signal or in response to a user interaction signal in the memory unit 8th stored object record 20 read. The overlay unit 14 may be configured, the superimposition of the object data set with the image data set in dependence on a via the connecting line 22 to receive the received user interaction signal.

The central control unit 2 is also via a connection line 38 with the camera 10 connected. About this connection line 38 can the camera 10 to be controlled. For example, a configuration of the camera 10 be set and / or this is via the connection line 38 triggered.

In this embodiment, by the image display unit 4 an illustration of a rough visibly represented, which a space geometry with the space geometry edges 36x . 36y and 36z having. A wall of the room lies in one through the space geometry edges 36z and 36x spanned level. There is a mark on the wall 34 appropriate. The detection direction and position from which the camera 10 an illustration of the rough measure has been detected by the investigator 16 has been determined, wherein the determination unit 16 the mark 34 has recorded.

1

system

2

central control unit

4

Image reproduction unit

6

User interface

8th

storage unit

10

camera

12

entrance for a camera signal

14

Overlay unit

16

determining unit

18

Data bus

20

Records, respectively representing an object

22

connecting line

24

connecting line

26

connecting line

28

connecting line

30

connecting line

32

connecting line

34

mark

36x

Chamber geometry edge

36y

Chamber geometry edge

36z

Chamber geometry edge

38

connecting line

Claims (10)

System ( 1 ), in particular an augmented reality system for planning a production environment, wherein the system ( 1 ) an image display unit ( 4 ) with an input for an image signal, and the system ( 1 ) one with the image display unit ( 4 ) Actively connected superposition unit ( 14 ), which is formed, an object data set ( 20 ), which is a to be positioned, in particular three-dimensional object ( 20 ), with a two-dimensional image, in particular a two-dimensional image of a space, representing a superimposed image data set to a perspective two-dimensional representation, and to generate a perspective image representing the two-dimensional image signal and this to the image display unit ( 4 ), characterized in that the system ( 1 ) one with the overlay unit ( 14 ) Operational Investigation Unit ( 16 ), which is designed for perspective superimposition of the object data set ( 20 ) from the image data set to determine a detection direction and position from which the image represented by the image data record has been detected. System according to claim 1, characterized in that the determination unit ( 16 ) is formed, at least one space geometry shown in the figure ( 36x . 36 , y, 36z ) and the detection direction and position from which the image represented by the image data record has been acquired, on the basis of at least one of the spatial geometries shown in FIG. 36x . 36 , y, 36z ) to investigate. System according to claim 1 or 2, characterized in that the determination unit ( 16 ) is formed, a predetermined marking shown in the figure ( 34 ) and the detection direction and position as a function of the marking ( 34 ) to investigate. System according to claim 3, characterized in that the determination unit ( 16 ), a marking ( 34 ), which has a predetermined geometric pattern. System according to one of the preceding claims, characterized in that the system with a camera ( 10 ), which is designed to detect electromagnetic radiation emitted or reflected by an object, in particular a room, and to generate the two-dimensional image data record representing an image of the object. System according to claim 5, characterized in that the camera ( 10 ) is a 3D camera, in particular a radiation pulse transit time camera, which is designed to detect electromagnetic radiation emitted by an object, in particular a space, and to generate a two-dimensional data record with a multiplicity of pixels representing an image of the object, each one Pixel represents a distance value. Method for planning a production environment, comprising the method steps: - generating a to-be-planned, in particular three-dimensional object data record ( 20 ), - overlay the object data set ( 20 ) with a two-dimensional image, in particular a two-dimensional image of a space representing image record in a spatial representation, characterized by the method steps: - Determining a detection direction and position from the image data set from which represented by the image data set Figure has been captured, for perspective overlaying the to pla nenden object. The method of claim 7, comprising the following Step: - Determine the detection direction and position based on in the figure contained spatial geometries. Method according to Claim 7 or 8, comprising the following method steps: detecting a predetermined marking (shown in the figure) ( 34 ), - determining the detection direction and position in dependence on the detected marking ( 34 ). Method according to one of claims 7 to 9, comprising the following method step: - detecting a marking ( 34 ) representing a predetermined geometric pattern.