DE10245649A1 - Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator - Google Patents
Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator Download PDFInfo
- Publication number
- DE10245649A1 DE10245649A1 DE10245649A DE10245649A DE10245649A1 DE 10245649 A1 DE10245649 A1 DE 10245649A1 DE 10245649 A DE10245649 A DE 10245649A DE 10245649 A DE10245649 A DE 10245649A DE 10245649 A1 DE10245649 A1 DE 10245649A1
- Authority
- DE
- Germany
- Prior art keywords
- component
- orientation
- augmented reality
- joined
- movements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000005516 engineering process Methods 0.000 title claims description 10
- 230000003190 augmentative effect Effects 0.000 title claims description 9
- 230000000007 visual effect Effects 0.000 claims abstract description 7
- 238000000034 method Methods 0.000 claims description 19
- 230000001404 mediated effect Effects 0.000 claims 1
- 230000001953 sensory effect Effects 0.000 abstract 1
- 238000004519 manufacturing process Methods 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 239000011521 glass Substances 0.000 description 2
- 230000013011 mating Effects 0.000 description 2
- 230000021317 sensory perception Effects 0.000 description 2
- 230000003416 augmentation Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 230000015541 sensory perception of touch Effects 0.000 description 1
- 230000003319 supportive effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B19/00—Programme-control systems
- G05B19/02—Programme-control systems electric
- G05B19/418—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM]
- G05B19/41805—Total factory control, i.e. centrally controlling a plurality of machines, e.g. direct or distributed numerical control [DNC], flexible manufacturing systems [FMS], integrated manufacturing systems [IMS] or computer integrated manufacturing [CIM] characterised by assembly
-
- G—PHYSICS
- G05—CONTROLLING; REGULATING
- G05B—CONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
- G05B2219/00—Program-control systems
- G05B2219/30—Nc systems
- G05B2219/31—From computer integrated manufacturing till monitoring
- G05B2219/31046—Aid for assembly, show display on screen next workpiece, task, position to be assembled, executed
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Manufacturing & Machinery (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Automation & Control Theory (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Abstract
Description
Die Erfindung betrifft ein System und Verfahren zur Unterstützung bei Montageaufgaben, bei denen die Fügestelle verdeckt oder nicht einsehbar ist. Dabei wird die dreidimensionale Position und Orientierung der Bauteile zueinander, vorteilhafterweise auch die Blickrichtung des Betrachters, bestimmt. Mittels der Augmented Reality (AR) Technologie wird die Realität des Werkers dann mit zusätzlichen Sinneswahrnehmungen angereichtert, um das Fügen der Bauteile zu erleichtern. Beispielsweise könnte dem Wecker mittels einer Datenbrille statt des verdeckenden Bauteils eine halbtransparente Darstellung des verdeckenden Bauteils und eine Darstellung des zu fügenden, normalerweise verdeckten Bauteils eingeblendet werden. Die unterstützenden Sinneswahrnehmungen können den optischen Sinn, aber auch andere Sinne, wie den taktilen Sinn, oder eine Kombination verschiedener Sinneswahrnehmungen betreffen. So könnte der Wecker durch unterschiedliche Vibrationssignale eines Fügewerkzeug zur korrekten Fügestelle geleitet werden.The invention relates to a system and support procedures for assembly tasks where the joint is covered or not is visible. The three-dimensional position and orientation the components to each other, advantageously also the direction of view of the viewer. Using augmented reality (AR) technology becomes reality of the worker with additional Sensory perceptions enriched to facilitate the joining of the components. For example, the Alarm clock using data glasses instead of the concealing component a semi-transparent representation of the concealing component and a representation of the to be joined normally hidden component. The supportive Sensory perceptions can the optical sense, but also other senses, such as the tactile sense, or a combination of different senses. So could the alarm clock by different vibration signals of a joining tool to the correct joint be directed.
Stand der TechnikState of the art
Aus dem Stand der Technik sind sogenannte Augmented Reality Systeme bekannt. Diese erlauben die Überlagerung von Seheindrücken der realen Umgebung mit computergenerierten, virtuellen Informationen. Hierzu werden die Seheindrücke der realen Welt, vorzugsweise mit auf dem Kopf getragenen halbdurchlässigen Datenbrillen, mit virtuellen Informationen gemischt. Die Einblendung der virtuellen Informationen kann dabei kontextabhängig, d.h. angepasst und abgeleitet von der jeweilig betrachteten realen Umgebung ausgeführt sein. Als Informationen können grundsätzlich jede Art von Daten wie Texte, Abbildungen etc. verwendet werden. Ebenso wie die visuelle Informationsanreicherung, sind auch akustische und taktile Informationsanreicherungen möglich.So-called augmented are from the prior art Reality systems known. These allow the superimposition of visual impressions of the real environment with computer-generated, virtual information. For this, the visual impressions the real world, preferably with semi-transparent data glasses worn on the head, mixed with virtual information. The display of the virtual information can be context-dependent, i.e. adapted and derived from the respectively considered real Environment his. As information can in principle any kind of data such as text, images etc. can be used. Just like visual information enrichment, there are also acoustic ones and tactile information enrichment possible.
Dokumentierte Anwendungen der Technologie sehen einen Einsatz in der Produktion, im Service und in der Entwicklung komplexer Produkte vor. Auch ist der Einsatz der Technologie in der Produktion von Flugzeugen bekannt. Nach der Documented applications of the technology see a use in production, service and development complex products. The use of technology is also in the production of aircraft known. After
Druckschrift
Bekannte Anwendungen der Augmented Reality für den Bereich der Montage sehen die Anzeige eines Soll-Fügevorgangs oder einer Soll-Fügeposition vor. Machteilig an den bekannten Verfahren ist, dass Ist-Position und Ist-Orientierung des zu verbauenden Teils dem AR-System nicht bekannt sind. Es können Arbeitsschritte und die gewünschte Endposition des zu verbauenden Teils angezeigt werden, der Werken muss jedoch die wahre Position und Orientierung des zu verbauenden Teils selbst abschätzen. Die schwierige Abschätzung der Position und Orientierung des Teils erhöht den zeitlichen Montageaufwand. Bei empfindlichen Oberflächen, kann es zu Beschädigungen durch falsches Ansetzen kommen.Known applications of augmented Reality for the assembly area will see the display of a target joining process or a target joining position in front. Part of the known procedure is that the actual position and the actual orientation of the part to be installed does not match the AR system are known. It can Work steps and the desired one End position of the part to be installed are displayed, the factories however, the true position and orientation of the to be installed Partly estimate yourself. The difficult assessment the position and orientation of the part increases the time required for assembly. With sensitive surfaces, can cause damage come from wrong starting.
Der Erfindung liegt somit die Aufgabe zu Grunde dem Wecker Informationen über die Position und/oder Orientierung des zu fügenden Bauteils relativ zur Fügestelle zur Verfügung zu stellen.The invention is therefore the object based on the alarm clock information about the position and / or orientation of the to be added Component relative to the joint to disposal to deliver.
Beschreibung Endungdescription ending
Die zuvor hergeleitete und aus dem Stand der Technik hervorgehende Aufgabe wird erfindungsgemäß durch ein Verfahren gelöst, das dem Wecker eine virtuelle Repräsentation des zu fügenden, nicht sichtbaren Bauteils anzeigt und/oder Informationen über die relative Position und/oder Orientierung des Bauteils mittels akkustischer und/oder taktiler Signale anzeigt. Hierzu werden erfindungsgemäß Augmented Reality Technologien eingesetzt.The previously derived and from the State of the art object is achieved by the invention solved a procedure that gives the alarm clock a virtual representation of what component that is not visible and / or information about the relative position and / or orientation of the component by means of acoustic and / or displays tactile signals. For this purpose, augmentation is carried out according to the invention Reality technologies used.
Das Rechnersystem kann dem Werken
[
Bei einem weiteren, vorteilhaften
Systemaufbau errechnet das Rechnersystem [
- 100100
- Fügestellejoint
- 200200
- zu fügendes Bauteilto mating component
- 300300
- Manipulator für zu fügendes Bauteil, vorteilhafterweisemanipulator for too mating Component, advantageously
- Fügewerkzeugjoining tool
- 310310
- Aktor zur Erzeugung taktiler Informationen, vorteilhafterweise inactuator for generating tactile information, advantageously in
- Manipulator intergriertmanipulator intergriert
- 400400
- verdeckendes Bauteil (Position und Orientierung bekannt)concealing Component (position and orientation known)
- 500500
- Werkerimprovement
- 600600
- virtuelle Arbeitsanweisung orientiert an Fügestellevirtual Work instructions based on the joint
- 610610
- virtuelle Anzeige der Position des zu fügenden Bauteilsvirtual Display the position of the to be joined component
- 700700
- Anzeigegerät, vorteilhafterweise Head Mounted DisplayDisplay device, advantageously Head mounted display
- 800800
- Sensorik für die Blickrichtung und Position des Betrachterssensors for the Direction and position of the viewer
- 810810
- Sensorik für die Position und Orientierung des Fügewerkzeugssensors for the Position and orientation of the joining tool
- 820820
- Kamera, vorteilhafterweise mit integriertenCamera, advantageously with integrated
- BildverarbeitungsfunktionenImage processing functions
- 900900
- Rechnersystemcomputer system
- 10001000
- Lautsprecherspeaker
Claims (14)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE10245649A DE10245649A1 (en) | 2002-09-30 | 2002-09-30 | Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| DE10245649A DE10245649A1 (en) | 2002-09-30 | 2002-09-30 | Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| DE10245649A1 true DE10245649A1 (en) | 2004-04-08 |
Family
ID=31984299
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| DE10245649A Ceased DE10245649A1 (en) | 2002-09-30 | 2002-09-30 | Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator |
Country Status (1)
| Country | Link |
|---|---|
| DE (1) | DE10245649A1 (en) |
Cited By (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AT502977B1 (en) * | 2004-07-13 | 2008-10-15 | Ams Engineering Sticht Ges M B | DEVICE AND METHOD FOR HANDLING SAMPLE CONTAINERS IN A LABORATORY |
| ES2525104A1 (en) * | 2013-06-17 | 2014-12-17 | Proyectos, Ingeniería Y Gestión, Sociedad Anónima (P.R.O.I.N.G.E., S.A.) | System of supervision and help of manual operations of industrial assembly using augmented reality and procedure of use (Machine-translation by Google Translate, not legally binding) |
| FR3017736A1 (en) * | 2014-02-14 | 2015-08-21 | Dassault Aviat | METHOD FOR MAKING A PLUG OF INSTRUCTIONS FOR MOUNTING AND / OR USING A FUNCTIONAL ASSEMBLY OF A PLATFORM, AND SYSTEM THEREFOR |
| DE102015205357A1 (en) * | 2015-03-24 | 2016-10-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | System and method for the interactive reconstruction of artifacts and other disassembled objects |
| DE102017130913A1 (en) * | 2017-12-21 | 2019-06-27 | Rehau Ag + Co | Method for constructing a pipe system while creating at least one pipe connection |
| DE102008060832B4 (en) * | 2008-12-05 | 2021-01-28 | Volkswagen Ag | Method for manufacturing a motor vehicle or a motor vehicle component |
-
2002
- 2002-09-30 DE DE10245649A patent/DE10245649A1/en not_active Ceased
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| AT502977B1 (en) * | 2004-07-13 | 2008-10-15 | Ams Engineering Sticht Ges M B | DEVICE AND METHOD FOR HANDLING SAMPLE CONTAINERS IN A LABORATORY |
| DE102008060832B4 (en) * | 2008-12-05 | 2021-01-28 | Volkswagen Ag | Method for manufacturing a motor vehicle or a motor vehicle component |
| ES2525104A1 (en) * | 2013-06-17 | 2014-12-17 | Proyectos, Ingeniería Y Gestión, Sociedad Anónima (P.R.O.I.N.G.E., S.A.) | System of supervision and help of manual operations of industrial assembly using augmented reality and procedure of use (Machine-translation by Google Translate, not legally binding) |
| FR3017736A1 (en) * | 2014-02-14 | 2015-08-21 | Dassault Aviat | METHOD FOR MAKING A PLUG OF INSTRUCTIONS FOR MOUNTING AND / OR USING A FUNCTIONAL ASSEMBLY OF A PLATFORM, AND SYSTEM THEREFOR |
| DE102015205357A1 (en) * | 2015-03-24 | 2016-10-13 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | System and method for the interactive reconstruction of artifacts and other disassembled objects |
| DE102015205357A8 (en) * | 2015-03-24 | 2017-01-12 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | System and method for the interactive reconstruction of artifacts and other disassembled objects |
| DE102017130913A1 (en) * | 2017-12-21 | 2019-06-27 | Rehau Ag + Co | Method for constructing a pipe system while creating at least one pipe connection |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Petzold et al. | A study on visual, auditory, and haptic feedback for assembly tasks | |
| Dalle Mura et al. | An integrated environment based on augmented reality and sensing device for manual assembly workstations | |
| DE102004016331B4 (en) | Apparatus and method for concurrently displaying virtual and real environmental information | |
| DE102014006732B4 (en) | Image overlay of virtual objects in a camera image | |
| WO2002050649A2 (en) | User-controlled link of information within an augmented reality system | |
| EP3458939A1 (en) | Interaction system and method | |
| KR100936090B1 (en) | The semi-immersive multi computerized numuerical control machine tools simulation system | |
| JP6736298B2 (en) | Information processing apparatus, information processing method, and program | |
| EP1701233B1 (en) | Generation of virtual worlds based on a real environment | |
| DE102014111386A1 (en) | Method for operating a ride, in particular a roller coaster | |
| DE102017215163A1 (en) | System of a motor vehicle and an augmented reality goggles and method for determining a pose of augmented reality goggles in the interior of a vehicle | |
| DE10245649A1 (en) | Support system for assembly of conceal parts using augmented reality technology to indicate orientation or position of component with acoustic and/or tactile output to operator | |
| EP4005894A1 (en) | Method for depicting a virtual element | |
| KR20190116601A (en) | Training system of a surgical operation using authoring tool based on augmented reality | |
| Eguchi et al. | Between-tactor display using dynamic tactile stimuli for directional cueing in vibrating environments | |
| DE102004021379B4 (en) | Operating and monitoring system for industrial plants and processes | |
| EP1262213A1 (en) | Method of locating an object, a person and/or a part of it | |
| DE102015100943A1 (en) | Method for operating a device, in particular a ride, a means of transport, a fitness device or the like | |
| DE102014010309B4 (en) | View additional content in a virtual scenery | |
| EP3820726B1 (en) | Optical flow for motion sickness reduction | |
| Moczulski et al. | Applications of augmented reality in machinery design, maintenance and diagnostics | |
| DE102005045973A1 (en) | Device for camera-based tracking has processing arrangement for determining movement information for evaluating images, whereby information characterizes object position change within time interval | |
| JP2020201634A (en) | Video processing method, video processing device, video processing program, and recording medium storing video processing program | |
| Ito et al. | Development of a powered wheelchair driving simulator for research and development use | |
| DE10240392A1 (en) | A system for determining relative spacing of virtual and real objects e.g. for planning of buildings and manufacturing equipment, requires involving an augmented reality system for environmental real object position |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| OP8 | Request for examination as to paragraph 44 patent law | ||
| 8122 | Nonbinding interest in granting licences declared | ||
| 8127 | New person/name/address of the applicant |
Owner name: AUGMENTED SOLUTIONS GMBH, 85748 GARCHING, DE |
|
| 8181 | Inventor (new situation) |
Inventor name: MEIER, PETER GEORG, 80799 MUENCHEN, DE |
|
| 8131 | Rejection |