GB2478738A

GB2478738A - Eye level display in communication with electronic device

Info

Publication number: GB2478738A
Application number: GB1004332A
Authority: GB
Inventors: Christopher Davies
Original assignee: Belron Hungary Kft Zug Branch
Current assignee: Belron Hungary Kft Zug Branch
Priority date: 2010-03-16
Filing date: 2010-03-16
Publication date: 2011-09-21
Also published as: AR080523A1; TW201205517A; GB201004332D0; WO2011114149A1

Abstract

A system suitable for job related instructional purposes comprising an electronic device 2 and an eye level user mounted display 6 in communication with the electronic device. The electronic device is for storing information, and it includes a (further) display screen 9 and input means. The electronic device may be portable and carried or worn by the user. Visual content may be displayed on both screens. The eye level display 6 may be mounted to eyewear 3 (such as glasses or goggles) which is part of a head mounted unit 1. The system may include voice input means such as a microphone, and audio output means such as an earpiece or headphones. Work related or instructional audio/video content may be downloaded to the system from a remote server. This system may be particularly useful in the field of glazing panel repair or replacement.

Description

Augmented Reality System The present invention relates to an augmented reality system and particularly but not exclusively to an augmented reality glazing panel replacement technique and system which can be used for training or real jobs.

There is benefit in improving repair and maintenance procedures in the automotive arena, for example in vehicle glazing panel replacement. Best practice standardisation of techniques and tips specific to different vehicle models can be usefully passed on to operatives in a convenient manner by means of instruction.

Augmented reality systems have been proposed for providing instruction to a user, for example for repair or maintenance purposes. Such a system is disclosed in, for example An improved arrangement has now been devised.

According to a first aspect, the present invention provides an augmented reality system for job related instructional purposes, particularly for glazing panel repair or replacement, the system comprising: a portable electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.

It is preferred that the electronic device is a portable electronic device arranged to be user-borne (i.e. carried or worn by the user).

The invention requires the provision of two visual display screens, a first one on the portable electronic device and a second one on the eye level user mounted display device.

An advantage of this arrangement is realised in the flexibility of the system. For example if an operative is not familiar with glazing panel replacement for a particular manufacturer or model of vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed. This can be done prior to commencing the job by interacting and viewing the instructional material on the screen of the portable electronic device, and additionally or alternatively whilst actually performing the job by viewing on the eye level user mounted display.

This facility for the instructional visual content to be displayed on the display of the portable electronic device and separately on the eye level mounted display enhances the versatility of use of the system. The user may watch a complete and thorough demonstration on the display of the portable electronic device and importantly re-run key portions of the instruction at key points during the actual procedure whilst viewing the eye level mounted display with hands free to undertake the job.

It is therefore preferred that the electronic device stores visual (preferably video) content which is arranged to be displayed on the electronic device display screen and by the eye level mounted display device.

An additional benefit is that the interaction concerning the job issues other that watching instructional content, can be undertaken whilst viewing the display screen of the device rather that it being necessary to view via the eye level display.

Beneficially, the eye level user mounted display device is head mounted and may be mounted to eyewear such as glasses, goggles or a visor.

It is preferred that the eye level user mounted display device is mounted to be viewed by oneeyeonly.

Beneficially, the system further comprises voice input means to enable user interaction to control operation of the electronic device. The voice input means may comprise a microphone worn by the user and communicating with the electronic device.

Beneficially, the system includes audio output means for outputting audio content to be audible to the user. The audio output means may comprise an earpiece or headphone(s) arrangement to be worn by the user.

In a preferred realisation, the system further comprises a remote server arranged to communicate with the user's electronic device, such that job information and instructional audio and/or visual content relating to the job is downloaded from the remote server to the user's electronic device.

According to a broader aspect, the invention provides an augmented reality system for job related instructional purposes the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.

According to an alternative aspect, the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen of the device, wherein the user can also view the visual instructional content on an eye level user mounted display device in communication with the electronic device is.

Most broadly, the invention provides a glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen.

The invention will now be further described in a specific embodiment, by way of example only and with reference to the accompanying drawings, in which: Figure 1 is a schematic perspective representation of an operative kitted out to use the augmented reality glazing panel replacement system of the invention; Fig 1 a is an enlarged view of the electronic device 2 of figure 1; Figure 2 is a view of the interactive electronic device of the invention being mounted to the operative; Figure 3 is an alternative view of the operative using the augmented reality glazing panel replacement system of the invention; Figure 4 is a view of the operative using the augmented reality glazing panel replacement system of the invention whilst lifting a glazing panel for replacement.

Referring to the drawings, there is shown an augmented reality glazing panel replacement system comprising a head mounted unit lused in combination with an interactive portable electronic device 2 which is in wireless communication with the head mounted unit 1.

The portable electronic device 2 (shown enlarged in figure 1A) may be a computer device which has a means, such as a display screen 9 and audio output for outputting visual display and audio content. Beneficially the device has electronic input means such as a keypad or touch pad or touch screen 9 for interacting with computer files and software applications stored or running on the device 2. The portable computer device 2 preferably has electronic storage means, such as memory, for storing electronic information relating to the operatives schedule or activities.

The head mounted unit 1 comprises a pair of safety glasses 3 having an integrally mounted microphone 4, audio earpiece 5 and display screen 6. The head mounted unit 1 is arranged to deliver coordinated visual and audio content on demand to the user which relates to the vehicle glazing panel replacement task being scheduled to be undertaken by the operative.

The content may be delivered from a remote source for example by wireless means. The content may be stored on the portable interactive electronic device 2 which is in connection communication with the head mounted unit 1. The connection may be means of cable such as optical cable, or wireless. Currently video content may best be supplied via a cable connection.

The portable electronic device 2 is beneficially configured to receive input commands from the operative via physical interaction such as with a keypad, touch screen 9 or the like and also via voice commands through the microphone 4, via a wireless connection such as via a Bluetooth connection to the device 2. In a practical realisation of the invention a Bluetooth earpiece 5 and microphone 4 may be used, to be in Bluetooth wireless communication with the portable electronic device 2.

The electronic device 2 may be body mounted to be portable with the operative whilst leaving the operatives hands free for other activities. For example figure 2 shows the electronic device being attached on the operative's belt.

The electronic device 2 is beneficially loaded with content related to the operative's specific intended tasks. For example the device 2 may be loaded with a schedule of jobs for the operative to complete in a particular session. The operator will be prompted to input the specific job that he is to begin and it will be possible for the operative to select the augmented reality glazing panel replacement system to run audio andlor visual content relating to that specific job.

If an operative is not familiar with glazing panel replacement for a particular make model vehicle it will be possible to run video footage of training material to provide clear instruction on procedures to be followed. This can be done prior to commencing the job by interacting and viewing the instructional material on the screen of the device 2, and subsequently, or alternatively whilst actually performing the job by viewing on the safety glasses mounted display screen 6 on the safety glasses 3. This facility for the instructional visual content to be displayed on the display 9 of the electronic device 2 and also on the glasses mounted display enhances the versatility of use of the system.

For example, by means of this, the operative may watch a complete and thorough demonstration on the display 9 of the portable electronic device 2 and importantly re-run key portions of the instruction at key points during the actual procedure whilst viewing the display screen 6 with hands free to undertake the job.

The display screen 6 is mounted to the outer periphery of one eye lens of the safety glasses 3 in order to enable the operative to view through the glasses without significant distraction, but shift gaze easily to view the image display screen 6 when desired. Indeed the screen can be pivoted away from the goggles if desired in order to give a greater unimpaired field of view. A glasses mounted display suitable for this purpose is commercially available at the present time under the registered trade mark TAC-EYE LT from Vuzix Corporation.

It is possible for the user to control the playing of the instructional content whilst keeping the hands free by means of voice commands into the microphone 4 which are wirelessly directed to control operation of the electronic device 2.

The system is flexible in that it allows an operative to play and replay content in situations where guidance and instruction is requested. Alternatively commands may be input to skip instructional steps or instructions for entire jobs where the job is one that is commonplace for the operative.

The device 2 is beneficial in that it can act as a work flow scheduler and a record log of jobs undertaken in addition to acting to implement an augmented reality glazing panel replacement system.

The device 2 can be used to interact with a primary server or computer which may be located in a remote location. For example a main server may communicate, wirelessly or otherwise, with the operative's electronic device 2 in order to download or upload information and content appropriately. For example, each day job information and audio/visual instructional content may be downloaded to the device 2, related specifically to the jobs to be undertaken that day. Following completion of the jobs information may be uploaded from the device 2 to the remote server. Such information may relate for example to the duration of a specific job, whether instructional content was used for a specific job, and the like.

Figure 4 shows a vehicle glass replacement operative 10 wearing the head mounted unit 1 of the system and preparing to lift a glazing panel 11 for fitment to a vehicle 12.

Claims

Claims: 1. An augmented reality system for job related instructional purposes, particularly for glazing panel repair or replacement, the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
2. An augmented reality system according to claim 1, wherein the electronic device is a portable electronic device arranged to be user-borne (carried or worn by the user).
3. an augmented reality system according to claim 1 or claim 2 wherein the electronic device stores visual content which is arranged to be displayed on the electronic device display screen and by the eye level mounted display device.
4. an augmented reality system according to any preceding claim wherein the visual content comprises video content.
5. an augmented reality system according to any preceding claim, wherein the eye level user mounted display device is head mounted.
6. an augmented reality system according to any preceding claim wherein the eye level user mounted display device is mounted to eyewear such as glasses goggles or a visor. -9..
7. an augmented reality system according to any preceding claim, wherein the eye level user mounted display device is mounted to be viewed by one eye only.
8. an augmented reality system according to any preceding claim wherein the system further comprises voice input means to enable user interaction to control operation of the electronic device.
9. an augmented reality system according to claim 8, wherein the voice input means comprises a microphone worn by the user and communicating with the electronic device.
10. an augmented reality system according to any preceding claim wherein the system includes audio output means for outputting audio content to be audible to the user.
11. an augmented reality system according to claim 10, wherein the audio output means comprises an earpiece or headphone(s) arrangement to be worn by the user.
12. an augmented reality system according to any preceding claim, further comprising a remote server arranged to communicate with the users electronic device, such that job information and instructional audio and/or visual content relating to the job is downloaded from the remote server to the users electronic device.
13. An augmented reality system for job related instructional purposes the system comprising: an electronic device for storing information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken; the electronic device including a display screen for visual display, and input means to enable user interaction to control operation of the electronic device; *40** an eye level user mounted display device in communication with the electronic device for displaying visual instructional content.
14. A glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen of the device, wherein the user can also view the visual instructional content on an eye level user mounted display device in communication with the electronic device is.
15. A glazing panel repair or replacement technique using an augmented reality system, wherein information concerning scheduled jobs and/or audio and/or visual instructional content relating to the jobs to be undertaken is stored on a users electronic device; the user interacting with the device including viewing the job information or instructional content on a display screen.