JP2008076734A - Glasses device and image generation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To correctly recognize the information of an object visible through an eyeglass device. <P>SOLUTION: The direction of the viewing field of an eyeglass device is specified from the current location measured in a GPS unit 108 and the angular velocity measured by a gyro sensor 107. The information relevant to an object in the direction of the viewing field is extracted from the memory unit and is added to the image obtained in the imaging section 111 and displayed on the display 105. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

The present invention relates to a spectacle device capable of magnifying an observation object in a visual field and an image generation method in the spectacle device.

Patent Document 1 describes a technique related to special spectacles such as binoculars capable of viewing an observation object and map information.

In the technique described in Patent Document 1, planar map information is switched or superimposed on an observation target in a spectacle field of view.

Japanese Patent Laid-Open No. 9-11815

In the conventional technique, in the spectacle field of view, switching the planar map information to the observation object,
Or, since they are only displayed in a superimposed manner, the correspondence between the observation object and the map information is unclear, and information relating to the observation object that is visible with the eyeglass device cannot be accurately recognized.

Therefore, an object of the present invention is to make it possible to accurately recognize information related to an observation object that is visible through an eyeglass device.

In order to solve the above problems, the present invention is an eyeglass device capable of magnifying an observation object in a visual field, and measures an angular velocity and an imaging unit that captures an area including at least the visual field Acquired by the gyro sensor, a position measurement unit for measuring the position, a storage unit for storing information for specifying the position of the object, a display unit, a current position measured by the position measurement unit, and the gyro sensor Processing to specify the visual field range using the angular velocity to be used, and related information related to the object located in the visual field range is added to the image captured by the imaging unit and displayed on the display unit And a processing unit for performing the processing.

Here, the processing unit specifies a visual field direction from the current position measured by the position measurement unit and the angular velocity acquired by the angular velocity sensor, and the visual field range is determined based on a visual field arrival range in the visual field direction. It is also possible to specify.

Further, the processing unit may be configured not to display related information related to an object shielded by another object among the objects located within the visual field range on the display unit.

In addition, the storage unit stores information for specifying the height of the object, and the processing unit is configured so that one object located within the field of view is in advance behind another object. When the vertical angle from the current position measured by the position measurement unit to the position of the one object is smaller than the vertical angle to the position of the other object It is also possible to determine that it is shielded.

Further, the display unit may be provided separately from the lens provided with the spectacle device.

The display unit can be viewed through a lens provided in the eyeglass device.

In addition, the present invention provides a storage unit that stores information for specifying the position of an object and a display unit, and the display unit uses the display unit in an eyeglass device capable of magnifying an observation object in a field of view. An image generation method for generating a display image to be displayed, the imaging process for imaging an area including at least the visual field, an angular velocity measurement process for measuring an angular velocity, a position measurement process for measuring a position,
A visual field range identifying process for identifying a visual field range using a current position measured in the position measuring process and an angular velocity acquired by the angular velocity measuring process, and the object located in the visual field range. An image generation method comprising: generating an image to be displayed on the display unit by extracting related information from the storage unit and adding the extracted information to the image captured by the imaging unit. provide.

As described above, according to the present invention, it is possible to accurately recognize information related to an observation object that is visible through the eyeglass device.

  FIG. 1 is a perspective view of a spectacle device 100 according to a first embodiment of the present invention.

As shown in the figure, the eyeglass device 100 is provided with an objective lens 102, an eyepiece lens (not shown because it is on the back surface of the casing 101) 103, and a display unit 105.

As shown in FIG. 2 (schematic diagram of the eyeglass device 100), the housing 101 includes a prism 104, a half mirror 106, a gyro sensor 107, and a GPS (Global
Positioning System) unit 108, antenna 109, and processing unit 110 are provided.

An object to be observed far from the objective lens 102 is observed from the eyepiece lens 103 side at a predetermined magnification by the objective lens 102 attached to one side of the housing 101, the eyepiece lens 103 attached to the other side, and the prism 104. Have been able to.

Here, in the present embodiment, between the objective lens 102 and the eyepiece lens 103,
A half mirror 106 is provided so that a part of the light that has entered the housing 101 via the objective lens 102 can be input to the imaging unit 111 of the processing unit 110.

The display unit 105 displays the image data output from the processing unit 110. Here, a liquid crystal display or the like may be used as the display unit 105.

The gyro sensor 107 detects the angular velocity in the three axes and outputs it to the processing unit 110. For example, a triaxial vibration type micro gyro sensor may be used as the gyro sensor 107.

The GPS unit 108 measures the arrival time of the radio wave from the GPS satellite, so that the latitude,
Calculate longitude and altitude. Since these calculation methods are known techniques, detailed description thereof is omitted.

Then, the GPS unit 108 displays the calculated latitude, longitude, and altitude as the processing unit 110.
Output to.

As shown in FIG. 2, the processing unit 110 includes an imaging unit 111, an A / D conversion unit 112, an image processing unit 113, a buffer 114, a storage unit 115, and a CPU (Central Processi
ng Unit) 116 and an input unit 117.

The imaging unit 111 converts light intensity input through the half mirror 106 into an electrical signal. For example, a CCD (Charge Coupled Device) image sensor or a CMOS (Compl.
ementary Metal Oxide Semiconductor) sensor.

The A / D converter 112 samples the analog image signal that is the output of the imaging unit 111 and converts it to a digital image signal.

In response to a command from the CPU, the image processing unit 113 generates a display image signal in which predetermined related information is added to a display position included in the command in response to a command from the CPU.

In addition, the image processing unit 113 also performs various correction processes such as noise removal of the digital image signal obtained from the A / D conversion unit 112.

The buffer 114 temporarily stores the digital image signal processed by the image processing unit 113 and outputs the digital image signal to the display unit 105 at a predetermined timing.

The storage unit 115 stores information related to an object for displaying related information on the display unit 105.

For example, the storage unit 115 stores an object table 115a as shown in FIG. 3 (schematic diagram of the object table 115a).

The object table 115a includes an ID column 115b, a latitude column 115c,
A longitude column 115d, an altitude column 115e, an attribute column 115f, and a related information column 115g are provided.

In the ID column 115b, identification information for identifying an object whose related information is displayed on the display unit 105 is stored.

In the latitude column 115c, information for specifying the latitude of the object identified in the ID column 115b is stored.

Here, the longitude column 115c may store the latitude of an arbitrary point included in the object. For example, if the object is a mountain, the latitude of the peak (top) position of the mountain may be stored. If the object is a building, the latitude of the center position of the roof of the building is stored. Further, if the object is a lake, the latitude of the center position of the lake may be stored.

Information specifying the longitude of the object identified in the longitude field 115d and the ID field 115b is stored.

Here, the longitude column 115d may store the longitude of an arbitrary point included in the object. For example, if the object is a mountain, the longitude of the peak (top) position of the mountain may be stored. If the object is a building, the longitude of the center position on the roof of the building is stored. Further, if the object is a lake, the longitude of the center position of the lake may be stored.

In the altitude column 115e, information for specifying the altitude of the object identified in the ID column 115b is stored.

Here, the altitude column 115d may store any one altitude included in the object. For example, if the object is a mountain, the altitude at the top (top) position of the mountain may be stored. If the object is a building, the altitude at the center position on the roof of the building is stored. Further, if the object is a lake, the altitude at the center position of the lake may be stored.

The attribute information column 115f stores information for specifying the attribute of the object identified in the ID column 115b. For example, in this embodiment, an attribute ID for identifying a mountain, a building, and a lake is stored as such an attribute.

In the related information column 115g, related information of the object to be displayed on the display unit 105 is stored. For example, information about the name and height of the object is stored.

The CPU 116 specifies the visual field range of the spectacle device 100 from the position information of the spectacle device 100 obtained from the GPS unit 108 and the angular velocity information obtained from the gyro sensor 107, and stores an object included in the specified visual field range. Object table 1 stored in 115
The related information of the specified object is sent to the image processing unit 113, specified from 15a.

Specifically, the CPU 116 specifies the position of the eyeglass device 100 from the latitude, longitude, and altitude of the eyeglass device 100 obtained from the GPS unit 108.

Then, the CPU 116 integrates angular velocity information obtained from the gyro sensor 107, and
The displacement angle is calculated, and the inclination of the eyeglass device 100 is calculated. The extension direction (viewing direction) of the optical axis of the eyeglass device 100 is specified from the inclination calculated in this way. Then, from such an extension direction (viewing direction), the magnification and the field of view of the eyeglass device 100, the CPU 116 specifies a three-dimensional field of view range including latitude, longitude, and altitude.

Next, the CPU 116 identifies an object whose longitude, latitude, and altitude stored in the object table 115a are included in this visual field range.

Then, the CPU 116 detects whether or not the specified one object is shielded by the other specified object.

For example, when another object existing at a position closer to the eyeglass device 100 than the specified one object is extracted, and the attributes of the extracted other object are “mountain” and “building”, There is one object specified in a predetermined range behind the mountain or building, and the vertical angle from the position of the eyeglass device 100 to the position of the one object is the vertical angle of the other object If it is larger than that, the one target object is assumed to be unshielded and set as a display target.

The CPU 116 calculates the display position of the object in the image displayed on the display unit 105 from the latitude, longitude, and altitude of the target object to be displayed in this way, and the image processing unit 113 displays the display position and related information. Output to.

Note that the display position of the object is the position in the horizontal direction of the object in the image displayed on the display unit 105 from the latitude and longitude of the object, and is separated upward by a predetermined distance from the altitude of the object. It is desirable to set the vertical position as the vertical position.

Then, the image processing unit 113 generates a display image signal by incorporating related information into the display position output from the CPU 116, and outputs the display image signal to the buffer 114.

The display image signal output to the buffer 114 is output to the display unit 105 at a predetermined timing, and an image is displayed on the display unit 105 based on the display image signal. For example, in the display unit 105, as illustrated in FIG.
A display image in which related information is added to the captured image captured in step (b) is displayed. Here, in FIG. 4, the name and height of the mountain and the name of the lake are displayed at predetermined positions.

The input unit 117 is a user interface for inputting power on / off of the display unit 106 from the user.

A processing flow of the eyeglass device 100 according to this embodiment configured as described above will be described with reference to a flowchart shown in FIG.

First, the CPU 116 detects the position of the eyeglass device 100 from the latitude, longitude, and altitude of the eyeglass device 100 obtained from the GPS unit 108 (S10).

Next, the CPU 116 integrates the angular velocity information obtained from the gyro sensor 107, calculates the displacement angle, and calculates the tilt of the spectacle device 100, thereby detecting the viewing direction of the spectacle device 100 (S11).

Next, the CPU 116 specifies the visual field range of the spectacle device 100 from the position of the spectacle device 100 detected in step S10, the visual field direction of the spectacle device 100 detected in step S11, and the magnification and the visual field of the spectacle device 100. (S12).

For example, as shown in FIG. 6 (perspective view for explaining the visual field range T1), the CPU 116 detects the position P1 of the spectacle device 100 detected in step S10 and the visual field direction of the spectacle device 100 detected in step S11. Based on D1 and the magnification and field of view of the spectacle device 100, the reach range S1 that is the limit position that can be visually recognized by the spectacle device 100 is determined as the position P of the spectacle device 100.
The three-dimensional area T1 from the position P1 of the eyeglass device 100 to the reach range S1 is set as the visual field range.

For the reach range S1, the distance and range from the position P1 of the spectacle device 100 may be appropriately determined in advance according to the performance (magnification and field of view) of the spectacle device 100.

Next, the CPU 116 identifies objects included in the visual field range T1 whose longitude, latitude, and altitude stored in the object table 115a of the storage unit 115 are identified in Step S12 (
S13).

The CPU 116 extracts one unidentified object identified in step S13 (S14), and determines whether the object extracted in step S14 is shielded by another object. (S15).

For example, whether or not it is shielded is another object in a position closer to the eyeglass device 100 than the object specified in step S13 in the visual field range specified in step S12. The attributes are “mountain” and “building”, the object specified in step S13 is within a predetermined range behind the other object, and the one object is further determined from the position of the eyeglass device 100. When the vertical angle to the position of the object is smaller than the vertical angle to the position of the other object, it is determined that the object is shielded.

In step S15, if it is determined that it is not blocked, step S1
If it is determined to be shielded, the process proceeds to step S18.

In step S <b> 16, the CPU 116 calculates the display position of the object in the image displayed on the display unit 105.

The display position is the horizontal display position of the object in the image displayed on the display unit 105 from the latitude and longitude of the object, and is further away from the altitude of the object by a predetermined distance. Let the position be the vertical display position.

Then, the CPU 116 performs step S1 from the object table 115a of the storage unit 115.
The related information of the object determined not to be shielded at 5 is acquired (S17), and the process proceeds to step S18.

In step S18, the CPU 116 checks whether there is an unconfirmed object identified in step S13. If there is an unconfirmed object, the process returns to step S14 and repeats the process.

On the other hand, if there is no unconfirmed item in step S18, the CPU 116 instructs the image processing unit 113 to display the related information acquired in step S17 at the display position calculated in step S16, and the image processing unit 113. Then, by incorporating the relevant information into the display position of the image data output from the A / D conversion unit 112, a display image signal is generated, output to the buffer 114, and displayed on the display unit 105 (S19).

Since the present embodiment is configured as described above, for example, in the eyeglass device 100, a scene similar to the scene seen with the eyepiece 103 can be viewed on the display unit 105. Since the related information such as the name of the object is displayed, the object can be clearly grasped.

In the embodiment described above, the light introduced from the objective lens 102 is incident on the imaging unit 111 by the half mirror 106. However, the present invention is not limited to this mode. For example, FIG. As shown in a schematic diagram illustrating a modification of the apparatus 100, it is also possible to provide an imaging lens 120 separately and allow light to enter the imaging unit 111 via the imaging lens 120.

In the embodiment described above, the display unit 105 is fixedly provided on the housing 101. However, the display unit 105 is not limited to such a mode. For example, the display unit 105 is rotatable with respect to the housing 101 via a hinge. It is also possible to connect.

  FIG. 8 is a perspective view of the eyeglass device 200 according to the second embodiment of the present invention.

In the first embodiment, related information of an object viewed through the eyepiece lens 103 can be confirmed on the display unit 105. In the present embodiment, the display unit 2
The difference is that the image displayed in 05 can be viewed through the magnifying lens 221. Details will be described below.

As shown in the figure, the eyeglass device 200 is provided with an imaging lens 220 and a magnifying lens (not shown because it is on the back surface of the housing 101) 221 in the housing 101, which is the same as in the first embodiment. In comparison, one imaging lens 220 is provided in place of the two objective lenses 102, and a magnifying lens 221 is provided in place of the eyepiece lens 103.
The difference is that the display unit 105 is not provided outside the housing 101.

As will be described later, in this embodiment, the display unit 205 is provided inside the housing 101.

In the present embodiment, since the magnifying lens 221 is configured to view the image displayed on the display unit 205, the objective lens and the eyepiece lens are not necessary, and the imaging unit 111 receives light from the imaging lens 220. It is designed to receive light.

As shown in FIG. 9 (schematic diagram of the eyeglass device 200), inside the housing 101, there are a mirror 222, a gyro sensor 107, a GPS unit 108, and an antenna 109 arranged on the magnifying lens 221 side. In addition, a processing unit 110 and a display unit 205 are provided.

Here, compared with the first embodiment, the mirror 222 disposed on the magnifying lens 221 side.
Since the display unit 205 is different, items related to these will be described below.

The display unit 205 in this embodiment is housed inside the housing 101. Here, the display unit 205 itself can be configured by a liquid crystal display or the like as in the first embodiment. However, in this embodiment, the display unit 205 can be enlarged and visually recognized by the magnifying lens 221, so that the display unit 205 is smaller. Things can be used.

The mirror 222 is arranged on the magnifying lens 221 side, and reflects the image displayed on the display unit 205 in the direction of the magnifying lens 221.

Since the spectacle device 200 according to the present embodiment is configured as described above, the user of the spectacle device 200 looks at the image to which the predetermined related information is added by looking inside the spectacle device 200 from the magnifying lens 221. Therefore, it is possible to accurately grasp the object.

In addition, related information can be confirmed using the same method of use as when viewing with binoculars, and the feeling of use is excellent.

In this embodiment, the image data received by one imaging unit 111 can be viewed through the two magnifying lenses 221. However, in order to further improve the usability, FIG. 200 is a schematic diagram illustrating a modification example of the image pickup lens 2.
20, two imaging units 111, A / D conversion units 112, image processing units 113, buffers 114, and two display units 205 are provided so that the left and right magnifying lenses 221 can view the left and right images, respectively. It is also possible to make it.

In the embodiment described above, the binocular spectacle device 200 is used. However, the present invention is not limited to such a mode, and for example, shown in FIG. 11 (a schematic diagram showing a modification of the spectacle device 200). As shown in the figure, it is also possible to use a monocular type in which an image displayed on the display unit 205 is viewed with a single magnifying lens 221.

The perspective view of the spectacles apparatus which is 1st embodiment. FIG. Schematic of an object table. Schematic which shows the example of a display in a display part. The flowchart which shows the processing flow of an eyeglass device. The perspective view for demonstrating a visual field range. Schematic which shows the modification of spectacles apparatus. The perspective view of the spectacles apparatus which is 2nd embodiment. FIG. Schematic which shows the modification of the spectacles apparatus 200. FIG. Schematic which shows the modification of the spectacles apparatus 200. FIG.

Explanation of symbols

100, 200 Eyeglass device 101 Case 102 Objective lens 103 Eyepiece 104 Prism 105, 205 Display unit 106 Half mirror 107 Gyro sensor 108 GPS unit 109 Antenna 110 Processing unit 111 Light source conversion unit 112 A / D conversion unit 113 Image processing unit 114 Buffer 115 Storage unit 116 CPU
117 Input unit 120, 220 Imaging lens 221 Magnifying lens 222 Mirror

Claims (7)

An eyeglass device capable of magnifying an observation object in a field of view,
An imaging unit for imaging an area including at least the visual field;
A gyro sensor that measures angular velocity;
A position measurement unit for measuring the position;
A storage unit for storing information for specifying the position of the object;
A display unit;
Processing for specifying a visual field range using the current position measured by the position measurement unit and the angular velocity acquired by the gyro sensor, and related information related to the object located in the visual field range Processing for adding to the image captured by the imaging unit and displaying the image on the display unit;
A processing unit for performing
An eyeglass device characterized by the above. The eyeglass device according to claim 1,
The processing unit identifies a visual field direction from the current position measured by the position measurement unit and the angular velocity acquired by the angular velocity sensor, and identifies the visual field range according to a visual field arrival range in the visual field direction. thing,
An eyeglass device characterized by the above. The eyeglass device according to claim 1 or 2,
The processor is
Relevant information related to what is shielded by other objects among the objects located within the visual field range is not displayed on the display unit,
An eyeglass device characterized by the above. The eyeglass device according to claim 3,
Information for specifying the height of the object is stored in the storage unit,
The processor is
One object located within the field of view is in a predetermined range behind the other object, and the current position measured by the position measurement unit is changed to the position of the one object. If the vertical angle is smaller than the vertical angle to the position of the other object, it is determined to be shielded;
An eyeglass device characterized by the above. The eyeglass device according to any one of claims 1 to 4,
The display unit is provided separately from a lens provided with the eyeglass device;
An eyeglass device characterized by the above. The eyeglass device according to any one of claims 1 to 4,
The display unit can be viewed through a lens provided in the eyeglass device;
An eyeglass device characterized by the above. A storage unit that stores information for specifying the position of an object and a display unit, and generates a display image to be displayed on the display unit in an eyeglass device that can enlarge and view an observation object in the field of view An image generation method for
An imaging process for imaging an area including at least the visual field;
Angular velocity measurement process for measuring angular velocity,
A position measurement process for measuring the position;
A visual field range specifying process for specifying a visual field range using the current position measured in the position measuring process and the angular velocity acquired by the angular velocity measuring process;
An image generation process for generating an image to be displayed on the display unit by extracting related information related to the object located in the visual field range from the storage unit and adding the extracted information to the image captured by the imaging unit; Providing
An image generation method characterized by the above.

Images