[go: up one dir, main page]

JP2004298290A - Three-dimensional observation state measuring device and method - Google Patents

Three-dimensional observation state measuring device and method Download PDF

Info

Publication number
JP2004298290A
JP2004298290A JP2003092921A JP2003092921A JP2004298290A JP 2004298290 A JP2004298290 A JP 2004298290A JP 2003092921 A JP2003092921 A JP 2003092921A JP 2003092921 A JP2003092921 A JP 2003092921A JP 2004298290 A JP2004298290 A JP 2004298290A
Authority
JP
Japan
Prior art keywords
unit
eye
line
sight
coordinate
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2003092921A
Other languages
Japanese (ja)
Other versions
JP4121881B2 (en
Inventor
Mariko Kobayashi
真理子 小林
Toshibumi Mihashi
俊文 三橋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Topcon Corp
Original Assignee
Topcon Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Topcon Corp filed Critical Topcon Corp
Priority to JP2003092921A priority Critical patent/JP4121881B2/en
Publication of JP2004298290A publication Critical patent/JP2004298290A/en
Application granted granted Critical
Publication of JP4121881B2 publication Critical patent/JP4121881B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Eye Examination Apparatus (AREA)

Abstract

【課題】自然な三次元対象物を視聴者が観察する場合の眼の三次元観察状態を測定することで、眼疲労状態が正確に測定できる三次元観察状態測定装置を提供すること。
【解決手段】視線方向を含むステレオ画像を取得する画像取得部20と、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物10の三次元座標値を取得する座標取得部22と、被検眼14の視線方向を検出する視線方向検出部30と、視線方向検出部30で検出された視線から、被検眼14の注視点位置を求める注視点位置測定部32と、注視点位置測定部32で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物10の注視点座標値とを比較する座標比較部40とを備えている。
【選択図】 図1
An object of the present invention is to provide a three-dimensional observation state measuring device capable of accurately measuring an eye fatigue state by measuring a three-dimensional observation state of an eye when a viewer observes a natural three-dimensional object.
An image acquisition unit (20) for acquiring a stereo image including a line-of-sight direction, and coordinate acquisition for acquiring three-dimensional coordinate values of the observation target (10) in the line-of-sight direction based on the stereo image obtained by the image acquisition unit (20). A gaze direction detection unit 30 that detects the gaze direction of the eye 14 to be examined, a gaze point measurement unit 32 that determines a gaze point position of the subject eye 14 from the gaze detected by the gaze direction detection unit 30, A coordinate comparing unit 40 is provided for comparing the gazing point position obtained by the gazing point position measuring unit 32 with the gazing point coordinate value of the observation target 10 in the line of sight at the time when the gazing point position is obtained.
[Selection diagram] Fig. 1

Description

【0001】
【産業上の利用分野】
本発明は、例えば立体的な観察対象物を視聴する視聴者の視覚状態を測定する三次元観察状態測定装置及び方法に関する。
【0002】
【従来の技術】
本出願人は、眼特性測定装置として各種の装置を製造・販売している。例えば、特許文献1で示すように、眼屈折力測定装置を提供して、被検眼の視力測定を容易にしている。また、特許文献2で示すように、視線監視装置を提供して、視野計や眼底カメラでの被検眼の検査を容易にしている。
【0003】
【特許文献1】
特公平5−88131号公報 第1図
【特許文献2】
特公平1−52012号公報 第2図
【0004】
ここで、新しい眼鏡を処方する際の測定手順を説明すると、以下のようになっている。
▲1▼被検者の屈折の変化(年齢などによる)により眼鏡が必要になると、オートレフラクトメータなどにより他覚検眼を行い、だいたいの球面度、乱視度、乱視軸を測定する。
▲2▼他覚検眼と平行して、ホロプター等を用いて、レンズ交換法により自覚検眼をおこない、正確な球面度、乱視度、乱視軸を測定している。ここで自覚検眼とは、所定の視標を被検者がみて、はっきり見えているかを、答えてもらう方法である。また、自覚検眼にも誤差があるので、▲1▼の他覚検査の値と大きく矛盾しないかをチェックする。
【0005】
▲3▼上記▲1▼、▲2▼の検査は片眼で行なわれていたが、次の段階として、実際に新たな矯正特性の眼鏡をつくったとして、それが被検者にとって快適かなどを両眼で検査する。即ち、かけ枠に測定された仕様のレンズをいれ、これを被検者が30分ぐらい装用して、その見え具合、かけ具合をチェックし、被検者がその装用状態をよいと感じれば、当該矯正特性で被検者用の眼鏡をつくることになる。
▲4▼さらに、この作られた眼鏡での装用状態チェックも、▲3▼と同様に行うことがのぞましい。
【0006】
【発明が解決しようとする課題】
しかし、▲3▼の装用状態での検査は、自覚的検査である為、特に被検者が子供である場合には、ある程度の信頼性をおける回答をえることは容易でないという課題がある。即ち、子供によっては検査担当者に対して不服を申立てる事を望まない内気な子も多く、その為矯正が適切に行われていない場合でも、矯正された新たな眼鏡の矯正状態で承諾してしまう。すると、適切に矯正された眼鏡でない為に、子供は眼鏡を新調したのに、旨く対象物を見ることができなくなるという課題があった。
【0007】
より詳しく説明すると、新しい眼鏡は、従前の眼鏡と比較して球面度、乱視度、乱視軸が変更されていることが多い。たとえば球面度が変更されている場合に、乱視度や乱視軸も併せて変更されている可能性がかなりある。ここで、遠くから近いところをみるときに、人間の視覚系が行っていることを簡単に説明する。
遠くから近くを見るときに変化するのは、調節と輻輳が考えられる。両眼視で輻輳が支配的とすると、まず、輻輳により近くの物体、例えば50cm、即ち2D(ディオプター)の距離にある物体を見る場合を説例とする。すると、輻輳はかなり正確に、この物体の位置を予測し、輻輳角を2Dに変更する。調節は、輻輳調節応答により、2Dに調節するように水晶体の屈折力を変える信号を出す。
【0008】
ここで、眼鏡が変更されている影響を付加して考察する。説例として、従前の眼鏡よりも1D強い眼鏡を、新しい眼鏡としてかけていたとする。そうすると、輻輳調節応答で2Dのところを見るように水晶体の屈折力を調節すると、新しい眼鏡装用では、3Dのところにピントが合うように調節してしまう。しかし、このような不適切な調節も、暫く新しい眼鏡をかけ続けていれば、新しい輻輳調節のプログラムが体得される為、解消するのが一般的である。そこで、従前の眼鏡で適切に水晶体の屈折力を調節できていたことが、新しい眼鏡でもできるように習熟して、被検者もこの新しい眼鏡で快適に対象物が見えるようになるはずである。
【0009】
しかし、現実の臨床現場では、なんらかの理由で新しい眼鏡が旨く被検者にフィットしないことがあり、被検者は眼疲労状態に対して不快感を訴えることがあった。ところが、新しい眼鏡に対する新しい輻輳調節のプログラムを体得するのが困難な状況であるために、眼疲労状態を他覚的に検査する装置が、従来は存在していないという課題があった。
【0010】
【発明が解決しようとする課題】
本発明は、上述する課題を解決したもので、第1の目的は、自然な三次元対象物を視聴者が観察する場合の眼の三次元観察状態を測定することで、眼疲労状態が正確に検査できる三次元観察状態測定装置及び方法を提供することである。本発明の第2の目的は、自然な三次元対象物を視聴者が観察する場合に、視聴者の被検眼における屈折力、輻輳、瞳孔径等の眼特性を容易に計測できる三次元観察状態測定装置及び方法を提供することである。
【0011】
【課題を解決するための手段】
上記目的を達成する本発明の三次元観察状態測定装置は、例えば図1に示すように、視線方向を含むステレオ画像を取得する画像取得部20と、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物10の三次元座標値を取得する座標取得部22と、被検眼14の視線方向を検出する視線方向検出部30と、視線方向検出部30で検出された視線から、被検眼14の注視点位置を求める注視点位置測定部32と、注視点位置測定部32で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物10の注視点座標値とを比較する座標比較部40とを備えている。
【0012】
このように構成された装置においては、画像取得部20は、視線方向を含むステレオ画像を取得するもので、典型的には観察対象物10の像がステレオ画像に含まれている。座標取得部22は、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物10の三次元座標値を取得するもので、座標値の基準点を、例えば被検眼14とする。注視点位置測定部32は、視線方向検出部30で検出された視線から、被検眼14の注視点位置を求める。座標比較部40は、注視点位置測定部32で得られた注視点位置と、当該注視点位置を求めた時点の視線方向を視線方向検出部30で検出して、当該視線方向における観察対象物10の座標値とを比較して、偏差を求める。座標比較部40により求められる偏差は、例えば新しい眼鏡の装用時の検査に有用な情報と考えられる。
【0013】
上記目的を達成する本発明の三次元観察状態測定装置は、例えば図3に示すように、視線方向を含むステレオ画像を取得する画像取得部20と、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物10の三次元座標値を取得する座標取得部22と、被検眼14の視線方向を検出する視線方向検出部30と、被検眼14の屈折力を測定する屈折力測定部34と、屈折力測定部34で得られた被検眼14のピント位置と、当該ピント位置を求めた時点の視線方向における観察対象物10の座標値とを比較する第2の座標比較部42とを備えている。
【0014】
このように構成された装置においては、画像取得部20は、視線方向を含むステレオ画像を取得するもので、典型的には観察対象物10の像がステレオ画像に含まれている。座標取得部22は、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物10の三次元座標値を取得するもので、座標値の基準点を、例えば被検眼14とする。屈折力測定部34は、被検眼14の屈折力を測定するもので、被検眼14のピント位置情報を得ることができる。第2の座標比較部42は、屈折力測定部34で得られた被検眼14のピント位置と、当該ピント位置を求めた時点の視線方向を視線方向検出部30で検出して、当該視線方向における観察対象物の注視座標値とを比較する。第2の座標比較部42により求められる偏差は、例えば新しい眼鏡の装用時の検査に有用な情報と考えられる。
【0015】
上記目的を達成する本発明の三次元観察状態測定装置は、例えば図6に示すように、視線方向を含むステレオ画像を取得する画像取得部20と、画像取得部20で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部22と、被検眼14の視線方向を検出する視線方向検出部30と、被検眼14の屈折力を測定する屈折力測定部34と、視線方向検出部30で検出された視線方向から、被検眼14の注視点位置を求める注視点位置測定部32と、注視点位置測定部32で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物10の座標値とを比較する第1の座標比較部40と、屈折力測定部34で得られたピント位置と、ピント位置を求めた時点の視線方向における観察対象物10の座標値とを比較する第2の座標比較部42とを備えている。
【0016】
上記三次元観察状態測定装置において、好ましくは、さらに被検眼14の前に配置され、赤外反射するダイクロイックミラー16を備え、屈折力測定部34が、被検眼14のダイクロイックミラー16を含む反射光軸上に配置される構成とすると、視線方向検出部30、屈折力測定部34等の眼特性を測定する装置を並列に設ける場合の装置配列がコンパクト化される。
【0017】
上記三次元観察状態測定装置において、例えば図6に示すように、好ましくは、さらに、被検眼14の瞳孔径を測定する瞳孔径測定部37、または、被検眼14のまばたきを測定するまばたき測定部38を備える構成とすると、視聴者に生ずる眼疲労徴候としての眼の生理的機能を測定できる。
【0018】
上記三次元観察状態測定装置において、好ましくは、被検眼の屈折力と視線方向の経時変化を測定するように構成されていると、座標比較部40や第2の座標比較部42の求めた偏差の経時変化を用いて、視聴者に生ずる眼疲労メカニズムを観察できる。
【0019】
上記目的を達成する本発明のコンピュータを用いた三次元観察状態測定方法は、例えば図2に示すように、画像取得部20により視線方向を含むステレオ画像を取得し(S102)、ステレオ画像に基づき、座標取得部22により当該視線方向の観察対象物10の三次元座標値を取得し(S104)、視線方向検出部30により被検眼14の視線方向を検出し(S108)、注視点位置測定部32により、視線方向検出部30で検出された視線から、被検眼14の注視点位置を求め(S110)、注視点位置測定部32で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物10の注視座標値とを比較する(S112〜S116)工程を有している。
【0020】
上記目的を達成する本発明のコンピュータを用いた三次元観察状態測定方法は、例えば図4に示すように、画像取得部20により視線方向を含むステレオ画像を取得し(S202)、ステレオ画像に基づき、座標取得部22により当該視線方向の観察対象物10の三次元座標値を取得し(S204)、視線方向検出部30により被検眼14の視線方向を検出し(S208)、屈折力測定部34により被検眼14の屈折力を測定すると共にピント位置を求め(S212)、屈折力測定部34で得られたピント位置と、当該ピント位置を求めた時点の視線方向における観察対象物10の注視座標値とを比較する(S214、S216)工程を有している。
【0021】
【発明の実施の形態】
以下、本発明の実施の形態を図面により説明する。図1は本発明の第1の実施の形態を説明する構成ブロック図である。三次元観察状態測定装置は、ダイクロイックミラー16、画像取得部20、座標取得部22、視線方向検出部30、注視点位置測定部32、座標比較部40並びに視線方向座標演算部41を備えているもので、被検者が観察対象物10を観察している状態を計測するものである。
ここで、観察対象物10は例えば人形や構造体のような三次元の可視物体で、静止していてもよく、また可動体でもよい。
【0022】
ダイクロイックミラー(Dichroic Mirror)16は、薄膜による光の干渉を利用して、特定波長領域の光のみを反射して、残りの波長領域の光を透過する鏡である。ここでは、ダイクロイックミラー16は、被検眼14と観察対象物10との間に設置され、視線方向検出部30で放射される赤外光を被検眼14方向に反射すると共に、観察対象物10から放射される可視光を透過している。
【0023】
画像取得部20は、視線方向を含むステレオ画像を取得するもので、典型的にはステレオカメラが用いられる。ステレオカメラとは、基線距離離れた左右の同一特性を有するカメラで対象物を撮影するもので、ステレオカメラで撮影した左右画像の視差差が三次元の高さ方向の情報として重要であるため、レンズ収差の極めて少ない写真画像が得られるように構成されている。テレオカメラの視線方向には、観察対象物10が設置されており、ステレオ画像に観察対象物10の像が含まれるように倍率が配慮されている。観察対象物10が静止体であれば、一台のカメラの撮影場所を基線距離だけ離して左右の画像を作成して、ステレオ画像とすることができる。
【0024】
座標取得部22は、画像取得部20で得られたステレオ画像に基づき、観察対象物10の三次元座標値を取得するもので、座標値の基準点として、例えば被検眼14の位置を用いる。座標取得部22は、例えば予め画像取得部20で得られるステレオ画像に関して三次元座標が得られるように調整したキャリブレーション情報を用いる。キャリブレーション情報は、寸法が既知の校正体を用いて、画像取得部20で撮影されるステレオ画像の各種パラメータ、例えばレンズの焦点距離やレンズ収差の値を取得しておく。このようなキャリブレーション情報は、例えば本出願人の提案に係る特開2003−42730号公報、42732号公報に開示された校正体を用いた表面形状測定装置により得ることができる。また、座標取得部22は、例えば本出願人の提案に係る特開2003−42726号公報に開示された校正体を観察対象物10の設置場所に置いて、被検眼から校正体までの距離や方向を予め測定しておき、この校正体の測定結果を用いて観察対象物10の三次元座標値を設定できるようにしてもよい。
【0025】
視線方向検出部30は、被検眼14の視線方向を検出するもので、代表的な検出原理としては角膜検出方式と強膜反射方式とがある。角膜検出方式は、角膜上に赤外LED(Light Emitting Diode)の放射光による虚像を作り、眼球の移動に従ってその虚像が移動するのを検出する方式である。強膜反射方式は、眼に弱い赤外線を照射し、赤外光の反射光量が黒目と白目で異なることを利用する。
【0026】
注視点位置測定部32は、視線方向検出部30で検出された視線から、被検眼14の注視点位置を求める。被検者は左右眼で観察対象物10を観察しているので、視線方向検出部30で左右の被検眼14の視線方向を検出し、左右の視線方向の交点を求めることで、被検眼14の注視点位置を求めることができる。
【0027】
視線方向座標演算部41は、注視点位置測定部32によって注視点位置を求めた時点の視線方向における観察対象物10との交点である注視座標値を演算する。即ち、観察対象物10には立体像としての大きさがあるので、視線方向座標演算部41は、視線方向検出部30で検出された左右の被検眼14の視線方向情報を用いて、左右の被検眼14で注視点に相当する観察対象物10の座標値を求める。なお、左右の被検眼14の視線方向と観察対象物10の表面で実質的に一点に収束していない場合には、左右の被検眼14の一方しか観察対象物10の表面部位を注視していない状態と考えられるので、視線方向座標演算部41において、有効な側の眼の視線方向のみを採用するとか、左右の被検眼14により観察対象物10を見ている方向の中間位置を採用するなどの適宜の措置をとるとよい。
【0028】
座標比較部40は、注視点位置測定部32で得られた注視点位置と、視線方向座標演算部41で取得した観察対象物10の座標値とを比較して、両者の乖離量を求める。そして、座標比較部40は、被検者の眼疲労度を識別する為に設定した基準値に対して、注視点と注視座標値との乖離量を比較して、左右の被検眼14が健康な状態にあるか眼疲労状態にあるかの判定を行なう。なお、座標比較部40に設定してある基準値は、集団検診等で標準的な被検者の調節機能を用いて設定し、個別の被検者向けに設定する場合には当該個人の被検者の検査履歴を用いて設定するとよい。
【0029】
このように構成された装置の動作を次に説明する。図2は図1の装置を用いた三次元観察状態測定方法の一例を示すフローチャートである。まず、観察対象物10を三次元観察状態測定装置の近傍に設置する(S100)。そして、画像取得部20により視線方向を含むステレオ画像を取得し(S102)、ステレオ画像に基づき、座標取得部22により当該視線方向の観察対象物10の三次元座標値を取得する(S104)。次に、被検者を三次元観察状態測定装置の所定位置、例えばダイクロイックミラー16と観察対象物10の光軸上に案内する(S106)。
【0030】
すると、三次元観察状態測定装置は、視線方向検出部30により被検眼14の視線方向を検出し(S108)、注視点位置測定部32により、視線方向検出部30で検出された左右の被検眼14の視線方向から、被検眼14の注視点位置を求める(S110)。また、視線方向座標演算部41により、視線方向検出部30によって注視点位置を求めた時点の視線方向であって、観察対象物10との交点である注視座標値を演算する(S112)。
【0031】
そして、座標比較部40は、座標注視点位置測定部32で得られた注視点位置と、S112で求めた注視座標値とを比較して、乖離量を演算する(S114)。そして、座標比較部40は、乖離量が基準値よりも大きいか比較して(S116)、大きい場合には被検眼の眼疲労が大きくなっていると判断して(S118)、被検者が観察対象物10を観察することを停止させて、休息を取るように指示する(S120)。他方、S116で小さい場合には、被検眼の眼疲労は小さいと判断できるから、被検者による観察対象物10の観察を許可する(S122)。被検者は、S106に戻って観察対象物10の観察を継続してもよい。
【0032】
図3は本発明の第2の実施の形態を説明する構成ブロック図である。三次元観察状態測定装置は、ダイクロイックミラー16、ハーフミラー8、画像取得部20、座標取得部22、視線方向検出部30、屈折力測定部34、視線方向調整部36、視線方向座標演算部41並びに第2座標比較部42を備えている。なお、図3において、図1で説明した構成要素と同一要素に関しては同一符号を付して、説明を省略する。
【0033】
図において、ハーフミラー8は、ダイクロイックミラー16で反射された左右の被検眼14からの赤外光を、屈折力測定部34と視線方向検出部30とに分枝する。屈折力測定部34は、被検眼14の屈折力を測定するもので、所謂他覚式の眼屈折力測定装置が用いられる。他覚式の眼屈折力測定装置では、例えば被検眼の眼底に測定ターゲット像を投影し、この測定ターゲット像の合焦状態に基づいて被検眼の屈折度を測定すると共に、眼の屈折力より視軸上のピント位置を求めることができる。この場合に、輻輳角を用いてピント情報を更に精緻に求めることができる。ここで、輻輳(vergence)とは、見ようとする対象物に両眼の視軸を集中させることを言い、両眼の視軸のなす角度を輻輳角という。
【0034】
視線方向調整部36は、視線方向検出部30によって眼球の向きも視線方向測定と同時に観測し、視線方向の動きに合わせてダイクロイックミラー16と屈折力測定部34を同時に回転・移動させ、光軸をあわせる。視線方向調整部36により、屈折力測定部34の測定する光軸が眼球運動によってずれてしまうのを防止できる。第2の座標比較部42は、屈折力測定部34で得られたピント位置と、視線方向座標演算部41で取得した観察対象物10の座標値とを比較して、両者の乖離量を求める。そして、第2の座標比較部42は、被検者の眼疲労度を識別する為に設定した基準値に対して、ピント位置と注視座標値との乖離量を比較して、左右の被検眼14が健康な状態にあるか眼疲労状態にあるかの判定を行なう。
【0035】
このように構成された装置の動作を次に説明する。図4は図3の装置を用いた三次元観察状態測定方法の一例を示すフローチャートである。まず、観察対象物10を三次元観察状態測定装置の近傍に設置する(S200)。そして、画像取得部20により視線方向を含むステレオ画像を取得し(S202)、このステレオ画像に基づき、座標取得部22により当該視線方向の観察対象物10の三次元座標値を取得する(S204)。次に、被検者を三次元観察状態測定装置の所定位置、例えばダイクロイックミラー16と観察対象物10の光軸上に案内する(S206)。
【0036】
すると、三次元観察状態測定装置は、視線方向検出部30により被検眼14の視線方向を検出し(S208)、視線方向座標演算部41により、視線方向検出部30によって注視点位置を求めた時点の視線方向であって、観察対象物10との交点である注視座標値を演算する(S210)。また、屈折力測定部34により、被検眼14のピント位置を求める(S212)。この場合に、屈折力測定部34により測定される輻輳角の情報も加味するとよい。
【0037】
そして、第2の座標比較部42は、屈折力測定部34で得られたピント位置と、S210で求めた注視座標値とを比較して、乖離量を演算する(S214)。
次に、第2の座標比較部42は、乖離量が基準値よりも大きいか比較して(S216)、大きい場合には被検眼の眼疲労が大きくなっていると判断して(S218)、被検者が三次元画像を視聴することを停止させて、休息を取るように指示する(S220)。他方、S216で小さい場合には、被検眼の眼疲労は小さいと判断できるから、被検者による観察対象物10の観察を許可する(S222)。被検者は、S206に戻って観察対象物10の観察を継続してもよい。
【0038】
図5は図4のS210の詳細を説明するフローチャートである。まず、屈折力測定部34により赤外光を被検眼14に入射する(S252)。そして、屈折力測定部34は、リング状指標を眼底に投影し、粗アライメントに続いて精密アライメントを行なう(S254、S256)。そして、ダイクロイックミラー16を輻輳に応じて変化させる(S258)。そして、屈折力測定部34は、眼底と共役関係に配置される眼底像検出部で眼底上に投影されたリング状の形状を測定し、その形状の変形を測定して屈折力を求める(S260)。更に、屈折力測定部34は、瞳孔径や必要な場合には輻輳も測定できる。屈折力測定部34は、測定した屈折力から眼が焦点を合わせているピント位置を求めることができる。そして、測定時間が終了したか判断し(S262)、未了であればS256に戻って測定を継続する。終了であれば、戻しとする。
【0039】
図6は本発明の第3の実施の形態を説明する構成ブロック図である。第3の実施の形態においては、第1の実施の形態における座標比較部40と、第2の実施の形態における第2の座標比較部42を組合せたものである。さらに、ハーフミラー19が、ダイクロイックミラー16と観察対象物10との間に設置され、被検眼14の像を瞳孔径測定部37とまばたき測定部38に導く。瞳孔径測定部37は、瞳孔径を測定する。まばたき測定部38は、被検眼14のまばたきの回数を測定する。眼疲労判定部39は、瞳孔径測定部37が測定した瞳孔径と、被検者が近いところの像を見るときの瞳孔径の基準値と比較して、瞳孔収縮が正常に行なわれるか判断することで眼疲労の判定を行なう。また、眼疲労判定部39は、まばたき測定部38が測定した被検眼14のまばたきの回数と、眼の調節機能が充分に発揮されている状態の標準的なまばたきの回数と比較して、まばたきの回数が低下している場合に眼疲労状態と判定する。
【0040】
このように構成すると、視線方向座標演算部41で取得した観察対象物10の座標値に対して、注視点位置測定部32で得られた注視点位置と、屈折力測定部34で得られたピント位置の二つの情報を用いて被検眼の眼疲労度が測定でき、測定の信頼性がます。
【0041】
また、健康な状態の眼の生理的機能としては、近いところを見るときには、瞳孔が小さくなる傾向が存在しているが、瞳孔径測定部37による瞳孔径測定によって、瞳孔の大小を調節する機能が正しく応答しているか判断できる。また、健康な状態の眼の生理的機能としては、一定頻度でまばたきを行なっているが、眼精疲労の状態ではまばたきの回数が減少して、角膜の表面が乾燥してしまうために、眼疲労度が更に増す現象が知られている。そこで、まばたき測定部38により、被検者のまばたきの回数を測定して、眼疲労徴候を観測すると良い。
【0042】
なお、上記の実施の形態においては、三次元観察状態測定装置として視線方向検出部や屈折力測定部を用いて、数分程度の比較的短時間の視力測定により被検眼の眼疲労度を測定しているが、本発明はこれに限定されるものではなく、例えば数時間程度の比較的長時間における注視点位置やピント位置の経時変化情報を用いて、眼疲労度の経時変化を計測するようにしてもよい。
【0043】
【発明の効果】
以上説明したように、本発明の三次元観察状態測定装置によれば視線方向を含むステレオ画像を取得する画像取得部と、当該画像取得部で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部と、被検眼の視線方向を検出する視線方向検出部と、前記視線方向検出部で検出された視線から、前記被検眼の注視点位置を求める注視点位置測定部と、前記注視点位置測定部で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する座標比較部を備える構成としているので、被検者がみている観察対象物の方向や距離を、画像取得部と座標取得部によって、動的に三次元的に計測し、この三次元的計測位置と被検者の注視点位置と比較することにより、眼疲労状態が正確に検査できる。
【0044】
また、本発明の三次元観察状態測定装置によれば、視線方向を含むステレオ画像を取得する画像取得部と、当該画像取得部で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部と、被検眼の視線方向を検出する視線方向検出部と、前記被検眼の屈折力を測定する屈折力測定部と、前記屈折力測定部で得られた前記被検眼のピント位置と、当該ピント位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する第2の座標比較部とを備える構成としているので、被検者がみている観察対象物の方向や距離を、画像取得部と座標取得部によって、動的に三次元的に計測し、この三次元的な計測位置と被検眼のピント位置と比較することにより、眼疲労状態が正確に検査できる。また、屈折力測定部により視聴者の被検眼における屈折力、輻輳、瞳孔径等の眼特性を容易に計測できるので、例えば新しい眼鏡の装用時の検査が、矯正に適合した情報として正確に取得できる。また、被検眼のピント位置は左右の片眼でも測定できるので、注視点位置測定部のように注視点位置を求めるために必ず左右両眼を必要とする場合に比較して、光学系を簡素化できる。
【図面の簡単な説明】
【図1】本発明の第1の実施の形態を説明する全体構成ブロック図である。
【図2】図1の装置を用いた三次元観察状態測定方法の一例を示すフローチャートである。
【図3】本発明の第2の実施の形態を説明する全体構成ブロック図である。
【図4】図3の装置を用いた三次元観察状態測定方法の一例を示すフローチャートである。
【図5】図4のS210の詳細を説明するフローチャートである。
【図6】本発明の第3の実施の形態を説明する構成ブロック図である。
【符号の説明】
10 観察対象物
14 被検眼
20 画像取得部
22 画像座標取得部
30 視線方向検出部
32 注視点位置測定部
34 屈折力測定部
37 瞳孔径測定部
38 まばたき測定部
40、42 座標比較部
41 視線方向座標演算部
[0001]
[Industrial applications]
The present invention relates to a three-dimensional observation state measuring apparatus and method for measuring a visual state of a viewer who views a three-dimensional observation target, for example.
[0002]
[Prior art]
The present applicant manufactures and sells various devices as eye characteristic measuring devices. For example, as disclosed in Patent Document 1, an eye refractive power measuring device is provided to facilitate eyesight measurement of an eye to be examined. Further, as disclosed in Patent Document 2, a gaze monitoring device is provided to facilitate inspection of an eye to be inspected with a perimeter or a fundus camera.
[0003]
[Patent Document 1]
Fig. 1 [Patent Document 2]
Fig. 2 of Japanese Patent Publication No. 1-52012
Here, the measurement procedure when prescribing new glasses will be described as follows.
{Circle around (1)} When spectacles are required due to a change in refraction (depending on age, etc.) of the subject, objective optometry is performed using an auto-refractometer or the like, and the approximate spherical degree, astigmatism degree, and astigmatic axis are measured.
{Circle around (2)} In parallel with the objective optometry, a subjective optometry is performed by a lens exchange method using a horopter or the like, and the accurate sphericity, astigmatism, and astigmatic axis are measured. Here, the subjective optometry is a method in which a subject sees a predetermined target and sees if the subject is clearly visible. Also, since there is an error in the subjective optometry, it is checked whether the value does not largely contradict the value of the objective test in (1).
[0005]
(3) Although the tests (1) and (2) above were performed with one eye, the next step was to make glasses with new corrective characteristics and see if they were comfortable for the subject. Is inspected with both eyes. In other words, put the lens of the measured specifications in the hanging frame, the subject wears it for about 30 minutes, checks the appearance, the degree of hanging, and if the subject feels that the wearing state is good, The eyeglasses for the subject will be made with the correction characteristics.
{Circle around (4)} Further, it is desirable that the wearing state check using the glasses thus made is performed in the same manner as in (3).
[0006]
[Problems to be solved by the invention]
However, since the examination in the wearing state of (3) is a subjective examination, there is a problem that it is not easy to give a reliable answer, particularly when the subject is a child. In other words, some children are shy and do not want to file an appeal with the inspector, so even if the correction has not been performed properly, they will accept the corrected state of the new corrected glasses. Would. Then, since the glasses are not properly corrected, there is a problem that the child cannot see the target object satisfactorily even though the child renews the glasses.
[0007]
More specifically, new eyeglasses often have changed sphericity, astigmatism, and astigmatism axis as compared to conventional eyeglasses. For example, when the sphericity is changed, it is highly possible that the astigmatic degree and the astigmatic axis are also changed. Here, a brief explanation of what the human visual system is doing when looking at a place from a distance is described.
Changes that can be seen when looking from a distance to a near point include accommodation and congestion. Assuming that convergence is dominant in binocular vision, a case where an object closer to convergence, for example, an object at a distance of 50 cm, that is, an object at a distance of 2D (diopter) is first viewed. The convergence then predicts the position of this object fairly accurately and changes the convergence angle to 2D. The adjustment sends a signal that changes the refractive power of the lens to adjust to 2D according to the convergence adjustment response.
[0008]
Here, the effect of changing the spectacles will be considered. As an example, it is assumed that glasses that are 1D stronger than conventional glasses are worn as new glasses. Then, if the refractive power of the crystalline lens is adjusted so as to look at the 2D position in the convergence adjustment response, the new eyeglass wearing adjusts the focus to the 3D position. However, such inappropriate adjustment is generally eliminated if a new spectacle adjustment program is obtained if new glasses are worn for a while. Therefore, the ability to properly adjust the refractive power of the crystalline lens with the conventional eyeglasses has become proficient so that the new eyeglasses can be used, and the subject should be able to comfortably see the object with the new eyeglasses .
[0009]
However, in actual clinical settings, new glasses may not fit the subject satisfactorily for some reason, and the subject may complain of eye fatigue. However, since it is difficult to acquire a new program for adjusting convergence for new glasses, there has been a problem that a device for objectively examining eye fatigue has not existed.
[0010]
[Problems to be solved by the invention]
The present invention has solved the above-mentioned problem. A first object is to measure a three-dimensional observation state of an eye when a viewer observes a natural three-dimensional object, so that an eye fatigue state can be accurately determined. It is an object of the present invention to provide a three-dimensional observation state measuring device and method which can be inspected at a high speed. A second object of the present invention is to provide a three-dimensional observation state in which, when a viewer observes a natural three-dimensional object, eye characteristics such as refractive power, convergence, and pupil diameter of the viewer's eye can be easily measured. It is to provide a measuring device and a method.
[0011]
[Means for Solving the Problems]
The three-dimensional observation state measurement device of the present invention that achieves the above object includes, for example, as shown in FIG. 1, an image acquisition unit 20 that acquires a stereo image including a line-of-sight direction, and a stereo image acquired by the image acquisition unit 20. A coordinate acquisition unit 22 that acquires a three-dimensional coordinate value of the observation target object 10 in the gaze direction, a gaze direction detection unit 30 that detects a gaze direction of the eye 14 to be inspected, and a gaze detected by the gaze direction detection unit 30. Gazing point position measuring unit 32 for obtaining the gazing point position of the eye 14 to be examined, the gazing point position obtained by the gazing point position measuring unit 32, and the observation target 10 in the line of sight at the time of obtaining the gazing point position. And a coordinate comparing unit 40 for comparing the coordinate value of the gazing point.
[0012]
In the device configured as described above, the image obtaining unit 20 obtains a stereo image including the line-of-sight direction. Typically, the image of the observation target 10 is included in the stereo image. The coordinate obtaining unit 22 obtains three-dimensional coordinate values of the observation target object 10 in the line of sight direction based on the stereo image obtained by the image obtaining unit 20. I do. The gazing point position measuring unit 32 obtains the gazing point position of the eye 14 from the line of sight detected by the sight line direction detecting unit 30. The coordinate comparing unit 40 detects the gazing point position obtained by the gazing point position measuring unit 32 and the line of sight at the time when the gazing point position is obtained by the line of sight direction detecting unit 30, and detects the observation target in the line of sight. The deviation is obtained by comparing with the coordinate values of 10. The deviation obtained by the coordinate comparing unit 40 is considered to be useful information for an inspection when new eyeglasses are worn, for example.
[0013]
The three-dimensional observation state measuring apparatus of the present invention that achieves the above object includes, for example, as shown in FIG. 3, an image acquisition unit 20 that acquires a stereo image including a line-of-sight direction, and a stereo image acquired by the image acquisition unit 20. A coordinate acquisition unit 22 that acquires the three-dimensional coordinate value of the observation target object 10 in the line-of-sight direction, a line-of-sight direction detection unit 30 that detects the line-of-sight direction of the eye 14, and a refraction that measures the refractive power of the eye 14. A second coordinate comparison for comparing the focus position of the eye 14 obtained by the force measurement unit 34 and the refractive power measurement unit 34 with the coordinate value of the observation object 10 in the line of sight at the time when the focus position is obtained. A part 42.
[0014]
In the device configured as described above, the image obtaining unit 20 obtains a stereo image including the line-of-sight direction. Typically, the image of the observation target 10 is included in the stereo image. The coordinate obtaining unit 22 obtains three-dimensional coordinate values of the observation target object 10 in the line of sight direction based on the stereo image obtained by the image obtaining unit 20. I do. The refractive power measurement unit 34 measures the refractive power of the eye 14 to be inspected, and can obtain focus position information of the eye 14 to be inspected. The second coordinate comparison unit 42 detects the focus position of the subject's eye 14 obtained by the refractive power measurement unit 34 and the gaze direction at the time when the focus position was obtained by the gaze direction detection unit 30, and determines the gaze direction. Is compared with the gaze coordinate value of the observation target in. The deviation obtained by the second coordinate comparing unit 42 is considered to be useful information for an inspection when new glasses are worn, for example.
[0015]
The three-dimensional observation state measuring apparatus of the present invention that achieves the above object includes, for example, as shown in FIG. 6, an image acquisition unit 20 that acquires a stereo image including a line-of-sight direction, and a stereo image acquired by the image acquisition unit 20. A coordinate acquisition unit 22 that acquires the three-dimensional coordinate value of the observation target in the gaze direction, a gaze direction detection unit 30 that detects the gaze direction of the eye 14, and a refractive power that measures the refractive power of the eye 14. A measuring unit 34, a gazing point position measuring unit 32 that obtains a gazing point position of the subject's eye 14 from the gaze direction detected by the gaze direction detecting unit 30, a gazing point position obtained by the gazing point position measuring unit 32, The first coordinate comparison unit 40 that compares the coordinate value of the observation target object 10 in the line of sight at the time when the fixation point position is obtained, the focus position obtained by the refractive power measurement unit 34, and the focus position are obtained. In the gaze direction at the time And a second coordinate comparison unit 42 for comparing the coordinate values of the observation object 10.
[0016]
In the three-dimensional observation state measuring apparatus, preferably, the apparatus further includes a dichroic mirror 16 arranged in front of the eye 14 and reflecting infrared light, and the refractive power measuring unit 34 includes the dichroic mirror 16 of the eye 14. With the arrangement arranged on the axis, the arrangement of devices in the case where devices for measuring eye characteristics, such as the line-of-sight direction detection unit 30 and the refractive power measurement unit 34, are provided in parallel, is compact.
[0017]
In the three-dimensional observation state measuring device, for example, as shown in FIG. 6, preferably, further, a pupil diameter measuring unit 37 for measuring a pupil diameter of the eye 14 to be inspected, or a blink measuring unit for measuring blinking of the eye 14 to be inspected With the configuration including 38, the physiological function of the eye as a sign of eye fatigue occurring to the viewer can be measured.
[0018]
Preferably, in the three-dimensional observation state measuring device, if the refractive power of the subject's eye and the temporal change in the line of sight are measured, the deviation obtained by the coordinate comparing unit 40 and the second coordinate comparing unit 42 By using the time-dependent change of the eye, an eye fatigue mechanism occurring to the viewer can be observed.
[0019]
In the three-dimensional observation state measuring method using a computer according to the present invention that achieves the above object, for example, as shown in FIG. 2, a stereo image including a line-of-sight direction is acquired by an image acquiring unit 20 (S102), and based on the stereo image The coordinate acquisition unit 22 acquires the three-dimensional coordinate value of the observation target 10 in the line of sight (S104), the line-of-sight direction detection unit 30 detects the line-of-sight direction of the eye 14 (S108), and the gazing point position measurement unit. 32, the gazing point position of the subject's eye 14 is obtained from the line of sight detected by the sight line direction detecting unit 30 (S110), and the gazing point position obtained by the gazing point position measuring unit 32 and the gazing point position are obtained. There is a step of comparing the gaze coordinate values of the observation target object 10 in the viewing direction at the time (S112 to S116).
[0020]
In the three-dimensional observation state measurement method using a computer according to the present invention that achieves the above object, as shown in FIG. 4, for example, a stereo image including a line of sight is acquired by an image acquisition unit 20 (S202), and based on the stereo image. The three-dimensional coordinate value of the observation object 10 in the line-of-sight direction is acquired by the coordinate acquisition unit 22 (S204), the line-of-sight direction of the eye 14 is detected by the line-of-sight direction detection unit 30 (S208), and the refractive power measurement unit 34 And the focus position is determined (S212), and the focus position obtained by the refractive power measurement unit 34 and the gazing coordinates of the observation target 10 in the line of sight at the time the focus position is obtained. It has a step of comparing with the values (S214, S216).
[0021]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram illustrating the configuration of the first embodiment of the present invention. The three-dimensional observation state measurement device includes a dichroic mirror 16, an image acquisition unit 20, a coordinate acquisition unit 22, a gaze direction detection unit 30, a gazing point position measurement unit 32, a coordinate comparison unit 40, and a gaze direction coordinate calculation unit 41. This is for measuring a state in which the subject is observing the observation object 10.
Here, the observation object 10 is a three-dimensional visible object such as a doll or a structure, and may be stationary or a movable body.
[0022]
A dichroic mirror (Dichroic Mirror) 16 is a mirror that reflects only light in a specific wavelength region and transmits light in the remaining wavelength region by using light interference by a thin film. Here, the dichroic mirror 16 is installed between the subject's eye 14 and the observation target 10, reflects infrared light emitted by the line-of-sight direction detection unit 30 in the direction of the subject's eye 14, and Transmits visible light.
[0023]
The image acquisition unit 20 acquires a stereo image including the line of sight direction, and typically uses a stereo camera. A stereo camera is one that shoots an object with a camera having the same characteristics on the left and right separated by a base line distance, and the parallax of the left and right images taken by the stereo camera is important as three-dimensional height direction information, It is configured so that a photographic image with very little lens aberration can be obtained. An observation target 10 is provided in the line of sight of the teleo camera, and the magnification is considered so that the stereoscopic image includes the image of the observation target 10. If the observation target object 10 is a stationary body, the left and right images can be created with the shooting location of one camera separated by the base line distance to be a stereo image.
[0024]
The coordinate obtaining unit 22 obtains three-dimensional coordinate values of the observation target 10 based on the stereo images obtained by the image obtaining unit 20, and uses, for example, the position of the subject's eye 14 as a reference point of the coordinate values. The coordinate acquisition unit 22 uses, for example, calibration information adjusted so that three-dimensional coordinates can be obtained for a stereo image obtained by the image acquisition unit 20 in advance. As the calibration information, various parameters of the stereo image captured by the image obtaining unit 20, for example, the focal length of the lens and the value of the lens aberration are obtained using a calibrator having a known size. Such calibration information can be obtained by, for example, a surface shape measuring device using a calibrator disclosed in Japanese Patent Application Laid-Open No. 2003-42730 and 42732 proposed by the present applicant. In addition, the coordinate acquisition unit 22 places the calibration body disclosed in Japanese Patent Application Laid-Open No. 2003-42726, which is proposed by the present applicant, at the installation location of the observation target 10 and calculates the distance from the eye to be examined to the calibration body. The direction may be measured in advance, and the three-dimensional coordinate value of the observation target 10 may be set using the measurement result of the calibration body.
[0025]
The line-of-sight direction detection unit 30 detects the line-of-sight direction of the eye 14 to be inspected, and typical detection principles include a corneal detection method and a scleral reflection method. The corneal detection method is a method of forming a virtual image on the cornea by radiation of an infrared LED (Light Emitting Diode) and detecting the movement of the virtual image as the eyeball moves. The scleral reflection method irradiates the eyes with weak infrared rays, and utilizes the fact that the amount of reflected infrared light differs between the black eyes and the white eyes.
[0026]
The gazing point position measuring unit 32 obtains the gazing point position of the eye 14 from the line of sight detected by the sight line direction detecting unit 30. Since the subject observes the observation object 10 with the left and right eyes, the gaze direction detection unit 30 detects the gaze directions of the left and right eyes 14 and obtains the intersection of the left and right gaze directions. Can be obtained.
[0027]
The gaze direction coordinate calculation unit 41 calculates a gaze coordinate value that is an intersection with the observation target 10 in the gaze direction at the time when the gaze point position is obtained by the gaze point measurement unit 32. That is, since the observation target 10 has a size as a stereoscopic image, the line-of-sight direction coordinate calculation unit 41 uses the line-of-sight direction information of the left and right subject eyes 14 detected by the line-of-sight direction detection unit 30 to calculate the left and right The coordinate value of the observation target object 10 corresponding to the gazing point is obtained by the subject's eye 14. When the line of sight of the left and right eyes 14 and the surface of the observation object 10 are not substantially converged at one point, only one of the left and right eyes 14 is gazing at the surface portion of the observation object 10. Since it is considered that there is no state, the line-of-sight direction coordinate calculation unit 41 adopts only the line of sight of the effective eye or an intermediate position in the direction in which the left and right eyes 14 are looking at the observation object 10. It is advisable to take appropriate measures such as
[0028]
The coordinate comparing unit 40 compares the gazing point position obtained by the gazing point position measuring unit 32 with the coordinate value of the observation target 10 obtained by the gaze direction coordinate calculating unit 41, and obtains a difference between the two. Then, the coordinate comparing unit 40 compares the divergence amount between the gazing point and the gazing coordinate value with a reference value set for identifying the degree of eye fatigue of the subject, and determines whether the left and right eyes 14 are healthy. It is determined whether the subject is in a normal state or in an eye fatigue state. The reference value set in the coordinate comparison unit 40 is set using a standard subject adjustment function in a group examination or the like, and when set for an individual subject, the reference value of the individual subject is set. The setting may be made using the inspection history of the examiner.
[0029]
The operation of the device configured as described above will now be described. FIG. 2 is a flowchart showing an example of a three-dimensional observation state measuring method using the apparatus of FIG. First, the observation target 10 is placed near the three-dimensional observation state measuring device (S100). Then, the image acquisition unit 20 acquires a stereo image including the line-of-sight direction (S102), and based on the stereo image, the coordinate acquisition unit 22 acquires three-dimensional coordinate values of the observation target 10 in the line-of-sight direction (S104). Next, the subject is guided to a predetermined position of the three-dimensional observation state measuring device, for example, on the optical axis of the dichroic mirror 16 and the observation target 10 (S106).
[0030]
Then, the three-dimensional observation state measurement device detects the gaze direction of the eye 14 by the gaze direction detection unit 30 (S108), and the left and right eyes to be detected detected by the gaze direction detection unit 30 by the gazing point position measurement unit 32. The gazing point position of the subject's eye 14 is determined from the viewing direction of the eye 14 (S110). The gaze direction coordinate calculation unit 41 calculates a gaze coordinate value that is the gaze direction at the time when the gaze point position is obtained by the gaze direction detection unit 30 and that is an intersection with the observation target object 10 (S112).
[0031]
Then, the coordinate comparing unit 40 compares the gazing point position obtained by the coordinate gazing point position measuring unit 32 with the gazing coordinate value obtained in S112, and calculates a deviation amount (S114). Then, the coordinate comparing unit 40 compares whether the deviation amount is larger than the reference value (S116), and when it is larger, determines that the eye fatigue of the subject's eye is large (S118), and An instruction is given to stop observing the observation object 10 and take a rest (S120). On the other hand, if it is small in S116, it can be determined that the eye fatigue of the subject's eye is small, so that the subject is allowed to observe the observation target 10 (S122). The subject may return to S106 and continue observation of the observation target object 10.
[0032]
FIG. 3 is a block diagram illustrating the configuration of the second embodiment of the present invention. The three-dimensional observation state measuring device includes a dichroic mirror 16, a half mirror 8, an image acquisition unit 20, a coordinate acquisition unit 22, a gaze direction detection unit 30, a refractive power measurement unit 34, a gaze direction adjustment unit 36, and a gaze direction coordinate calculation unit 41. And a second coordinate comparing unit 42. In FIG. 3, the same elements as those described in FIG. 1 are denoted by the same reference numerals, and description thereof will be omitted.
[0033]
In the figure, the half mirror 8 branches the infrared light from the left and right eyes 14 reflected by the dichroic mirror 16 to a refractive power measuring unit 34 and a line-of-sight direction detecting unit 30. The refractive power measuring unit 34 measures the refractive power of the eye 14 to be examined, and a so-called objective type eye refractive power measuring device is used. In an objective-type eye refractive power measuring device, for example, a measurement target image is projected on the fundus of the eye to be inspected, and the refractive power of the eye to be inspected is measured based on the in-focus state of the measurement target image. The focus position on the visual axis can be obtained. In this case, the focus information can be obtained more precisely using the convergence angle. Here, convergence means that the visual axes of both eyes are concentrated on an object to be viewed, and the angle formed by the visual axes of both eyes is called a convergence angle.
[0034]
The gaze direction adjustment unit 36 also observes the direction of the eyeball at the same time as the gaze direction measurement by the gaze direction detection unit 30, and simultaneously rotates and moves the dichroic mirror 16 and the refractive power measurement unit 34 in accordance with the movement in the gaze direction. To match. The line-of-sight direction adjustment unit 36 can prevent the optical axis measured by the refractive power measurement unit 34 from shifting due to eye movement. The second coordinate comparison unit 42 compares the focus position obtained by the refractive power measurement unit 34 with the coordinate value of the observation target 10 obtained by the line-of-sight direction coordinate calculation unit 41, and obtains a difference between the two. . Then, the second coordinate comparing unit 42 compares the amount of deviation between the focus position and the gaze coordinate value with a reference value set for identifying the degree of eye fatigue of the subject, and compares the left and right eyes to be examined. It is determined whether 14 is in a healthy state or in an eye fatigue state.
[0035]
The operation of the device configured as described above will now be described. FIG. 4 is a flowchart showing an example of a three-dimensional observation state measuring method using the apparatus of FIG. First, the observation target 10 is set near the three-dimensional observation state measuring device (S200). Then, the image acquisition unit 20 acquires a stereo image including the line-of-sight direction (S202), and based on the stereo image, the coordinate acquisition unit 22 acquires three-dimensional coordinate values of the observation target 10 in the line-of-sight direction (S204). . Next, the subject is guided to a predetermined position of the three-dimensional observation state measuring device, for example, on the optical axis of the dichroic mirror 16 and the observation object 10 (S206).
[0036]
Then, the three-dimensional observation state measuring device detects the gaze direction of the subject's eye 14 by the gaze direction detection unit 30 (S208), and determines the gaze point position by the gaze direction detection unit 30 by the gaze direction coordinate calculation unit 41. A gaze coordinate value, which is the line-of-sight direction and an intersection with the observation target object 10, is calculated (S210). Further, the focus position of the subject's eye 14 is determined by the refractive power measuring unit 34 (S212). In this case, information on the convergence angle measured by the refractive power measurement unit 34 may be added.
[0037]
Then, the second coordinate comparing unit 42 compares the focus position obtained by the refractive power measuring unit 34 with the gaze coordinate value obtained in S210, and calculates the amount of deviation (S214).
Next, the second coordinate comparison unit 42 compares whether the deviation amount is larger than the reference value (S216), and when it is larger, determines that the eye fatigue of the subject's eye is increased (S218), The subject is instructed to stop viewing the three-dimensional image and to take a rest (S220). On the other hand, if it is small in S216, it can be determined that the eye fatigue of the subject's eye is small, so that the subject is allowed to observe the observation target 10 (S222). The subject may return to S206 and continue to observe the observation target object 10.
[0038]
FIG. 5 is a flowchart illustrating details of S210 in FIG. First, infrared light is incident on the subject's eye 14 by the refractive power measurement unit 34 (S252). Then, the refractive power measurement unit 34 projects the ring-shaped index on the fundus, and performs fine alignment following coarse alignment (S254, S256). Then, the dichroic mirror 16 is changed according to the congestion (S258). Then, the refractive power measuring unit 34 measures the ring-shaped shape projected on the fundus by the fundus image detecting unit arranged in a conjugate relationship with the fundus, and measures the deformation of the shape to obtain the refractive power (S260). ). Further, the refractive power measuring unit 34 can measure the pupil diameter and, if necessary, the convergence. The refractive power measurement unit 34 can determine the focus position where the eye is focused from the measured refractive power. Then, it is determined whether or not the measurement time has ended (S262). If the measurement time has not ended, the process returns to S256 to continue the measurement. If finished, return.
[0039]
FIG. 6 is a block diagram illustrating the configuration of the third embodiment of the present invention. In the third embodiment, the coordinate comparison unit 40 in the first embodiment is combined with the second coordinate comparison unit 42 in the second embodiment. Further, the half mirror 19 is provided between the dichroic mirror 16 and the observation target 10, and guides the image of the eye 14 to the pupil diameter measurement unit 37 and the blink measurement unit 38. The pupil diameter measuring unit 37 measures the pupil diameter. The blink measurement unit 38 measures the number of blinks of the subject's eye 14. The eye fatigue determination unit 39 compares the pupil diameter measured by the pupil diameter measurement unit 37 with a reference value of the pupil diameter when the subject looks at an image close to the subject, and determines whether the pupil contraction is performed normally. To determine eye fatigue. The eye fatigue determining unit 39 compares the number of blinks of the eye 14 measured by the blink measuring unit 38 with the number of standard blinks in a state where the eye adjustment function is sufficiently exhibited. If the number of times has decreased, it is determined that the subject is in eye fatigue state.
[0040]
With this configuration, the gazing point position obtained by the gazing point position measuring unit 32 and the gazing point position obtained by the refractive power measuring unit 34 are obtained for the coordinate values of the observation target 10 obtained by the gaze direction coordinate calculating unit 41. The degree of eye fatigue of the subject's eye can be measured using the two information of the focus position, and the measurement reliability is improved.
[0041]
Further, as a physiological function of a healthy eye, there is a tendency that the pupil becomes small when looking at a close place, but the function of adjusting the size of the pupil by the pupil diameter measurement by the pupil diameter measurement unit 37. Is responding correctly. In addition, as a physiological function of healthy eyes, blinking is performed at a certain frequency.However, in the state of eye strain, the number of blinks decreases and the surface of the cornea dries, A phenomenon that the degree of fatigue further increases is known. Therefore, it is preferable that the blink measurement unit 38 measures the number of blinks of the subject to observe signs of eye fatigue.
[0042]
In the above-described embodiment, the degree of eye fatigue of the subject's eye is measured by using a gaze direction detecting unit or a refractive power measuring unit as a three-dimensional observation state measuring device and measuring the visual acuity for a relatively short time of about several minutes. However, the present invention is not limited to this. For example, the temporal change of the eye fatigue degree is measured using the temporal change information of the gazing point position and the focus position for a relatively long time of about several hours. You may do so.
[0043]
【The invention's effect】
As described above, according to the three-dimensional observation state measuring device of the present invention, the image acquisition unit that acquires a stereo image including the line of sight, and the observation of the line of sight based on the stereo image obtained by the image acquisition unit A coordinate acquisition unit that acquires three-dimensional coordinate values of the target object, a gaze direction detection unit that detects a gaze direction of the eye to be inspected, and a gazing point position of the eye to be inspected from the gaze detected by the gaze direction detection unit A gazing point position measuring unit, and a coordinate comparing unit for comparing the gazing point position obtained by the gazing point position measuring unit with the gazing coordinate value of the observation target in the line of sight at the time when the gazing point position is obtained. With the configuration, the direction and distance of the observation object viewed by the subject are dynamically and three-dimensionally measured by the image acquisition unit and the coordinate acquisition unit, and the three-dimensional measurement position and the subject's By comparing with the fixation point position , Eye fatigue state can be accurately inspected.
[0044]
Further, according to the three-dimensional observation state measuring device of the present invention, an image acquisition unit that acquires a stereo image including the line-of-sight direction, and based on the stereo image obtained by the image acquisition unit, the observation object in the line-of-sight direction A coordinate acquisition unit that acquires three-dimensional coordinate values, a gaze direction detection unit that detects the gaze direction of the eye to be inspected, a refractive power measurement unit that measures the refractive power of the eye to be inspected, and a refractive power measurement unit that is obtained by the refractive power measurement unit The configuration includes a second coordinate comparison unit that compares the focus position of the eye to be inspected and the gaze coordinate value of the observation target in the line of sight at the time of obtaining the focus position. The direction and distance of the object to be observed are dynamically and three-dimensionally measured by the image acquisition unit and the coordinate acquisition unit, and the three-dimensional measurement position is compared with the focus position of the eye to be examined, so that the eye fatigue state is obtained. Can be accurately inspected. In addition, since the refractive power measurement unit can easily measure the eye characteristics such as the refractive power, convergence, and pupil diameter of the viewer's eye to be inspected, for example, an examination at the time of wearing new glasses can be accurately obtained as information suitable for correction. it can. In addition, since the focus position of the subject's eye can be measured with the left and right eyes, the optical system is simpler than in the case where both the left and right eyes are always required to obtain the gaze point position as in the gaze point measurement unit. Can be
[Brief description of the drawings]
FIG. 1 is an overall configuration block diagram for explaining a first embodiment of the present invention.
FIG. 2 is a flowchart showing an example of a three-dimensional observation state measuring method using the apparatus of FIG.
FIG. 3 is an overall configuration block diagram for explaining a second embodiment of the present invention.
FIG. 4 is a flowchart illustrating an example of a three-dimensional observation state measuring method using the apparatus of FIG. 3;
FIG. 5 is a flowchart illustrating details of S210 in FIG. 4;
FIG. 6 is a configuration block diagram illustrating a third embodiment of the present invention.
[Explanation of symbols]
REFERENCE SIGNS LIST 10 observation object 14 eye 20 to be examined 20 image acquisition unit 22 image coordinate acquisition unit 30 gaze direction detection unit 32 gaze point measurement unit 34 refractive power measurement unit 37 pupil diameter measurement unit 38 blink measurement units 40, 42 coordinate comparison unit 41 gaze direction Coordinate calculator

Claims (8)

視線方向を含むステレオ画像を取得する画像取得部と;
当該画像取得部で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部と;
被検眼の視線方向を検出する視線方向検出部と;
前記視線方向検出部で検出された視線から、前記被検眼の注視点位置を求める注視点位置測定部と;
前記注視点位置測定部で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する座標比較部と;を備える三次元観察状態測定装置。
An image acquisition unit for acquiring a stereo image including the line of sight;
A coordinate acquisition unit that acquires three-dimensional coordinate values of the observation target in the line-of-sight direction based on the stereo image obtained by the image acquisition unit;
A gaze direction detection unit that detects a gaze direction of the eye to be inspected;
A gazing point position measuring unit that obtains a gazing point position of the eye to be inspected from the sight line detected by the sight line direction detecting unit;
A three-dimensional observation state measurement comprising: a gazing point position obtained by the gazing point position measuring section; and a coordinate comparing section for comparing the gazing coordinate value of the observation target in the line of sight at the time of obtaining the gazing point position. apparatus.
視線方向を含むステレオ画像を取得する画像取得部と;
当該画像取得部で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部と;
被検眼の視線方向を検出する視線方向検出部と;
前記被検眼の屈折力を測定する屈折力測定部と;
前記屈折力測定部で得られた前記被検眼のピント位置と、当該ピント位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する第2の座標比較部と;を備える三次元観察状態測定装置。
An image acquisition unit for acquiring a stereo image including the line of sight;
A coordinate acquisition unit that acquires three-dimensional coordinate values of the observation target in the line-of-sight direction based on the stereo image obtained by the image acquisition unit;
A gaze direction detection unit that detects a gaze direction of the eye to be inspected;
A refractive power measuring unit for measuring the refractive power of the eye to be examined;
A second coordinate comparing unit that compares the focus position of the eye to be inspected obtained by the refractive power measurement unit and the gaze coordinate value of the observation target in the line of sight at the time of obtaining the focus position. Original observation state measurement device.
視線方向を含むステレオ画像を取得する画像取得部と;
当該画像取得部で得られたステレオ画像に基づき、当該視線方向の観察対象物の三次元座標値を取得する座標取得部と;
被検眼の視線方向を検出する視線方向検出部と;
前記被検眼の屈折力を測定する屈折力測定部と;
前記視線方向検出部で検出された視線方向から、前記被検眼の注視点位置を求める注視点位置測定部と;
前記注視点位置測定部で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する第1の座標比較部と;前記屈折力測定部で得られたピント位置と、ピント位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する第2の座標比較部と;を備える三次元観察状態測定装置。
An image acquisition unit for acquiring a stereo image including the line of sight;
A coordinate acquisition unit that acquires three-dimensional coordinate values of the observation target in the line-of-sight direction based on the stereo image obtained by the image acquisition unit;
A gaze direction detection unit that detects a gaze direction of the eye to be inspected;
A refractive power measuring unit for measuring the refractive power of the eye to be examined;
A gazing point position measuring unit that obtains a gazing point position of the eye to be inspected from a gaze direction detected by the gaze direction detecting unit;
A first coordinate comparison unit that compares the fixation point position obtained by the fixation point position measurement unit with the fixation coordinate value of the observation target in the line of sight at the time when the fixation point position is obtained; A second coordinate comparison unit that compares the focus position obtained by the unit with the gaze coordinate value of the observation target in the line of sight at the time of obtaining the focus position.
前記三次元観察状態測定装置において、さらに被検眼の前に配置され、赤外反射するダイクロイックミラーを備え;
前記屈折力測定部が、前記被検眼の前記ダイクロイックミラーを含む反射光軸上に配置された;
請求項1ないし請求項3の何れか1項に記載の三次元観察状態測定装置。
The three-dimensional observation state measuring apparatus further includes a dichroic mirror disposed in front of the subject's eye and reflecting infrared light;
The refractive power measurement unit is disposed on a reflection optical axis including the dichroic mirror of the eye to be inspected;
The three-dimensional observation state measuring device according to any one of claims 1 to 3.
前記三次元観察状態測定装置において、さらに、前記被検眼の瞳孔径を測定する瞳孔径測定部、または、前記被検眼のまばたきを測定するまばたき測定部を備えた;
請求項1ないし請求項3の何れか1項に記載の三次元観察状態測定装置。
The three-dimensional observation state measuring apparatus further includes a pupil diameter measurement unit that measures a pupil diameter of the eye to be inspected, or a blink measurement unit that measures blinking of the eye to be inspected;
The three-dimensional observation state measuring device according to any one of claims 1 to 3.
被検眼の屈折力と視線方向の経時変化を測定するように構成されていることを特徴とする請求項1ないし請求項5の何れか1項に記載の三次元観察状態測定装置。The three-dimensional observation state measuring device according to any one of claims 1 to 5, wherein the three-dimensional observation state measurement device is configured to measure a temporal change in a refractive power and a line-of-sight direction of the eye to be inspected. 画像取得部により視線方向を含むステレオ画像を取得し;
前記ステレオ画像に基づき、座標取得部により当該視線方向の対象物の三次元座標値を取得し;
視線方向検出部により被検眼の視線方向を検出し;
注視点位置測定部により、前記視線方向検出部で検出された視線から、前記被検眼の注視点位置を求め;
前記注視点位置測定部で得られた注視点位置と、当該注視点位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する;コンピュータを用いた三次元観察状態測定方法。
Acquiring a stereo image including the line-of-sight direction by the image acquisition unit;
Based on the stereo image, a coordinate acquisition unit acquires three-dimensional coordinate values of the object in the line-of-sight direction;
A gaze direction detector for detecting a gaze direction of the subject's eye;
A gazing point position measuring unit that determines a gazing point position of the subject's eye from the line of sight detected by the sight line direction detecting unit;
A gazing point position obtained by the gazing point position measuring unit is compared with a gazing coordinate value of an observation target in a line of sight at the time when the gazing point position is obtained; a three-dimensional observation state measuring method using a computer.
画像取得部により視線方向を含むステレオ画像を取得し;
前記ステレオ画像に基づき、座標取得部により当該視線方向の対象物の三次元座標値を取得し;
視線方向検出部により被検眼の視線方向を検出し;
屈折力測定部により前記被検眼の屈折力を測定すると共にピント位置を求め;前記屈折力測定部で得られたピント位置と、当該ピント位置を求めた時点の視線方向における観察対象物の注視座標値とを比較する;コンピュータを用いた三次元観察状態測定方法。
Acquiring a stereo image including the line-of-sight direction by the image acquisition unit;
Based on the stereo image, a coordinate acquisition unit acquires three-dimensional coordinate values of the object in the line-of-sight direction;
A gaze direction detector for detecting a gaze direction of the subject's eye;
A refractive power measuring unit measures the refractive power of the eye to be examined and determines a focus position; a focus position obtained by the refractive power measuring unit, and a gazing coordinate of the observation target in a line of sight at the time when the focus position is determined. Compare with the value; a method of measuring the three-dimensional observation state using a computer.
JP2003092921A 2003-03-28 2003-03-28 Three-dimensional observation state measuring apparatus and method Expired - Fee Related JP4121881B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2003092921A JP4121881B2 (en) 2003-03-28 2003-03-28 Three-dimensional observation state measuring apparatus and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2003092921A JP4121881B2 (en) 2003-03-28 2003-03-28 Three-dimensional observation state measuring apparatus and method

Publications (2)

Publication Number Publication Date
JP2004298290A true JP2004298290A (en) 2004-10-28
JP4121881B2 JP4121881B2 (en) 2008-07-23

Family

ID=33405835

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2003092921A Expired - Fee Related JP4121881B2 (en) 2003-03-28 2003-03-28 Three-dimensional observation state measuring apparatus and method

Country Status (1)

Country Link
JP (1) JP4121881B2 (en)

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006309432A (en) * 2005-04-27 2006-11-09 Toyota Motor Corp Driver state estimation device
JP2006305325A (en) * 2005-03-31 2006-11-09 Topcon Corp Ophthalmic equipment
JP2007094716A (en) * 2005-09-28 2007-04-12 Fuji Heavy Ind Ltd Vehicle driving support device
JP2009022308A (en) * 2007-07-17 2009-02-05 Kowa Co Image processing device
WO2009139740A1 (en) * 2008-05-12 2009-11-19 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
JP2010535049A (en) * 2007-07-30 2010-11-18 レイン アプライド ダイアノスティクス リミテッド Optical measuring apparatus and optical measuring method
CN109381158A (en) * 2017-08-04 2019-02-26 黎浩桦 Adapter, fundus camera system including adapter, and method of using same
CN120732352A (en) * 2025-08-18 2025-10-03 中国科学院长春光学精密机械与物理研究所 Human eye dynamic refraction detection method based on three-dimensional phase deflection method

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104980732B (en) * 2008-05-12 2018-01-16 汤姆森特许公司 The system and method for measuring the potential eye fatigue of stereoscopic motion picture

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0321222A (en) * 1989-06-19 1991-01-30 Agency Of Ind Science & Technol Device for simultaneously adjusting and measuring convergence
JPH10276987A (en) * 1997-04-03 1998-10-20 Sony Corp Eye position detection device
JP2003042732A (en) * 2001-08-02 2003-02-13 Topcon Corp Surface shape measuring device and method, surface shape measuring program, and surface state mapping device

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0321222A (en) * 1989-06-19 1991-01-30 Agency Of Ind Science & Technol Device for simultaneously adjusting and measuring convergence
JPH10276987A (en) * 1997-04-03 1998-10-20 Sony Corp Eye position detection device
JP2003042732A (en) * 2001-08-02 2003-02-13 Topcon Corp Surface shape measuring device and method, surface shape measuring program, and surface state mapping device

Cited By (12)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2006305325A (en) * 2005-03-31 2006-11-09 Topcon Corp Ophthalmic equipment
JP2006309432A (en) * 2005-04-27 2006-11-09 Toyota Motor Corp Driver state estimation device
JP2007094716A (en) * 2005-09-28 2007-04-12 Fuji Heavy Ind Ltd Vehicle driving support device
JP2009022308A (en) * 2007-07-17 2009-02-05 Kowa Co Image processing device
JP2010535049A (en) * 2007-07-30 2010-11-18 レイン アプライド ダイアノスティクス リミテッド Optical measuring apparatus and optical measuring method
WO2009139740A1 (en) * 2008-05-12 2009-11-19 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
JP2011520398A (en) * 2008-05-12 2011-07-14 トムソン ライセンシング System and method for measuring potential eye strain from stereoscopic video
US8787654B2 (en) 2008-05-12 2014-07-22 Thomson Licensing System and method for measuring potential eyestrain of stereoscopic motion pictures
CN102027752B (en) * 2008-05-12 2016-02-17 汤姆森特许公司 System and method for measuring potential eyestrain of stereoscopic motion picture
CN109381158A (en) * 2017-08-04 2019-02-26 黎浩桦 Adapter, fundus camera system including adapter, and method of using same
CN109381158B (en) * 2017-08-04 2023-06-20 黎浩桦 Adapter, fundus camera system including adapter and method of using same
CN120732352A (en) * 2025-08-18 2025-10-03 中国科学院长春光学精密机械与物理研究所 Human eye dynamic refraction detection method based on three-dimensional phase deflection method

Also Published As

Publication number Publication date
JP4121881B2 (en) 2008-07-23

Similar Documents

Publication Publication Date Title
JP4942661B2 (en) Design method for eyeglass lenses considering individual head and eye movements
CN109964167B (en) Method for determining eye parameters of a user of a display device
KR100729889B1 (en) Optometry
US9055890B2 (en) Eyeglass prescription method
JP5997351B2 (en) Manufacturing method of spectacle lens
US20050030477A1 (en) Apparatus and method for determining objective refraction using wavefront sensing
KR101789972B1 (en) Method and system for determining the refractive properties of an eye of a child
US10959615B2 (en) Eye-fatigue examining device and eye-fatigue examining method
US20100030570A1 (en) Systems and methods for ordering lenses
WO2004086962A1 (en) Refraction measuring instrument
TW200527032A (en) Method for designing spectacle lenses taking into account an individual's head and eye movement
JP4121881B2 (en) Three-dimensional observation state measuring apparatus and method
JP4890060B2 (en) Ophthalmic equipment
JP4551107B2 (en) Optical system alignment apparatus and method, and three-dimensional observation state measurement apparatus and method using the same
CN114340472B (en) Joint determination of accommodation and vergence
JP4121880B2 (en) Three-dimensional observation state measuring apparatus and method
JP7600985B2 (en) Optometry Equipment
CN118591336B (en) Methods, apparatus, and computer programs for determining the sensitivity of at least one eye of a test subject.
JP2017000224A (en) Vision testing apparatus
KR20230059330A (en) Machine learning-based eyeglasses ordering devices and methods with VR
CN120322186A (en) Apparatus and method for determining refractive error of at least one eye of a subject

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20060207

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20070904

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20070911

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20071030

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20080415

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20080430

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110509

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110509

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120509

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130509

Year of fee payment: 5

LAPS Cancellation because of no payment of annual fees