HK1028121A - Simulation system for wearing glasses - Google Patents

Description

Glasses try-on simulation system

The present invention relates to a glasses fitting simulation system for displaying a composite image of a frame of a glasses with respect to an image of a person who does not wear glasses, that is, fitting glasses in a virtual mode, and more particularly, to a glasses fitting simulation system for easily and accurately determining a frame and lenses preferred by a glasses wearer.

Simulation systems for spectacle wearers have been developed for some time to date. For example, japanese laid-open patent No.61-80222 proposes a system that takes a portrait using a camera, determines a glasses area on the portrait in a square frame display, and generates a composite image by superimposing a frame on this area. Further, japanese laid-open patent No.63-76581 proposes a system that determines a photographic magnification ratio of a composite image of a portrait and a spectacle frame by comparing an actual measurement value of PD (eye distance) with an actual measurement value of the image.

However, with the simulation systems disclosed in the above-mentioned Japanese unexamined patent publication Nos. 61-80222 and 63-76581, it is difficult to simultaneously compare and study wearing states of various frames on a screen, and the operation is complicated. Further, these systems only simulate the wearing state of the frame, and cannot compare the state in which the actual specification lenses are mounted on the frame, and cannot compare the simulation to determine preferred eyeglasses that satisfy conditions such as light weight, good look, and the like.

Furthermore, a method is proposed, wherein a computer selects a lens shape adapted to the shape of the face of a spectacle wearer according to predetermined design rules. This approach does not adequately reflect the preferences of the eyeglass wearer.

In view of the above, an object of the present invention is to provide a spectacle fitting simulation system capable of simulating a state of a lens in consideration, approaching an actual wearing state of the lens, and easily and accurately specifying spectacles suited to the preference of a person.

Another object of the present invention is to provide a spectacle try-on simulation system which makes a judgment based on spectacles specified from a large amount of readily understandable frame information.

It is still another object of the present invention to provide a glasses fitting simulation system which can easily generate and select a lens type preferred by a person while confirming a glasses wearing state.

To achieve the above object, the present invention adopts the following configuration.

The spectacle try-on simulation system (configuration 1) of the present invention is characterized in that the system has the following functions: capturing and displaying a portrait of a person without glasses as image data on a display screen; selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance; synthesizing the image of the selected picture frame with the portrait and displaying a synthesized image simulating the picture frame on the display screen; and a lens selection support function of calculating a lens shape state when the lens is mounted on the selected frame based on lens specification data, lens material data, and lens optical design data input in advance, and displaying the calculation result of the lens shape in numerical values or figures.

Numerical or graphical lens shape data includes, for example, numerical lens thickness, graphical lens appearance and shape. Specifically, by displaying the information on the lens shape data relating to the thickness of the peripheral portion (edge) of the lens when the lens is mounted on the frame in numerical values or graphics, the appearance of the lens viewed from the side, etc. can be perceived. Thus, a simulation that approximates and actually simulates the wearing state can be achieved, and the optimum glasses can be selected. In addition, frame shape data (numerical or graphically displayed edges, endpieces, temples, and other shape and size data) may be included and displayed along with the lens shape data.

An aspect (configuration 2) of configuration 1 is characterized in that the composite image and the lens shape data according to the lens selection support function can be displayed side by side on the display screen, and further, the weight of the lens calculated according to the lens selection support function can be displayed on the display screen.

Since the composite image and the lens shape data are displayed side by side on the display screen, complicated judgment can be made at the time of determining the glasses. In addition, since the weight of the lenses is also displayed on the display screen, the glasses related to the preference of people can be determined from the weight perspective, and the optimal glasses selection can be made.

Another aspect (configuration 3) of the above configuration 1 is characterized in that a lens value can be displayed on the above display screen according to the degree of lens surface treatment.

Since the degree of lens surface treatment, e.g., the degree of anti-reflective coating (with or without, the degree of surface treatment (difference in transmittance, difference in color interference of the coating surface)), can be immediately known, lens selection can be rapidly made from a variety of angles. When a value corresponding to the degree of the antireflection coating applied to the lens surface is displayed, it is preferable to also display an image indicating a transmittance state in accordance with the degree of the antireflection coating.

Still another aspect (configuration 4) of the above configuration 1 is characterized in that a plurality of shape data calculated by the lens selection support function based on the above lens specification data, lens material data, and lens optical design data can be displayed on the above display screen.

Since comparison and collation are performed by displaying a plurality of lens shape data on the display screen, a desired lens can be selected quickly and easily.

Still another aspect (configuration 5) of the configuration 1 is characterized in that a plurality of synthetic images formed by simulating a plurality of selected mirror frames on the portrait are displayed side by side on the display screen.

When the composite images with the plurality of lenses are displayed side by side on the display screen in this manner, the difference between the images of the respective frames added to the figure can be easily recognized, compared and collated, so that the eyeglass wearer can easily select his or her favorite eyeglasses.

Still another aspect (configuration 6) of the above configuration 1 is characterized by including a guide screen which guides the flow of the entire system operation, including the above-described frame selection operation, until the desired glasses are selected.

With a similar guidance screen, it is easy to operate the system alone and determine the glasses they like, even if the person ordering the glasses is not familiar with the system.

Still another aspect (configuration 7) of the above configuration 1 is characterized in that it further includes a measuring function for displaying a ruler display image by superimposing on the portrait on a display screen, wherein the portrait is glasses-free, and a distance in a face width direction of the portrait can be read by the ruler display image; and is used to obtain face width data from the display screen.

Face width, eye distance, and other face width data are used, for example, to avoid determining too large or too small frames, and/or to determine a composite ratio between frames and portrait on a display screen.

Still another aspect (configuration 8) of the above configuration 1 is characterized in that it includes a face surface processing function according to image processing with respect to the portrait on the display screen.

Facial surface treatment is a treatment process used to blur or mask wrinkles and imperfections, and/or to correct the skin tone of the face to make it more beautiful and natural. More specifically, the process of blurring or masking wrinkles and imperfections is accomplished by blending the colors of points within the area by dividing the face surface into fine areas and correcting the colors within each area to a mixed color.

Still another aspect of the above configuration 8 (configuration 9) is characterized by an image processing procedure not performing the above-described face surface processing function to the eyes and the mouth.

Since the image processing process according to the above-described face surface processing function is not performed on the eyeglasses and the mouth, the processing process can be completed while sufficiently holding the face of the wearer of the eyeglasses.

Still another aspect (configuration 10) of the above configuration 1 is characterized in that it has an inspection function screen on which, since at least a frame type, a lens shape, and a frame price are displayed and checked, the above factors are selected and displayed on the display screen according to a function of selecting the above frame.

Due to the frame type, the lens shape and the frame price are displayed simultaneously on the screen, and a plurality of complex judgments can be easily made in determining the frame by checking the frame on the basis of the frame data.

Still another aspect (configuration 11) of the above configuration 1 is characterized in that it includes a screen graphically displaying lens design data determined by the specifications of eyeglasses.

As the lens layout data, the optical center position, the eyepoint position, the layout of the distance vision area (distance area) and near vision area (reading area), the position of the hole for mounting the frame element on the lens, and the like can be noted. Since the layout data is displayed graphically, the layout state can be visually confirmed.

Still another aspect (configuration 12) of the above configuration 1 is characterized in that it has an order-making function for processing an order arrangement including frame data required for manufacturing eyeglasses after the specification of lenses is determined, and lens data processing instructions.

Furthermore, the eyewear try-on simulation system of the present invention (configuration 13) is characterized in that it has the following functions: capturing and displaying a portrait of a person without glasses as image data on a display screen; selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance; synthesizing the image of the selected picture frame with the portrait and displaying a synthesized image simulating the picture frame on the display screen; and a function of performing image processing for adding an appearance effect to the transmission image of the synthetic image lens portion in accordance with the specification lens refractive index.

By adding an appearance effect according to the refractive index in accordance with the strength of the specification lens, which shows the enlargement or reduction of the eye and the peripheral portion in accordance with the refractive index of the lens, the fitting state of the actual spectacles with the specification lens can be simulated in a realistic manner. Thus, the eyeglass wearer can make an accurate selection of eyeglasses that meets his wishes.

In addition, the transmission state according to the grade of the anti-reflection coating indicated by the lens can also be used as the appearance effect.

The spectacle fitting simulation system (configuration 14) according to the invention is characterized in that it has the following functions: capturing an image of a person without glasses displayed as image data on a display screen; selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance; the picture of the selected picture frame is synthesized with the portrait and a synthesized picture simulating the picture frame is displayed on the display screen, and the picture frame data is read from a multimedia directory and includes text data and sound data related to the selected picture frame in addition to the picture frame image of the selected picture frame.

Since the spectacle wearer can not only see the picture of the frame but also understand the frame by reading the letters describing the product and hearing the related sounds, even ordinary spectacle wearers can accurately and easily understand the features of the frame, etc., and can quickly and easily select the frame. Furthermore, it is desirable to use, as the frame image, an oblique view of the entire frame and an enlarged view of the portion near the end piece, because this allows the spectacle wearer to get a rough impression of the frame with less screens.

The eyeglass try-on simulation system (configuration 15) of the present invention is characterized by having a composite image in which a frame is simulated on a portrait of a person who does not wear eyeglasses, wherein the frame is selected from frame data including a plurality of frame images, the plurality of frames being classified according to the type of lens shape, to be displayed on a display screen.

One aspect of the above configuration 15 (configuration 16) is characterized in that the types of the above lens shapes are classified according to the number of circular elements constituting the contour of the lens shape.

The system proposes a classification method in which the shape of the lens is classified by the number of circular elements constituting the outline of the lens shape, according to an analysis of the point at which the aesthetic appearance of the shape lies in a circle (or a set of circular arcs). The number of circular elements here refers to the number of circles or arcs (including line segments as well) when the contour of the lens shape is processed into a line connecting the circles or arcs. For example, the number of circular elements is 1 when the lens shape is considered to be circular and 2 when the lens shape is composed of 2 sections considered to be circular arcs. According to this novel lens shape classification method (concept of type), lens shapes (e.g., Boston shape, Wellington shape) are classified by an appropriate classification number, and then, according to a desired lens shape selected from the lens shapes classified in this manner, a composite image of a rim on which the selected lens shape is worn is displayed, and the effect of the lens shape when worn can be immediately perceived through a display screen.

Another aspect (configuration 17) of the above configuration 15 is characterized in that a composite image of two lens frames wearing different lens shapes, which are selected from the above plurality of lens frames, is displayed side by side on the above display screen, which allows selection of a lens frame of a lens shape that is preferred by a person while comparing and collating the two composite images.

Since the composite images of two frames wearing different lens shapes can be compared and collated side by side on the display screen, the eyeglass wearer can easily select a preferred lens shape and select a desired pair of eyeglasses in a short time.

Another aspect (configuration 18) of the configuration 15 is characterized in that a system diagram of a tree structure indicating the category of the lens shapes is displayed on the display screen, and the two lens shapes displayed in the two composite images are displayed in the system diagram so as to be recognized.

Another aspect of configuration 15 above (configuration 19) is characterized in that of the plurality of currently selected lens shapes, two lens shapes that differ most in lens shape and/or lens overlay image are compared and compared.

Another aspect (configuration 20) of the configuration 15 is characterized in that a plurality of frame images of basic lens shapes classified according to the lens shape type or a plurality of combined images in which a frame of the plurality of basic lens shapes is simulated on the human image are displayed side by side on the display screen, and a combined image in which a frame of a plurality of lens shapes, each of which is further subdivided into basic lens shapes, is simulated is displayed according to selection of one of the frame images of the plurality of basic lens shapes or one of the plurality of combined images.

The spectacle try-on simulation system (configuration 21) of the present invention is characterized by having the following functions: displaying a composite image screen and a conversion operation screen side by side on a display screen, wherein the composite image screen simulates a rimless frame on a portrait without wearing glasses, and the conversion operation screen is used for converting the shape of lenses of the rimless frame; and converting the lens shape of the composite image according to the lens shape conversion operation on the conversion operation screen. Since the composite image simulating a rimless frame and the lens shape changeover operation screen are displayed side by side on the display screen, the lens shape of the composite image is changed over in correspondence with the lens shape changeover operation, the changeover operation according to the lens shape changeover operation screen is easy to understand and has outstanding operability, and further, the wearing state after the lens shape changeover can be immediately seen through the composite image.

One aspect (configuration 22) of the above configuration 21 is characterized in that the conversion of the above lens shape conversion operation is a cut conversion in which conversion of the lens portion is completed by cutting a portion of the lens with respect to the rimless frame lens shape displayed on the conversion operation screen in a curved line or a straight line.

One aspect (configuration 23) of the above configuration 21 is characterized in that the conversion according to the above lens shape conversion operation includes the following conversion: a transformation which accompanies the movement of the positions of the poles of the curves constituting the contour of the lens shape; a transition accompanied by expansion or contraction of the curve; or a movement of enlarging or reducing according to the above-mentioned lens shape.

One aspect (configuration 24) of the above configuration 21 is characterized in that the currently selected lens shape is converted by synthesizing the lens shape and the lens shape of the specific image in a desired ratio according to the conversion of the above lens shape conversion operation into image conversion.

One aspect (configuration 25) of the configuration 21 is characterized by having a contour correction function capable of projecting and correcting the lens shape contour.

FIG. 1 is a flow chart showing an overview of a glasses fitting simulation system according to an embodiment of the present invention;

fig. 2 to 28 are views showing display screens showing the contents of each processing procedure in the system of fig. 1.

Fig. 1 is a flowchart showing an overview of an eyeglass fitting simulation system according to an embodiment of the present invention, and fig. 2 to 28 are views showing display screens showing the contents of each processing procedure in the system of fig. 1. Next, the eyeglass try-on simulation system of this embodiment is described with reference to these drawings.

The basic hardware structure constituting the system is the same as that described in the following japanese laid-open patent: nos. 61-80222, 62-280717, 63-113671, 1-76362, and is constituted by a portrait photographing device, frame data, a computer, a display device (display) (not shown in the figure).

A hardware configuration different from the conventional system employs a digital camera in the portrait photographing apparatus, and a computer employs an input device including a mouse. In addition, the frame data adopts a multimedia directory, combines image data, text data and sound data, and aims to enhance operability and data capacity and further achieve human-computer interactivity.

Further, in fig. 1, the portrait data 1 preparation (step S1), the frame data preparation (step S2), the lens data 3 preparation (step S3), the use of the multimedia directory 5 (step S2), the lens shape design data 6 preparation (step S2-1), and the image synthesis 4 (step S4) are processing sections, which are features of the embodiment. The basic operation configuration will be described below according to the display screen of each processing configuration.

(step S1)

In the portrait data 1 preparation step, a customer profile of a person who goes to a shop to order glasses is first prepared. At this time, the specification of the lens to be tested by the optometrist is inputted. The digital camera takes a portrait of a customer without glasses, inputs the portrait into a computer, then prepares portrait data by displaying a portrait on a display screen and performs scale measurement, and if necessary, performs face surface treatment (beautification treatment). A digital camera is used to capture a portrait due to the diversity of photographic image post-processing techniques (which can be used), but portrait photographing is not limited to digital cameras.

In this embodiment, after photographing, image data of a portrait read by a computer is simultaneously displayed on a screen at a time, beautified with respect to the display screen while communicating with a customer, and scale measurement is performed to synthesize the portrait and a frame image.

Fig. 2 is a display screen thereof. The face image 20 is displayed on a sky blue background on the left side of the screen 21 and the screen process on the right side 22 is used for a screen for inputting and displaying symbols, numerical values, such as the name of the customer, face measurement data, and the like. Further, a beautification processing key is provided under the face image 20 in the area 24 of the left screen 21. The beautification processing key is composed of beautification processing 'start' and 'cancel' operation keys and standard keys 'L', 'M', 'H' and 'SH' for specifying beautification processing degree.

The beautification processing function is a feature of the present invention that enables beautification image processing of the face 20 and is used, for example, to simulate a decorative face in which wrinkles and imperfections are masked. The screen processing technique divides the face area into subareas and processes the colors of the subareas into mixed colors that match the colors within the divided areas, and the degree of beautification processing varies depending on the range of the subarea setting. Since the system is used to select a frame for a mirror and at the same time, people can see their own image obtained by intentionally enlarging some parts of the face, which cannot be seen in detail in daily life, the purpose of beautifying the lining is to achieve the effect of reducing psychological fluctuation in advance. However, the present invention adopts a technique of maintaining original features by adopting a technique of removing eyes and mouths from a beautification process according to a mask. In this way, the beautification process can be performed while maintaining the original features of the face.

In the right screen 22 of fig. 2, a digital display area for face measurement data is provided. Also provided in the right screen 22 are an area 25 for inputting the values of the left and right eye distance areas PD, an area 26 for inputting the values of the binocular PD, and a value input area 27 for the wearing width (face width). When the wearing width is determined, the "display" key of the ruler key is pressed, a ruler is displayed on the face image of the left screen 21, and the face width can be measured by reading the distance of the ruler image 23. The measured values of the measured face width are used as position and expansion/contraction data for synthesizing the face image and the frame image. Further, pressing the "delete" key of the scale key 28 may delete the scale image 28. Further, the PD value is measured on the screen by pressing the left and right eye positions of the face image 20 after pressing the "PD" key. If the PD value on the screen is compared with the actual PD measurement value, the screen composite magnification can be calculated, and composite screen data of the face image 20 and the frame image of the frame data can be determined.

Fig. 3 is a management screen of the glasses shop managing the system when it is not displayed to the customer. The main part of the screen is a specification input screen. The input data is stored in a database and the next time the same customer arrives at the store, the data read from the database can omit photography and other steps. In addition, modification and supplementation can be performed using the screen. While the screen of fig. 3 is being depicted, a code of the customer, data of the customer's first-time visit to the shop (as a visit history), a customer name, a sex, a distance area PD (eye distance), eyesight of the left and right eyes, a wearing width, and an age group (teenager, adolescent, middle age) may be input. Further, specification data of the left and right lenses, such as SPH (referring to spherical strength), CYL (referring to astigmatic strength), AX (referring to astigmatic axis), ADD (referring to additive strength), PRSM (referring to prism), and BASE (referring to the BASE direction of prism), may be input. Items not necessary for the lens specification may not be filled.

Furthermore, the measurement of the screen PD in the screen of fig. 2 can also be performed on this screen. The "viewpoint correction" key 30 at the upper part of the screen is pressed and the position can be inputted by moving the cross displayed on the face screen 33 to the left, right, up, or down using the arrow keys 31. Further, pressing the "ruler display" key 32 makes it possible to perform the face width measurement as shown in fig. 2. After the portrait data preparation is complete, pressing the "shop guide" key 34 moves the system to the next frame selection screen.

(step S2)

The overview of the preparation of the frame data 2 is shown in fig. 1, starting from fig. 4, the system changing to a screen operated by the customer himself. First, the photographic portrait screen 41 is displayed on the left side screen, and in order to guide the customer to complete the basic flow of operations to be started, a guidance screen is displayed on the right side screen 42, which displays the minimization screens to be shown below while playing a guidance role, and the flow of these minimization screens is indicated by arrows.

Therefore, the operator can view his/her image and grasp the flow of the selection operation to be performed, thereby achieving the effect of basic understanding of the simulation system.

Further, the guide screen of fig. 4 serves as an operation guide for determining a frame that is preferred by an individual, and includes a guide screen of a lens design method by oneself for designing a lens shape described below, or a guide screen of only a lens shape design method.

Further, in an area 43 on the upper part of the right screen 42, operation guidance information is displayed, and the guidance information is displayed on all screens below.

Fig. 5 shows a picture frame type screen, which has a "ok (next)" key 51, a "no designation" key 52, and a "return" key 53 on the upper part of the screen, and a picture frame type area on the lower part. On the guide screen 54 on the upper part of the frame type area, "press your favorite frame", "selected type is represented by a red symbol", "when a specific frame type is not specified," do not specify "key" and other information are displayed. At the bottom of the guide screen 54, 5 tilt views of the frame are shown. These 5 types of frames are classified according to frame materials and shape characteristics, and include a metal frame 55, a plastic frame 56, a rimless frame 57, a half-frame (half-type) using nylon 58, and a combined frame 59.

Further, the areas 551, 561, 571 below the typical metal frame 55, plastic frame 56, rimless frame 57 display explanatory information. For example, in the region 551 under the metal frame 55, the statement "standard frame, the main part of the frame front being made of metal" appears.

Fig. 6 and 7 are screens depicting a basic lens type database, forming the basis for classification according to the novel lens shape categories described below.

In a region 61 in the upper part of the screen of fig. 6, there are provided 4 operation keys, a "ok (next)" key, a "not designate" key, a "return" key, and a "select/compare both" key. (furthermore, pressing the "select/compare both" operation key shifts to the lens shape comparison screen described below (FIG. 7))

Further, below the area 61 is an information area 62 displaying "select (press) a picture of a shape you like", "press a 'not-designate' key when a specific shape is not selected", "compare press a 'compare' key and select both frames". A composite screen 63 in which a face wears a currently selected lens (in this operation, a certain standard lens shape is selected in advance as an assumed lens shape), and a composite screen 651-. Further, when any one of the composite screens 651-. Further, below each of the composite screens 651-659 is a "compare" key 66, and a pair of composite images can be compared and selected by pressing the "compare" key 66.

Fig. 7 is a lens shape selection function screen for comparing a pair of composite screens, which is a selection confirmation screen in more detail than the screen of fig. 6. Two contrasting screens 77, 78 for glasses with different lenses on the face are provided on the left and right sides, in the middle screen 75, as a guide for identifying and selecting the position of the currently selected lens shape, a system diagram of a tree structure (decision tree) 76 for classifying the lens shapes is shown. Accordingly, the shape features of the lens shape may be highlighted and the operator may be guided in making selections while being aware of these features.

The system design of this embodiment uses the lens shape as the most important selection factor for frame selection. In this system, a functional analysis of the lens shape is performed in advance, and a plurality of basic lens shapes are selected and classified based on the analysis type rule.

Conventional lens shapes include Paris, Semiauto, Boston, oval, quadrilateral, fox, eggplant, Wellington, Lexington, circular and octagonal shapes. However, since there is no limitation on the shape of the lens and the number of kinds of the shape is not sufficient, it is impossible to establish an ideal classification.

In this regard, in the present embodiment, according to the analysis result, that is, the shape is beautiful in a circle (or a set of circular arcs), as a classification method, a circle is taken as the center of the basic shape, and the existing lens shape is classified according to the number of circular elements contained therein. That is, since the lens shape profile closely approximates a line joining a circle and a circular arc (including a line segment), the lens shapes are classified by the number of circles or circular arcs (including a line segment) that are considered to constitute the lens shape profile. For example, in this classification method, an elliptical lens is considered to have 1 circular element, and a square-like lens is considered to have 4 circular elements (a lens is considered to have 4 portions of a circular arc). The lens shapes were divided into 9 in total. (in addition, in the present invention, the classification number is not limited to 9. for example, the classification number may be 7 shapes, 5 shapes, or 12 shapes.)

As shown in fig. 7, in this embodiment, as a method of selecting from a plurality of eyeglass try-on screens, a "pair-wise comparison method" of comparing and comparing two eyeglass try-on screens is currently employed. When there are too many screens to compare, the selection becomes complicated, and it takes a long time to make the selection (especially when the glasses wearer operates the system by himself or herself to make the selection), and therefore, the utility of the system for the glasses shop is weakened. Thus, in fig. 7, screens 77, 78 are provided for comparing two selected eyewear try-on screens. In the upper area 71 of the screen of fig. 7, there are provided a "ok (next)" key, a "no designation" key and a "back" key, and the lower area 72 displays the following information "select (press) a picture of a frame type you like" and "press the" no designation "key when a specific frame type is not designated". In addition, the areas 73, 74 above the screens 77, 78 display information describing the simulated spectacle frame, for example, "lines are highlighted to form a gentle and gentle figure" in the area 73, and "a square-like appearance forms a serious, realistic figure" in the area 74.

In addition, as a tool to further simplify the selection, a decision tree 76 is displayed in the middle screen 75 of fig. 7. The decision tree 76 is designed to be selectable on the basis of a pair-wise comparison with an intermediate branch 77 as a starting point. Further, the pair-wise comparison of this embodiment adopts a method of comparing the lens shapes of the candidate lenses when the image difference of the shapes of the lenses is the largest. That is, as shown in the figure, the method adopted is: the lens shapes are arranged on the decision tree 76 in the order of (1) - (9) according to the different lens shapes and images. First, in the center branch 77, the lens shape of (1) and the lens shape of (9) are compared on the screens 77 and 78, and a lens shape preferred by the user is selected. For example, when the lens shape of (1) is more in line with the individual's preference, the system then moves to branch 771 where the lens shape of (1) is compared to the lens shape of (5). The range of lens choices narrows in this way.

Fig. 8 is a display screen for selecting a price range of the frame. In the past, price estimation was not used in similar systems, but this functional screen was set up because one recognized that price was an important factor in making selections. In addition, the selection may be made without specifying a price range, or the selection of a price range may be changed.

FIG. 9 is a brand selection function screen. In this screen, only the subject and trademark information (brand, company name, and designer name) is displayed, and these information can be selected. The brand indicates the frame manufacturer and the designer's brand, graphic indicia, text, etc. are displayed in the lower region 91. Further, the selection may be made without specifying a brand, or the brand selection may be changed.

Fig. 10 is a screen setting the designated function (selection) of the frame, with the option of a spring hinge, a high-level elastic (shape-memory-effect) frame, a sunglass function, a frame designed for persons allergic to metal, a jewel frame (jewelry) and a gold mirror frame. In the screens of the respective functions, pictures of the frame shape in oblique view are displayed (in fig. 10, the frame shape is not shown). The selection of the setting is displayed as a selection item in the form of a graph that can be selected, and displayed as a setting selection item frame classified according to the structure, shape, and frame function. The spring hinge represents a particularly functional hinge component, the super-flexibility referring to a particular frame metal, and the sunglass function referring to a particular frame shape. Metal allergy rims serve to limit the performance of rims for persons allergic to certain metals (e.g. nickel), a gemstone rim referring to a rim inlaid with a gemstone, and a gold rim referring to a rim specification of a gold material. Further, selection may be made without specifying these special functions (selection), and selection may be added or changed.

Fig. 11 is a condition chart confirmation screen, and displays the above-described frame selection conditions, i.e., frame type (style), frame price range, type (shape) of lens shape, brand, and selection (special function). Since these frame selection conditions are displayed on the screen at the same time, the frame selection can be checked in various ways to determine the overall frame determination. If it is confirmed that the frame selection condition is not changed, the system moves to frame list selection by pressing the "search list" key 111.

Fig. 12 is a function screen for comprehensively displaying the frame charts selected according to the above selection conditions. In the upper area of the screen is an information screen 121 in which "press your favorite picture of a mirror to simulate an enlarged image", "press 'previous page", "next page' to change a page" and "search with different conditions, press 'back' key" are displayed. Further, in an area 122 on the left side of the information screen 121, there are provided "previous page", "next page", and "return" keys.

Also below the information screen 121 is a candidate frame map area, the oblique view picture of the frame is displayed in the area marked with the numeral 123, the price is shown as text information in the area 124, and text information describing the characteristics of the frame is displayed in the area 125. Under the areas 123, 124, 125, other candidate frames are also displayed in the same format.

Fig. 13 is a list candidate frame screen designated from the candidate frame of fig. 12 as a function screen constituting a multimedia list, which is one of the features of the present invention.

The screen of fig. 13 is a frame display screen, and displays a frame selected according to different conditions. The screen is comprised of an overall oblique view 136 enabling one to appreciate the overall impression of the frame, an enlarged view of the portion of the frame near the end piece 137, and textual annotations regarding frame features. And also provides the sound of the picture frame product description. To listen to the language description, the "voice description" key 138 may be pressed. In the conventional system, there is only one picture frame image, and in order to make it easier to understand one picture frame, text information and language information are added. In the upper screen area 131, information such as "try on a pair of glasses, please press the" try on "key", "return to chart", and press the "return" key "is displayed. The area 132 below it is provided with "try on" and "back" keys. Reference numeral 133 denotes a display area of the brand description, reference numeral 134 denotes a display area of the brand mark, and reference numeral 135 denotes a display area of the frame description.

In addition, in fig. 13, other frames may also be displayed in the form of split screens for comparison.

Fig. 14 shows a try-on screen 140 for trying on a selected frame, and pictures of the tried-on frames are displayed side by side on the right side of the try-on screen 140. Scroll bars 141, 142 are provided at the right and bottom edges of the try-on screen, and the position of the frame can be moved up and down or left and right from the standard wearing position according to the operation of the scroll bars 141, 142. This position adjustment function is used to determine the fitted position when the layout processing of the frame with respect to the face image of the try-on screen 140 is inappropriate.

Further, when a rimless frame is selected, it is difficult to see the contour shape of the lens, and the lens contour can be highlighted and modified using a "contour" key labeled with reference numeral 143, which corrects the strength of the contour by coloring. In addition, when preparing lens shape design data as described below, a contour correction function is provided, and the contour of the lens shape can be highlighted and corrected.

In the try-on screen 140 of fig. 14, the lens portion 144 is an image including a prescribed lens light intensity effect (appearance effect). Further, 3 keys, that is, an "end" key 145, a "catalog" key 146, and a "candidate" key 147 are provided in the lower left part of the screen of fig. 14. Pressing the "catalog" key 146 returns the system to the frame chart screen of fig. 12. Further, pressing the "candidate" key (or the "register with candidate" key) 147 records a candidate frame that someone likes and temporarily stores. Further, in the area below the frame screen on the right side of the screen, an area 148 displays the frame price, an area 149 displays the caption of the frame, and reference numerals 1410, 1411 represent frame size modification keys, and "decrease" and "increase" can be designated to change and synthesize the frame size of the face image with respect to the try-on screen 140. Further, at the lower right edge of the screen of fig. 14, function keys, i.e., "frame" key 1412, "display frame candidate" key 1413, "lens color" key 1414, "thickness/weight" key 1415, and "detail" key 1416 are provided. Pressing the "frame" key 1412 displays a magnified image, brand name, etc. of the frame, and pressing the "details" key 1416 displays, for example, the frame brand name, brand description, frame selection, etc.

Fig. 15 shows a screen displayed when the "display frame candidate" key 1413 is pressed or the like. In the area 151 on the upper right side, for example, "compare, please press the" compare "key and select 2 frames" and "enlarge the composite image on the left side and press the" enlarge "key" are displayed. The 4 screens (minimized try-on screen) on the right side of fig. 15 are try-on screens of mirror frames as candidates, and on the left side of each screen, the key 152 is a "compare" key and the key 153 is an "enlarge" key. Further, the contrast screen displayed when the "contrast" key is pressed constitutes a screen containing the pair selection/contrast method illustrated in the lens shape contrast of fig. 7.

(step S3)

Fig. 16 is a screen displayed when the "thickness/weight" key 1415 is pressed, having a lens selection support function which is one of the main features of the present invention. The lens selection support function calculates the refractive index of the lens based on previously inputted specification data, optical design data of the lens for the selected frame (specifying processing condition information if necessary), the state of the lens shape after the lens is mounted on the frame, and displays the numerical value of the lens thickness data and a figure of the lens shape based on the calculation result.

The area on the left side of the screen of fig. 16 displays a try-on screen 161 that displays a frame selected from a frame list according to a frame simulation operation, similar to the screen of fig. 14, and has a function of adjusting the position of the frame image with respect to the face image according to the operation of the scroll bar. Meanwhile, according to the above-described lens selection support function, the right screen 162 includes an area 163 displaying a lens outline pattern and an area 164 displaying numerical values of lens thickness data. In the area 163 of the lens shape figure display, the side shapes of the left and right lenses viewed from the side (cheek side) in the case of 2 types of lenses are displayed in a form of being contrasted with each other. One is a common finished lens for lens manufacturers and one is a thin finished lens specifically designed to meet the individual preferences of the eyeglass wearer. Further, in the lens thickness data numerical value display area 164, the thicknesses (maximum edge thickness (thickness of lens periphery), mm) and the lens weights (g) of the left and right lenses are displayed for the ordinary processed lens and the thin processed lens, respectively.

From the displayed values of the lens thickness data and the figure of the lens outer shape, it is possible to check whether there is a problem in selecting a frame for a large sunglass when a person (eyeglass wearer) wearing a power lens of a specification of, for example, -7 diopters selects the frame and when the thickness of the lens edge seen by another person is not a desired appearance. In addition, the lens thickness varies depending on the refractive index of the lens, the lens processing system, and the lens design, which allows its main factors to be simulated simultaneously for frame and lens selection. Further, in the transmission image of the lens portion 167 of the try-on screen 161, image processing may be performed to apply a lens intensity effect (influence) which is seen by being enlarged or reduced in accordance with the refractive index in accordance with the intensity of the prescribed lens. When the intensity effect is asserted, the lens intensity effect check key 1610 below the on-screen 161 is pressed to display a check mark in an "on" state, as shown. In addition, to remove the intensity effect, the check key may be pressed once again to obtain a blank display, i.e., in the "off" state. The fitting situation can be simulated on the screen on the basis of the provided lens power effect, wherein the prescribed lenses are actually mounted on the frame, so that the selection of the glasses is in accordance with the individual's expectations. For example, the degree to which the eyes of a person become smaller or larger can be determined from a prescribed lens, the case where the contour of the face deviates from the lens portion 167 can be determined, and the up-down position can be determined when a larger lens-shaped frame is selected that is wider than the face of a person. Further, since the degree of eye reduction differs between even a spherical lens and an aspherical lens of the same strength, an aspherical lens check key 1611 is provided. Pressing the aspheric lens check key 1611 to the "on" state produces a strength effect equivalent to wearing an aspheric lens, and then pressing to the "off" state produces a lens strength effect equivalent to wearing a spherical lens.

In addition, pressing the "lens color" key 168 can freely select a lens color (density, kind, shade) and apply the color to the lens portion 167 of the face screen 161.

Further, in the right screen 162, there are provided an area 165 for specifying material selection of a plastic lens or a glass lens, and an area 166 for specifying a refractive index or a specific gravity of the selected lens material (plastic or glass). The refractive index is divided in the following terms: normal, slightly weak, very weak, weakest.

FIG. 17 is a screen which depicts the screen of FIG. 16 in more detail and which is displayed when the "calculate" key 169 of FIG. 16 is pressed. In the upper screen area 171, the values of the lens thickness (mm) and the lens weight (g) are displayed in tabular form, and in the lower screen area 172, a graphic of the lens shape is formed. In the lens thickness/weight table display area 171, the items on the left side are set by dividing them according to the left and right lenses, normal machining, and thin machining, and the items on the top side are set by dividing according to the refractive index of the lens material (refractive index portion falls within the following lens thickness classification range: normal, slightly thin, very thin, thinnest) and lens design conditions (into spherical and aspherical). Further, as for lens design conditions, there are curves, layout of far vision zone and near vision zone of segmented (progressive) lenses, positions of respective portions of bifocal eyes, and the like, in addition to spherical and aspherical surfaces, which can be added and further divided.

Here, the thin processing refers to special eyeglass processing, and when the lens thickness of the non-order manufacturing lens specification of the positive strength specification lens is excessively thick according to the frame shape and specification factor, the thin processing provides a lens having an optimum lens thickness by re-performing the optical design of the lens according to the frame and specification. For example, HOYAMETS is a well-known on-line eyeglass manufacturing system that can perform such thin manufacturing.

Further, in the lens shape display area 172, the side shape of the lens selected from the above-described lens thickness/weight table is graphically displayed. The lens shape graphic display area 172 is configured to be able to select and display two types of lenses (fig. 17 shows a state of selecting lenses a and H), and selection can be made simultaneously.

Fig. 18 is a screen displayed when the "display graphics" key 173 of fig. 17 is pressed with the mouse. The screen of fig. 18 converts the tabular display of the thickness and weight numbers according to lens fig. 17 to a graphical display of the lens thickness and weight so that the comparison of the lens thickness and lens weight is more easily visually understood according to the graphical display.

In the graphic display, a normal processing thickness 181, a normal processing weight 182, a thin processing thickness 183, and a thin processing weight 184 are displayed from the left based on the bar graphs of the respective lenses a to H. The height of these bar graphs of thickness and weight 181-184 represent the sum of the values for the left and right lens, with the maximum value for the 8 lens types A-H shown as 100% in a relative manner. (furthermore, the lens thickness and the lens weight may of course be graphically displayed at a height proportional to the absolute value of the left and right lenses if sufficient space is secured on the screen.) furthermore, for the graphical display, either of a comparative display of only the lens thickness, a comparative display of only the lens weight, or a comparative display of both the lens thickness and the weight may be selected (examples are shown in the figures). This selection can be made by pressing the left key 185 of the selected item to turn on the option mm (lens thickness only vs. display), the option g (lens weight only vs. display) or the options mm, g (lens thickness vs. display and lens weight vs. display). Further, the "number display" key 186 may be pressed back to the display corresponding to the number shown in fig. 17.

Fig. 19 is a screen displayed when the "lens price list" key 174 of fig. 17 is pressed. In the upper area 191 of the screen of fig. 19, a lens price chart is shown for 8 lens types a-H, which is consistent with the degree of anti-reflective coating applied to the lens (no coating, single coating, multiple coating, super multiple coating).

In this lens tariff, the options on the left are all in the range of no coating, single coating, multiple coating, super multiple coating, and the options on the top are sorted according to refractive index (normal, slightly thinner, very thin, thinnest) and lens design conditions (spherical, aspherical) similar to lens thickness/weight. In each block of the lens price list, the price of the manufacturer and the associated lens is displayed. For example, as shown in the example, for a multi-coated spherical lens with a "very thin" refractive index, one lens manufactured by company H is shown to be 31,000 dollars. Further, when the anti-reflection coating degree, the refractive index of the lens, and the design condition of the lens produced by a plurality of manufacturers are the same (when the lens corresponds to the same block in the lens price list), as shown in the figure, a pop-up menu key 192 is displayed, and a button 192 displays a menu of a plurality of lens manufacturers and lens prices. Further, on the left side of the region 191, since the transmittance and the coating interference color are different depending on the degree and kind of the antireflection coating, a change in visibility is caused, and such a change in visibility for 4 coating states (no coating, single coating, multi-coating, super multi-coating) can be displayed in an easily understandable manner according to the screen 193, the screen 193 dividing the circle into 4 segments.

(step S2-1)

The following describes the method of designing the lens shape itself for a rimless frame. In this method, the steps up to the determination of the basic lens shape are the same as in the above-described conventional system, and thereafter the basic lens shape is converted into a lens shape of a novel design. Further, the lens shape designing method is not limited to this embodiment, and can be applied to a fitting simulation system of other eyeglasses (or eyeglass frames).

Fig. 20 is a lens shape design start screen, and in an information area 201 on the upper part of the screen, "prepare lens shape, press 'prepare' key" and "return diagram," press 'return' key ". Further, a "prepare" key 202 and a "return" key 203 are provided above the face screen 200. Numeral 204 indicates an area showing the original basic lens shape of the manufacturer, from which a lens shape close to the preferred lens shape is selected as a starting point for designing the lens shape.

Fig. 21 is a screen for selecting which of two method (lens shape conversion method) types is used for lens shape generation of the system. For this embodiment, free transition (in this embodiment, image transition included in the free transition screen) and switching techniques are developed. Free transformation includes creating a free shape by further systemizing the lens shape, and switching includes creating the lens shape by specifying and employing a cutting tool.

In the screen of fig. 21, reference numeral 211 denotes a "ok (next)" key, and information "press a picture of a desired conversion type" and "a selected type is indicated by red characters" are displayed in a lower area 212. In addition, in the following area 213, explanation information "the lens shape can be designed using various conversion tools" is displayed. Further, reference numerals 214 and 215 denote display units for describing the correspondence conversion method by graphics and characters.

Fig. 22 is a screen for switching the lens shape, and a face screen 221 wearing glasses is provided on the left side, and a switching operation screen 222 is provided on the right side. A switching screen 223 displaying the shape of the lens to be switched by cutting and a cutting tool (cutter) 224 cutting a part of the contour of the shape of the lens are provided on the switching operation screen 222. For the cutter 224, an appropriate curve shape is selected in advance to be able to produce an aesthetic line as a lens shape of the glasses. That is, the curve of the cutting tool 224 is configured such that a special curve (circular arc, parabola) that can be set in advance is used as a reference curve, and the special curve can be further deformed according to the mounting conditions. The reason for specifying a particular curve (reference curve) is that the curve assumes too many degrees of freedom to be cut often several times, resulting in an aesthetically undesirable shape of the frame. Thus, the aesthetic problems of the eyeglasses are considered in advance, and the switching work can be performed by limiting the cutting curve of the cutting tool 224 used. In this embodiment, a circular arc and a straight line (in this embodiment, the straight line is considered as a circular arc having an infinite diameter) are employed as lines for cutting the lens.

For the cutter 224, the center position 227 of the curve is shown as a circular mark, and the position of the cutter 224 is changed by moving the center position of the cutter 224 up and down, left and right, and rotating the cutter 224 by 180 ° left and right (upside down) around the center position 227. Further, the curve of the cutting tool 224 may vary at high and low speeds within a predetermined range. Further, when a cutting tool is employed, the angle range in which the cutting conversion is performed may be displayed in the form of a number corresponding to the movement of the cutting tool in the lower portion of the screen.

Further, in the cutting changeover screen 223, ear-side and nose-side directions are marked, and a display 225 of a fixing screw member for fastening the frame portion to the lens face and a lens shape outline 226 distinguished in red on the lens outline are marked within the basic lens shape. If the line of the cutter 224 intersects the red lens outline area 226, a warning that the switching is impossible due to the structural relationship with the frame fixing portion is automatically displayed in the form of letters in the lower portion of the screen.

When the cutting operation is performed, the graphic processing of the lens shape cutting conversion is completed by setting the cutting tool 224 of the cutting conversion screen 223 to a desired position of the lens shape and clicking the "ok" key 228 at the lower part of the screen 223. When cutting with a circular arc (curved line), the points at which the circular arc of the cutter 224 intersects with the contour line of the lens shape are smoothly connected by a predetermined minimum circular arc. In contrast, when cutting with a straight line, the point at which the straight line intersects the contour line of the lens shape remains in a state in which the contour line is cut by the straight line. In addition, in order to delete the operation after the completion of the cutting transition, the system is set up to return the screen to the state of the previous step (or initial state) by clicking the "delete" key 229. Further, the system may be configured such that the lens of the face screen 221 may be converted in correspondence to the conversion of the lens shape on the cut conversion screen 223, so that the conversion operation of the lens shape may be completed while the face screen 221 is checked.

Fig. 23 is a free changeover screen in which free changeover of the lens shape is performed.

A face screen 231 wearing glasses is displayed on the left side of the free changeover screen, and a free changeover cutter screen 232 and a cutting changeover cutter screen 233 are displayed on the right side. A screen 234 is displayed on the upper part of a free changeover tool screen 232, in which the positions to be subjected to lens shape changeover are indicated by arrows [1] - [7], and changeover operation keys 2301 and 2307 corresponding to the arrows [1] - [7] are provided below the screen 234.

The key 2301 is an operation key for enlargement/reduction conversion (change in size of lens shape), and the entire lens shape can be enlarged or reduced in the same shape. An operation screen (not shown in the figure) including a figure of a lens shape outline, an enlargement/reduction key, a confirmation command key is displayed below the free conversion tool screen 232 by selecting enlargement/reduction conversion by clicking 2301 a key. In the enlargement/reduction conversion operation screen, the lens shape outlines are shown as: the state before the transition is a white line; the state after the amplification conversion is a red line; the state after the zoom-out transition is a blue line. Further, when other conversion operations are selected by clicking the 2302-.

In the enlargement/reduction conversion of the lens shape, since the nose width of the frame cannot be changed, the enlargement and reduction in the left-right direction are performed in such a case that the extreme point of the nose-side contour line of the lens shape cannot be changed in position in the left-right direction (X coordinate). In contrast, the up/down zooming in has symmetry in the vertical direction with the geometric center of the lens as the center.

Further, in the face screen 231 on which glasses are worn, the contour line (shown with a dotted line in the drawing) of the converted lens shape 2312 is pre-checked in a different color from the contour line before conversion, so that the converted lens shape can be checked before confirmation. Pressing the confirmation key to make the lens shape before conversion disappear, and displaying the lens shape after conversion. To return the lens shape to the state immediately before the transition, the "back" key may be pressed.

In the preview display face screen 231, there are some cases where the affected display is displayed when the position of the band or other frame portion is outside the lens according to the free switching operation of the enlargement/reduction or other lens shape, but in the switched face screen 231, the system is constituted so that the position thereof can be automatically moved and displayed in the normal position. Further, even in the post-conversion face screen 231, the system may be configured to display two face screens side by side, respectively displaying the lens shape frames before and after conversion, so that the lens shape can be selected according to individual preference according to the above-described pair-wise comparison.

The key 2302 is an operation key for upper expansion/contraction conversion, which converts an upper curve (a portion indicated by an arrow [2 ]) of the lens shape by vertical expansion and contraction. This operation of the upper expansion/contraction conversion moves the up-down direction positions (Y positions) of all points of the lens shape upper contour line without changing the left-right direction position (X coordinate). The upper expansion/contraction transition is a transition that adjusts the upward bulging state of the upper profile curve. According to the expanding operation, the upper contour line forms an upwardly rounded shape, and according to the contracting operation, the upper contour line forms a flat shape. According to the upper expansion/contraction conversion or the conversion of other lens shapes, there are some cases when the lens shape is an abnormal position with respect to the upper and lower positions of the face image of the face screen 231. In this case, pressing the "layout" key 238 automatically moves and adjusts the lens shape up and down to the normal position. This layout function (automatic adjustment function) is performed while keeping track of the viewpoint and the B-size (weight, width) of the mirror frame after the conversion. Further, this layout function can also be applied to the above-described lens shape cutting conversion and the lens shape image conversion described below.

The key 2303 is an operation key for lower expansion/contraction conversion for converting the lower contour line (portion indicated by arrow [3 ]) of the lens shape by vertical expansion or contraction. According to the expanding operation, the lower contour line forms a downwardly rounded shape, and according to the contracting operation, the lower contour line forms a flat shape.

Key 2304 is an operation key for top pole motion conversion. In this top extremity motion conversion, when the extremity (point indicated by arrow [4 ]) of the top contour of the lens shape moves horizontally, the top contour moves left and right (X coordinate) in accordance with the movement of the extremity, but the top contour curve remains as it is at the position [ Y direction ] in the up-down direction, and the top contour curve changes as a whole to form a smooth curve (for example, a curve connecting a plurality of circular arcs together). In addition, it is generally attractive to match the contour of the lens shape to the brow line, so the top contour is usually matched to the brow line.

Key 2305 is an operation key for bottom pole motion conversion. In this bottom extreme motion conversion, when the extreme point (point indicated by arrow [5 ]) of the bottom contour of the lens shape moves vertically, all points on the bottom contour move left and right (X coordinate) according to the movement of the extreme point, but the position in the up-down direction (Y direction) remains as it is, and the bottom contour curve changes as a whole to form a smooth curve.

The key 2306 is an operation key for ear side pole motion conversion. In this ear side pole movement conversion, when the poles (points indicated by arrow [6 ]) of the ear side contour of the lens shape move vertically, all points on the ear side contour move up and down according to the movement of the poles, but the positions in the left and right directions remain as they are, and the ear side contour curve changes as a whole to form a smooth curve.

The key 2307 is an operation key for nasal pole movement conversion. In the nose side extreme motion conversion, when the extreme point (point indicated by arrow [7 ]) of the nose side contour line of the lens shape moves vertically, all points on the nose side contour line move up and down according to the movement of the extreme point, but the position in the left-right direction remains as it is, and the nose side contour curve changes as a whole to form a smooth curve.

In the free change screen of fig. 23, the cutting change by the cutting tool may be performed on the lens shape subjected to the free change. In order to cut the lens shape with a straight line at that time, a straight line cutting tool is selected by pressing the straight line cutting tool key 235 of the cutting tool screen 233, and in order to cut the lens shape with an arc, an arc cutting tool is selected by pressing the arc cutting tool key 236. Further, the specific operation of the cutting conversion is as described above.

Further, in this embodiment, free conversion can be performed on the lens shape that has been converted. Further, the free switching that can freely switch the lens shape acts on the rimless frame structure that fixes the lens only with the mirror surface side strips, and cannot act on the rimless frame structure that fixes the lens with the mirror surface side strips and the mirror surface side strips. However, according to the use of the above-described lens end side strips, the system can also be freely switched by specifying a freely switchable area for the rimless frame, which is locally limited.

Fig. 24 is a screen appearing at the time of the image key 239 of the free conversion screen of fig. 23, and is an image conversion screen for converting the lens shape. On the left side of the image conversion screen, a face screen 241 with glasses is displayed, and on the right side, an image conversion tool screen 242 is displayed.

The lens shape image conversion synthesizes and converts the currently selected lens shape and the lens shape having the designated image (mild type, sportsman type, etc.) in a desired ratio, and converts the lens shape into the designated image by adding the designated image lens shape element to the shape element of the currently selected lens shape 2411. For example, a composite shape is prepared by performing calculations to add and combine the shape elements of the currently selected round lens shape and the shape elements of the square lens shape with the selected specified converted image in a predetermined ratio (e.g., 50% of each point). Image transformation employs morphing techniques that produce composite images that smoothly combine and transform two different images in a desired ratio.

In the image conversion tool screen 242, 8 types of conversion tool keys 2431 and 2438 are provided as conversion tool keys for adding a conversion image (a deformed image) for a specific meaning, that is, "warm and soft type", "smart type", "sportsman type", "personal meaning type", "cool type", "archaic type", "gorgeous type", "mental and concise type". As the lens shape having a prescribed image, for example, in this embodiment, the circular lens shape is used as "soft type", the elliptical lens shape is used as "smart type", the eggplant-shaped lens shape is used as "player type", and the rectangular lens shape is used as "personal sense type".

When the image of the lens shape 2411 of the currently selected face screen 241 is converted, a key is selected and clicked from the conversion tool keys 2431 and 2438 to add a desired conversion image. The image conversion screen of fig. 25 appears according to the selected conversion tool. In the image conversion tool screen 252 of fig. 25, the conversion strength setting key 2531 and 2535 are provided, and the degree of image conversion (conversion strength and deformation strength) can be set in 5 stages (weakest, weak, medium, strong, strongest). The weakest setting key 2531 adds the lowest degree/scale of the shape element specifying the image shape, and the strongest setting key 2535 adds the highest degree/scale of the shape element specifying the image shape. Further, instead of setting the degree of image conversion at each stage, the system may be configured such that the degree of image conversion can be continuously set.

Clicking any one of the conversion intensity setting keys 2531 and 2535 to preview display the post-image-conversion lens shape contour line 2512 (shown by a dotted line in the figure) in a color different from the currently selected lens shape contour line 2511 in the on-glasses face screen 251 allows the post-image-conversion lens shape to be checked before confirmation. At this time, clicking a conversion intensity setting key other than the currently selected conversion intensity setting key changes the conversion intensity setting, and the lens shape after image conversion is changed to a contour line corresponding to the changed setting intensity.

The confirmation key 254 is pressed to display the image-converted mirror shape only on the face screen 251. To return to the lens shape immediately prior to the transition state, the "back" key 255 need only be pressed. Further, in order to perform image conversion using an image conversion tool different from the currently selected one, the 8 types of conversion tool keys 2431 and 2438 of fig. 24 are displayed on the left side of the image conversion tool screen 252 by pressing the image re-selection key 256, and a desired conversion tool can be selected from the conversion tool keys. The image conversion for the confirmed image conversion lens shape can be done here by reselecting any of the 8 kinds of image conversion tools. Further, the lens shape after the free conversion is converted again, and the lens shape after the image conversion can be further freely converted. Further, pressing the "condition setting" key 257 returns the system to the confirmation screen of the frame condition chart of fig. 11, and pressing the "conversion tool" key 258 returns to the lens shape conversion method selection screen of fig. 21.

(step S6)

When the customer determines the pair of glasses he or she wants and determines the final glasses specification based on the simulation, the customer record is generated as shown in the screen of fig. 26. In the customer record, the screen 260 displaying the determined glasses face is displayed on the right side of the screen as shown in the figure, the customer information is displayed in the area 261, the frame data is displayed in the area 262, and the lens data is displayed in the area 263. Further, the left and right lens layout data are graphically displayed in the area 264. As shown, the optical center position 266, the viewpoint position 267, the sectioning position 268 of the bifocal lens, and the position 269 of the hole for mounting the lens fixing metal frame are displayed as layout data with respect to the left and right lens shapes 265. The segments 268 are shown in the uncut lens machined shape so that it can be checked how the small lens 268 is cut according to the lens shape 265. The customer record screen has its contents stored in a computer and constitutes a database of the glasses, and in addition, the customer record screen serves as a confirmation screen for mainly describing and confirming the relevant contents of the glasses determined by the customer.

After receiving the final customer order (placing the order), the processing instructions required for manufacturing the spectacles of the determined specifications are prepared. Fig. 27 is a screen for displaying the contents of the processing instruction, and as the contents necessary for the eyeglass processing, the frame data is displayed in the area 271, the lens data is displayed in the area 272, and the lens layout data is displayed in the area 273. When lens processing is placed on behalf of an outside merchant, an order including the contents of the processing order is transmitted (or otherwise) online to the outside merchant. Further, when lens processing is performed in a spectacle store, the system is configured such that lens processing can be performed by inputting a processing instruction according to an instruction sheet into the lens edger.

Further, with this system, store clerk information for providing all the glasses data to the glasses store clerk is prepared as shown in the screen of fig. 28. The store clerk information can be used together with the processing instruction described above, for example, in lens processing, and stored as integrated information combining customer information and processing information.

In the above-described embodiment, an example is given in which the eyewear try-on simulation system is used in an eyewear store. However, as is clear from the above description, since the eyeglass specifications can be determined using the frame data and lens data of the eyeglass try-on simulation system in this embodiment, all eyeglass manufacturing processes can be customized from outside vendors by using a computer-based communication network (such as the HOYA online system) according to the eyeglass specifications, and the system can be used in a place where the actual frame and lens are not stored at all. Thus, the system can be used in clinics and the like, where an optometrist in a hospital can make lens specifications based on the results of an eye refraction.

Further, the layout and format of the on-screen function selection keys in the above-described embodiments are not particularly limited to, for example, the case of the lens shape cutting conversion screen and the free conversion screen, and the function selection keys may also be displayed according to a tool bar (tool box).

The present invention is a glasses fitting simulation system capable of displaying a synthesized image of wearing glasses, which synthesizes a frame image with respect to an image of a person who does not wear glasses, and which can easily and accurately determine a frame and lenses satisfying the preference of a wearer of glasses. Furthermore, the spectacle fitting simulation system of the present invention is easy to operate and can be operated by the average wearer himself, even in an ophthalmic clinic where the frame or lenses are not stored at all.

Claims (25)

1. An eyewear fitting simulation system, comprising:

a function of capturing and displaying a portrait of a person without wearing glasses as image data on a display screen;

a function of selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance;

a function of synthesizing the frame image of the selected frame with the portrait and displaying a synthesized image simulated with a frame on the display screen; and

a lens selection support function of calculating a lens shape state when the lens is mounted on the selected frame based on lens specification data, material data, and lens optical design data input in advance, and displaying the calculation result of the lens shape in numerical values or figures.

2. The eyewear try-on simulation system according to claim 1, wherein the composite image and the lens shape data according to the lens selection support function can be displayed side by side on the display screen, and further, a weight of the lens calculated according to the lens selection support function can be displayed on the display screen.

3. The eyewear try-on simulation system of claim 1, comprising a function to display a lens price on the display screen according to a degree of lens surface treatment.

4. The eyewear try-on simulation system of claim 1, wherein a plurality of lens shape data calculated by a lens selection support function based on the lens specification data, lens material data and lens optical design data can be displayed on the display screen.

5. The eyewear try-on simulation system of claim 1, wherein a plurality of composite images formed by simulating a plurality of selected frames on the portrait may be displayed side by side on the display screen.

6. The eyewear try-on simulation system of claim 1, comprising:

and the guiding screen guides the flow of the whole system operation, including the picture frame selection operation, until the ideal glasses are selected.

7. The eyewear try-on simulation system of claim 1, further comprising:

a measurement function of displaying a ruler display image by superimposing on the portrait of a display screen, the portrait being glasses-free, by which a distance in a face width direction of the portrait can be read out; and is used to obtain face width data from the display screen.

8. The eyewear try-on simulation system of claim 1, comprising:

a face surface processing function according to image processing with respect to a portrait on the display screen.

9. The eyewear try-on simulation system of claim 8, wherein the image processing of the facial surface processing function is not performed on the eyes and mouth.

10. The eyewear try-on simulation system of claim 1, having:

-an inspection function screen for displaying and verifying on the screen at least the frame type, the lens shape and the frame price, said screen being selected and displayed on said display screen according to the function of selecting said frame.

11. The eyewear try-on simulation system of claim 1, comprising:

and a screen for graphically displaying the lens layout data determined by the specification of the glasses.

12. The eyewear try-on simulation system of claim 1, having:

an order-placing function for processing an order arrangement including frame data required to manufacture the eyewear after the lens specification is determined, and lens data processing instructions.

13. An eyewear fitting simulation system, comprising:

a function of capturing and displaying a portrait of a person without wearing glasses as image data on a display screen;

a function of selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance;

a function of synthesizing the frame image of the selected frame with the portrait and displaying a synthesized image simulated with a frame on the display screen; and

a function of performing image processing for adding an appearance effect with respect to the transmission image of the synthetic image lens section according to the refraction of the specification lens.

14. An eyewear fitting simulation system, comprising:

a function of capturing and displaying a portrait of a person without wearing glasses as image data on a display screen;

a function of selecting an arbitrary frame from frame data including a plurality of types of frame images stored in advance;

a function of synthesizing the frame image of the selected frame with the portrait and displaying a synthesized image simulating a frame on the display screen,

the frame data is read from a multimedia directory and includes, in addition to a frame image of a selected frame, text data and sound data relating to the selected frame.

15. An eyewear fitting simulation system, comprising:

a function of displaying on a display screen a composite image of a frame simulating a portrait without wearing glasses, wherein the frame is selected from frame data including a plurality of frame images,

the frames are classified according to the type of lens shape.

16. The eyewear simulation fit system of claim 15, wherein the types of the lens shapes are classified according to the number of circular elements constituting the outline of the lens shape.

17. A simulated try-on system for glasses according to claim 15 wherein a composite image of two frames wearing different lens shapes is displayed side by side on the display screen, the frame being selected from the plurality of frames, such that a frame of a preferred lens shape can be selected while comparing and contrasting the two composite images.

18. The eyewear simulation fit system of claim 15, wherein an architectural diagram representing a tree structure of the lens shape categories is displayed on the display screen, and two lens shapes displayed in the two composite images are displayed in the architectural diagram for recognition.

19. An eyewear simulation fit system according to claim 15 wherein of the plurality of currently selected lens shapes, two lens shapes that differ most in lens shape and/or lens overlay image are compared and contrasted.

20. An eyeglass simulation fitting system as set forth in claim 15, characterized in that a plurality of frame images of basic lens shapes classified according to the lens shape category or a plurality of composite images in which a plurality of frames of basic lens shapes are simulated on the figure are displayed side by side on the display screen, and a composite image simulating a plurality of lens shapes each of which is subdivided into basic lens shapes is displayed according to selection of one of the plurality of basic lens shape frames or one of the plurality of composite images.

21. An eyeglass try-on simulation system characterized by having the following functions:

displaying a composite image screen and a conversion operation screen side by side on a display screen, wherein the composite image screen simulates a rimless frame on a portrait without wearing glasses, and the conversion operation screen is used for converting the shape of lenses of the rimless frame;

and converting the lens shape of the composite image according to a lens shape conversion operation on the conversion operation screen.

22. The eyewear try-on simulation system according to claim 21, wherein the conversion according to the lens shape conversion operation is a cut conversion in which conversion of the lens portion is performed with respect to a portion of the lens of the rimless frame lens shape displayed on the conversion operation screen by cutting in a curved line or a straight line.

23. The eyewear try-on simulation system of claim 21, wherein the conversion according to the lens shape conversion operation comprises the following conversion: a transformation accompanied by a movement of the positions of the extremities of the curve constituting the contour of the lens shape; a transition accompanying expansion or contraction of the curve; or a transformation according to a magnification or reduction of the lens shape.

24. The eyewear try-on simulation system of claim 21, wherein the currently selected lens shape is converted by synthesizing the lens shape with the lens shape of the particular image in a desired ratio based on the conversion of the lens shape conversion operation to an image conversion.

25. The eyewear try-on simulation system of claim 21 having a contour correction function capable of highlighting and correcting the lens shape contour.