JP2018055364A - Server device, nail region detection system, and drawing device - Google Patents

Abstract

An object of the present invention is to provide a user with a more versatile model by updating a model for extracting a nail region using data of a large number of users, and to improve the detection accuracy of the nail region. A server device, a nail region detection system, and a drawing device are provided. A server-side model storage area for storing a plurality of nail area extracting models M to be fitted to a finger image when specifying the nail area from the finger image, and fitting of the nail area extracting model M to the finger image are performed. At this time, feature point error information which is an error between the corrected feature point P obtained by correcting the plurality of feature points P constituting the contour line of the nail region extraction model M according to the finger image and the feature point P before the correction. And the feature point error information received by the server side communication unit 93 is classified for each nail region extraction model M, and the error of the feature point P is determined for each nail region extraction model M. And a model updating unit 911 that updates the nail region extraction model M. [Selection] Figure 1

Description

  The present invention relates to a server device, a nail region detection system, and a drawing device.

2. Description of the Related Art Conventionally, a drawing apparatus that draws a nail design on a nail is known (see, for example, Patent Document 1).
In such an apparatus, the drawing position / drawing range cannot be specified unless the fingernail region (hereinafter referred to as “nail region”) is accurately detected.

  Therefore, in order to recognize the nail region by defining the boundary line between the nail region and the other part (that is, the contour line of the nail), the finger image is captured, and the captured finger image is processed by image processing. It is conceivable to extract a region.

However, the nail that is the drawing target of the drawing device for nail printing, the skin portion of the finger other than the nail, and the like have very similar optical characteristics and contain the same color information. Further, since the color of the nail portion and the skin varies from person to person, it is difficult to accurately extract the nail region by simply performing image processing on the finger image.
Therefore, as a specific method for extracting and specifying the nail region by image analysis, it is conceivable to fit the nail image as a model to the finger image of the user and specify the position and range of the nail.

Special table 2003-534083 gazette

However, the size and position of the nails vary greatly depending on the physique (whether they are fat or thin), gender (male or female), age (adult or child), etc., and their shapes are also different.
For this reason, when extracting and specifying the nail area using a model of the nail image, it is effective to collect as much sample data as possible for each physique and prepare an averaged model for each physique It is.

However, there is a problem that it is difficult to complete a highly versatile model by collecting a large amount of sample data at the time of manufacturing the device.
In addition, depending on the season, nails with a thin tip or a nail with a square tip are preferred.There are trends in the shape of the nails, and it is preferable to prepare a model that reflects these trends. There is a limit to preparing models of various shapes in advance in anticipation of the fashion.

  The present invention has been made in view of the circumstances as described above, and a model with higher versatility can be obtained by updating a model for extracting a nail region using many users' data afterwards. It is an advantage to provide a server device, a nail region detection system, and a drawing device that can be provided and can improve the detection accuracy of the nail region.

In order to solve the above problems, the server device of the present invention provides:
Server-side model storage means for storing a plurality of nail region extraction models to be fitted to the finger image when specifying the nail region from the finger image;
When fitting the nail region extraction model to the finger image, a plurality of feature points constituting the contour line of the nail region extraction model are corrected according to the finger image and before correction. Server side communication means for receiving feature point error information which is an error from the feature point of
The feature point error information received by the server-side communication means is classified for each nail region extraction model, and the nail region extraction model is updated based on the feature point error for each nail region extraction model. Model update means to
It is characterized by having.

  According to the present invention, a model for extracting a nail region using many users' data is updated afterwards to provide a more versatile model to the user and improve the detection accuracy of the nail region. be able to.

(A) is a figure which shows the whole structure of the nail | claw area | region detection system in this embodiment, (b) is a figure which shows the whole structure of the modification of a nail | claw area | region detection system. (A) is a front view of the drawing apparatus in this embodiment, (b) is a side view which shows the internal structure of the drawing apparatus shown by (a). It is a principal part block diagram which showed the control structure of the drawing apparatus which concerns on this embodiment. (A)-(c) is explanatory drawing which shows the model for nail | claw area | region extraction typically. It is the figure which matched each feature point of the nail | claw area | region extraction model, and its coordinate. It is the figure which matched each nail | claw area | region extraction model memorize | stored in the data area for model selection of this embodiment, and the threshold value at the time of selecting each model. It is the principal part block diagram which showed the control structure of the external server apparatus which concerns on this embodiment. It is a flowchart which shows the drawing process of the drawing apparatus which concerns on this embodiment. (A) is explanatory drawing explaining correction of the nail area | region extraction model by the drawing apparatus which concerns on this embodiment, (b) is explanatory drawing which shows typically the nail | claw area | region extraction model after correction | amendment. . It is a flowchart which shows the model update process of the external server apparatus which concerns on this embodiment.

An embodiment of a server device, a nail region detection system, and a nail print device (drawing device) according to the present invention will be described with reference to FIGS. 1 (a) and 1 (b) to 10.
The embodiments described below are given various technically preferable limitations for carrying out the present invention, but the scope of the present invention is not limited to the following embodiments and illustrated examples.
Further, in the following embodiment, the nail print apparatus 1 will be described assuming that the fingernail of the hand is drawn on this, but the drawing target of the present invention is not limited to the fingernail of the hand, For example, the toenails may be drawn.

Fig.1 (a) is a figure which shows schematic structure of the whole nail | claw area | region detection system in this embodiment.
As shown in FIG. 1A, the nail area detection system according to this embodiment includes a nail print device 1 that is a drawing device and an external server device that can communicate with the nail print device 1 (hereinafter referred to as “external server device 9”). “)”.
FIG. 1A illustrates a case where three nail print apparatuses 1 are connected to the external server apparatus 9 via the network N, but the number of nail print apparatuses 1 that can be connected to the external server apparatus 9 is illustrated. Is not particularly limited. As the number of nail print devices 1 connected to the external server device 9 increases, the nail region detection model M described later can be updated to a more general one.
Although the network N is interposed between the nail print device 1 and the external server device 9, any network may be used, for example, a web application may be used like cloud computing.
In addition, the structure of a nail | claw area | region detection system is not limited to what is shown to Fig.1 (a). For example, as shown in FIG. 1B, the nail region detection system 200 may be configured such that the nail print device 1 is connected to the network N and thus the external server device 9 via the communication terminal device Pd.

FIG. 2A is a front view showing the internal configuration of the nail printing apparatus, and FIG. 2B is a side view showing the internal configuration of the nail printing apparatus shown in FIG.
As shown in FIGS. 2A and 2B, the nail print apparatus 1 according to the present embodiment includes a pen 41 and an inkjet head 71 whose drawing head 43 is a drawing tool, and includes a plotter method and an inkjet method. Is a drawing apparatus that draws on the nail T in combination.
The nail print apparatus 1 includes a case main body (housing) 2 and an apparatus main body 10 accommodated in the case main body 2.

  As shown in FIG. 1B, the case body 2 has a lid portion 23 configured to be openable and closable from the upper surface to the upper front surface for exchanging a pen 41 and an inkjet head 71 of the drawing unit 40 described later. Is provided. The lid 23 is rotatable from a closed state to an open state as shown in FIG.

An operation unit 25 (see FIG. 3) is installed on the upper surface (top plate) of the case body 2.
The operation unit 25 is an input unit on which a user performs various inputs.
The operation unit 25 includes, for example, a power switch button for turning on the power of the nail printing apparatus 1, a stop switch button for stopping the operation, a design selection button for selecting a design image to be drawn on the nail T, and a drawing start for instructing a drawing start. Operation buttons (not shown) for performing various inputs such as buttons are arranged.
In the present embodiment, the touch panel TP is provided integrally with the display unit 26 on the surface of the display unit 26, and various inputs can be performed by a touch operation with a stylus pen or the like (not shown). It is designed to function as an operation unit.
For example, on the display screen of the display unit 26, a print switch button, a stop switch button for stopping the operation, and a nail image pattern to be drawn (that is, a desired design to be drawn in the nail area Ta that is a drawing target area) are displayed by the user. Various operation buttons such as a pattern selection switch button for selecting an image are displayed, and the user also makes various inputs by touching these operation buttons on the display screen of the display unit 26. be able to.
In the present embodiment, a finger image can be displayed on the display screen of the display unit 26, and a nail region extraction model M described later can be superimposed on the finger image. Then, the user adjusts the contour position of the nail region extraction model M on the display screen so as to match the position of the nail T in his / her finger image, and performs a touch operation of touching with a stylus pen or the like. The position of a feature point P (described later) indicating the contour of the region extraction model M can be appropriately moved and corrected so as to match the contour of his / her nail T.

In addition, a display unit 26 is installed at a substantially central portion of the upper surface (top plate) of the case body 2.
The display unit 26 is a display unit configured by, for example, a liquid crystal display (LCD), an organic electroluminescence display, or other flat displays.
The display unit 26 includes, for example, a liquid crystal panel (LCD: Liquid Crystal Display). In the present embodiment, the display unit 26 includes, for example, a finger image obtained by photographing the printing finger U1. To select an image obtained by superimposing the nail region extraction model M on the finger image, a contour line (nail region) of the nail T included in the finger image, a design image to be drawn on the nail region of the printing finger U1, and a design image A design selection screen, a thumbnail image for design confirmation, an instruction screen for displaying various instructions, and the like are appropriately displayed.
Further, as described above, the touch panel TP is integrally formed on the display unit 26.

  The apparatus main body 10 is formed in a substantially box shape, and a lower machine casing 11 installed below the inside of the case main body 2 and an upper machine installed above the lower machine casing 11 and above the inside of the case main body 2. And a frame 12.

The lower machine casing 11 includes a back plate 111, a bottom plate 112, a pair of left and right side plates 113 a and 113 b, an X-direction moving stage accommodating portion 114, a Y-direction moving stage accommodating portion 115 and a partition wall 116.
The lower ends of the side plates 113a and 113b are connected to the left and right ends of the bottom plate 112, respectively, and the side plates 113a and 113b are provided in a state where they stand up against the bottom plate 112.
The lower part of the back plate 111 is formed to be recessed in two steps toward the front (front side in the finger insertion direction). A lower end portion of the back plate 111 is connected to a front end portion of the bottom plate 112, and the back plate 111 divides a region surrounded by the bottom plate 112 and the side plates 113a and 113b back and forth.
A space formed on the back side of the recessed back plate 111 is an X-direction moving stage accommodating portion 114 and a Y-direction moving stage accommodating portion 115 (see FIG. 2B). In the X-direction moving stage accommodating portion 114, the X-direction moving stage 45 of the drawing portion 40 is accommodated when the drawing portion 40 moves forward (front side in the finger insertion direction). A Y-direction moving stage 47 of the drawing unit 40 is disposed in the Y-direction moving stage accommodating unit 115.
Further, the partition wall 116 divides the space on the front side inside the lower machine casing 11 (the space on the front side in the finger insertion direction surrounded by the back plate 111, the bottom plate 112, and the side plates 113a and 113b) vertically. Is provided inside. The partition wall 116 is provided substantially horizontally, the left and right ends of the partition wall 116 are connected to the side plates 113 a and 113 b, respectively, and the rear end portion of the partition wall 116 is connected to the back plate 111.

The lower machine casing 11 is integrally provided with a finger fixing unit 30 (see FIG. 2B).
The finger fixing unit 30 includes a finger receiving unit 31 that receives a finger (hereinafter referred to as “printing finger U1”) corresponding to a nail T (that is, a drawing target) to be drawn, and a finger other than the printing finger U1 (hereinafter referred to as “printing finger U1”) , Which is referred to as “non-printing finger U2”).
The finger receiving portion 31 is disposed on the upper side of the partition wall 116, for example, slightly to the right of the center in the width direction of the lower machine casing 11. In addition, a space partitioned by the partition wall 116 on the lower side of the lower machine casing 11 constitutes the finger retracting portion 32.
For example, when drawing on the nail T of the ring finger, the ring finger as the printing finger U1 is inserted into the finger receiving unit 31, and the other four fingers (thumb, forefinger, middle finger, little finger) as the non-printing finger U2 are pointed. Insert into the retracting portion 32.
The finger receiving portion 31 is open on the front side of the lower machine casing 11 (the front side in the printing finger insertion direction), and the lower side is a finger placement portion that constitutes a part of the partition wall 116. The finger placement unit places a finger (printing finger U1) of the nail T to be drawn on the XY plane.
Moreover, the upper side of the finger receiving part 31 is opened, and the surface of the nail T of the printing finger U1 inserted into the finger receiving part 31 (that is, the drawing target surface) is exposed.
The user can sandwich the partition wall 116 between the printing finger U1 inserted into the finger receiving unit 31 and the non-printing finger U2 inserted into the finger retracting unit 32. Therefore, the printing finger U1 inserted into the finger receiving part 31 is stably fixed.

On the upper surface of the lower machine casing 11 and on the side of the finger receiving portion 31 (a position corresponding to the medium insertion / exit 24 of the case main body 2 and on the left side in FIG. 2A), it will be described later. In the drawing possible range by the drawing head 43, a writing part 61 for performing break-in to eliminate blurring at the time of writing a pen tip (tip part) 413 of the pen 41 described later is provided.
The custom writing portion 61 is a flat plate portion on which a drawing medium (not shown) inserted from the medium insertion port 24 of the case body 2 is placed.
The drawing medium placed on the custom writing unit 61 may be any medium that can perform the writing-in of the pen tip (tip portion) 413, for example, a piece of paper.

The drawing unit 40 includes a drawing head 43, a unit support member 44 that supports the drawing head 43, and an X direction for moving the drawing head 43 in the X direction (the X direction in FIG. 2A and the left and right direction of the drawing apparatus 1). A moving stage 45, an X direction moving motor 46, a Y direction moving stage 47 for moving the drawing head 43 in the Y direction (Y direction in FIG. 2B, the front and rear direction of the drawing apparatus 1), a Y direction moving motor 48, and the like. It is configured with.
The drawing unit 40 is a drawing unit that draws the nail region specified by the nail region detection unit 812 described later.

As shown in FIG. 2A and FIG. 2B, the drawing head 43 of this embodiment is adjacent to a pen holder 42 that detachably holds a pen and an inkjet holder 72 that holds an inkjet head 71. Are arranged together.
The inkjet head 71 faces, for example, an ink cartridge (not shown) corresponding to yellow (Y; YELLOW), magenta (M; MAGENTA), and cyan (C; CYAN) ink, and a drawing target (nail T) in each ink cartridge. This is an ink cartridge integrated head in which an ink discharge portion (not shown) provided on the surface (in this embodiment, the lower surface in FIG. 1A and the like) is integrally formed. The ink ejection unit includes a nozzle array including a plurality of nozzles that eject ink of each color, and the inkjet head 71 atomizes the ink, and the drawing surface of the drawing target (nail T) from the ink ejection unit. The ink is directly sprayed to draw. The ink jet head 71 is not limited to the one that ejects the three colors of ink. You may provide the ink cartridge and ink discharge part which store another ink.

The pen holding unit 42 holds at least one pen 41 so that it can be mounted. In the present embodiment, one pen holding unit 42 that holds one pen 41 is provided in the drawing head 43. .
The pen 41 is a drawing tool that uses the surface of the nail T as a drawing target surface and draws the nail T by contacting the surface of the nail T whose tip is the drawing target surface.
As shown in FIG. 2A and the like, the pen 41 has a pen tip 413 on the distal end side (lower side in FIG. 2A) of the rod-shaped pen shaft portion 411 inserted into the hollow cylindrical pen holder 410. It is provided.
The interior of the pen shaft portion 411 is an ink storage portion that stores various inks.
Various types of ink can be applied as the ink stored in the pen shaft portion 411. The viscosity of the ink and the particle size (particle size) of the color material are not particularly limited. For example, gold-silver glitter ink, white ink, UV curable ink, gel nail, undercoat ink, top A coating ink, a nail polish, or the like can also be used.

In the present embodiment, the pen 41 is a ballpoint pen type in which, for example, the pen tip 413 is pressed against the surface of the nail T so that the ink contained in the pen shaft portion 411 oozes out and is drawn. It is a pen.
The pen 41 is not limited to a ballpoint pen type. For example, a sign pen type in which ink is soaked in a felt-shaped pen tip or a brush pen type in which ink is soaked into a bundled hair and drawn may be used. Various types of pen tip 413 can be prepared.

The pen holding part 42 is a member for holding and fixing one pen 41 by a locking part (not shown) and moving it together with the drawing head 43. In the present embodiment, the pen holding portion 42 is supported on the side portion of the drawing head 43.
The pen holding unit 42 is configured to be movable in the vertical direction by driving a pen vertical motor 426 (see FIG. 3) mounted on the drawing head 43.

Further, the unit support member 44 is fixed to an X direction moving unit 451 attached to the X direction moving stage 45. The X-direction moving unit 451 moves in the X direction along a guide (not shown) on the X-direction moving stage 45 by driving the X-direction moving motor 46, and is thereby attached to the unit support member 44. The drawing head 43 is moved in the X direction (X direction in FIG. 1A, left and right direction of the nail printing apparatus 1).
The X direction moving stage 45 is fixed to the Y direction moving portion 471 of the Y direction moving stage 47. The Y-direction moving unit 471 is moved in the Y-direction along a guide (not shown) on the Y-direction moving stage 47 by driving the Y-direction moving motor 48, and is thereby attached to the unit support member 44. The drawing head 43 is moved in the Y direction (Y direction in FIG. 2B, the front-rear direction of the nail printing apparatus 1).
In this embodiment, the X direction moving stage 45 and the Y direction moving stage 47 are configured by combining an X direction moving motor 46 and a Y direction moving motor 48 with a ball screw and a guide (not shown).
In the present embodiment, a head moving unit 49 as an XY driving unit that drives the drawing head 43 including the pen 41 in the X direction and the Y direction is configured by the X direction moving motor 46, the Y direction moving motor 48, and the like.

  The pen up / down motor 426, the inkjet head 71, the X-direction moving motor 46, and the Y-direction moving motor 48 in the drawing unit 40 are connected to a drawing control unit 814 (see FIG. 3) of the control device 80, which will be described later. 814 is controlled.

The photographing unit 50 includes a photographing device 51 and a lighting device 52.
The photographing unit 50 illuminates the nail T of the printing finger U1 inserted into the finger receiving unit 31 and visible from the upper opening by the illumination device 52. Then, the photographing device 51 photographs the printing finger U1, and acquires a nail image (a finger image including the nail image) that is a photographed image of the nail T of the printing finger U1. In the present embodiment, the photographing device 51 acquires a plurality of nail images having different light irradiation angles with respect to the nail T.
As shown in FIGS. 2A and 2B, in the present embodiment, the drawing head 43 of the drawing unit 40 has one end of the upper surface (the right side in FIG. 2A) protruding sideways. The substrate 53 is attached to the protruding portion. The photographing device 51 and the illumination device 52 constituting the photographing unit 50 are provided on the lower surface of the substrate 53 so as to face the partition wall 116.

The imaging device 51 is, for example, a small camera configured to include a solid-state imaging element having about 2 million pixels or more, a lens, and the like.
Note that the imaging device 51 captures a plurality of captured images (nail images) by capturing the nail T from different positions and angles by movement by the head moving unit 49 in order to detect the curved shape of the nail T of the printing finger U1. ) Is preferred.
When a plurality of photographed images (nail images) are acquired by the photographing device 51, the nail region detecting unit 812 (see FIG. 3) changes the curved shape of the nail T based on these photographed images (nail images). Can be detected.
The illumination device 52 is a light source such as a white LED.
The illumination device 52 is directed downward and emits light downward to illuminate at least the imaging range below the imaging device 51. The position of the illumination device 52 with respect to the photographing device 51 is constant. The number of the lighting devices 52 provided, the arrangement thereof, and the like are not limited to the illustrated example.
The photographing unit 50 is connected to a photographing control unit 811 (see FIG. 3) of the control device 80 described later, and is controlled by the photographing control unit 811.
Note that image data of an image photographed by the photographing unit 50 is stored in a nail image storage area 821 of the storage unit 82 described later.

The control device 80 is installed on, for example, the substrate 13 disposed on the upper machine casing 12.
FIG. 3 is a principal block diagram showing a control configuration in the present embodiment.
As shown in FIG. 3, the control device 80 includes a control unit 81 configured by a CPU (Central Processing Unit) (not shown), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like (both not shown). And a storage unit 82 constituted by the computer.

The storage unit 82 stores various programs and various data for operating the nail printing apparatus 1.
Specifically, the ROM of the storage unit 82 includes various types of programs such as a nail region detection program for detecting the nail T region, a drawing data generation program for generating drawing data, and a drawing program for performing drawing processing. Programs are stored, and by executing these programs by the control device 80, each unit of the nail print apparatus 1 is controlled in an integrated manner.
In the present embodiment, the storage unit 82 includes a nail image storage area 821 for storing an image of the user's printing finger U1 (a finger image including a nail image of the nail T) acquired by the photographing unit 50, and a nail area detection unit. The nail information storage area 822 in which the nail information detected by 812 (information such as the nail area constituted by the xy coordinates of the contour line indicating the shape of the nail T and the curved shape of the nail T) is stored is detected. A model storage area 823 for storing the nail area extraction model M referred to in the process, a model selection data area 824 for storing model selection data for selecting the nail area extraction model M that matches the user's nail T, and A nail design storage area 825 for storing nail design image data drawn on the nail T is provided.

FIG. 4A to FIG. 4C are diagrams illustrating an example of the nail region extraction model M stored in the model storage region 823 in the present embodiment.
The model storage area 823 is a device-side model storage unit that stores a plurality of nail area extraction models M.
Specifically, the model storage area 823 includes a plurality of nail area extraction models M (nail area extraction models Ma, Mb, Mc in FIGS. 4A to 4C) and each nail area extraction model. The number (P1-Pn) of the feature point P of the model M, the coordinate information (xy coordinate) of each feature point P, etc. are stored (refer FIG. 5).
The nail region extraction model M is used to identify (determine) a nail region from a finger image. When the nail region of the nail T is identified from a finger image obtained by photographing the printing finger U1. Are fitted to the finger image of the printing finger U1. The nail region extraction model M is a model of the contour line of the nail region, and this contour line is composed of a plurality of feature points P (in this embodiment, feature points P1 to Pn, see FIG. 5).

As the model M for extracting the nail region that approximates the user's nail region is used, the nail region can be extracted and specified more quickly and with high accuracy. It depends on whether you are fat or thin. In the present embodiment, as the nail region extracting model M, the finger nail region extracting model Ma for thin fingers is selected according to the size of the finger (thickness of the finger in the present embodiment). An example in which three types of nail region extraction models M having different contour lines, i.e., a nail region extraction model Mb and a thick finger nail region extraction model Mc are stored in the model storage region 823 is shown. In the following description, when simply referred to as “nail region extracting model M”, all three types of nail region extracting models Ma to Mc are included.
The nail region extraction model M is not limited to these three types. For example, a nail region extracting model M that is further subdivided according to sex (male or female), age group (10's, 30's, 50's, etc.) may be stored. A nail region extraction model M may be prepared for each nail of each finger (thumb, forefinger, middle finger, ring finger, little finger). Further, the present invention is not limited to the case where all the nail area extraction models M illustrated here are prepared. For example, the nail area extraction model Ma for thin fingers and the nail area extraction model Mc for thick fingers Only the type may be stored in the model storage area 823.

  The method for generating the nail region extraction model M is not particularly limited. For example, finger images of a plurality of people each serving as a sample for each person with a thin finger, a person with a thick finger, and a person with a medium thickness finger. (In other words, a finger image including an image of the nail T) is acquired, and feature points P are set at substantially equal intervals along the contour line of the nail T. Then, samples belonging to the same group (groups classified by finger thickness) are averaged to generate nail region extraction models Ma to Mc as average nail region models for each group.

In the present embodiment, the nail area extraction models Ma to Mc are generated in advance in the stage before the factory shipment of the nail print apparatus 1 and are set as defaults in the model storage area 823 of the storage unit 82 of each nail print apparatus 1 to be shipped. Stored.
The model storage area 823 is a rewritable memory. When update information is distributed later from the external server device 9 as will be described later, the model storage area 823 is used for extracting the nail area stored in the model storage area 823. The coordinate information of the models Ma to Mc and the feature point P is appropriately rewritten and updated.

The model selection data area 824 is necessary for performing a model selection process for selecting, from among a plurality of nail area extraction models M stored in the model storage area 823, a model suitable for the nail T for the user's finger. This is a storage area in which various data are stored.
In the present embodiment, it is suitable for the user from among the three types of nail area extraction models M (Ma to Mc) stored in the model storage area 823 of the storage unit 82 based on the dimension of the user's printing finger U1. A single nail region extraction model M is selected, and the maximum finger width corresponding to each nail region extraction model M (that is, a finger) is selected as threshold data for selecting the nail region extraction model M. , The threshold value of “Wmax” in FIGS. 4A to 4C and FIG. 6) is stored in the model selection data area 824.

It is statistically known that the finger width varies depending on the difference in physique and the like, and it is possible to select the nail region extraction model M suitable for the user by estimating the physique of the user from the maximum finger width Wmax. Become.
Specifically, in the present embodiment, as shown in FIG. 6, if the maximum finger width Wmax of the user's print finger U1 is 13 mm or less, the finger nail region extraction model Ma for thin fingers (FIG. 4A). If the maximum finger width Wmax of the user's print finger U1 is greater than 13 mm and less than 20 mm, the nail region extraction model Mb for a medium-thick finger is applied, and the maximum finger of the user's print finger U1 is applied. If the width Wmax is equal to or greater than 20 mm, a threshold value is set in advance so that the thick finger nail region extraction model Mc is applied, and this threshold value is associated with each nail region extraction model Ma to Mc. Are stored in the model selection data area 824.
Note that data for selecting a model suitable for the user from the nail region extraction models M (Ma to Mc) stored in the model selection data region 824 is not limited to those exemplified here. Further, the threshold value for selecting the nail region extraction model M is not limited to those exemplified here, and may be changed as appropriate.
The model selection data area 824 is a rewritable memory, and is stored in the model selection data area 824 when update information is subsequently distributed from the external server device 9 as will be described later. The threshold for selecting the nail region extraction model M is also appropriately rewritten and updated.

  When viewed functionally, the control unit 81 includes an imaging control unit 811, a nail region detection unit 812, a drawing data generation unit 813, a drawing control unit 814, a display control unit 815, and the like. The functions of the photographing control unit 811, the nail region detection unit 812, the drawing data generation unit 813, the drawing control unit 814, the display control unit 815, and the like are stored in the CPU of the control unit 81 and the ROM of the storage unit 82. Realized by collaboration with

The imaging control unit 811 controls the imaging device 51 and the illumination device 52 of the imaging unit 50, and the nail that is an image of a finger including the image of the nail T of the printing finger U <b> 1 inserted into the finger receiving unit 31 by the imaging device 51. An image (captured image) is captured.
In the present embodiment, it is preferable that the imaging control unit 811 captures the nail T from at least two different positions while moving the positions of the imaging device 51 and the illumination device 52 by the head moving unit 49 of the drawing unit 40.
Thus, by acquiring a plurality of images from a plurality of positions, not only the contour of the nail T but also the curvature (degree of curvature) of the nail T can be detected from the image.
The image data of the nail image acquired by the imaging unit 50 is stored in the nail image storage area 821 of the storage unit 82.

The nail region detection unit 812 is based on the image of the nail T of the printing finger U1 inserted into the finger receiving unit 31 photographed by the photographing device 51 (that is, the finger image including the nail image), and the nail T of the printing finger U1. The nail information about is acquired.
In the present embodiment, the nail region detection unit 812 acquires, as nail information, for example, a two-dimensional shape such as the shape (contour) of the nail T and the XY coordinates of the horizontal position of the nail T based on the captured image, Information indicating the three-dimensional shape of the nail T, such as the curvature of the nail T, is also acquired as nail information from a plurality of images acquired by the imaging device 51.

Further, in the present embodiment, the nail region detection unit 812 fits the finger image captured by the imaging device 51 with the nail region extraction model M that matches the finger width of the print finger U1, and then uses the finger image. The nail region of the nail T is detected.
As described above, in the present embodiment, when the finger image is fitted with the nail region extraction model M and the contour has a deviation, the user uses the touch panel P or the like to use the nail region extraction model. The feature point P constituting the contour line of M can be moved and corrected. When the user corrects the nail region extraction model M in accordance with the finger image, the nail region detection unit 812 configures the feature points of the contour line of the nail region extraction model M according to the operation instruction input by the user. P is corrected. Then, the corrected nail region extraction model M and the error (difference) between the corrected feature point P and the uncorrected feature point P are stored in the model storage region 823 as feature point error information.

The drawing data generation unit 813 generates drawing data for drawing applied to the nail T of the printing finger U1 by the drawing head 43 based on the nail information acquired by the nail region detection unit 812.
Specifically, the drawing data generation unit 813 determines the nail design based on the shape (contour shape) of the nail T, the nail width value, the nail length value, and the like acquired by the nail region detection unit 812. A fitting process (fitting process) for matching the shape of the nail T is performed by enlarging, reducing, cutting out the image data.
In addition, the drawing data generation unit 813 has a nail design designated to be drawn on the nail T according to the height (depth) of the nail T acquired by the nail region detection unit 812 and the curved shape of the nail T. A curved surface correction or the like is appropriately performed on the image data.
Thereby, image data for drawing a nail design drawn by the pen 41 or the inkjet head 71 is generated.

The drawing control unit 814 outputs a control signal to the drawing unit 40 based on the drawing data generated by the drawing data generation unit 813, and performs drawing according to the drawing data on the nail T. The control unit controls the X-direction movement motor 46, the Y-direction movement motor 48, the pen up / down motor 426, the inkjet head 71, and the like.
Specifically, the drawing control unit 814 operates the X direction moving motor 46 and the Y direction moving motor 48 as appropriate to move the drawing head 43 in the X direction and the Y direction while moving the drawing head 43 to a predetermined position on the nail T. Sequential drawing is performed.

  The display control unit 815 controls the display unit 26 to display various display screens on the display unit 26. In the present embodiment, the display control unit 815 displays, for example, a nail design selection screen, a thumbnail image for design confirmation, a nail image obtained by photographing the printing finger U1, various instruction screens, an operation screen, and the like on the display unit 26. It is supposed to be displayed.

Further, the nail print apparatus 1 includes a communication unit 27 as a device-side communication unit configured to be able to communicate with the external server device 9.
The communication unit 27 transmits the feature point P of the nail region extraction model M corrected by the nail region detection unit 812 to the external server device 9 as feature point error information.
Further, when update information of the nail region extraction model M is delivered from the external server device 9 to the nail print device 1, it can be received.
The information sent from the nail print apparatus 1 to the external server apparatus 9 is not limited to the feature point error information. The maximum finger width Wmax of the user, personal information (for example, sex, age, etc.) regarding the user, finger images, the type of nail design drawn on the nail T, and the like may also be transmitted.

Note that the timing at which the feature point error information is transmitted to the external server device 9 by the communication unit 27 is not particularly limited.
For example, each time the nail region extraction model M is corrected, it may be transmitted to the external server device 9 as needed, or when a predetermined number of points are accumulated, the feature point error information accumulated at that time is collectively transmitted. It is good.
Also, once the power of the device is turned on and after the power is turned off, it is divided into one segment, and when an instruction to turn off the power is input from the operation unit 25 or the like, the instruction is issued after the power is turned on. The feature point error information accumulated until it is input may be transmitted together.

  If the user does not want to upload information to the external server device 9, it is possible to select not to transmit the information of the own device to the external server device 9 by selecting it on the operation unit 25 or the like. It has become.

FIG. 7 is a principal block diagram showing the control configuration of the external server device in the present embodiment.
As shown in FIG. 7, the external server device 9 of this embodiment includes a server control device 90 including a control unit 91 and a storage unit 92, and a server-side communication unit 93.

The storage unit 92 of the present embodiment is provided with a server-side model storage area 921 as server-side model storage means.
The server-side model storage area 921 stores the same nail area extraction model M (in this embodiment, the nail area extraction models Ma to Mc) stored as a default in the model storage area 823 of the nail printing apparatus 1. In addition, feature point error information transmitted from the nail printing apparatus 1 and the updated nail region extraction model M when the nail region extraction model M is updated based on the feature point error information are stored. .

The storage unit 92 of the present embodiment is provided with a server-side nail design storage area 922 that stores various nail designs.
The nail design stored in the server-side nail design storage area 922 may include the latest nail design data via the network N or the like as needed.
The nail designs stored in the server-side nail design storage area 922 are divided into a design suitable for a thin finger, a design suitable for a thick finger, a design compatible with any finger, etc., and is recommended respectively. It is preferable that the nail region extracting model M is stored in a correlated form.
Also, information on which nail design is adopted by the user when a certain nail region extraction model M is selected and drawn is included in the information sent from the nail print device 1 to the external server device 9. If included, the nail design data stored in the server-side nail design storage area 922 includes statistical data indicating which nail design is adopted when the nail area extraction model M is selected. They may be linked and accumulated.

The control unit 91 of the external server device 9 includes a model update unit 911 as a function unit.
The model update unit 911 classifies the feature point error information transmitted from the individual nail printing apparatus 1 and received by the server-side communication unit 93, which is a server-side communication unit, for each nail region extraction model M. For each extraction model M, the nail region extraction model M is updated based on the error of the feature points.
In the present embodiment, when a predetermined number of feature point error information is accumulated for each nail region extraction model M, the nail region extraction model M is updated as needed.
Specifically, when feature point error information around the upper side of the nail region extraction model M (that is, the toe side of the nail T) is accumulated, the accumulated feature point errors are added together and divided by the accumulated number. Analyze the averaged one. If this error is equal to or greater than a predetermined value (for example, ± 2 mm or greater), the position of the feature point P around the upper side of the nail region extraction model M is moved in a direction to cancel the error.
Similarly, around the left side of the nail region extraction model M (ie, the left side of the nail T), around the lower side of the nail region extraction model M (ie, the base of the nail of the nail T), and the right side of the nail region extraction model M (ie, Analyze the averaged feature point error information around the right side of the nail T, and if there is an error greater than or equal to a predetermined value, correct this by moving the position of the feature point P in the direction to cancel the error, The nail area extraction model M is updated to the corrected contents and stored in the server-side model storage area 921.
In the present embodiment, when the error of the feature point P is greater than or equal to a predetermined value (for example, ± 2 mm or more) for all four sides around the nail region extraction model M, a new nail region extraction model M (for example, The nail region extraction model Md) is stored in the server-side model storage region 921.
Further, when a feature is extracted from the analysis result of the error of the feature point P, for example, when a plurality of peaks are detected, the larger peak is selected and is used as a new nail region extraction model M. Alternatively, a plurality of new nail region extraction models M may be created corresponding to the detected peaks (for example, when two peaks are obtained, two new nail region extraction models M are obtained. A nail region extraction model M is created.)

The server-side communication unit 93 receives feature point error information and the like transmitted from each nail print apparatus 1.
In addition, the server side communication unit 93 updates the updated nail region extraction model M when the model update unit 911 as a model update unit is updated or when a new nail region extraction model M is added. Update information such as the nail region extraction model M and the added nail region extraction model M is transmitted (distributed) to the nail print apparatus 1 periodically or when a user requests it.
The timing at which the server-side communication unit 93 transmits update information such as the updated nail region extraction model M and the added nail region extraction model M to the individual nail printing apparatuses 1 is not particularly limited. For example, transmission may be performed at any time when a predetermined number of update information is accumulated.

  If the user has made a setting that the user does not want to share information with the external server device 9, the nail printing device 1 will be used unless such setting is canceled on the nail printing device 1 side. Update information etc. are not distributed.

Next, operations of the external server device 9, the nail print device 1 (drawing device), and the nail region detection system 100 in the present embodiment will be described with reference to FIGS.
The following description is based on the assumption that the nail print apparatus 1 is set not to refuse information sharing with the external server apparatus 9.

FIG. 8 is a flowchart showing a drawing process performed by the nail print apparatus 1.
When drawing with the nail printing apparatus 1, the user first turns on the power switch to activate the control device 80, and selects a nail design to be printed on the nail T of the printing finger U1. The selected nail design may be displayed on the display unit 26 as a thumbnail image for design confirmation.
The user operates the drawing switch (not shown) after inserting the printing finger U1 into the finger receiving unit 31 and positioning and fixing the printing finger U1.

When the printing finger U1 is positioned on the finger receiving unit 31, as shown in FIG. 8, the imaging control unit 811 controls the imaging unit 50 to image the printing finger U1 including the nail T and acquire a finger image. (Step S1).
The nail area detection unit 812 detects the maximum finger width Wmax of the printing finger U1 from the acquired finger image (step S2), and selects the nail area extraction model M stored in the model selection data area 824. The nail region extraction model M to be applied to the nail T of the printing finger U1 is selected with reference to the threshold value (step S3).
For example, when the maximum finger width Wmax of the printing finger U1 is 15 mm, the nail region detection unit 812 selects the nail region extraction model Mb.

The display control unit 815 causes the display unit 26 to display an image in which the selected nail region extraction model Mb is superimposed on the finger image of the printing finger U1 (step S4), and prompts the user to confirm.
The user checks the display unit 26 and operates an OK button (not shown) if there is no correction portion. In this case, an approval instruction for the nail region is output to the control unit 81 (step S5), and the nail region detection unit 812 detects the contour line indicated by the nail region extraction model Mb as a nail region ( Step S6).
On the other hand, when the nail region extraction model Mb is deviated from the actual contour line of the nail T and there is a portion that needs correction, the user moves the feature point P of the portion to be corrected by operating the touch panel TP or the like. .
For example, in the example shown in FIG. 9A, the periphery of the lower edge of the actual nail T is outside the nail region extraction model Mb (lower side in FIG. 9A). Therefore, the user moves the feature point P around the lower side of the contour of the nail T to a position that matches the actual contour of the nail T, as indicated by an arrow in FIG. When the user moves and confirms the feature point P, the correction result of the feature point P is output to the control unit 81 (step S7), and the nail region detection unit 812 displays the corrected contour line (FIG. 9 ( In step b), the nail region extraction model Mb2) is detected as the contour line (nail region) of the nail T (step S8).
For example, when the nail region extraction model Mb before correction is shown by a broken line in FIG. 9B, the nail region detected by the nail region detection unit 812 after correction is substantially the same as the actual contour line of the nail T. Overlapping regions (shown as nail region extracting model Mb2 in FIG. 9B).
When the nail region extraction model Mb is corrected, the nail region detection unit 812 corrects the correction information of the nail region extraction model Mb2 and the individual feature points P (that is, the feature points P before the correction). The difference from the corrected feature point P, “feature point error information”, which is the difference, is stored in the model storage area 823 (step S9).
Further, the nail region detection unit 812 also detects other nail information such as the curvature of the nail T (step S10).

When the nail region detection unit 812 detects the nail region, the curvature of the nail T, and the like, the drawing data generation unit 813 generates drawing data based on the detection result (step S11).
The generated drawing data is output from the drawing control unit 814 to the drawing unit 40, and the drawing unit 40 performs drawing based on the drawing data (step S12).
Thereafter, for example, at the timing when the power of the nail printing apparatus 1 is turned off, the feature point error information and the like accumulated in the model storage area 823 from the time when the power is turned on to the time when the power is turned off are It is transmitted to the server device 9 (step S13).

Next, FIG. 10 is a flowchart showing model update processing by the external server device 9.
As shown in FIG. 10, when feature point error information or the like is transmitted from the individual nail printing apparatus 1 to the external server apparatus 9, it is received by the server side communication section 93 (step S21).
The model update unit 911 of the server control device 90 classifies the received feature point error information for each nail region extraction model M (step S22). Further, the model updating unit 911 has the same maximum finger width Wmax of the printing fingers U1 for which the nail region extraction model M is selected as those classified for each nail region extraction model M. Are grouped (step S23).
Then, the model update unit 911 determines whether or not there is a group in which a predetermined number or more of feature point error information is accumulated (step S24). If there is no group (step S24; NO), the model update unit 911 returns to (step S21). Repeat the process.
On the other hand, when there is a group in which a predetermined number or more of feature point error information is accumulated (step S24; YES), the start of the process of analyzing the error of the feature point P for the group is determined (step S25), and the following In this way, processing for analyzing the error of the nail region extraction model M for each side is performed.
In addition, although the case where it processes sequentially for every edge is illustrated below, the method of a process is not limited to this, The process which analyzes the error of the feature point P about all the feature points P is performed in parallel Also good.
Also, here, the following model update processing is performed only when the feature point error information belonging to each nail region extraction model M or each group when further subdividing the model M exceeds a predetermined number. For example, the model update process may be automatically performed every predetermined period regardless of the number of accumulated feature point error information.

In the present embodiment, the model updating unit 911 first adds up the accumulated feature point error information around the upper side of the nail region extraction model M (that is, the toe side of the nail T), and divides it by the accumulated number. It is determined whether or not the error of the averaged feature point P is not less than a predetermined value (for example, ± 2 mm or more) (step S26). If the error is equal to or larger than the predetermined value (step S26; YES), the model update unit 911 moves the position of the feature point around the upper side of the nail region extraction model M in a direction to cancel the error (step S27). ). On the other hand, when the error is not equal to or greater than the predetermined value (step S26; NO), the error is ignored and the process proceeds to the next step without correcting the feature points around the upper side of the nail region extraction model M.
That is, the model update unit 911 adds up the accumulated feature point error information around the left side of the nail region extraction model M (that is, the left side of the nail T), divides it by the accumulated number, and averages the feature points It is determined whether or not the error of P is equal to or greater than a predetermined value (for example, ± 2 mm or more) (step S28). If the error is greater than or equal to the predetermined value (step S28; YES), the model update unit 911 moves the position of the feature point around the left side of the nail region extraction model M in a direction to cancel the error (step S29). ). On the other hand, if the error is not equal to or greater than the predetermined value (step S28; NO), the error is ignored and the process proceeds to the next step without correcting the feature points around the left side of the nail region extraction model M.

That is, the model update unit 911 adds up the accumulated feature point error information around the lower side of the nail region extraction model M (that is, the base of the nail of the nail T), divides it by the accumulated number, and averages it. It is determined whether the error of the feature point P is greater than or equal to a predetermined value (for example, ± 2 mm or more) (step S30). If the error is equal to or greater than the predetermined value (step S30; YES), the model update unit 911 moves the position of the feature point around the lower side of the nail region extraction model M in a direction to cancel the error (step S31). ). On the other hand, if the error is not equal to or greater than the predetermined value (step S30; NO), the error is ignored and the process proceeds to the next step without correcting the feature points around the lower side of the nail region extraction model M.
That is, the model update unit 911 adds up the accumulated feature point error information around the right side of the nail region extraction model M (that is, the right side of the nail T), divides it by the accumulated number, and averages the feature points It is determined whether or not the error of P is equal to or greater than a predetermined value (for example, ± 2 mm or more) (step S32). If the error is equal to or larger than the predetermined value (step S32; YES), the model update unit 911 moves the position of the feature point around the right side of the nail region extraction model M in a direction to cancel the error (step S33). ). On the other hand, if the error is not equal to or greater than the predetermined value (step S32; NO), the error is ignored and the feature point around the right side of the nail region extraction model M is not corrected and the process proceeds to the next step.

When the model update unit 911 moves the feature point P and corrects the nail region extraction model M, the model update unit 911 updates the nail region extraction model M to the corrected content and stores it in the server-side model storage region 921 ( Step S34).
Further, the model update unit 911 determines whether or not there is an error of a predetermined value or more (for example, ± 2 mm or more) for all four sides around the nail region extraction model M (step S35), and the error is a predetermined value or more. In the case (step S35; YES), the model updating unit 911 does not correct the nail region extraction model M (for example, the nail region extraction model Mb), but a new nail region extraction model M (for example, nail region extraction). And stored in the server-side model storage area 921 as a model for use Md) (step S36).

When the model update process by the model update unit 911 is completed, the updated nail area extraction model M information is transmitted from the server-side communication unit 93 via the network on a regular basis or when requested by the user. Transmit (deliver) to the device 1.
Note that the transmission (distribution) of the updated nail region extraction model M information to each nail print apparatus 1 may not be performed every time the model update process is completed. For example, the update information about the nail region extraction model M may be appropriately transmitted (distributed) to each nail print apparatus 1 every time a predetermined number or more of the update information is accumulated.

At this time, the information transmitted from the server side communication unit 93 is not limited to the information of the updated nail region extraction model M.
For example, when the recommended nail design for each nail region extraction model M is associated and stored in the server-side nail design storage region 922, information on the updated nail region extraction model M is stored When transmitting (distributing) to the nail print apparatus 1, the recommended nail design may also be transmitted. By doing in this way, the user can know what nail design suits his / her nails T, and can use it as a reference when selecting a design.

When the updated information about the nail region extraction model M is transmitted from the external server device 9, the information is received by the communication unit 27 of each nail print device 1, and the model storage region 823 in the storage unit 82, The contents of the model selection data area 824 are updated.
For example, when the threshold value stored in the model selection data area 824 is associated with a nail area extraction model M corresponding to a thin finger (for example, when the maximum finger width Wmax is 12 mm, the nail area extraction model). Even when Ma is associated), many of the users with the maximum finger width Wmax of 12 mm adjust the feature point P of the nail region extraction model Ma according to their nails T. As a result, nail region extraction is performed. When the shape is modified to be close to the model for use Mb, the correspondence between the threshold value of the maximum finger width Wmax and the nail region extraction model M to be selected may be modified.

As described above, each nail print device 1 is linked to the external server device 9 via the network N, and information on a plurality of nail print devices 1 is aggregated in the external server device 9 to perform analysis and update. The nail region extraction model M for extracting the region can be made more versatile and accurate.
Further, by collecting information from individual nail printing apparatuses 1 and updating the nail region extraction model M as needed, it is possible to prepare a nail region extraction model M corresponding to the fashion that changes with time. In addition, even when the shape of the user's nail T changes due to a change in fashion, it is possible to detect the nail region with high accuracy while minimizing the user's effort.

As described above, according to the present embodiment, the nail print device 1 specifies the nail region by fitting the model storage region 823 for storing the nail region extraction model M and the nail region extraction model M to the finger image. A nail region detecting unit 812 for performing correction so that the nail region detecting means corrects the feature points P constituting the contour line according to the finger image when fitting the nail region extracting model M to the finger image. Thus, when the nail region extraction model M is corrected, an error (difference) between the corrected feature point P and the uncorrected feature point P is transmitted to the external server device 9 as feature point error information. It has become. Also, in the external server device 9 that has received this feature point error information, the model update unit 911 classifies the feature point error information for each nail region extraction model M, and the feature point P for each nail region extraction model M. The nail area extraction model M is updated on the basis of the above error, and the updated nail area extraction model M is transmitted to the nail printing apparatus 1.
For this reason, it becomes possible to collect and analyze and update the correction information of the nail region extraction model M accumulated in the individual nail print apparatuses 1 in the external server apparatus 9.
As a result, a large amount of user information can be reflected on the nail region extraction model M for extracting the nail region afterwards, and more versatile and accurate information can be obtained.
Also, by collecting information from the individual nail printing apparatus 1 and updating the nail region extraction model M as needed, a nail region extraction model M corresponding to a trendy nail shape that changes with time Even when the shape of the user's nail T changes due to a change in fashion, it becomes possible to select a nail region extraction model M that matches the shape of each nail T, and for nail region extraction. It is possible to detect the nail region with high accuracy while reducing the user's trouble of adjusting the feature point after selecting the model M as much as possible.

In the present embodiment, the model update unit 911 performs the update process of the nail region extraction model M after the feature point error information is accumulated to some extent.
For this reason, it is possible to avoid an unnatural update of the nail region extraction model M by reflecting corrections corresponding to a small number of special nails T, and for more versatile nail region extraction. Appropriate update processing can be performed so that the model M is obtained.

  Although the embodiments of the present invention have been described above, the present invention is not limited to such embodiments, and various modifications can be made without departing from the scope of the present invention.

  For example, in the present embodiment, when the model update unit 911 performs model update processing, the feature point error information is classified for each nail region extraction model M, and the maximum finger width Wmax serving as a model selection threshold value However, the classification based on the value of the maximum finger width Wmax is not essential, and the model update process may be performed with the feature point error information classified for each nail region extraction model M. Good.

In the present embodiment, the value of the maximum finger width Wmax is used as a threshold for selecting which nail region extraction model M from among the plurality of nail region extraction models M. It is not limited.
For example, the dimension in the thickness (height) direction of the finger may be used as the threshold value.

In particular, when an individual user uses the nail print apparatus 1 as a dedicated machine, the user uses the nail area extraction model frequently used by the user regardless of update information from the external server apparatus 9 on the nail print apparatus 1 side. M may be registered.
Further, although not a dedicated machine, when a specific user uses the nail printing apparatus 1, each user name may be registered in association with a nail region extraction model M frequently used by the user. Good.
By doing so, even if the selectable nail region extraction model M is subdivided by the model update process and the number increases, the nail region extraction model M that matches the nail T is not mistaken. It becomes possible to select.

In the present embodiment, the update information transmitted from the external server device 9 may be accompanied by nail design information suitable for each nail region extraction model M. Information indicating the nail design frequently used in the past by a person who is judged to have a similar nail shape, such as a width user, is transmitted to the nail printing apparatus 1 in the form of a ranking format, etc. It may be proposed as a high nail design.
In this case, by updating the ranking from time to time, the user can know which design suits the current fashion among the designs that look good on him. can do.

If the nail design selected by the user does not match the nail region extraction model M selected based on the threshold value such as the value of the user's maximum finger width Wmax, a message or a warning to that effect is displayed on the display unit 26. You may make it alert by making it display or displaying the image at the time of actually drawing.
For example, when a user who is determined to be a vertically long and narrow nail T selects a design having a horizontal width as a nail design to be drawn, a warning is displayed with a finished image.
Accordingly, it is possible to reduce a risk that the user makes a wrong design selection and executes a nail print different from the image.
In the case where the nail print apparatus 1 includes a speaker or the like, a warning may be given by voice or the like.

Further, in the present embodiment, the case of registering as a new nail region extraction model M when all four sides exceed a predetermined error is exemplified, but the original nail region extraction model M is corrected / updated. The determination of whether to stop or register as a new nail region extraction model M is not limited to the example illustrated here.
For example, if it is highly necessary to register as a separate model, such as when one side greatly exceeds a predetermined error or when there are many users who have made similar corrections, a new nail region extraction The model M may be registered.

In the present embodiment, the case where the nail print apparatus (drawing apparatus) 1 is directly connected to the external server apparatus 9 via the network N is illustrated. However, the nail print apparatus (drawing apparatus) 1 is directly connected to the network N. There is no need to be connected.
For example, as shown in FIG. 1B, a nail print device (drawing device) 1 may be connected to a network N via various communication terminal devices Pd.
In this case, it is not necessary to provide the operation unit 25 and the display unit 26 in the nail printing apparatus (drawing apparatus) 1. Further, the communication terminal device Pd can acquire nail design data, various programs, and the like via the external server device 9, and the nail print device (drawing device) using the operation unit and display unit of the communication terminal device Pd. One drawing operation or the like may be controlled. In this case, the nail print apparatus (drawing apparatus) 1 only needs to have a function capable of drawing according to the control of the communication terminal device Pd, and the nail print apparatus (drawing apparatus) 1 can be simply and inexpensively. It is also possible to configure.

  In the present embodiment, the drawing head 43 of the nail printing apparatus (drawing apparatus) 1 includes the pen holder 42 that holds the drawing pen 41 and the inkjet head 71. Providing both is not an essential configuration, and may be a drawing apparatus that draws only one of them.

  In this embodiment, the drawing head 43 includes one pen holder 42. However, the number of pen holders 42 provided in the drawing head 43 is not limited to one. For example, two or more pen holders 42 may be provided, and two or more drawing pens 41 may be held.

  In the present embodiment, the case where the user manually replaces the pen 41 held by the pen holder 42 is illustrated as an example. However, for example, a standby space for waiting the pen 41 on the partition wall 116 is provided. The necessary pen 41 may be automatically acquired from the waiting space and replaced with the pen holder 42 by the pen replacement mechanism.

  Further, in this embodiment, the nail print apparatus 1 that performs drawing sequentially by inserting fingers one by one into the apparatus has been described as an example. However, a plurality of fingers can be continuously inserted without inserting or removing each finger. It is also possible to adopt a configuration that can perform drawing.

  Further, the nail printing apparatus 1 may include a drying unit including a heater and a fan for drying ink after drawing.

Although several embodiments of the present invention have been described above, the scope of the present invention is not limited to the above-described embodiments, but includes the scope of the invention described in the claims and equivalents thereof. .
The invention described in the scope of claims attached to the application of this application will be added below. The item numbers of the claims described in the appendix are as set forth in the claims attached to the application of this application.
[Appendix]
<Claim 1>
Server-side model storage means for storing a plurality of nail region extraction models to be fitted to the finger image when specifying the nail region from the finger image;
When fitting the nail region extraction model to the finger image, a plurality of feature points constituting the contour line of the nail region extraction model are corrected according to the finger image and before correction. Server side communication means for receiving feature point error information which is an error from the feature point of
The feature point error information received by the server-side communication means is classified for each nail region extraction model, and the nail region extraction model is updated based on the feature point error for each nail region extraction model. Model update means to
A server device comprising:
<Claim 2>
The server-side communication means can communicate with the drawing apparatus;
The server apparatus according to claim 1, wherein the server-side communication unit transmits the updated nail region extraction model updated by the model update unit to the drawing apparatus.
<Claim 3>
The model update unit updates the nail region extraction model after a predetermined number or more of the feature point error information received by the server side communication unit is accumulated. The server apparatus of description.
<Claim 4>
The server device according to any one of claims 1 to 3,
A drawing device;
A nail region detection system comprising:
<Claim 5>
The drawing device includes:
A device-side model storage means for storing a nail region extraction model having an outline composed of a plurality of feature points and fitting to the finger image when the nail region is specified from the finger image;
Nail area detection means for specifying the nail area by fitting the nail area extraction model to the finger image;
Drawing means for drawing on the nail area specified by the nail area detecting means;
The nail region detection means is a unit that corrects the feature points constituting the contour line according to the finger image when fitting the nail region extraction model to the finger image. And device side communication means for transmitting an error between the feature point before correction and the feature point error information to the server device,
The nail | claw area | region detection system of Claim 4 characterized by the above-mentioned.
<Claim 6>
A device-side model storage means for storing a nail region extraction model having an outline composed of a plurality of feature points and fitting to the finger image when the nail region is specified from the finger image;
Nail area detection means for specifying the nail area by fitting the nail area extraction model to the finger image;
Drawing means for drawing on the nail area specified by the nail area detecting means;
A device-side communication means configured to be able to send and receive information to and from an external server device;
With
The nail region detection means corrects the feature points constituting the contour line according to the finger image when fitting the nail region extraction model to the finger image.
The device-side communication means transmits an error between the corrected feature point and the uncorrected feature point to the external server device as feature point error information, and the nail region extraction model is updated in the external server device. A drawing device that receives the updated nail region extraction model from the external server device.

DESCRIPTION OF SYMBOLS 1 Nail print apparatus 9 External server apparatus 31 Finger receiving part 40 Drawing part 41 Pen 50 Image | photographing part 51 Image | photographing apparatus 81 Control part 82 Memory | storage part 812 Nail area | region detection part 911 Model update part T Nail U1 Printing finger

Claims (6)

Server-side model storage means for storing a plurality of nail region extraction models to be fitted to the finger image when specifying the nail region from the finger image;
When fitting the nail region extraction model to the finger image, a plurality of feature points constituting the contour line of the nail region extraction model are corrected according to the finger image and before correction. Server side communication means for receiving feature point error information which is an error from the feature point of
The feature point error information received by the server-side communication means is classified for each nail region extraction model, and the nail region extraction model is updated based on the feature point error for each nail region extraction model. Model update means to
A server device comprising: The server-side communication means can communicate with the drawing apparatus;
The server apparatus according to claim 1, wherein the server-side communication unit transmits the updated nail region extraction model updated by the model update unit to the drawing apparatus.   The model update unit updates the nail region extraction model after a predetermined number or more of the feature point error information received by the server side communication unit is accumulated. The server apparatus of description. The server device according to any one of claims 1 to 3,
A drawing device;
A nail region detection system comprising: The drawing device includes:
A device-side model storage means for storing a nail region extraction model having an outline composed of a plurality of feature points and fitting to the finger image when the nail region is specified from the finger image;
Nail area detection means for specifying the nail area by fitting the nail area extraction model to the finger image;
Drawing means for drawing on the nail area specified by the nail area detecting means;
The nail region detection means is a unit that corrects the feature points constituting the contour line according to the finger image when fitting the nail region extraction model to the finger image. And device side communication means for transmitting an error between the feature point before correction and the feature point error information to the server device,
The nail | claw area | region detection system of Claim 4 characterized by the above-mentioned. A device-side model storage means for storing a nail region extraction model having an outline composed of a plurality of feature points and fitting to the finger image when the nail region is specified from the finger image;
Nail area detection means for specifying the nail area by fitting the nail area extraction model to the finger image;
Drawing means for drawing on the nail area specified by the nail area detecting means;
A device-side communication means configured to be able to send and receive information to and from an external server device;
With
The nail region detection means corrects the feature points constituting the contour line according to the finger image when fitting the nail region extraction model to the finger image.
The device-side communication means transmits an error between the corrected feature point and the uncorrected feature point to the external server device as feature point error information, and the nail region extraction model is updated in the external server device. A drawing device that receives the updated nail region extraction model from the external server device.

Images