WO2015152225A1 - 薬剤撮影装置 - Google Patents
薬剤撮影装置 Download PDFInfo
- Publication number
- WO2015152225A1 WO2015152225A1 PCT/JP2015/060090 JP2015060090W WO2015152225A1 WO 2015152225 A1 WO2015152225 A1 WO 2015152225A1 JP 2015060090 W JP2015060090 W JP 2015060090W WO 2015152225 A1 WO2015152225 A1 WO 2015152225A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- medicine
- drug
- light source
- image
- discrimination
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/9508—Capsules; Tablets
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B90/361—Image-producing devices, e.g. surgical cameras
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01B—MEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
- G01B11/00—Measuring arrangements characterised by the use of optical techniques
- G01B11/24—Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
- G01N21/255—Details, e.g. use of specially adapted sources, lighting or optical systems
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
- G16H20/10—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients
- G16H20/13—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to drugs or medications, e.g. for ensuring correct administration to patients delivered from dispensers
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/56—Cameras or camera modules comprising electronic image sensors; Control thereof provided with illuminating means
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- H04N7/181—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast for receiving images from a plurality of remote sources
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/062—LED's
-
- G—PHYSICS
- G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
- G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
- G16H30/00—ICT specially adapted for the handling or processing of medical images
- G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
Definitions
- the present invention relates to a drug imaging device that captures an image of a drug, and a drug identification software that identifies a drug.
- Patent Documents 1 and 2 a drug discrimination device that automatically performs drug discrimination has been proposed.
- Patent Documents 1 and 2 a drug discrimination device that automatically performs drug discrimination has been proposed.
- Patent Documents 1 and 2 a drug discrimination device that automatically performs drug discrimination has been proposed.
- Patent Documents 1 and 2 such a device is still at the literature level and has not been put into practical use.
- many developments are still required in various aspects of the drug identification system such as devices and software.
- inspections may be performed on drugs that have been dispensed at pharmacies. In this inspection, it is confirmed whether the dispensed medicine matches the prescription. And the apparatus which performs this inspection is also developed. However, unlike discrimination, it is only necessary to determine whether or not the drug dispensed in the light of the prescription is correct, so there is no need to find a candidate drug from a myriad of existing drugs. . Therefore, inspection techniques cannot be applied as they are for identification.
- the purpose of the present invention is to contribute to the practical application of a drug discrimination system.
- a first aspect of the present invention relates to a medicine photographing apparatus used for photographing a medicine image.
- the medicine photographing apparatus includes a placement unit, a first camera, a second camera, a first light source, a second light source, a third light source, and a fourth light source.
- a medicine is set on the mounting portion.
- the first camera is installed above the placement unit.
- the second camera is installed below the placement unit.
- the first light source is installed above the placement unit.
- the second light source is composed of the same type of light source as the first light source, and is installed below the placement unit.
- the third light source is a light source different from the first light source, and is installed above the placement unit.
- the fourth light source is composed of the same type of light source as the third light source, and is installed below the placement unit.
- the first camera and the second camera are preferably capable of taking color images.
- the first light source and / or the second light source is preferably used for photographing a medical inscription.
- the third light source and / or the fourth light source is preferably used for photographing the printing of the medicine.
- the first light source and the second light source are preferably direct light sources, and more preferably ring illumination.
- this ring illumination is referred to as first ring illumination.
- the first ring illumination is positioned higher than the bottom of the placement item and lower than the upper end of the placement item. It is preferable to be located at a place.
- the placement item preferably includes a petri dish having a transparent bottom. And when this petri dish is set to a mounting part, it is preferable that a petri dish is inserted inside the ring of 1st ring illumination. In that case, it is preferable that the bottom surface of the petri dish is located below the first ring illumination. On the other hand, it is preferable that the upper surface of the placing item is located above the first ring illumination.
- the imaging area of the first camera includes the inside of the ring of the first ring illumination.
- the imaging region of the second camera includes the inside of the ring of the second ring illumination when the placement unit is viewed from below. Is preferred.
- the light from the third light source reaches the medicine through the ring of the first ring illumination.
- the light from the fourth light source preferably reaches the medicine through the ring of the second ring illumination.
- the distance from the third light source and the fourth light source to the placement unit is larger than the distance from the first light source and the second light source to the placement unit.
- the 3rd light source is installed in the side lower than a mounting part in the position lower than a 1st camera.
- the fourth light source is installed at a position higher than the second camera and on the side of the placement unit.
- the third light source and the fourth light source are preferably diffused light sources. More specifically, it is preferable that the third light source and the fourth light source include a polarizing filter, and the light passing through the polarizing filter is configured to reach the medicine.
- both the 3rd light source and the 4th light source are comprised by several bar illumination. In that case, it is preferable that at least one of these bar lights is installed in parallel with the front-rear direction of the medicine photographing apparatus.
- the placement unit, the first camera, the second camera, the first light source, the second light source, the third light source, and the fourth light source are preferably housed in a case. And it is preferable that this case can be opened and closed at at least a part of the front surface and at a position higher than the placement portion. It is preferable that an inclined portion is formed on the front surface of the case at a position higher than the placement portion so that the distance from the back surface of the medicine photographing device decreases as it goes from the bottom to the top.
- the medicine photographing apparatus has a slope in front of the first camera. It is preferable that this slope extends in the left-right direction of the medicine photographing apparatus, and the horizontal position of the lower end is closer to the back surface of the medicine photographing apparatus than the horizontal position of the upper end.
- the medicine photographing apparatus there is an internal space of the medicine photographing apparatus, and a position higher than the placement portion in this internal space is called an internal upper space. It is preferable that the medicine photographing apparatus has an inclined surface facing the internal upper space in the vicinity of the placement portion. It is preferable that this slope extends in the front-rear direction of the medicine photographing apparatus, and the horizontal position of the lower end is closer to the mounting portion than the horizontal position of the upper end. Furthermore, when the medicine photographing apparatus is viewed from the front, the inclined surface is preferably located on the right side or the left side of the placement unit.
- the internal space of the medicine photographing apparatus is in communication with the front and left and right external spaces of the medicine photographing apparatus at a position lower than the first camera and higher than the second camera.
- the internal space is preferably in communication with the external space in the vicinity of the mounting portion, and more preferably in communication between the first light source and the second light source.
- the placement item of the medicine photographing device is placed with a placement item for setting the medicine in the device. It is preferable that the placing item has a configuration in which a petri dish is attached to the tray. It is preferable that the center of the bottom surface of the petri dish is transparent and the peripheral edge of the bottom surface is opaque. In the petri dish, an opaque member having a recess on the upper surface is installed as necessary.
- the second aspect of the present invention relates to drug discrimination software that allows a computer to perform drug discrimination.
- This medicine discrimination software displays on the first part of the display device of the computer an image obtained by photographing an area containing the medicine (first step). Further, the medicine discrimination software enlarges and displays the selected medicine among the medicines displayed in the area on the second portion of the display device (second step). In addition, the medicine discrimination software displays information on medicines that are candidates for the medicine selected as a result of the discrimination on the third part of the display device (third step). Further, the medicine discrimination software displays information on the medicine selected by the user from the information on the medicines as candidates on the fourth portion of the display device (fourth step).
- the selection of the drug in the second step may be performed by the user or automatically by the computer. For example, when the user selects any one of the medicines displayed in the first part, the selected medicine is displayed in the second part. Then, when the discrimination of the selected medicine is completed, the computer displays information on the medicine that is a candidate for the selected medicine on the third portion of the display device. In another aspect, the computer automatically selects one drug that has been identified by the computer from among the drugs displayed in the first portion. The selected medicine is enlarged and displayed on the second portion of the display device.
- the computer attaches a first label indicating that the discrimination of the drug is completed to the drug for which the discrimination of the drug is completed among the drugs displayed in the first part.
- the drug selected and displayed in the second part has a second indicator indicating that the drug is displayed in the second part. It is preferable to attach to the corresponding medicine displayed in the first part.
- the drug displayed in the fourth part is displayed with a third indicator indicating that the selection by the user is completed in the fourth part. It is preferable to attach to the corresponding drug.
- marker are comprised with a different color.
- Information on the candidate drug displayed in the third part includes the name of the drug, the image of the drug stored in the database, a numerical value or rank indicating the degree of correctness, the stamp or print code of the drug, and the drug The code to identify is illustrated. Information about one drug is preferably displayed in the same row.
- arbitrary drugs among a plurality of drugs displayed in the first part are grouped.
- the computer causes the user to select an arbitrary plurality of drugs from the plurality of drugs displayed in the first part.
- the computer then groups these selected drugs as a group.
- discrimination of the incomplete medicine is omitted.
- the selection result is reflected on other drugs belonging to the same group.
- a third aspect of the present invention relates to drug identification software that allows a computer to perform drug identification.
- a computer equipped with this medicine discrimination software first acquires an image displaying a medicine (first step). Next, the computer separates the region where the drug is present from the acquired image (second step). The computer then extracts the stamps and / or prints in the separated area (third step). Next, the computer searches for a medicine based on the extracted stamp and / or print (fourth step).
- the computer obtains a color image taken from above and a color image taken from below.
- the computer associates the drug region separated from the image photographed from above with the drug region separated from the image photographed from below. This association can be performed, for example, by inverting either one of the image photographed from above and the image photographed from below and superimposing both images.
- the computer may determine whether or not the separated medicine is a tablet. This determination can be made, for example, by comparing an image taken from above with an image taken from below. More specifically, when the above-described drug areas can be associated, it can be determined that the drug is a tablet.
- a drug inscription is extracted from an image on which a medicine is displayed in the third step
- the medicine print is extracted from the image on which the medicine is displayed in the third step, it is preferable to use an image of the medicine photographed in a state where the medicine is illuminated with diffuse illumination.
- the computer may detect whether the medicine is stamped and / or printed before, during, or after the third step.
- medicines to be searched may be narrowed down based on the detected marking and / or presence / absence of printing.
- the computer may determine whether the medicine has a secant.
- the medicines to be searched may be narrowed down based on the determination result of the presence / absence of the secant. Further, the computer may extract a representative color of the medicine prior to performing the fourth step.
- the computer may narrow down the medicines to be searched based on information obtained from the photographed medicine images.
- information obtained from the photographed medicine images include the type of drug, the shape of the drug, the size of the drug, the presence / absence of marking, the presence / absence of printing, the presence / absence of a secant, and the color of the drug.
- the fourth step it is preferable to perform drug search by performing pattern matching on the template image data stored in the database with the imprinted and / or printed image data obtained in the third step.
- this pattern matching it is preferable to calculate a score representing the matching rate between the image data obtained in the third step and the template image data.
- position correction may be performed on the obtained image data and / or template image data. Further, the obtained image data and / or template image data may be rotated prior to pattern matching.
- the pattern matching may be performed on the entire stamped and / or printed image data obtained in the third step, or may be performed using only a part of the obtained image data.
- Drug identification software for causing a computer to identify a drug, Displaying an image of a region containing a medicine on a first portion of a display device of a computer; A step of enlarging and displaying the selected medicine among the medicines displayed in the region on the second portion of the display device; As a result of discrimination, displaying information on the drug that is a candidate for the selected drug on the third portion of the display device; Drug discrimination software characterized by causing a computer to perform
- Aspect (2) a step of displaying information on a drug selected from information on the candidate drug on a fourth part of the display device;
- the drug discrimination software according to aspect (1) further causing a computer to perform the operation.
- Aspect (3) A step of attaching a first label indicating that the differentiation of a drug is completed to a drug that has been identified as a drug among the drugs displayed in the first portion,
- the drug discrimination software according to the aspect (1) or (2) further causing the computer to perform.
- Aspect (4) The step of displaying the medicine selected by the user among the medicines displayed in the first part on the second part; If the selection of the selected medicine has been completed, displaying information on the medicine that is a candidate for the selected medicine on the third portion of the display device;
- the drug identification software according to any one of aspects (1) to (3), further causing a computer to perform the above.
- Aspect (5) Among the drugs displayed in the first part, the computer automatically selects a drug that has been identified by the computer, and the selected drug is selected as the second part of the display device. Step to zoom in, The drug identification software according to any one of aspects (1) to (3), further causing a computer to perform the above.
- Aspect (6) Among the drugs displayed in the first part, the drug selected and displayed in the second part indicates that the drug is displayed in the second part Attaching a second sign, The drug discrimination software according to the aspect (4) or (5), further causing the computer to perform.
- Aspect (7) displaying information on a drug selected by the user from information on the drug as a candidate on the fourth part of the display device; Of the drugs displayed in the first part, the drug displayed in the fourth part is attached with a third indicator indicating that the selection by the user has been completed;
- the drug identification software according to any one of aspects (1) to (6), wherein
- the drug discrimination software according to any one of embodiments (1) to (7).
- Aspect (9) In the first part, an image taken from above and / or an image taken from below of the region containing the drug is displayed, In the second part, an image taken from above and / or an image taken from below of the selected medicine is displayed.
- the drug discrimination software according to any one of embodiments (1) to (8).
- Aspect (10) In the third part, as information on the candidate drug, the name of the drug, the image of the drug stored in the database, a numerical value or rank indicating the degree of correctness, and the drug Display a stamp or print code,
- the drug discrimination software according to any one of embodiments (1) to (9).
- Aspect (11) Displaying the name of the drug, the image of the drug stored in the database, the numerical value or rank indicating the degree of correctness, and the stamp or print code of the drug in the same line.
- Aspect (12) One of a plurality of medicine images displayed in the third portion is enlarged and displayed in accordance with a user operation.
- Aspect (13) Grouping arbitrary medicines among a plurality of medicines displayed in the first portion;
- Aspect (14) Let a user select an arbitrary plurality of drugs from the plurality of drugs displayed in the first part, and group these selected drugs as one group.
- Drug discrimination software for causing a computer to identify a drug, Obtaining an image displaying a medicine to be identified; Extracting a region occupied by the drug from the image; Extracting inscriptions and / or prints in said area; Performing a drug search based on the extracted stamps and / or prints; Drug discrimination software characterized by causing a computer to perform
- Aspect (21) After performing the step of extracting the region occupied by the medicine, the step of associating the region extracted from the image taken from above with the region extracted from the image taken from below And let the computer do it, When this association is made, it is determined that the medicine is a tablet.
- Aspect (22) In the step of acquiring the image on which the medicine is displayed, an image of the medicine is taken in a state where the medicine is illuminated with direct illumination, In the step of extracting the stamp, the stamp is extracted based on the photographed image.
- the drug discrimination software according to any one of embodiments (16) to (21).
- Aspect (23) In the step of acquiring the image on which the medicine is displayed, an image of the medicine is taken in a state where the medicine is illuminated with diffuse illumination, In the step of extracting the print, the print is extracted based on the captured image.
- the drug discrimination software according to any one of embodiments (16) to (22).
- Aspect (24) In the step of extracting the stamp and / or print in the region, it is detected whether or not the drug is stamped and / or printed. In the step of searching for the medicine, the medicine to be searched is narrowed down based on the presence or absence of stamping and / or printing.
- the drug discrimination software according to any one of embodiments (16) to (23).
- Aspect (25) After performing the step of extracting the area occupied by the drug, the computer further performs the step of determining whether the drug has a secant line, When searching for the medicine, narrowing down the medicine to be searched based on the determination result of the presence or absence of the secant line,
- the drug discrimination software according to any one of embodiments (16) to (24).
- Aspect (26) In the step of searching for the medicine, based on at least one of the kind of medicine, the shape of the medicine, the size of the medicine, the presence or absence of engraving, the presence or absence of printing, the presence or absence of a secant, and the color of the medicine , Narrow down the drugs you want to search,
- the drug discrimination software according to any one of embodiments (16) to (25).
- Aspect (27) The extracted stamp and / or print image data is searched for a drug by performing pattern matching on the template image data stored in the database.
- the drug discrimination software according to any one of embodiments (16) to (26).
- Aspect (28) In the pattern matching, a score serving as an index of a degree of matching between the extracted stamp and / or print image data and the template image data is calculated.
- a drug identification method for identifying a drug Obtaining an image displaying a medicine to be identified; Extracting a region occupied by the drug from the image; Extracting inscriptions and / or prints in the area; Performing a drug search based on the extracted stamp and / or print;
- a method for identifying a drug comprising:
- a drug identification device for identifying drugs Means for obtaining an image displaying a medicine to be identified; Means for extracting an area occupied by the drug from the image; Means for extracting inscriptions and / or prints in said area; Means for searching for drugs based on the extracted stamps and / or prints;
- a drug discrimination device comprising:
- the present invention enables automation of drug discrimination. This will reduce the burden of drug discrimination work.
- FIG. 1 is a schematic diagram showing an outline of a drug discrimination system.
- FIG. 2 is a perspective view of the embodiment of the medicine imaging apparatus.
- FIG. 3 is a perspective view showing a state in which the front cover of the medicine photographing apparatus shown in FIG. 2 is opened.
- FIG. 4 is a perspective view showing an internal configuration of the medicine photographing apparatus shown in FIG. This figure mainly shows the frame and the members attached to the frame.
- FIG. 5 is a front view of the medicine photographing apparatus shown in FIG.
- FIG. 6A is a perspective view showing an overall image of the support member.
- FIG. 6B is a side view showing the positional relationship between the first light source, the second light source, and the medicine placement item.
- Fig.7 (a) is a perspective view which shows 1st Embodiment of the tray set to a chemical
- FIG. 7B is a top view of the tray.
- FIG. 7C is a side view of the tray.
- FIG. 8 is a perspective view of a petri dish attached to the tray shown in FIG.
- FIG. 9-21 show screen layouts of computer images created primarily by drug identification software.
- FIG. 9 is an image of the initial stage after the drug identification software is activated.
- FIG. 10 is a first stage image for performing drug image discrimination.
- FIG. 11 is a second stage image for performing drug image discrimination.
- FIG. 12 is a third-stage image for performing drug image discrimination.
- FIG. 13 is a fourth stage image for performing drug image discrimination.
- FIG. 14 is a fifth-stage image image for performing drug image discrimination.
- FIG. 15 is a sixth-stage image image for performing drug image discrimination.
- FIG. 16 is an image when grouping in drug image discrimination.
- FIG. 17 is a first-stage image image of drug image discrimination used when all drugs are composed of the same type of drug.
- FIG. 17 is a first-stage image image of drug image discrimination used when all drugs are composed of the same type of drug.
- FIG. 18 is an image image of the second stage of the drug image discrimination started in FIG.
- FIG. 19 is an image of the third stage of drug image discrimination that started in FIG.
- FIG. 20 is an image of the fourth stage of drug image discrimination that started in FIG.
- FIG. 21 is an image when the loupe function of the medicine discrimination software is used.
- FIG. 22 to 25 show processing procedures when the medicine discrimination software performs automatic medicine discrimination.
- FIG. 22 is a flowchart showing processing in the upstream part of discrimination.
- FIG. 23 is a flowchart showing a process of individual medicine discrimination.
- FIG. 24 is a flowchart showing a tablet discrimination process.
- FIG. 25 is a flowchart showing a capsule discrimination process.
- FIG. 26A is a perspective view of a calibration sheet used for camera calibration.
- FIG. 26B is a plan view of the calibration sheet.
- FIG. 27 is an exploded perspective view showing a second embodiment of a tray set in the medicine photographing apparatus.
- FIG. 28 is an image image of another embodiment of the third stage for performing drug image discrimination.
- FIG. 29 is an image of another embodiment of the sixth stage for performing drug image discrimination.
- FIG. 30 is a print image in which the discrimination result is printed.
- FIG. 31 is a flowchart showing an automatic learning procedure.
- FIG. 32 is an image of a message displayed on the screen during automatic learning.
- FIG. 33 is an image image of the fifth stage of the medicine image discrimination started in FIG.
- FIG. 34 is an image of the sixth stage of drug image discrimination that started in FIG.
- FIG. 35 is an image of the seventh stage of drug image discrimination that started in FIG. FIG.
- FIG. 36 is an image of a message displayed before the discrimination result is printed.
- FIG. 37A is a plan view of a second embodiment of a calibration sheet used for camera calibration.
- FIG. 37B is a side view of the calibration sheet of the second embodiment.
- FIG. 38 is an image of the second embodiment of the seventh stage of drug image discrimination starting in FIG.
- FIG. 39 is an image of the third embodiment of the seventh stage of drug image discrimination starting in FIG.
- FIG. 40 is an image of the fourth embodiment of the seventh stage of drug image discrimination starting in FIG.
- FIG. 41 is an image of manual medicine search.
- FIG. 42 is an image when the medicine in the wrapping paper is identified.
- FIG. 1 is a schematic diagram showing an outline of a drug discrimination system.
- the drug discrimination system 100 includes a drug imaging device 200 and a computer 500.
- the medicine imaging apparatus 200 images the medicine
- the computer 500 discriminates the medicine based on the obtained image data of the medicine.
- the computer 500 includes a main body 520 incorporating a CPU, a storage device, a recording device, and the like, a display device 530 that functions as an output device, and a keyboard 541 and a mouse 542 that function as input devices.
- the display device 530 includes a screen 531 and a touch screen 532, and the user can input to the computer 500 via the touch screen 532.
- drug discrimination software 600 is installed in the computer 500.
- the computer 500 in which the medicine discrimination software (also called a medicine discrimination program) 600 is installed can also be called a medicine discrimination device.
- the computer 500 is configured by a so-called PC (personal computer), and the drug discrimination software 600 is stored in a recording device in the PC.
- the computer 500 is not a PC, for example, It may be a microcomputer incorporated in another device.
- the medicine discrimination software 600 may be written in a storage device such as a ROM (read only memory) of the device.
- the user When performing drug discrimination, the user first sets the drug to be identified in the drug imaging apparatus 200. Next, when the user operates the computer 500, the medicine imaging apparatus 200 performs imaging of the medicine. The taken image of the medicine is transmitted to the computer 500 as data. Then, the computer 500 searches for a medicine with reference to a database (not shown) based on the image data.
- the computer 500 has a built-in database.
- the comprehensive drug database “MDbank” (trademark) manufactured by Yuyama Manufacturing Co., Ltd. when the comprehensive drug database “MDbank” (trademark) manufactured by Yuyama Manufacturing Co., Ltd. is installed in the computer 500, the computer 500 searches for drugs by referring to MDbank without accessing an external database. It can be performed.
- the computer 500 accesses a database via a network.
- the drug guidance support system “PharmaRoad” (trademark) manufactured by Yuyama Manufacturing Co., Ltd. is installed on another computer (server) in the same facility, the computer 500 is connected via a LAN (local area network). You can search for drugs by accessing PharmaRoad in the server.
- the computer 500 may access the database via the Internet.
- FIG. 2 is a perspective view showing the appearance of the drug imaging device 200.
- the inside is not visible by the case 210, but a placement part 220 for placing the medicine is provided at substantially the center of the inside of the medicine photographing apparatus 200. More specifically, the medicine is put in a tray 300 as shown in FIG. 7, and this tray 300 is set on the placement unit 220.
- the upper side from the placement unit 220 is referred to as an upper part 201 and the lower side is referred to as a lower part 202.
- the lower case 211 covers the lower part 202 of the medicine photographing apparatus 200.
- a cutout 212 extending in the horizontal direction is formed on the upper surface of the lower case 211.
- the notch 212 is open in the left-right direction and the front direction of the medicine photographing apparatus 200. Through this notch 212, the user can insert a long wrapping paper into the medicine photographing apparatus 200. Specifically, the wrapping paper is spread in the horizontal direction and inserted into the notch 212 from the front side. Then, the wrapping paper is moved near the center of the medicine photographing apparatus 200. Thereby, the internal camera of the medicine photographing apparatus 200 can photograph the medicine enclosed in the inside of the wrapping paper without cutting the wrapping paper.
- the internal space of the medicine photographing apparatus 200 communicates with the external space in the left-right direction by the notch portion 212, even when the wrapping paper is longer than the width of the medicine photographing apparatus 200, the user can remove the wrapping paper.
- the wrapping paper can be easily inserted into the medicine photographing apparatus 200 in the unwound state.
- a tray support member 221 that supports a member that stores a medicine is provided immediately above the notch portion 212. Specifically, the tray 300 is placed on the tray support member 221. As shown in FIG. 6A, the tray support member 221 is a substantially square plate-like member, and a circular hole 222 is opened at the center thereof. As shown in FIG. 7, a petri dish 310 is fitted in the tray 300. When the tray 300 is set on the tray support member 221, the petri dish 310 is inserted into the hole 222.
- a recess having a planar shape corresponding to the planar shape of the tray 300 is formed on the upper surface of the mounting member 221. The recessed portion forms a fitting portion 223 into which the tray 300 is fitted. The tray 300 is placed in the fitting portion 223. Then, when the tray 300 is fitted into the fitting portion 223, the tray 300 is stably held by the tray support member 221.
- the upper surface 201 and the upper part 201 of the front surface of the medicine imaging device 200 are covered with a cover 214.
- the cover 214 can be opened upward.
- the cover 214 is hinged by a hinge 257 (see FIG. 4) at the upper end of the back surface of the upper case 213, and the cover 214 can be rotated in the vertical direction around the hinge 257.
- FIG. 3 shows a state where the cover 214 of the medicine photographing apparatus 200 is opened.
- an upper internal space 240 that is an upper portion 201 of the internal space of the medicine photographing apparatus 200 is opened to a space in front of the medicine photographing apparatus 200.
- the user can set the tray 300 to the fitting portion 223 of the placement portion 220 through the upper inner space 240.
- the front-side outer surface of the upper case 213 has a substantially inverted U-shape.
- This front side outer surface is inclined, and an inclined portion 215 is formed thereby.
- the inclined portion 215 is inclined so that the distance from the back surface of the medicine photographing apparatus 200 becomes smaller from the bottom to the top.
- the tray 300 is less likely to collide with the upper case 213.
- the front surface of the cover 214 is configured to cover the inclined portion 215. Therefore, when the cover 214 is closed, the front surface thereof is located in the vicinity of the inclined portion 215 and is parallel to the inclined portion 215.
- the upper surface and the front surface of the cover 214 are obtuse, corresponding to the obtuse angle between the upper surface of the upper case 213 and the inclined portion 215.
- the lower end of the inclined portion 215 is located behind the outer front surface of the guide member 230 and the lower case 211. That is, the distance from the back surface of the medicine imaging apparatus 200 to the lower end of the inclined portion 215 is smaller than the distance from the back surface of the medicine imaging apparatus 200 to the outer front surface of the guide member 230 and the outer front surface of the lower case 211. With this configuration, the user can more easily put the tray 300 into the upper internal space 240.
- an inclined surface 216 different from the inclined portion 215 is provided on the outer surface on the front side of the upper case 213. More specifically, the slope 216 is provided inside the U shape of the substantially inverted U-shaped inclined portion 215. The slope 216 is provided on the front surface of a first camera 410 (see FIG. 4), which will be described later, and protects the first camera 410. Thereby, when the user inserts the tray 300 into the upper internal space 240, it is possible to prevent the position and orientation of the first camera 410 from being shifted due to the tray 300 hitting the first camera 410. As shown in FIG. 3, the inclined surface 216 has a substantially rectangular shape and extends in the left-right direction of the medicine photographing apparatus 200.
- the distance from the back surface of the medicine photographing apparatus 200 to the inclined surface 216 gradually decreases from the top to the bottom. That is, the horizontal position of the upper end of the slope 216 is closer to the back surface of the medicine photographing apparatus 200 than the horizontal position of the lower end of the slope 216. This makes it difficult for the tray 300 to collide with the slope 216 during insertion, and the user can easily put the tray 300 in the back of the upper internal space 240.
- a pair of guide members 230 are provided between the upper case 213 and the mounting portion 220.
- the outer side surface of the guide member 230 extends in the vertical direction and is located on the same plane as the outer side surface of the upper case 213.
- the inner side surface of the guide member 230 is inclined with respect to the vertical direction, whereby an inclined surface 231 is formed.
- the inclined surface 231 has a substantially square shape and extends in the front-rear direction of the medicine photographing apparatus 200.
- the slope 231 faces the upper internal space 240.
- One of the inclined surfaces 231 is located on the upper right side of the placement unit 220, and the other is located on the upper left side of the placement unit 220.
- the slope 231 is formed so as to approach the central axis of the medicine imaging apparatus 200 as it goes from top to bottom. That is, when viewed in plan, the horizontal position of the lower end of the inclined surface 231 is closer to the placement unit 220 than the horizontal position of the upper end. Furthermore, the distance between the lower ends of the two inclined surfaces 231 is substantially the same as or slightly larger than the width of the fitting portion 223 (see FIG. 6A) of the tray support member 221. Specifically, the distance between the lower ends of the two inclined surfaces 231 is preferably about 1 to 1.2 times the width of the fitting portion 223.
- a part of the lower end of the inclined surface 231 is located at a position that is substantially in contact with the peripheral portion of the hole 222 of the tray support member 221. With this configuration, the user can easily place the tray 300 on the fitting portion 223 of the tray support member 221.
- FIGS. 4 and 5 are diagrams showing a state where the cases of the drug imaging device 200 are removed, that is, a diagram showing main members inside the drug imaging device 200.
- FIG. 4 is a perspective view of the medicine photographing apparatus 200
- FIG. 5 is a front view.
- a frame 250 is provided on the back side of the medicine photographing apparatus 200. Many of the main members of the medicine photographing apparatus 200 are directly or indirectly attached to the frame 250.
- the frame 250 includes a first column 251, a second column 252, a third column 253, a first beam 254, a second beam 255, a third beam 256, and a hinge 257.
- the first column 251 is provided on the left side of the back of the medicine photographing apparatus 200
- the second column 252 is provided in the center of the back
- the third column 253 is provided on the right side of the back.
- the first column 251, the second column 252, and the third column 253 are connected by the first beam 254, the second beam 255, and the third beam 256.
- a hinge 257 for rotating the cover 214 is attached to the third beam 256 positioned at the top of the frame 250.
- the medicine photographing apparatus 200 includes a first camera 410, a second camera 420, a first light source 430, a second light source 440, a third light source 450, a fourth light source 460, and a tray support member 221. , And a guide member 230.
- the tray support member 221 and the guide member 230 are directly attached to the frame 250.
- the first camera 410, the second camera 420, the third light source 450, and the fourth light source 460 are provided via the support member. Attached to the frame 250.
- the first light source 430 is accommodated in the tray support member 221 and supported by the tray support member 221.
- the second light source 440 is attached to the lower case 211 (see FIG. 2) via a support member.
- the main members inside the medicine photographing apparatus 200 are attached to the frame 250 instead of the case 210. This facilitates removal of the case 210 and facilitates maintenance work of the internal main members.
- the tray support member 221 is provided near the center of the medicine photographing apparatus 200.
- a guide member 230 is provided immediately above the tray support member 221.
- a third light source 450 is provided above the guide member 230.
- a first camera 410 is provided at a position higher than the third light source 450, that is, in the vicinity of the upper surface of the medicine photographing apparatus 200.
- a second light source 440 is provided below the tray support member 221 at a predetermined distance.
- a fourth light source 460 is provided near the side surface of the medicine photographing apparatus 200 at a position lower than the second light source 440.
- a second camera 420 is provided at a position lower than the fourth light source 460, that is, near the bottom surface of the medicine photographing apparatus 200.
- the first light source 430 and the third light source 450 constitute an upper light source.
- the second light source 440 and the fourth light source 460 constitute a lower light source.
- the tray support member 221 is provided near the center of the medicine photographing apparatus 200 and above the space 217 for the notch 212.
- a fitting portion 223 is formed on the upper surface of the tray support member 221, and the tray 300 (see FIG. 7) is placed on the fitting portion 223 in use.
- the A first light source 430 is attached to the bottom of the tray support member 221.
- the first light source 430 includes a first ring illumination 431.
- the first ring illumination 431 includes a plurality of light emitting diodes (LEDs) arranged in an annular shape. The plurality of LEDs are arranged so as to surround the outer periphery of the hole 222 of the tray support member 221 and face the hole 222.
- the petri dish 310 passes through the hole 222 and protrudes below the tray support member 221. For this reason, the bottom 311 of the petri dish 310 is located below the lower surface of the tray support member 221. In other words, when the tray 300 is placed on the fitting portion 223, the petri dish 310 is inserted inside the ring of the first ring illumination 431, and the bottom 311 of the petri dish 310 is below the first ring illumination 431. Will be located.
- the first ring illumination 431 when the tray 300 is placed on the fitting portion 223, the first ring illumination 431 is positioned higher than the bottom 311 of the petri dish 310, and the upper surface or upper end of the tray 300 (the highest portion of the tray 300). It will be located lower than. At least the bottom surface of the tray support member 221 and the side surface facing the hole 222 are made of a transparent material. As a result, when the first ring illumination 431 emits light, the emitted light is directed toward the center of the hole 222 and downward. As a result, the medicine put into the bottom 311 of the petri dish 310 is directly irradiated from 360 ° in all directions and obliquely from the emitted light of the first ring illumination 431. That is, the first light source 430 functions as a direct light source that directly illuminates the medicine.
- a second light source 440 is installed below the tray support member 221 via a notch space 217.
- the second light source 440 includes a second ring illumination 441 of the same type as the first ring illumination 431.
- the second ring illumination 441 is supported by a lower support plate 442 and an upper support plate 443.
- the lower support plate 442 and the upper support plate 443 are attached to the inner side surface of the lower case 211 (see FIG. 2).
- the upper support plate 443 is made of a transparent material. Further, the upper support plate 443 has a substantially quadrangular planar shape, and unlike the tray support member 221, there is no hole in the central portion (below the hole 222).
- the lower support plate 442 has a planar shape corresponding to the planar shape of the second ring illumination 441, and has a hole having a shape corresponding to the ring of the second ring illumination 441 at the center. .
- the second ring illumination 441 is positioned below the bottom 311 of the petri dish 310. Further, the planar position of the second ring illumination 441 is arranged to coincide with the planar position of the first ring illumination 431. When the second ring illumination 441 emits light, the emitted light is directed toward the center of the hole 222 and upward.
- the first light source 430 and the second light source 440 described above are mainly used for photographing a drug, mainly an inscription on the surface of the tablet. More specifically, the first light source 430 is used for photographing a mark located on the upper surface of the medicine, and the second light source 440 is used for photographing a mark located on the lower surface of the medicine.
- the present inventor has found that when the first light source 430 and the second light source 440 are configured as described above, the inscription on the surface of the tablet can be clearly photographed.
- a third light source 450 is provided above the guide member 230.
- the third light source 450 includes a plurality of bar lights, specifically, a first bar light 451 and a second bar light 452.
- the first bar illumination 451 is attached to the third pillar 253 via the support member 453.
- the second bar illumination 452 is attached to the first pillar 251 via the support member 454.
- the first bar illumination 451 and the second bar illumination 452 are provided on the side of the medicine photographing apparatus 200, specifically on the side of the placement unit 220. As shown in FIG.
- the first bar illumination 451 and the second bar illumination 452 are installed in a direction parallel to the front-rear direction of the medicine photographing apparatus 200, and the first bar illumination 451 and the second bar illumination 452 emit light.
- the surface faces obliquely downward, more specifically, to the mounting portion 220.
- the distance from the first bar illumination 451 and the second bar illumination 452 to the place where the medicine on the placement unit 220 is placed is from the first ring illumination 431 to the place where the medicine on the placement part 220 is placed. Greater than the distance.
- first bar illumination 451 and the second bar illumination 452 are installed at positions closer to the side surface of the medicine photographing apparatus 200 than the lower end of the inclined surface 231 of the guide member 230 and the outer periphery of the hole 222 of the tray support member 221. Yes. With such an arrangement of the third light source 450, a large space is secured in the upper internal space 240, and the user can easily place the tray 300 on the placement unit 220.
- the first bar illumination 451 and the second bar illumination 452 include a polarizing filter, and the diffused light passes through the polarizing filter and is configured to reach the medicine.
- the direct light from the first bar illumination 451 and the second bar illumination 452 is cut by the polarization filter, and the light diffused by the polarization filter is the hole 222 of the tray support member 221, that is, the ring of the first ring illumination 431. It is configured to reach the drug through the inside.
- the third light source 450 functions as a diffusion light source or an indirect light source. Thereby, the upper side of the medicine is suitably illuminated.
- the present inventor has found that when the third light source 450 is configured as described above, the print on the surface of the medicine can be clearly photographed. In addition, it is possible to photograph clearly whether the medicine is a tablet or a capsule.
- a fourth light source 460 of the same type as the third light source 450 is provided below the second light source 440.
- the fourth light source 460 includes a plurality of bar lights, specifically, a third bar lamp 461 and a fourth bar lamp 462.
- the third bar illumination 461 is attached to the third pillar 253 via the support member 463.
- the fourth bar illumination 462 is attached to the first column 251 via the support member 464.
- the third bar illumination 461 and the fourth bar illumination 462 are provided on the side of the medicine photographing apparatus 200, similarly to the first bar illumination 451 and the second bar illumination 452.
- the 3rd bar illumination 461 and the 4th bar illumination 462 are installed in the direction parallel to the front-back direction of the chemical
- the light emitting surfaces of the third bar illumination 461 and the fourth bar illumination 462 are obliquely upward, more specifically, facing the placement unit 220.
- the distance from the third bar illumination 461 and the fourth bar illumination 462 to the placement unit 220 is the distance from the second ring illumination 441 to the placement unit 220. Bigger than.
- the third bar illumination 461 and the fourth bar illumination 462 are each provided with a polarizing filter, and light diffused through the polarizing filter reaches the medicine. It is configured as follows. Specifically, the diffused light from the third bar illumination 461 and the fourth bar illumination 462 passes through the ring of the second ring illumination 441 and reaches the medicine. Thereby, the lower side of the medicine is illuminated so that the printing becomes clear.
- the third light source 450 and the fourth light source 460 are each configured by two bar lights, but in other embodiments, four bar lights may be provided. In this case, it is preferable to arrange the bar lights so that the four bar lights form a quadrangle and surround the placement unit 220.
- a first camera 410 is installed above the first bar illumination 451 and the second bar illumination 452.
- the first camera 410 is attached to the second pillar 252 via an attachment member 411.
- the first camera 410 is fixed by the attachment member 411 so as to be positioned vertically above the placement unit 220 and to face the placement unit 220.
- the photographing region of the first camera 410 includes the hole 222 of the tray support member 221 and the inside of the ring of the first ring illumination 431.
- the 1st camera 410 can image
- a second camera 420 is installed below the third bar illumination 461 and the fourth bar illumination 462.
- the second camera 420 is attached to the second pillar 252 via an attachment member 421.
- the mounting member 421 fixes the second camera 420 so as to be positioned vertically below the placement unit 220 and to face the placement unit 220.
- the imaging area of the second camera 420 includes the inside of the ring of the second ring illumination 441.
- the 2nd camera 420 can image
- Both the first camera 410 and the second camera 420 described above can capture a color image.
- the medicine imaging apparatus 200 has a tray 300 as shown in FIG. 7 as a placement item for placing a medicine. Is used.
- the tray 300 has a structure in which a hole 321 is formed in a rectangular flat plate-shaped main body 320 and a transparent tube 322 is fitted into the hole 321.
- a petri dish 310 as shown in FIG. 8 is installed in the cylinder 322.
- FIG. 8 shows the petri dish 310.
- the bottom surface 311 and the side surface 312 of the petri dish 310 are transparent.
- An opaque flat ring 313 is installed on the outer edge of the bottom surface 311.
- the ring 313 can suitably prevent the drug from rolling near the inner wall.
- the ring 313 can reduce undesirable reflection of illumination light that occurs near the boundary between the bottom surface 311 of the petri dish 310 and the inner wall. From such a viewpoint, the ring 313 is preferably black.
- the width of the ring 313 is preferably about 1/20 to 1/2 of the radius of the bottom surface 311 of the petri dish 310.
- a capsule mounting member 314 preferably made of a black opaque material is installed on the bottom surface 311 of the petri dish 310.
- the transparent material constituting the bottom surface 311 is exposed in the remaining half.
- a portion of the bottom surface 311 where the transparent material is exposed is referred to as a transparent portion 315. It is recommended that the tablet be placed in this transparent portion 315.
- capsules such as capsules and soft capsules are placed on the capsule mounting member 314 in principle.
- the capsule mounting member 314 has a planar shape close to a trapezoid.
- the capsule mounting member 314 has a long side and a short side in the longitudinal direction, and two oblique sides having substantially the same length in the transverse direction. The distance between the hypotenuses becomes smaller from the long side to the short side.
- the capsule mounting member 314 has a wave-shaped portion on the top surface when viewed from the side.
- the capsule mounting member 314 has groove-shaped recesses 316 and 317 on the upper surface. The width and depth of the recess 316 are set larger than the width and depth of the recess 317.
- the length of the recess 316 is larger than the length of the recess 317. Accordingly, relatively large capsules can be easily placed in the recesses 316, and relatively small capsules can be easily placed in the recesses 317.
- the capsules are placed in the recesses 316 or 317 so that the print faces up. Since the capsules are prevented from rolling by the concave portion 316 or 317, the first camera 410 can accurately photograph the printing of the capsule.
- the tray 300 is placed on the tray support member 221 (see FIG. 6).
- the first ring illumination 431 is positioned in the vicinity of the upper portion of the tube 322.
- the first ring illumination 431 is positioned laterally and upward near the bottom surface 311 of the petri dish 310, that is, near the bottom surface 311.
- the present inventor has found that when the first ring illumination 431 is installed at such a position, the medicine can be illuminated so that the tablets can be photographed more clearly. As shown in FIG.
- the height difference from the second ring illumination 441 to the bottom surface 311 of the petri dish 310 is set to be substantially the same as the height difference from the first ring illumination 431 to the bottom surface 311 of the petri dish 310. ing. From this point of view, the height difference from the second ring illumination 441 to the bottom surface 311 of the petri dish 310 is about 0.5 to 2 times the height difference from the first ring illumination 431 to the bottom surface 311 of the petri dish 310. Is preferred.
- FIG. 27 is an exploded perspective view showing a second embodiment of a tray set in the medicine photographing apparatus. Similar to the tray 300, the tray 300 ′ has a configuration in which a hole 321 is formed in a rectangular plate-shaped main body 320, and a transparent cylinder 322 is fitted in the hole 321. The tray 300 ′ is greatly different from the tray 300 in that a circular and transparent flat plate 330 is installed at the bottom of the tube 322 instead of the petri dish 310. When the bottom portion of the tube 322 is configured by the flat plate 330, the choice of materials constituting the bottom portion of the tube 322 increases.
- a ring 313 is installed on the outer peripheral portion of the flat plate 330.
- the outer shape of the ring 313 is substantially the same as the diameter of the flat plate 330.
- a transparent second cylinder 331 is installed on the ring 313. More specifically, the second cylinder 331 is installed such that the outer periphery thereof is in contact with the inner periphery of the cylinder 322. In another embodiment, the second cylinder 331 is directly installed on the outer periphery of the flat plate 330.
- the ring 313 is installed on the flat plate 330 so as to be adjacent to the inner wall of the second cylinder 331. That is, the ring 313 is installed on the flat plate 330 while being inserted into the second cylinder 331. Finally, a capsule placement member 314 is installed on the flat plate 330.
- the medicine photographing apparatus 200 described above is connected to a computer 500 as shown in FIG.
- the computer 500 has drug discrimination software 600, and the computer 500 controls the operation of the drug imaging apparatus 200 by the drug discrimination software 600. Specifically, the computer 500 controls illumination in the medicine photographing apparatus 200 and causes the camera to photograph medicine. Then, the computer 500 receives the photographed medicine image from the medicine photographing apparatus 200.
- the computer 500 obtains information necessary for narrowing down and searching for drugs by variously processing and processing drug image data. Based on this information, the computer 500 narrows down and searches for medicines, and displays the result on the screen 531 of the display device 530 as a discrimination result.
- FIG. 9 shows a screen 531 in a state where the medicine discrimination software 600 is activated. More specifically, the drug discrimination software is called by the medication guidance support system 610, and a tablet discrimination menu window 620 is displayed at the lower right of the screen 531 by the drug discrimination software. From this window 620, discrimination according to the purpose of the user is started. As shown in FIG. 9, a “tablet image discrimination” item 621, a “returned tablet image discrimination” item 622, and a “loupe” item 623 are displayed in the window 620. The window 620 is named “tablet discrimination”, but the drug discrimination software 600 can distinguish not only tablets but also capsules.
- the brought medicine identification software is activated by another software. However, the brought medicine identification software can be activated and operated alone by clicking the icon, for example.
- a “tablet image discrimination” window 700 as shown in FIG. 10 is displayed on the screen 531.
- a message 701 is displayed in the “Tablet Image Identification” window 700.
- This message 701 prompts the user to set the petri dish 310 into which the medicine has been loaded in the medicine photographing apparatus 200 and select the “photographing” item 751. Based on this, the user puts the medicine to be discriminated into the petri dish 310 of the tray 300, and sets the tray 300 on the placement unit 220 of the medicine photographing apparatus 200.
- the user touches (when inputting with the touch screen 532) or clicks (when inputting with the mouse 542) the “photographing” item 751.
- the medicine photographing apparatus 200 performs image photographing of the set medicine.
- the “Tablet Image Identification” window 700 is displayed as shown in FIG.
- the “tablet image discrimination” window 700 includes a first part 710, a second part 720, a third part 730, a fourth part 740, and a first item display part 750. And a second item display portion 760.
- the first part 710 and the second part 720 are arranged on the left side of the “Tablet image discrimination” window 700.
- the widths of the first portion 710 and the second portion 720 are substantially the same.
- the third portion 730 and the fourth portion 740 are arranged on the right side of the “tablet image discrimination” window 700.
- the widths of the third portion 730 and the fourth portion 740 are substantially the same.
- the first item display portion 750 is provided in the lower part of the “Tablet Image Identification” window 700. Further, the second item display portion 760 is provided below the third portion 730. In the first item display portion 750 and the second item display portion 760, various items that can be selected by the user are displayed.
- an image of the petri dish 310 photographed by the medicine photographing apparatus 200 is displayed.
- an image taken with the first light source 430 or the second light source 440 turned on is preferably used. This is because when an image is taken under such illumination, the contrast between the background and the medicine tends to increase.
- This image includes a region including a plurality of photographed drugs.
- a “view from above” tab 711 and a “view from below” tab 712 are provided at the top of the first portion 710. When the user selects the “view from above” tab 711, an image of the medicine taken from above is displayed in the first portion 710. When the “view from below” tab 712 is selected, an image obtained by photographing the medicine from below is displayed in the first portion 710.
- the computer 500 When the computer 500 acquires the image of the petri dish 310, the computer 500 automatically recognizes the area occupied by each medicine based on the image. Then, the number of recognized medicines is automatically counted, and the number of medicines obtained as a result is displayed on the gauge portion 752 of the first item display portion 750. In addition, the computer 500 automatically and sequentially identifies each recognized drug in the background. Then, the computer 500 displays on the gauge unit 752 a bar indicating the number of medicines for which automatic discrimination has been completed and how many of the medicines in the petri dish 310 have been identified. Thus, in this embodiment, since the progress of discrimination is displayed in a graph, the user can grasp at a glance how much the discrimination is progressing. Note that the user can forcibly stop the automatic discrimination by the computer 500 by selecting the “stop” item 753.
- the computer 500 sequentially attaches a first label 713 indicating that the discrimination has been completed to the medicine for which the discrimination has been completed.
- the first marker 713 is constituted by, for example, a solid line surrounding the medicine, and this solid line is drawn with a predetermined color (for example, red).
- the medicine is automatically selected by the computer 500 from the medicines that have been distinguished.
- the size 721 of the medicine is displayed at the lower right of the medicine image.
- the dimension 721 is a dimension actually measured by the drug discrimination software 600 based on the drug image, and is displayed in millimeters, for example. If the drug is circular, the drug size is the diameter of the drug. When the medicine is non-circular, the dimension of the medicine is the length of the long axis of the medicine.
- the second mark 714 is attached to the selected drug so that the user or the drug selected by the computer 500 can be seen.
- the second label 714 is different in appearance from the first label 713.
- marker 714 is comprised with the broken line surrounding a chemical
- the second indicator 714 may be displayed in an animation to make the selected drug stand out.
- a broken line surrounding the drug may rotate around the drug.
- the second marker 714 may be drawn with the same color (for example, red) as the first marker 713, or may be drawn with a different color (for example, green).
- the computer 500 displays a list of candidate drugs obtained as a result of the identification in the third portion 730.
- Each line in the list displays information on one candidate drug.
- the drugs that are more likely to be correct are displayed in the upper row of the list.
- the list display is sorted from top to bottom from the most likely drug to the lowest drug.
- the score obtained as a result of the search is used as an index to determine whether the possibility that the medicine is correct is high or low. Specifically, if the score of the possibility of matching with a medicine hit as a result of the search is high, the possibility that the medicine is correct is high, and if the score is low, the possibility of being correct is low.
- a score indicating the possibility that this candidate drug is correct an image of a drug stored in the database, a stamp or print code, and a drug name are displayed. If the setting is changed, instead of the score, the ranking of the possibility that this candidate drug is correct among all candidate drugs can be displayed. Furthermore, in addition to the drug name, a code (for example, YJ code) specifying the drug can also be displayed. In this way, when information related to one medicine is displayed together in one line, the user can easily understand. Moreover, you may display the dimension of a chemical
- the user can also select a drug that has not yet been identified by the computer 500 from among the drugs displayed in the first portion 710. For example, when the capsule displayed at the lower right of the first portion 710 is selected, the selected medicine is enlarged and displayed in the second portion 720, but the discrimination by the computer 500 is not yet completed. Results are not displayed in the third portion 730. Instead, the third portion 730 displays a message that the selected medication is currently being identified by the computer 500. Thus, in this embodiment, the user can also select a medicine that has not been identified. This is convenient because the user can immediately enlarge and view the image of the drug he / she is interested in. On the other hand, as shown in FIG. 11, the first label 713 is attached to the medicine that has been identified.
- the medicine image pointed to by the mouse cursor 543 is enlarged and displayed.
- the medicine image that the user is currently interested in is immediately displayed. Become more visible.
- this makes it easy for the user to compare the medicine image displayed in the second part 720 with the medicine image displayed in the third part.
- the user compares the drug displayed enlarged in the second portion 720 with the information on each candidate drug listed in the third portion 730, and selects the drug that the user determines to be correct. Specifically, the user selects a line in the third portion 730 where correct drug information is displayed. Although not shown in the figure, when the user selects a row in which drug information is displayed, at least a portion of the row is highlighted.
- the user selects the “select” item 761.
- information on the selected medicine is added to the fourth portion 740.
- the information to be added that is, the information displayed in the added line is similar to the line selected in the third portion 730. Specifically, in the added line, an image of a medicine stored in the database, a stamp or print code, a medicine name, and the number of medicines are displayed. With such a design, it is easy to understand when the user later reviewed which drug the user has selected.
- the user does so in the third part 730.
- a line on which various information is displayed is selected, and an “excluded” item 763 is selected.
- the information on the candidate drug is deleted from the third portion 730.
- information on candidate drugs that have been omitted from the list but most likely to be correct next is added to the third portion 730.
- the user performs “manual search”. Item 764 is selected. Accordingly, the user can manually search for information regarding the medicine.
- the third mark 715 is attached to the corresponding drug in the first part 710.
- the medicine with the third label 715 indicates that the selection / confirmation work by the user has been completed.
- the third marker 715 has a different appearance from the first marker 713 described above.
- the third label 715 is configured by a solid line surrounding the medicine, and this solid line is drawn in a color (for example, blue) different from that of the first label 713.
- the first label 713 and the third label 715 have different appearances, it is possible to know at a glance which medicine confirmation work is completed and which medicine confirmation work is not completed. Work efficiency is improved.
- the first label 713 and the third label 715 are colored differently, it is possible to intuitively know how far the drug confirmation work has been completed, and the user can identify all the drugs. You can get a sense of how much more work is needed to complete.
- the user may In the first part 710, an image of the medicine to be canceled is selected. Then, in a state where the medicine is selected, the “selection release” item 762 is selected. As a result, the selected medicine is deleted from the fourth portion 740. In the first portion 710, the third label 715 attached to the selected drug is returned to the first label 713 or the second label 714.
- the user selects another medicine that has not yet been confirmed in the first portion 710, and performs the same procedure as described above for this selected medicine. Confirmation work is performed.
- the computer 500 automatically selects the next medicine from among the medicines for which the discrimination has been completed. Also in this case, the user performs confirmation work on the selected medicine in the same manner as described above.
- the “tablet image discrimination” window 700 is as shown in FIG.
- the user When there is a medicine to be additionally identified, the user newly puts this medicine in the petri dish 310 and sets the petri dish 310 in the medicine photographing apparatus 200. Then, the user selects an “additional shooting” item 755. Thereby, imaging
- a plurality of image sets of the petri dish 310 are generated in this way, the user can go back and forth between the plurality of image sets by selecting the “page turning” item 757.
- the user can redo from the photographing of the medicine image.
- the medicine discrimination operation is interrupted, and the “tablet image discrimination” window 700 is closed.
- a “print” item 759 is further displayed in the first item display portion 750.
- the discrimination result is printed as shown in FIG. Items to be printed include title, date and date of identification, identification number of drug identification device, patient name, drug serial number, drug name, stamp (or printing), number of drugs, total number of drugs, etc. .
- the printed item may include the name of the pharmacist in charge, the captured image, or the image of the drug stored in the database.
- the discrimination results there are cases where it is necessary to write a precise discrimination report and there are cases where the discrimination results may be described in a simple document.
- Printing shown in FIG. 30, so-called journal printing is suitable for the latter application. Furthermore, there is a case where it is desired to paste the discrimination result on a handwritten chart. Journal printing is perfect for such applications.
- the computer 500 transmits the number of drugs and the usage to the medication guidance support system 610 in addition to the discrimination result. Good. The number of drugs is obtained by “grouping” described later. Further, the computer 500 may automatically group and count the drugs identified as the same drug by the discrimination. The computer 500 may open a usage input window on the screen 531, where the usage input regarding the identified medicine may be received from the user. In the medication instruction support system 610, the user often inputs the usage. When the medicine is identified, if the medicine identification software 600 can also input the usage, the convenience of the user's input is improved.
- medical agent discrimination software 600 does not need to perform the image discrimination mentioned above.
- the medicine discrimination software 600 is described above. Image identification may be omitted, and drug information obtained by barcode scanning may be transmitted to the medication instruction support system 610.
- a “grouping” item 765 is displayed in the second item display portion 760 as shown in FIGS.
- a “group” window 630 is opened in the screen 531 as shown in FIG.
- the user can group a plurality of arbitrary medicines.
- the “grouping” window 630 includes a first portion 631 and an item display portion 632.
- the same image as that of the first portion 710 is enlarged and displayed.
- an image obtained by photographing the petri dish 310 from above and an image obtained from below are displayed in parallel.
- the user selects a plurality of drugs determined to be of the same type from the images displayed in the first portion 631 by touching or clicking.
- the computer 500 determines whether or not the drugs displayed in the first portion 631 are of the same type, and the computer 500 automatically selects a plurality of drugs determined to be of the same type. The determination of whether or not they are the same type can be made by performing template matching, which will be described later, on each medicine displayed in the first portion 631.
- Drugs selected by the user or computer 500 are labeled with a grouping label 633. When the user selects the “Group” item 634 in this state, the selected medicines are grouped. That is, the drugs selected and labeled with the grouping label 633 are bundled in one group.
- the computer 500 When a plurality of medicines are grouped and a medicine that has been identified by the computer 500 is mixed with an incomplete medicine, the computer 500 omits the identification of the incomplete medicine. As a result, the time required for the computer 500 to identify all drugs can be shortened.
- the user selects one of the drugs in the third portion 730, the same selection is automatically made for other drugs in the same group. Is made. Therefore, the user's input is saved and the working time is shortened. As shown in FIG. 15, the confirmation work by the user is completed for the grouped medicines, and the number of medicines belonging to the group is displayed for the medicine added to the fourth portion 740. In addition, a drug that is not grouped is displayed as “1”.
- the drug discrimination software 600 has a function of automatically learning the discrimination result. More specifically, the computer 500 includes a learning database therein. Then, the medicine discrimination software 600 records the medicine (see FIG. 14) selected by the user in the learning database, and when the same medicine is specified by the computer 500 in the automatic discrimination from the next time, the computer 500 Displays the medicine selected by the previous user in the list of the third part 730 in the highest order.
- FIG. 31 shows details of a learning function by the computer 500.
- the drug selected by the user in the list of the third portion 730 has never been selected by the user before, the user's selection is recorded in the learning database. . If the medicine selected by the user in the list of the third portion 730 has been selected by the user once, as shown in FIG. The user has selected this drug. Please check again if this drug is correct. " If the drug selected by the user in the list of the third part 730 has been selected by the user more than once, the user has already confirmed the content recorded in the learning database. As such, the computer 500 does nothing specifically with the learning database.
- the computer 500 performs automatic discrimination based on the medicine image (step 510). Then, as shown in FIG. 12, the computer 500 displays the discrimination results in a list on the third portion 730 (step 520). At this time, if the previous selection result by the user is stored in the learning database, the previously selected medicine is displayed in a high order. The user then selects the correct drug from the list of candidate drugs displayed in the third portion 730 (step 530). Next, the computer 500 determines whether this selection by the user is the first time, the second time, or the third time or later (step 540).
- the computer 500 records the selection result of the candidate drug by the user in the learning database ( Step 551) and, as shown in FIG. 14, the selected candidate drug is added to the fourth portion 740 (Step 552).
- the computer 500 displays the figure. A message 731 as shown in FIG. 32 is displayed (step 561). This message 731 confirms with the user whether or not this medicine is the medicine learned in the previous discrimination, and this learning result is correct (step 562).
- the message 731 also displays the name of the medicine selected by the user in the previous discrimination, the marking (or printing), the photographed medicine image, and the medicine image stored in the database.
- the computer 500 sets a user confirmed flag for the learning result recorded in the learning database regarding the drug (step 563). Further, as shown in FIG. 14, the computer 500 adds the selected candidate drug to the fourth portion 740 (step 564). If the user selects the “No” item 733, the process returns to step 530 and the computer 500 prompts the user for a list of candidate drugs displayed in the third portion 730, as shown in FIG. 12. Gives you the opportunity to choose another candidate drug.
- step 540 in the third case, more specifically, when the learning result is recorded in the learning database for the drug selected by the user, and the user confirmed flag is on.
- the computer 500 adds the selected candidate drug to the fourth portion 740 (step 571). If such a procedure is followed, even if the user has mistakenly selected the wrong medicine before, the possibility that the user will continue to select the wrong medicine is reduced.
- whether the candidate drug selected by the user is learned in the learning database may be set by the user.
- the computer 500 temporarily stores the selection result of the candidate drug by the user, and the user collectively reviews the selection result at a later time (for example, after the end of the day's work), and the user performs the learning database. It is also possible to select the selection results of candidate drugs to be learned, and to record only the selected drugs in the learning database.
- a “Returned Tablet Image Identification” item 622 is arranged in the window 620 of the tablet identification menu.
- a “returned tablet image discrimination” window 640 is displayed on the screen 531 as shown in FIG. This returned tablet image discrimination is used when all of a plurality of medicines to be differentiated are of the same type.
- the “returned tablet image discrimination” window 640 includes a first portion 641, a second portion 642, a third portion 643, a counting and message display portion 644, and an item display portion 645. It consists of.
- the functions and configurations of the first portion 641, the second portion 642, and the third portion 643 are the same as the functions and configurations of the first portion 710, the second portion 720, and the third portion 730 described above. .
- the user sets the tray 310 containing the medicine to be identified in the medicine photographing apparatus 200 and selects the “imaging” item 646. Thereby, as shown in FIG. 18, an image of the photographed medicine is displayed in the first portion 641. Further, the computer 500 automatically counts the medicines and displays the counted number of medicines on the counting and message display portion 644. Furthermore, the computer 500 displays a message 647 on the counting and message display portion 644. This message 647 prompts the user to select one medication from among the medications displayed in the first portion 641. When the user selects one of the medicines displayed in the first portion 641, the screen changes as shown in FIG. Depending on the setting, instead of the user, the computer 500 automatically selects one of the drugs displayed in the first portion 641 as a representative drug.
- the computer 500 discriminates against the drug selected by the user or the computer 500.
- a second mark 648 is attached to the selected medicine in order to make it easy to understand the medicine selected by the user or the computer 500.
- the computer 500 displays a list of candidate drug information in the third portion 643.
- a message 649 is displayed in the count and message display portion 644. This message 649 prompts the user to select a medicine that the user determines to be correct from among the medicines displayed in the third portion 643, and to select the “start discrimination” item 651.
- the user can manually search for the medicine displayed in the second portion 642 by selecting a “manual search” item 656. . Then, the user can add the medicine found by the manual search to the list displayed in the third portion 643.
- the user can select a medicine from medicines that were not initially displayed in the list of the third portion 643.
- a “manual search” window 680 is displayed on the screen 531 as shown in FIG.
- the “manual search” window 680 includes a search expression input portion 681, a search result display portion 682, a database image display portion 683, and an item display portion 684.
- the user inputs a keyword or a search expression in the type portion 685 of the search expression input portion 681.
- the user can search for the medicine from either the stamp or the medicine name.
- search results displayed by the computer 500 are displayed in a list in the search result display portion 682.
- the computer 500 makes a discrimination for each medicine not selected by the user. If the discrimination results for all the remaining drugs are the same as the drugs that have already been confirmed by the user, the “returned tablet image discrimination” ends normally.
- the “print” item 653 in this state the counting result and the final result of the discrimination are printed. This printing includes a barcode (for example, JAN code) that identifies the medicine. By scanning this bar code with a bar code reader, it is easy to determine which tablet cassette should return the identified medicine.
- a barcode for example, JAN code
- the computer 500 displays the message “There are a plurality of different medicines” on the count and message display portion 644. To do. In this case, the user removes the medicine that seems to be different from the petri dish 310 and presses the “re-photograph” button 654. Then, the user and the computer 500 repeat the same operation as described above. As a result, when it is determined that all the drugs included in the photographed image are the same, the drug discrimination software can normally end the “returned tablet image discrimination”. If the “end” item 655 is selected, the user can end the process without completing the “returned tablet image discrimination”.
- FIG. 34 is a diagram showing a state where the user has selected the “start discrimination” item 651 shown in FIG. That is, FIG. 34 is a screen when the computer 500 is performing discrimination for each medicine not selected by the user.
- the second portion 642 displays an image of the medicine stored in the database, the name of the medicine, an inscription (or printing), and the number of medicines.
- the third portion 643 an enlarged image of the medicine displayed in the first portion 641 is displayed.
- the size of the medicine measured by the computer 500 from the medicine image is displayed. The display of dimensions is the same as described with reference to FIG.
- the “returned tablet image discrimination” window 640 changes as shown in FIG.
- the result of the discrimination for all the drugs is a drug with a different discrimination result from that for the drug selected by the user, that is, if a different type of drug is found.
- the computer 500 attaches the fourth labels 657 and 658 to the drugs having the different discrimination results. More specifically, a fourth indicator 657 is attached to the images of the medicines with different discrimination results displayed in the first portion 641. Then, a fourth indicator 658 is attached to the corresponding medicine image displayed in the third portion 643. Thereby, the user can easily understand that different types of drugs are mixed in with the drugs being identified.
- the computer 500 further displays a message 659 on the third portion 643.
- This message 659 prompts the user to visually check the images of all the drugs displayed in the third portion 643. If the user finds a different drug as a result of the visual confirmation, the user selects the drug. As a result, the fourth labels 657 and 658 are also attached to the drug.
- the computer 500 determines that the medicines are different, if the user determines that the same medicine is the result of visual inspection, the user can turn off the fourth markers 657 and 658 by selecting the medicine. . That is, the user can cancel the result of appraisal of different drugs by the computer 500.
- a message as shown in FIG. 36 is displayed on the screen.
- the computer 500 performing automatic discrimination for all the drugs, if a drug with a different discrimination result is not found, a message as shown in FIG. 36A is displayed on the screen.
- the discrimination result is printed.
- a message as shown in FIG. 36B is displayed on the screen. That is, the computer 500 determines that different drugs are included as a result of the appraisal, but inquires of the user whether the result may be printed. When the user selects “Yes”, a discrimination result including information on different drugs is printed. If the user confirms only the image of the medicine viewed from above and has not yet confirmed the image viewed from below, a message as shown in FIG. Not done.
- FIG. 38 is a diagram showing a second embodiment in a state where the discrimination is completed in the “returned tablet image discrimination” window 640 shown in FIG.
- the medicine having the same discrimination result as the discrimination result for the medicine selected by the user (or the computer 500), that is, the correct medicine A fifth indicator 671 is attached.
- the fifth mark 671 is configured by, for example, a blue solid line.
- the fourth label 658 is attached to the medicine having a different discrimination result from the discrimination result for the medicine selected by the user or the like, that is, the medicine having the different discrimination result from the discrimination result for the first medicine.
- the fourth marker 658 is constituted by, for example, a red solid line. In this way, when different colors of the correct drug and different drugs are labeled, it is possible to recognize at a glance which drug is a different drug.
- the label attached to the selected drug is changed to the second label 673.
- the second label 674 is attached to the medicine corresponding to the medicine selected in the third part 643, that is, the medicine to which the second label 673 is attached.
- the second label 673 has a different appearance from the fourth label 658 and the fifth label 671.
- marker 673 is comprised with the broken line surrounding the image of a chemical
- the second indicator 674 is a red dashed line that rotates around the drug.
- the second label 673 is configured by a blue broken line that rotates around the image of the medicine.
- the second indicator 674 is a blue dashed line that rotates around the drug.
- the medicine image displayed in the third portion 643 is difficult to determine which medicine is in the first portion 641.
- the drug currently being viewed by the user in the third part 643 is which drug in the petri dish 310. It becomes easy to grasp. As a result, the user can easily take out different drugs in the petri dish 310 with tweezers or the like while viewing the image of the first portion 641.
- FIG. 39 is a diagram showing a third embodiment in a state where the discrimination is completed in the “returned tablet image discrimination” window 640 shown in FIG.
- the medicine having the same discrimination result as the discrimination result for the medicine initially selected by the user (or the computer 500), that is, the correct medicine is obtained.
- the fifth drug 672 is attached to the correct drug, that is, the drug corresponding to the drug labeled with the fifth label 671 in the third part 643.
- a medicine having a different discrimination result from the discrimination result for the medicine first selected by the user or the like that is, a medicine having a different discrimination result from the discrimination result for the first medicine.
- the fourth label 657 is attached to a different agent, that is, the agent corresponding to the agent to which the fourth label 658 is attached in the third portion 643.
- the user looks at the image of the medicine displayed in the third portion 643, and whether the medicine displayed in the third portion 643 is actually correct, that is, the same medicine as the medicine first selected by the user or the like. It is confirmed one by one visually. If the user determines that the correct medicine is obtained as a result of visual inspection, the user selects the determined medicine. As a result, the sixth label 675 is attached to the image of the medicine. The sixth label 675 indicates that the visual confirmation by the user has been completed and the user has determined that the medicine is correct. When the user selects the “remaining collective OK” item 676 displayed in the item display portion 645, the sixth indicator 675 is attached to all the agents other than the agent to which the fourth indicator 658 is attached.
- FIG. 40 is a diagram showing a fourth embodiment in a state where the discrimination is completed in the “returned tablet image discrimination” window 640 shown in FIG.
- the computer 500 automatically switches the display of the front and back of each medicine so that the medicine first selected by the user or the like is the same for the medicine for which automatic discrimination has been completed. Furthermore, the computer 500 sequentially and automatically rotates the medicines for which automatic discrimination has been completed, and aligns the directions of the respective medicines so that the directions thereof are the same as those of the medicine first selected by the user or the like.
- the orientation of the medicine is the same as the orientation of the medicine image initially selected by the user or the like.
- the image of the medicine By rotating the image of the medicine, it can be aligned.
- the master image that matches the representative drug (the drug that was first selected by the user, etc.) is an image that faces correctly up and down
- the top and bottom of the representative drug match the top and bottom of the master image when matching with the master image
- the correct orientation can be corrected, and the other up-and-down drugs can be similarly corrected in the vertical direction when collating with the master image.
- the medicine that could not be displayed correctly in the vertical direction or that could not be displayed in the same orientation as that of the representative medicine could not be adjusted because the medicine was different. For this reason, it becomes easy for the user to find such images having different orientations, and the accuracy and efficiency of the visual inspection work can be improved.
- the automatic switching of the back and front display of the medicine is performed when the pattern on the back of the medicine matches the pattern on the front of the medicine first selected by the user as a result of pattern matching. If it is determined, or if it is determined that the pattern on the front of the medicine to be differentiated matches the pattern on the back of the medicine initially selected by the user or the like, the computer 500 will identify the medicine to be identified. This can be done by replacing the front and back images. Thereby, the visual confirmation work by the user is further facilitated, and the accuracy and safety of visual inspection are further improved.
- a “loupe” item 623 is arranged in the window 620 of the tablet identification menu.
- a “loupe” window 660 is displayed on the screen 531 as shown in FIG. Using the function of the “loupe” window 660, the user can enlarge and view the medicine he / she wants to see.
- the “loupe” window 660 includes a first portion 661 and an item display portion 662.
- the first portion 661 an image obtained by photographing the placement unit 220 (see FIG. 3) or the notch space 217 (see FIGS. 4 and 5) in the immediate vicinity of the placement unit 220 is displayed.
- an image of an area including the petri dish 310 is enlarged and displayed on the first portion 651.
- the user can insert the long wrapping paper into the medicine photographing apparatus 200 through the notch 212 (see FIG. 2).
- the image of the region including the wrapping paper located immediately below the placement unit 220 is displayed in an enlarged manner on the first portion 661.
- the first portion 661 displays an image selected by the user from an image obtained by photographing the subject from above and an image obtained by photographing the subject from below.
- the user selects an “enlarge” item 663, the user zooms in and displays the subject in an enlarged manner.
- the “reduction” item 664 is selected, the image is zoomed out and the subject is reduced and displayed. Further, the current magnification of the display image is displayed in the item display portion 662.
- the medicine photographing apparatus 200 performs illumination for illuminating the medicine between the first light source 430 and the second light source 440, and the third light source 450 and the fourth light source 460. Switch between.
- the medicine is illuminated by the first light source 430 and the second light source 440, the markings attached to the medicine are easy to see.
- the third light source 450 and the fourth light source 460 illuminate the medicine, it is easy to see the print attached to the medicine.
- the user can enlarge the engraving or printing of the medicine contained in the wrapping paper without dividing the long wrapping paper or taking out the medicine inside. Can be observed. Based on this, the user can also investigate manually without taking out the medicine in the wrapping paper. Note that when the “end” item 666 is selected, the “loupe” window 660 is closed.
- the medicine discrimination system 100 is convenient because the medicine in the wrapping paper can be distinguished without breaking the wrapping paper.
- images stored in the drug information database are printed on the back of the wrapping paper as sample photographs for the drugs enclosed in the wrapping paper.
- the image of the medicine actually contained in the packaging paper is displayed in the image obtained by photographing the packaging paper from above.
- a sample photograph of the medicine printed on the back of the wrapping paper is displayed in the image obtained by photographing the wrapping paper from below. More specifically, in the first portion 710, when the “view from above” tab 711 is selected, an image obtained by capturing the packaging paper from above is displayed. When the “view from the bottom” tab 712 is selected, an image obtained by photographing the wrapping paper from the bottom is displayed.
- the drug identification software 600 performs drug identification separately for each image in the background.
- two discrimination results are obtained in the drug discrimination software 600.
- the ranks are weighted for candidate drugs that have obtained high scores in both discriminations. That is, for a candidate drug that has obtained a high score in both discriminations, in addition to the sum of both scores, a further score is added.
- the candidate drug that has obtained a high score in both discriminations is displayed in the upper line in the list of candidate drugs displayed in the third portion 730.
- the photographed image includes two types of images, that is, an actual photographed image of the medicine and a photographed image of a printed sample photograph
- the medicine is separately identified for each of the two images, and then obtained.
- a candidate drug list is created by combining the obtained discrimination results, the accuracy of the discrimination is improved.
- the sample photograph is color-printed (in particular, full-color printing by an inkjet printer), the accuracy of discrimination is further increased.
- FIG. 22 shows an upstream process in performing drug discrimination.
- the drug imaging apparatus 200 captures a plurality of drug images (step 120).
- the computer 500 corrects the captured image (step 130).
- the computer 500 extracts a region where each medicine exists from the corrected image (step 140). Then, the extracted regions of each medicine are individually identified (step 200).
- ⁇ Step 110> User Input
- the user first puts a medicine to be identified into the petri dish 310 of the tray 300 (see FIG. 7). At this time, it is recommended that the tablet is placed directly on the transparent portion 315 of the bottom surface 311 of the petri dish 310 and the capsule is placed on the capsule placement member 314.
- the user installs the tray 300 on the placement unit 220 of the medicine photographing apparatus 200 and closes the cover 214. Then, the user selects the “shoot” item 751 shown in FIG.
- the medicine image acquisition computer 500 drives the medicine photographing apparatus 200 to photograph the image of the petri dish 310.
- the computer 500 acquires the following four images [Image 1] to [Image 4].
- the computer 500 is based on setting values (for example, camera focus, exposure time, and RGB gains) obtained by “camera focus adjustment” and “brightness and color calibration” described later. Set the camera's shooting conditions. Thereby, the reproducibility of the image quality is improved.
- [Image 1] An image of the petri dish 310 taken from above under illumination by the first light source 430. This image can be acquired by shooting with the first camera 410 with the first ring illumination 431 turned on.
- Step 130> Image Correction As will be described later, in the drug discrimination system 100, calibration is performed in advance, and the computer 500 holds calibration information by the calibration as data. The computer 500 corrects the captured image based on the calibration information. Specifically, the coordinates of the captured image are corrected based on the calibration information. As a result, the coordinate axis of the image captured by the first camera 410 and the coordinate axis of the image captured by the second camera 420 coincide.
- ⁇ Step 140> Extraction of medicine region After image correction, a region occupied by each medicine in the image is extracted.
- FIG. 23 shows a flow of the individual drug discrimination process 200.
- the following processing is performed individually for each medicine.
- the computer 500 associates the occupation area of one medicine in the photographed image from above with the occupation area of the medicine in the photographed image from below (step 210).
- the computer 500 determines whether the medicine is a tablet or a capsule (step 220). If it is determined that the tablet is a tablet, the computer 500 performs a tablet identification process (step 300). If it is determined that the tablet is a capsule, the computer 500 performs a capsule identification process (step 400).
- Step 210 Correspondence of medicines in upper and lower images
- the medicine placed directly on the transparent portion 315 of the petri dish 310 is an image photographed from above ([Image 1] and [Image 3]) and an image photographed from below ( It appears in both [Image 2] and [Image 4]).
- an area occupied by one medicine in the image taken from above is associated with an area occupied by this medicine in the image taken from below.
- the region occupied by the drug in one image is the same in the other image. It almost matches the area occupied by the drug. This matched area is an area occupied by one medicine in two images.
- one area of an image that has not been inverted and an area that overlaps the area of the inverted image that has been returned by canceling the inversion are areas corresponding to one medicine.
- an overlapping area where two images are inverted and overlapped can be set as a corresponding area.
- the computer 500 determines whether the medicine is a tablet or a capsule. Since the tablet is placed on the transparent portion 315 of the petri dish 310, the image taken from above shows the upper surface, and the image taken from below shows the lower surface. That is, when two images ([Image 1] and [Image 2]) are compared, if the drug is a tablet, there are areas corresponding to the drug in the image shot from above and the image shot from below. To do. Therefore, when one region can be associated with the two images in step 210, that is, the region occupied by the medicine recognized in the image taken from above is the medicine recognized in the image taken from below. If it is associated with the occupied area, the medicine is determined to be a tablet.
- the capsule is placed on an opaque capsule mounting member 314.
- the upper image is shown in the image taken from above, but the capsule is not shown in the image taken from below. That is, when the two images ([Image 1] and [Image 2]) are compared, when the medicine is a capsule, the image taken from above has an area occupied by the medicine, but the image taken from below There is no area occupied by the drug. Therefore, in the case where one region could not be associated with the two images in step 210, that is, the region corresponding to the occupied region of the medicine recognized in the image photographed from above was photographed from below. If it is not recognized in the image, the drug is determined as a capsule.
- FIG. 24 shows each process of the tablet identification process 300.
- the computer 500 determines whether or not the medicine is circular (step 310).
- the computer 500 performs an extraction process for the inscription on the surface of the medicine (step 320).
- the computer 500 performs an extraction process of the print attached to the surface of the medicine (step 330).
- the computer 500 determines whether the information attached to the surface of the medicine is stamped or printed (step 340).
- the computer 500 extracts a secant attached to the surface of the medicine (step 350).
- the computer 500 extracts a representative color of the medicine (step 360).
- the computer 500 narrows down candidate drugs based on the narrowing-down information related to the drug (step 370). Finally, the computer 500 performs template matching based on the stamp and / or print information extracted from the medicine image and performs a final search (step 380).
- the computer 500 obtains the circularity of the area occupied by the medicine. When the circularity is equal to or greater than a predetermined value, the computer 500 determines that the medicine is circular. When the circularity is less than the predetermined value, the computer 500 determines that the medicine is non-circular. When it is determined that the medicine is circular, the computer 500 calculates the center position and radius of the circle. If it is determined that the drug is non-circular, the computer 500 determines that the major axis of the region occupied by the drug is parallel to the X axis, and the minor axis is parallel to the Y axis. Rotate the area occupied by the drug. Furthermore, the computer 500 calculates the length of the major axis and the minor axis of the drug and the ratio of the length of the major axis to the minor axis.
- Step 320> Marking Extraction The computer 500 performs stamp extraction processing on [Image 1] and [Image 2], that is, images taken under illumination by the first light source 430 and the second light source 440.
- the present inventor has found that when an image of a medicine under illumination by the first light source 430 and the second light source 440 is taken, an image of the medicine in which the inscription is emphasized can be taken (see Equation 1 below).
- Step 330> Print Extraction The computer 500 performs print extraction processing on [Image 3] and [Image 4], that is, images taken under illumination by the third light source 450 and the fourth light source 460.
- the present inventor has found that when a medicine under illumination by the third light source 450 and the fourth light source 460 is photographed, an image of the medicine whose printing is emphasized can be photographed (see Equation 1 below).
- Step 340 Marking / Printing Determination
- the marking extraction process step 320
- the marking is applied to the surface of the medicine.
- An image in which the marked marks are suitably extracted is obtained.
- a print extraction process step 330
- the computer 500 determines whether the information attached to the surface of the drug is stamped or printed, that is, whether the surface of the drug is stamped and printed. Judgment is made.
- the computer 500 In order to determine whether or not a drug is stamped, the computer 500 first binarizes the stamp extraction image obtained in step 320 with a predetermined threshold as a reference. Next, the computer 500 uses the binarized image as a mask and takes an average value with the value of the stamped extracted image. If the average value is equal to or greater than the threshold value, the computer 500 determines that there is a stamp, and if it is less than the threshold value, determines that there is no stamp. Similarly, in order to determine whether or not the medicine is printed, first, the computer 500 binarizes the print extracted image obtained in step 330 with a predetermined threshold as a reference. Next, the computer 500 uses the binarized image as a mask and takes an average value with the value of the print extracted image. The computer 500 determines that printing is performed when the average value is equal to or greater than the threshold value, and determines that printing is not performed when the average value is less than the threshold value.
- the computer 500 performs a secant area extraction process on the stamped extracted image obtained in Step 320. Specifically, the computer 500 determines whether or not a secant exists in the medicine. If it is determined that the medicine is present, the medicine is separated into a region where the secant line is present and a region other than that.
- the computer 500 divides the representative color of the medicine into a region with a stamp or print and a region other than that, and extracts them separately.
- the extraction of the representative colors can be suitably performed by performing clustering on the colors constituting the pixels.
- “white”, “light color”, “dark color” is applied to an image of a medicine, or an area that is engraved or printed and other areas. ”Is determined. This can be done by determining “dark color” if the color in the region is less than the first threshold, “light color” if it is greater than or equal to the first threshold and less than the second threshold, and “white” if greater than the second threshold. it can.
- the computer 500 accesses a database. Based on the data obtained in the above steps, a candidate drug is searched. First, as a first step, narrowing down of drugs to be searched is performed. Specifically, the computer 500 determines the type of drug (tablet or other drug), the shape of the drug (circular or non-circular, or the ratio of the length of the major axis to the minor axis if non-circular), Size (diameter of the drug in the case of a circle, length of the major axis and minor axis of the drug in the case of a non-circular shape), presence / absence of marking, presence / absence of printing, presence / absence of a secant, representative color of the drug
- the medicines to be searched are narrowed down based on at least one of the representative color of the region, the representative color of the region to which printing is applied, and the representative color of other regions.
- the computer 500 can access the prescription history (for example, medicine notebook data) of the patient
- the computer 500 can also limit the drugs to be searched to the drugs included in the prescription history.
- the computer 500 accesses the medicine notebook data to obtain information on the medicine prescribed for the patient. can do.
- the medicine notebook is scanned, converted into text by OCR (optical character recognition), and based on this, the medicine to be searched can be narrowed down. . Thereby, the speed of drug search can be increased.
- Template matching is performed between the stamp extraction image and / or the print extraction image obtained in the above-described step and the stamp template image and / or the print template image of each medicine stored in the database. Pattern matching), and picks up a drug that is likely to be a symmetrical drug.
- the tablet is circular, the image area occupied by the medicine is moved and corrected so that the center of the circle is the center of the image prior to template matching.
- the extracted image and the template image may be corrected so that the center of gravity of the stamp and / or print is the center of the image.
- the tablet is circular, the extracted image and / or the template image are rotated so that the template matching result is maximized.
- template matching is performed on both images, and a score is calculated.
- This score indicates the degree of matching between both images as a numerical value.
- the computer 500 picks up a drug to which the template image belongs as a candidate drug.
- both template matching in a state where the secant exists and template matching in a state where the secant is removed may be performed.
- the computer 500 may perform template matching with each word as a unit, or the word is divided into letters, numbers, and symbols, and each letter / number is divided. -Template matching may be performed on symbols.
- the computer 500 may extract text information by OCR from an engraved or printed image and perform template matching based on this text information.
- FIG. 25 shows each process of the capsule identification process 400.
- the computer 500 divides the capsule into two regions (step 410).
- the computer 500 extracts representative colors from the two regions, respectively (step 420).
- the computer 500 performs a process of extracting the print attached to the surface of the medicine from each of the two areas (step 430).
- the computer 500 determines whether or not the surface of the medicine is printed (step 440).
- the computer 500 narrows down candidate drugs based on the narrowing-down information related to the drug (step 450).
- the computer 500 performs template matching based on the print information extracted from the medicine image and performs a final search (step 460).
- the computer 500 divides the medicine into two regions. Specifically, the color information of the medicine image, specifically, the pixel color is clustered. Next, the clustered color information is grouped, and an area to which the color group belongs is defined as one area. Thereby, the capsule comprised by the color from which the right half and the left half differ is suitably divided
- the computer 500 extracts a representative color of each region of the medicine. This can be suitably performed by clustering the color information of the pixels constituting the region.
- Step 430> Print Extraction The computer 500 performs print extraction from each region by performing the same processing as in Step 330 for each region divided in Step 410.
- the present inventor has found that when a capsule image is divided into two regions and a print image extraction process is separately performed on each region, the print can be more suitably extracted from the capsule.
- Step 440 Print Determination
- the computer 500 performs the same process as in Step 340 on each divided medicine area, and determines whether or not each area is printed.
- the computer 500 narrows down candidate drugs. Specifically, the computer 500 determines the type of drug (capsule or other drug), the shape of the drug (ratio of the length of the long axis to the short axis), the size of the drug (the length of the long axis of the drug). And the length of the minor axis), the representative color, and the presence or absence of printing in the area to which each representative color belongs, to narrow down the medicines to be searched.
- the computer 500 determines the type of drug (capsule or other drug), the shape of the drug (ratio of the length of the long axis to the short axis), the size of the drug (the length of the long axis of the drug). And the length of the minor axis), the representative color, and the presence or absence of printing in the area to which each representative color belongs, to narrow down the medicines to be searched.
- Step 460 Template matching The computer 500 cuts out a print portion from the print extracted image (input image) obtained in step 430. Next, in the same manner as in step 370, template matching is performed on the print extracted image for each region divided in step 410, and candidate drugs are picked up.
- step 370 the database accessed by the computer 500 stores a template image corresponding to a stamped extracted image and / or a printed extracted image. It is assumed that however, in some cases, only a mere picture of the drug is stored. In this case, a drug region may be acquired from the image data, and print extraction and stamp extraction may be performed in the same manner as described above, and the obtained print extraction image and stamp extraction image may be used as a template image.
- a template image stored in the database can be created by this method. The drug region can be acquired from the image data as follows.
- a background color is acquired, and a portion other than the background color and characters is determined as an area occupied by the medicine. An error occurs when one or more areas are found.
- the position of the center of gravity of each region is obtained, and the right and left of the medicine are determined from the position of the center of gravity.
- the first camera 410 and the second camera 420 are in focus. Further, it is necessary to match the shooting area of the first camera 410 and the shooting area of the second camera 420. Furthermore, it is necessary to keep the brightness and color of the photographed image within a predetermined range. For this reason, the calibration as described below is performed before shipment of the drug identification system 100 to the factory or at the time of setup of the drug identification system 100 at the delivery destination. Note that once this calibration is performed, it is usually unnecessary to perform it again.
- the camera is first aligned. First, the tray 300 on which the petri dish 310 is set is set on the placement unit 220 of the medicine photographing apparatus 200. Next, the petri dish 310 is photographed by the first camera 410, and this photographed image is displayed on the display device 530 of the computer 500. At this time, a virtual image having a cross shape at a predetermined position is superimposed on the image of the petri dish 310 and displayed. Then, the position and angle of the first camera 410 are finely adjusted so that the cross shape is contained in the petri dish 310. A similar operation is performed on the second camera 420.
- camera focus adjustment is performed. First, a template with a predetermined character, symbol, or figure is set on the placement unit 220 of the medicine photographing apparatus 200, and the template is photographed at a low magnification. Then, the focus of the camera is roughly adjusted so that the template is clearly displayed in the captured image. When this is completed, the magnification is increased and the same operation is performed to finely adjust the focus.
- ⁇ 5.2.3 Shooting area calibration This calibration makes it possible to match the coordinates of the shooting areas of the upper and lower cameras. In addition, the resolution of the camera can be acquired.
- a calibration sheet 810 as a calibration tool as shown in FIG. 26 is prepared.
- This calibration sheet 810 has m ⁇ n black circles of a predetermined size (3 ⁇ 4 in the example shown in FIG. 23) on a both sides of a plate or sheet having a predetermined thickness, in a matrix form. It is the composition arranged in. Further, the position and size of the black circle are the same on the front surface and the back surface of the calibration sheet 810.
- the calibration sheet 810 is set on the placement unit 220 of the medicine photographing apparatus 200, and the first camera 410 and the second camera 420 photograph the calibration sheet 810.
- a transformation matrix is obtained such that the black circle in the image is located at the designated coordinates and has the designated size. This is performed for both the image taken from above and the image taken from below of the calibration sheet 810.
- the image obtained by photographing the petri dish 310 is corrected based on this conversion matrix. Thereby, the coordinate position of the imaging region of the image taken from the top of the petri dish 310 and the image taken from the bottom coincide with each other. Further, the resolution (DPI) of the image, that is, the number of pixels constituting the unit length can be obtained from the conversion matrix.
- DPI resolution
- the first camera 410 takes a picture for a predetermined exposure time while the first light source 430 is on.
- the second camera 420 shoots with a predetermined exposure time while the second light source 440 is on.
- the brightness of each predetermined point of the photographed image is calculated. When this brightness is higher than the target value, the exposure time of the camera is lowered. If it is lower than the target value, increase the exposure time of the camera.
- FIG. 37 shows a second embodiment of the calibration sheet.
- the calibration sheet 810 ′ has a configuration in which m ⁇ n black circles 811 having a predetermined size are arranged in a matrix at predetermined intervals on both surfaces of a circular plate or sheet having a predetermined thickness. .
- straight lines 812 having a predetermined length are arranged on the center line of the circle at equal intervals of four directions (up, down, left and right), that is, 90 °. More specifically, the pair of straight lines 812 is arranged in parallel to the row direction of the circle 811 and is arranged on the extension of the circle 811 arranged in the row direction.
- the other pair of straight lines 812 is arranged in parallel to the column direction of the circles 811 and is arranged on an extension of the circles 811 arranged in the column direction.
- the other configuration of the calibration sheet 810 ′ is the same as that of the calibration sheet 810.
- the diameter of the calibration sheet 810 ' is substantially the same as the inner diameter of the ring 313 placed on the petri dish 310 (see FIG. 8) or the flat plate 330 (see FIG. 27).
- the planar shape of the calibration sheet 810 ' corresponds to the shape of the bottom surface of the placing item for placing the medicine.
- the calibration sheet 810 ′ When the calibration sheet 810 ′ is used, the calibration sheet 810 ′ is placed on the placement item, and then the placement item is set on the placement unit 220 of the medicine photographing apparatus 200. It is suitably prevented that the position is shifted. In addition, by using the straight line 812 as an index, it is easy to align the direction of the circle 811 to a predetermined direction.
- Second cylinder 410 First camera 420 ... Second camera 430 ... First light source 431 ... First ring illumination 440 ... Second light source 441 ... Second ring illumination 442 ... Lower support plate 443 Upper support plate 450 ... Third light source 451 ... First bar illumination 452 ... Second bar illumination 460 ... Fourth light source 461 ... Third Bar lighting 462 ... 4th bar lighting
Landscapes
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- General Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Chemical & Material Sciences (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Medical Informatics (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Surgery (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- Theoretical Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Veterinary Medicine (AREA)
- Animal Behavior & Ethology (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Molecular Biology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Heart & Thoracic Surgery (AREA)
- Biomedical Technology (AREA)
- Primary Health Care (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Medicinal Chemistry (AREA)
- Epidemiology (AREA)
- Medical Preparation Storing Or Oral Administration Devices (AREA)
- Medical Treatment And Welfare Office Work (AREA)
Abstract
Description
本発明の第一の態様は、薬剤の画像を撮影するのに用いられる薬剤撮影装置に関するものである。この薬剤撮影装置は、載置部と、第1カメラと、第2カメラと、第1光源と、第2光源と、第3光源と、第4光源とを有している。載置部には、薬剤がセットされる。第1カメラは、載置部の上方に設置される。第2カメラは、載置部の下方に設置される。第1光源は、載置部の上方に設置される。第2光源は、第1光源と同種の光源で構成され、載置部の下方に設置される。第3光源は、第1光源とは異種の光源で構成され、載置部の上方に設置される。第4光源は、第3光源と同種の光源で構成され、載置部の下方に設置される。
本発明の第二の態様は、薬剤の鑑別をコンピューターに行わせる薬剤鑑別ソフトウェアに関するものである。この薬剤鑑別ソフトウェアは、コンピューターの表示装置の第1の部分に、薬剤を含む領域を撮影した画像を表示させる(第1ステップ)。また、この薬剤鑑別ソフトウェアは、領域内に表示された薬剤のうち、選択された薬剤を、表示装置の第2の部分に拡大表示させる(第2ステップ)。また、この薬剤鑑別ソフトウェアは、鑑別の結果、選択された薬剤の候補となる薬剤の情報を、表示装置の第3の部分に表示させる(第3ステップ)。さらに、この薬剤鑑別ソフトウェアは、候補となる薬剤の情報の中から使用者によって選択された薬剤の情報を、表示装置の第4の部分に表示させる(第4ステップ)。
本発明の第三の態様は、薬剤の鑑別をコンピューターに行わせる薬剤鑑別ソフトウェアに関するものである。この薬剤鑑別ソフトウェアを備えるコンピューターは、まずは薬剤が表示された画像を取得する(第1ステップ)。次いで、コンピューターは、取得した画像から、薬剤が存在する領域を分離する(第2ステップ)。次いで、コンピューターは、分離した領域内の刻印および/または印刷を抽出する(第3ステップ)。次いで、コンピューターは、抽出した刻印および/または印刷に基づいて、薬剤の検索を行う(第4ステップ)。
態様(1):薬剤の鑑別をコンピューターに行わせる薬剤鑑別ソフトウェアであって、
コンピューターの表示装置の第1の部分に、薬剤を含む領域を撮影した画像を表示するステップと、
前記領域内に表示された薬剤のうち、選択された薬剤を、前記表示装置の第2の部分に拡大表示するステップと、
鑑別の結果、前記選択された薬剤の候補となる薬剤の情報を、前記表示装置の第3の部分に表示するステップと、
をコンピューターに行わせることを特徴とする、薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(1)に記載の薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(1)または(2)に記載の薬剤鑑別ソフトウェア。
当該選択された薬剤の鑑別が完了している場合には、前記選択された薬剤の候補となる薬剤の情報を、前記表示装置の第3の部分に表示するステップと、
をさらにコンピューターに行わせる、態様(1)~(3)のいずれか1つに記載の薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(1)~(3)のいずれか1つに記載の薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(4)または(5)に記載の薬剤鑑別ソフトウェア。
前記第1の部分に表示された薬剤のうち、前記第4の部分に表示された薬剤には、使用者による選択が完了したことを示す第3の標識を付すステップと、
をさらにコンピューターに行わせる、態様(1)~(6)のいずれか1つに記載の薬剤鑑別ソフトウェア。
前記候補となる薬剤の情報の中から使用者が選択した薬剤の情報を、前記表示装置の第4の部分に表示するステップと、
前記第1の部分に表示された薬剤のうち、前記第4の部分に表示された薬剤に、選択が完了したことを示す第3の標識を付すステップと、
をさらにコンピューターに行わせ、
前記薬剤の鑑別が完了したことを示す第1の標識と前記選択が完了したことを示す第3の標識とは、異なる色を有する、
態様(1)~(7)のいずれか1つに記載の薬剤鑑別ソフトウェア。
前記第2の部分には、選択された薬剤を上から撮影した画像および/または下から撮影した画像を表示する、
態様(1)~(8)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(1)~(9)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(10)に記載の薬剤鑑別ソフトウェア。
態様(10)または(11)に記載の薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(1)~(12)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(13)に記載の薬剤鑑別ソフトウェア。
態様(13)または(14)に記載の薬剤鑑別ソフトウェア。
態様(16):薬剤の鑑別をコンピューターに行わせる薬剤鑑別ソフトウェアであって、
鑑別対象の薬剤が表示された画像を取得するステップと、
前記画像から、薬剤が占める領域を抽出するステップと、
前記領域内の刻印および/または印刷を抽出するステップと、
抽出した刻印および/または印刷に基づいて、薬剤の検索を行うステップと、
をコンピューターに行わせることを特徴とする、薬剤鑑別ソフトウェア。
前記薬剤が占める領域を抽出するステップを行った後、上から撮影した画像に由来して抽出した薬剤の領域と下から撮影した画像に由来して抽出した薬剤の領域とを対応付けるステップ、をさらにコンピューターに行わせる、
態様(16)に記載の薬剤鑑別ソフトウェア。
態様(17)に記載の薬剤鑑別ソフトウェア。
をさらにコンピューターに行わせる、態様(16)~(18)のいずれか1項に記載の薬剤鑑別ソフトウェア。
前記上から撮影した画像および下から撮影した画像とを対比することにより、薬剤が錠剤であるか否かを判定する、
態様(19)に記載の薬剤鑑別ソフトウェア。
この対応付けができた場合には、薬剤が錠剤であると判定する、
態様(20)に記載の薬剤鑑別ソフトウェア。
前記刻印を抽出するステップでは、この撮影画像に基づいて刻印を抽出する、
態様(16)~(21)のいずれか1つに記載の薬剤鑑別ソフトウェア。
前記印刷を抽出するステップでは、この撮影画像に基づいて印刷を抽出する、
態様(16)~(22)のいずれか1つに記載の薬剤鑑別ソフトウェア。
前記薬剤の検索を行うステップでは、刻印および/または印刷の有無に基づいて、検索する薬剤の絞込みを行う、
態様(16)~(23)のいずれか1つに記載の薬剤鑑別ソフトウェア。
前記薬剤の検索の際には、割線の有無の判定結果に基づいて、検索する薬剤の絞込みを行う、
態様(16)~(24)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(16)~(25)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(16)~(26)のいずれか1つに記載の薬剤鑑別ソフトウェア。
態様(27)に記載の薬剤鑑別ソフトウェア。
態様(29):薬剤の鑑別を行う薬剤鑑別方法であって、
鑑別対象の薬剤が表示された画像を取得する工程と、
前記画像から、薬剤が占める領域を抽出する工程と、
前記領域内の刻印および/または印刷を抽出する工程と、
抽出した刻印および/または印刷に基づいて、薬剤の検索を行う工程と、
を有することを特徴とする、薬剤鑑別方法。
態様(30):薬剤の鑑別を行う薬剤鑑別装置であって、
鑑別対象の薬剤が表示された画像を取得する手段と、
前記画像から、薬剤が占める領域を抽出する手段と、
前記領域内の刻印および/または印刷を抽出する手段と、
抽出した刻印および/または印刷に基づいて、薬剤の検索を行う手段と、
を有することを特徴とする、薬剤鑑別装置。
図1は、薬剤鑑別システムの概要を示す模式図である。同図に示すように、薬剤鑑別システム100は、薬剤撮影装置200と、コンピューター500とで構成される。この薬剤鑑別システム100では、薬剤撮影装置200が薬剤の撮影を行い、得られた薬剤の画像データを基に、コンピューター500が薬剤の鑑別を行う。
図2は、薬剤撮影装置200の外観を示す斜視図である。この図では、ケース210により内部は見えないが、薬剤撮影装置200の内部のほぼ中央部には、薬剤を載置する載置部220が設けられている。より具体的には、薬剤は、図7に示すようなトレイ300に入れられ、このトレイ300が、載置部220にセットされる。以下、説明の便宜上、薬剤撮影装置200のうち、載置部220より上側を上部201、下側を下部202と呼ぶ。
図2に示すように、薬剤撮影装置200では、外側からは、下側ケース211、切り欠き部212、トレイ支持部材221、ガイド部材230、上側ケース213、およびカバー214が見える。
図4および図5は、薬剤撮影装置200のケース類を除去した状態を示す図、すなわち薬剤撮影装置200の内部の主要部材を示した図である。なお、図4は、薬剤撮影装置200の斜視図であり、図5は、正面図である。
§2.3.1 載置用アイテムの第1実施形態
薬剤撮影装置200には、薬剤を置くための載置用アイテムとして図7に示すようなトレイ300が使用される。トレイ300は、四角形平板状の本体320に孔321が形成され、この孔321に透明の筒322が嵌め込まれた構成となっている。この筒322内には、図8に示すようなシャーレ310が設置される。
図27は、薬剤撮影装置にセットされるトレイの第2実施形態を示す分解斜視図である。トレイ300’は、トレイ300と同様に、四角形平板状の本体320に孔321が形成され、この孔321に透明の筒322が嵌め込まれた構成となっている。トレイ300’がトレイ300と大きく異なっている点は、シャーレ310の代わりに、円形で透明の平板330が、筒322の底部に設置される点である。筒322の底部を平板330で構成すると、筒322の底部を構成する材料の選択肢が増える。このため、カメラや照明と最も相性の良い材料を選択することが容易となり、これにより、薬剤の撮影画像の画質をさらに向上できる。この平板330の外周部上には、リング313が設置される。このリング313の外形は、平板330の直径と、ほぼ同じとなっている。さらに、リング313上には、透明な第2筒331が設置される。より具体的には、第2筒331は、その外周が筒322の内周と接するように、設置される。別実施形態では、平板330の外周部上に、第2筒331が直接設置される。そして、第2筒331の内壁と隣接するように、リング313が、平板330上に設置される。すなわち、リング313は、第2筒331内に挿入された状態で、平板330上に設置される。最後に、平板330上には、カプセル載置用部材314が設置される。薬剤撮影装置200にセットされる載置用アイテムをこのような構成とすると、平板330の外縁部と第2筒331の底部との境界部付近で起こる照明光の乱反射が、より低減される。
以上述べた薬剤撮影装置200は、図1に示すように、コンピューター500に接続される。このコンピューター500は、薬剤鑑別ソフトウェア600を有しており、この薬剤鑑別ソフトウェア600によって、コンピューター500が、薬剤撮影装置200の動作を制御する。具体的には、コンピューター500が、薬剤撮影装置200内の照明の制御を行い、カメラに薬剤の撮影を行わせる。そして、コンピューター500は、撮影された薬剤の画像を、薬剤撮影装置200から受信する。コンピューター500は、薬剤の画像データを各種処理・加工して、薬剤の絞り込みおよび検索に必要な情報を得る。そして、コンピューター500は、この情報に基づいて、薬剤の絞り込みおよび検索を行い、その結果を鑑別結果として表示装置530の画面531に表示する。
図9は、薬剤鑑別ソフトウェア600が起動した状態の画面531を示している。より詳細には、服薬指導支援システム610により薬剤鑑別ソフトウェアが呼び出され、この薬剤鑑別ソフトウェアにより、画面531の右下に、錠剤鑑別メニューのウィンドウ620が表示されている。このウィンドウ620から、使用者の目的に沿った鑑別が開始される。図9に示すように、ウィンドウ620には、「錠剤画像鑑別」アイテム621と、「返品錠剤画像鑑別」アイテム622と、「ルーペ」アイテム623とが表示される。なお、ウィンドウ620では、『錠剤鑑別』と命名されているが、薬剤鑑別ソフトウェア600は、錠剤のみならずカプセル類の鑑別も行えるので、付記しておく。また、図9に示す例では、持参薬鑑別ソフトウェアは、別のソフトウェアによって起動されているが、持参薬鑑別ソフトウェアは、例えばそのアイコンをクリックすることにより、単独でも起動、動作することができる。
§3.2.1 グループ化
薬剤鑑別作業中は、図11~15に示すように、第2アイテム表示部分760に、「グループ化」アイテム765が表示される。この「グループ化」アイテム765が選択されると、図16に示すように、「グループ化」ウィンドウ630が、画面531内に開かれる。この「グループ化」ウィンドウ630内で、使用者は、複数の任意の薬剤をグループ化できる。
薬剤鑑別ソフトウェア600は、鑑別結果を自動学習する機能を有している。より具体的には、コンピューター500は、内部に学習データベースを備えている。そして、薬剤鑑別ソフトウェア600は、使用者が選択した薬剤(図14参照)を学習データベースに記録しておき、次回以降、自動鑑別において同様の薬剤がコンピューター500によって特定された場合には、コンピューター500は、第3の部分730のリストの中で、前回使用者が選択した薬剤を、最も高い順位で表示する。
図9に示すように、錠剤鑑別メニューのウィンドウ620には、「返品錠剤画像鑑別」アイテム622が配置されている。使用者がこの「返品錠剤画像鑑別」アイテム622を選択すると、図17に示すように、画面531には、「返品錠剤画像鑑別」ウィンドウ640が表示される。この返品錠剤画像鑑別は、鑑別したい複数の薬剤全てが同一種類の場合に、利用される。
図9に示すように、錠剤鑑別メニューのウィンドウ620には、「ルーペ」アイテム623が配置されている。使用者がこの「ルーペ」アイテム623を選択すると、図21に示すように、画面531には、「ルーペ」ウィンドウ660が表示される。この「ルーペ」ウィンドウ660の機能を使って、使用者は、見たい薬剤を、拡大して見ることができる。
前述したように、使用者は、切り欠き212(図2参照)を通して、長尺状の分包紙を、薬剤撮影装置200内に挿入することができる。そして、薬剤撮影装置200は、この分包紙内の薬剤を、撮影することができる。そして、薬剤鑑別ソフトウェア600は、この撮影した薬剤の鑑別を行うことができる。このように、本実施形態の薬剤鑑別システム100は、分包紙内の薬剤を分包紙を破らずに鑑別できるので、便利である。
以下、薬剤撮影装置200が撮影した画像内の各薬剤に対して、薬剤鑑別ソフトウェア600がどのように鑑別を行うか、詳述する。
使用者は、鑑別を行いたい薬剤をまずトレイ300のシャーレ310に入れる(図7参照)。このとき、錠剤は、シャーレ310の底面311の透明な部分315に直接置き、カプセルは、カプセル載置用部材314上に置くことが推奨される。次いで、使用者は、このトレイ300を、薬剤撮影装置200の載置部220に設置して、カバー214を閉める。そして、使用者は、図10に示す「撮影」アイテム751を選択する。
コンピュータ500は、使用者から薬剤の撮影を行う入力を受け付けると、薬剤撮影装置200を駆動して、シャーレ310の画像を撮影させる。具体的には、コンピュータ500は、下記[画像1]~[画像4]の4枚の画像を取得する。なお、このとき、コンピューター500は、後述する「カメラのピント調整」および「明るさおよび色のキャリブレーション」で得られた設定値(例えばカメラのピント、露出時間およびRGBの各ゲイン)に基づいて、カメラの撮影条件を設定する。これにより、画質の再現性が向上する。
[画像1]第1光源430による照明下、シャーレ310を上から撮影した画像。この画像は、第1リング照明431をオンにして、第1カメラ410で撮影を行うことにより取得できる。
[画像2]第2光源440による照明下、シャーレ310を下から撮影した画像。この画像は、第2リング照明441をオンにして、第2カメラ420で撮影を行うことにより取得できる。
[画像3]第3光源450による照明下、シャーレ310を上から撮影した画像。この画像は、第1バー照明451および第2バー照明452をオンにして、第1カメラ410で撮影を行うことにより取得できる。
[画像4]第4光源460による照明下、シャーレ310を下から撮影した画像。この画像は、第3バー照明461および第4バー照明462をオンにして、第2カメラ420で撮影を行うことにより取得できる。
後述するように、薬剤鑑別システム100では、事前にキャリブレーションが行われており、コンピュータ500は、このキャリブレーションによる較正情報をデータとして保持している。コンピュータ500は、この較正情報を基に、撮影した画像の補正を行う。具体的には、較正情報に基づいて、撮影した画像の座標の補正を行う。これにより、第1カメラ410で撮影した画像の座標軸と第2カメラ420で撮影した画像の座標軸が一致する。
画像補正後、画像内で各薬剤が占有する領域を抽出する。これには、背景と薬剤との明暗が大きく分かれる傾向の大きい[画像1]および[画像2]が好適に用いられる。領域抽出は、各画素の明るさを、閾値で2値化して(閾値未満=背景、閾値以上=薬剤)、閾値以上の領域を分離することにより行われる。
シャーレ310の透明な部分315に直接置かれた薬剤は、上から撮影した画像([画像1]および[画像3])と下から撮影した画像([画像2]および[画像4])の両方に映っている。本ステップにより、上から撮影した画像においてある1つの薬剤が占有する領域、および下から撮影した画像においてこの薬剤が占有する領域を対応づける。具体的には、ステップ130で補正された[画像1]および[画像2]の一方の画像を左右または上下反転させると、一方の画像内で薬剤が占有する領域は、他方の画像内で同じ薬剤が占有する領域とほぼ合致する。この合致した領域が、2つの画像において1つの薬剤がそれぞれ占有する領域である。すなわち、反転していない画像の1つの領域と、反転画像でこれと重なった領域が反転解除により戻った領域が、1つの薬剤にそれぞれ対応した領域となる。この際、2つの画像が反転して重なる重複領域を対応領域とすることもできる。
薬剤領域の対応づけ処理を実行したら、コンピューター500は、その薬剤が錠剤かカプセルかを判定する。錠剤は、シャーレ310の透明な部分315に置かれるので、上から撮影した画像にはその上面が、下から撮影した画像にはその下面が映っている。すなわち、2つの画像([画像1]および[画像2])を対比すると、薬剤が錠剤の場合、上から撮影した画像と下から撮影した画像とで、当該薬剤に対応する領域が、それぞれ存在する。したがって、上記ステップ210で2つの画像に対して1つの領域の対応づけができた場合、すなわち、上から撮影した画像において認識された薬剤の占有領域が、下から撮影した画像において認識された薬剤の占有領域と対応づけられた場合には、当該薬剤は錠剤と判定される。
コンピューター500によって選択された1個の薬剤が錠剤と判定された場合には、処理は、錠剤鑑別処理300に進む。図24は、錠剤鑑別処理300の各処理を示している。まず、コンピューター500は、薬剤が円形であるか否かの判定を行う(ステップ310)。次いで、コンピューター500は、薬剤の表面に付された刻印の抽出処理を行う(ステップ320)。次いで、コンピューター500は、薬剤の表面に付された印刷の抽出処理を行う(ステップ330)。次いで、コンピューター500は、薬剤の表面に付された情報が刻印か印刷かの判定を行う(ステップ340)。次いで、コンピューター500は、薬剤の表面に付された割線を抽出する(ステップ350)。次いで、コンピューター500は、薬剤の代表色を抽出する(ステップ360)。その後、コンピューター500は、当該薬剤に関する絞り込み情報を基に、候補となる薬剤の絞り込みを行う(ステップ370)。最後に、コンピューター500は、薬剤の画像から抽出した刻印および/または印刷情報を基に、テンプレートマッチングを行い、最終検索を行う(ステップ380)。
コンピューター500は、薬剤が占有する領域の円形度を求める。円形度が所定値以上の場合には、コンピューター500は、薬剤が円形であると判定する。また、円形度が所定値未満の場合には、コンピューター500は、薬剤が非円形であると判定する。薬剤が円形であると判定された場合、コンピューター500は、円の中心位置と半径を算出する。薬剤が非円形であると判定された場合には、コンピューター500は、薬剤が占有する領域の長軸がX軸と平行となるように、また、短軸がY軸と平行となるように、薬剤が占有する領域を回転させる。さらには、コンピューター500は、薬剤の長軸と短軸の長さ、および長軸と短軸の長さの比を算出する。
コンピューター500は、[画像1]および[画像2]、すなわち第1光源430および第2光源440による照明下撮影された画像に対して、刻印の抽出処理を行う。本発明者は、第1光源430および第2光源440による照明下薬剤を撮影すると、刻印が強調された薬剤の画像を撮影できることを見い出した(下記数1参照)。
コンピューター500は、[画像3]および[画像4]、すなわち第3光源450および第4光源460による照明下撮影された画像に対して、印刷の抽出処理を行う。本発明者は、第3光源450および第4光源460による照明下薬剤を撮影すると、印刷が強調された薬剤の画像を撮影できることを見い出した(下記数1参照)。
前述したように、第1リング照明431および第2リング照明441の照明下に撮影した画像に対して刻印抽出処理(ステップ320)を行うと、薬剤の表面に付された刻印が好適に抽出された画像が得られる。また、第1バー照明451、第2バー照明452、第3バー照明461および第4バー照明462の照明下に撮影した画像に対して印刷抽出処理(ステップ330)を行うと、薬剤の表面に付された印刷が好適に抽出された画像が得られる(上記数1参照)。コンピューター500は、これら刻印抽出画像および印刷抽出画像を基に、薬剤の表面に付された情報が刻印であるのか印刷であるのか、すなわち、薬剤の表面に刻印および印刷が付されているか否かの判定を行う。
コンピューター500は、ステップ320で得られた刻印抽出画像に対して、割線領域抽出処理を行う。詳しくは、コンピューター500は、薬剤に割線が存在するか否か判定する。また、存在すると判定した場合、薬剤を、割線が存在する領域とそれ以外の領域とに分離する。
次に、コンピューター500は、薬剤の代表色を、刻印または印刷が付された領域と、それ以外の領域とに分けて、別々に抽出する。代表色の抽出は、画素を構成する色に対してクラスタリングを行うことにより、好適に行える。また、別実施形態では、代表色を抽出する代わりに、薬剤の画像、あるいは、刻印または印刷が付された領域とそれ以外の領域とに対して、「白」、「薄い色」「濃い色」の色の濃さの判定を行う。これは、領域内の色が第1閾値未満なら、「濃い色」、第1閾値以上第2閾値未満なら「薄い色」、第2閾値以上なら、「白」と判定することにより行うことができる。
コンピューター500は、データベースにアクセスする。そして、以上のステップで得られたデータに基づいて、候補となる薬剤の検索を行う。まずは、最初の段階として、検索する対象の薬剤の絞り込みを行う。具体的には、コンピューター500は、薬剤の種類(錠剤かそれ以外の薬剤か)、薬剤の形状(円形か非円形か、非円形の場合長軸と短軸の長さの比)、薬剤のサイズ(円形の場合薬剤の直径、非円形の場合薬剤の長軸の長さおよび短軸の長さ)、刻印の有無、印刷の有無、割線の有無、薬剤の代表色(刻印が付された領域の代表色、印刷が付された領域の代表色、およびそれ以外の領域の代表色)の少なくとも1つに基づいて、検索する対象の薬剤を絞り込む。なお、コンピューター500が当該患者の処方履歴(例えばお薬手帳のデータ)にアクセスできる場合には、コンピューター500は、検索する対象の薬剤を、処方履歴に含まれる薬剤に限定することもできる。例えば、患者のスマートフォンに保存されたお薬手帳のデータにコンピューター500がアクセスできる場合には、コンピューター500は、当該お薬手帳のデータにアクセスして、当該患者に処方された薬剤の情報を取得することができる。また、紙に印刷されたお薬手帳が存在する場合には、そのお薬手帳をスキャンして、OCR(optical character recognition)によりテキスト化し、これに基づいて、検索対象の薬剤を絞り込むことができる。これにより、薬剤検索の速度を上げることができる。
その後、前述のステップで得られた刻印抽出画像および/または印刷抽出画像と、データベースに保存された各薬剤の刻印テンプレート画像および/または印刷テンプレート画像との間でテンプレートマッチング(パターンマッチングとも言う)を行い、鑑別対称の薬剤が該当する可能性の高い薬剤をピックアップする。なお、錠剤が円形の場合には、テンプレートマッチングに先立って、円の中心が画像の中心となるように、薬剤が占有する画像の領域を移動・補正する。別実施形態では、刻印および/または印刷の重心が画像の中心となるように、抽出画像およびテンプレート画像を補正してもよい。また、錠剤が円形の場合には、テンプレートマッチングの結果が最大となるように、抽出画像および/またはテンプレート画像を回転させる。その後、両画像に対してテンプレートマッチングを行い、スコアを算出する。このスコアは、両画像が合致している度合いを数値として示している。テンプレートマッチングのスコアが所定値以上の場合、あるいは最上位から所定順位以内である場合には、コンピューター500は、テンプレート画像が属する薬剤を、候補薬としてピックアップする。なお、錠剤が割線を有している場合には、割線が存在する状態でのテンプレートマッチングと、割線を除去した状態でのテンプレートマッチングとの両方を行ってもよい。また、印刷または刻印が単語で構成されている場合には、コンピューター500は、各単語を一単位としてテンプレートマッチングを行ってもよいし、単語を文字・数字・記号に分割し、各文字・数字・記号に対してテンプレートマッチングを行ってもよい。さらには、コンピューター500は、刻印または印刷画像からOCRによりテキスト情報を抽出し、このテキスト情報を基にテンプレートマッチングを行ってもよい。
図23のステップ220に戻って、コンピューター500によって選択された1個の薬剤がカプセルと判定された場合には、処理は、カプセル鑑別処理400に進む。図25は、カプセル鑑別処理400の各処理を示している。まず、コンピューター500は、カプセルを、2つの領域に分割する(ステップ410)。次いで、コンピューター500は、それぞれ2つの領域から、代表色を抽出する(ステップ420)。次いで、コンピューター500は、それぞれ2つの領域から、薬剤の表面に付された印刷の抽出処理を行う(ステップ430)。次いで、コンピューター500は、薬剤の表面に印刷が付されているかの判定を行う(ステップ440)。その後、コンピューター500は、当該薬剤に関する絞り込み情報を基に、候補となる薬剤の絞り込みを行う(ステップ450)。最後に、コンピューター500は、薬剤の画像から抽出した印刷情報を基に、テンプレートマッチングを行い、最終検索を行う(ステップ460)。
まず、コンピューター500は、薬剤を2つの領域に分割する。具体的には、薬剤の画像の色情報、具体的には画素の色をクラスタリングする。次いで、クラスタリングした色情報をグループ化し、この色グループが属する領域を、1つの領域とする。これにより、右半分と左半分とが異なる色で構成されたカプセルは、2つの領域に好適に分割される。
次に、コンピューター500は、薬剤の各領域の代表色を抽出する。これは、領域を構成する画素の色情報をクラスタリングすることにより、好適に行える。
コンピューター500は、ステップ410で分割された各領域に対し、ステップ330と同様の処理を施すことにより、各領域から印刷抽出を行う。本発明者は、カプセルの画像を2つの領域に分割し、それぞれの領域に対して別々に印刷画像の抽出処理を行うと、カプセルからより好適に印刷を抽出できることを見い出した。
コンピューター500は、分割された薬剤の各領域に対してステップ340と同様の処理を行い、各領域に印刷が付されているか否かの判定を行う。
コンピューター500は、ステップ360と同様にして、候補となる薬剤の絞り込みを行う。具体的には、コンピューター500は、薬剤の種類(カプセルかそれ以外の薬剤か)、薬剤の形状(薬剤の長軸と短軸の長さの比)、薬剤のサイズ(薬剤の長軸の長さおよび短軸の長さ)、代表色、各代表色が属する領域における印刷の有無、の少なくとも1つに基づいて、検索する対象の薬剤を絞り込む。
コンピューター500は、ステップ430で得られた印刷抽出画像(入力画像)から、印刷部分を切り出す。次いで、印刷抽出画像に対して、ステップ370と同様にして、ステップ410で分割された領域ごとにテンプレートマッチングを行い、候補薬をピックアップする。
§5.1 <ステップ370>での追加処理
前述したステップ370では、コンピューター500がアクセスするデータベースは、刻印抽出画像および/または印刷抽出画像に対応するテンプレート画像が保存されていることを前提とする。しかしながら、場合によっては、薬剤の単なる写真だけが保存されている場合がある。その場合、この画像データから薬剤の領域を取得して、前記と同様に印刷抽出および刻印抽出を行い、得られた印刷抽出画像および刻印抽出画像をテンプレート画像として用いてもよい。また、この方法によって、データベース内に保存されるテンプレート画像を作成することもできる。なお、画像データから薬剤の領域は、次のようにして取得することができる。まず、背景の色を取得し、背景色と文字以外の部分を、薬剤が占有する領域と判定する。なお、領域が1ヶ所または3箇所以上見つかった場合は、エラーとする。次いで、各領域の重心の位置を求め、この重心の位置から薬剤の左右を判定する。
上記実施形態を好適に実施するためには、第1カメラ410および第2カメラ420の焦点が合っている必要がある。また、第1カメラ410の撮影領域および第2カメラ420の撮影領域を合致させる必要がある。さらには、撮影画像の明るさおよび色も、所定値の範囲内に収める必要がある。このため、薬剤鑑別システム100の工場出荷前、あるいは薬剤鑑別システム100の納品先でのセットアップ時に、以下に述べるようなキャリブレーションを行う。なお、このキャリブレーションは、一度行えば、通常は、再び行う必要はない。
本キャリブレーションでは、まずはカメラの位置合わせを行う。まず、シャーレ310がセットされたトレイ300を、薬剤撮影装置200の載置部220にセットする。次いで、シャーレ310を第1カメラ410で撮影し、この撮影画像をコンピューター500の表示装置530に表示させる。このとき、シャーレ310の画像に、所定の位置に十字形を有する仮想画像を重ねて表示する。そして、この十字形がシャーレ310の内部に納まるように、第1カメラ410の位置と角度を微調整する。同様の操作を、第2カメラ420に対しても行う。
次に、カメラの焦点調整を行う。まずは、所定の文字、記号または図の表記がされたテンプレートを、薬剤撮影装置200の載置部220にセットし、低い倍率で、このテンプレートを撮影する。そして、撮影画像においてテンプレートの表記が最も鮮明となるように、カメラの焦点を粗調整する。これが完了したら、倍率を上げて同様の操作を行い、焦点の微調整を行う。
本キャリブレーションにより、上下のカメラの撮影領域の座標を合致させることができるようになる。また、カメラの解像度を取得することもできる。まずは、図26に示すような、キャリブレーション用ツールであるキャリブレーションシート810を用意する。このキャリブレーションシート810は、所定の厚みを有する板あるいはシートの両面に、所定のサイズの黒色の円が、所定間隔でm×n個(図23に示す例では3×4個)、行列状に配置された構成となっている。また、黒色の円の位置および大きさは、キャリブレーションシート810の表面と裏面とで、同じになっている。キャリブレーション時には、このキャリブレーションシート810を、薬剤撮影装置200の載置部220にセットし、第1カメラ410および第2カメラ420で、キャリブレーションシート810の撮影を行う。次いで、画像中の黒色の円が指定座標に位置し、かつ指定サイズとなるような変換行列を求める。これは、キャリブレーションシート810を上から撮影した画像、および下から撮影した画像の両方に行う。前述したステップ130では、この変換行列に基づいて、シャーレ310を撮影した画像の補正を行う。これにより、シャーレ310を上から撮影した画像および下から撮影した画像の撮影領域の座標位置が一致するようになる。また、変換行列から、画像の解像度(DPI)、すなわち単位長さを構成する画素数も得られる。
本キャリブレーションにより、撮影画像の色の再現性を高めることができる。前記と同様に、キャリブレーションシート810が載置部220に置かれた状態で、次の(a)~(b)を繰り返し行う。
(a)露出の調整:第1光源430がオンの状態で、所定の露出時間で、第1カメラ410による撮影を行う。また、第2光源440がオンの状態で、所定の露出時間で、第2カメラ420による撮影を行う。次いで、撮影された画像の所定の各点の明るさを算出する。この明るさが目標値よりも高い場合には、カメラの露出時間を下げる。目標値よりも低い場合には、カメラの露出時間を上げる。
(b)色(ホワイトバランス)の調整:撮影された画像の所定の各点のRGB値を算出する。B(青色)がR(赤色)よりも大きい場合には、Rのゲインを上げる。BがRよりも小さい場合には、Rのゲインを下げる。また、BがG(緑色)よりも大きい場合には、Gのゲインを上げる。BがGよりも小さい場合には、Gのゲインを下げる。
各値が目標値に達するまで、上記(a)~(b)を繰り返し行う。これにより、撮影時のカメラの設定値が得られる。また、同様の操作を、第3光源450および第1カメラ410を用いて、また、第4光源460および第2カメラ420を用いて行う。
210・・・・ケース
211・・・下側ケース
212・・・切り欠き部
213・・・上側ケース
214・・・カバー
215・・・傾斜部
216・・・斜面
217・・・切り欠き用スペース
220・・・・載置部
221・・・トレイ支持部材
222・・・孔
223・・・嵌合部
230・・・・ガイド部材
231・・・斜面
240・・・・上側内部空間
250・・・・フレーム
300、300’・・・トレイ
310・・・・シャーレ
311・・・底部
312・・・側面
313・・・リング
314・・・カプセル載置用部材
315・・・透明な部分
316・・・凹部
317・・・凹部
320・・・・本体
321・・・孔
322・・・筒
330・・・・平板
331・・・第2筒
410・・・・第1カメラ
420・・・・第2カメラ
430・・・・第1光源
431・・・第1リング照明
440・・・・第2光源
441・・・第2リング照明
442・・・下側支持板
443・・・上側支持板
450・・・・第3光源
451・・・第1バー照明
452・・・第2バー照明
460・・・・第4光源
461・・・第3バー照明
462・・・第4バー照明
520・・・・本体
530・・・・表示装置
531・・・画面
532・・・タッチスクリーン
541・・・キーボード
542・・・マウス
543・・・マウスカーソル
600・・・・・薬剤鑑別ソフトウェア
610・・・・服薬指導支援システムのウィンドウ
620・・・・錠剤鑑別メニューのウィンドウ
621・・・「錠剤画像鑑別」アイテム
622・・・「返品錠剤画像鑑別」アイテム
623・・・「ルーペ」アイテム
630・・・・「グループ化」ウィンドウ
631・・・第1の部分
632・・・アイテム表示部分
633・・・グループ化用標識
634・・・「グループ化」アイテム
635・・・「選択解除」アイテム
636・・・「グループ化一括解除」アイテム
637・・・「確定」アイテム
638・・・「閉じる」アイテム
640・・・・「返品錠剤画像鑑別」ウィンドウ
641・・・第1の部分
642・・・第2の部分
643・・・第3の部分
644・・・計数およびメッセージ表示部分
645・・・アイテム表示部分
646・・・「撮影」アイテム
647・・・メッセージ
648・・・第2標識
649・・・メッセージ
651・・・「鑑別開始」アイテム
652・・・第3標識
653・・・「印刷」アイテム
654・・・「再撮影」アイテム
655・・・「終了」アイテム
656・・・「手動検索」アイテム
657、658・・・第4標識
659・・・メッセージ
671、672・・・第5標識
673、674・・・第2標識
675・・・第6標識
676・・・「残り一括OK」アイテム
677・・・「表裏全切替」アイテム
660・・・・「ルーペ」ウィンドウ
661・・・第1の部分
662・・・アイテム表示部分
663・・・「拡大」アイテム
664・・・「縮小」アイテム
665・・・「照明切り替え」アイテム
666・・・「終了」アイテム
680・・・・「手動検索」ウィンドウ
681・・・検索式入力部分
682・・・検索結果表示部分
683・・・データベース画像表示部分
684・・・アイテム表示部分
685・・・タイプ部分
686・・・検索ボタン
687・・・「対象外」アイテム
688・・・「選択」アイテム
689・・・「新規追加」アイテム
691・・・「終了」アイテム
700・・・・・「錠剤画像鑑別」ウィンドウ
701・・・メッセージ
710・・・・第1の部分
713・・・第1標識
714・・・第2標識
715・・・第3標識
720・・・・第2の部分
721・・・寸法
730・・・・第3の部分
731・・・メッセージ
740・・・・第4の部分
750・・・・第1アイテム表示部分
751・・・「撮影」アイテム
752・・・ゲージ部
753・・・「中止」アイテム
754・・・「登録」アイテム
755・・・「追加撮影」アイテム
756・・・「再撮影」アイテム
757・・・「ページめくり」アイテム
758・・・「終了」アイテム
759・・・「印刷」アイテム
760・・・・第2アイテム表示部分
761・・・「選択」アイテム
762・・・「選択解除」アイテム
763・・・「対象外」アイテム
764・・・「手動検索」アイテム
765・・・「グループ化」アイテム
810、810’・・・キャリブレーションシート
811・・・円
812・・・直線
Claims (20)
- 薬剤の画像を撮影するのに用いられる薬剤撮影装置であって、
薬剤が載置される載置部と、
前記載置部の上方に設置された第1カメラと、
前記載置部の下方に設置された第2カメラと、
前記載置部の上方に設置された上部光源と、
前記載置部の下方に設置された下部光源と、
を有することを特徴とする薬剤撮影装置。 - 前記上部光源は、前記載置部の上方に設置された第1光源を備え、
前記下部光源は、前記載置部の下方に設置され、前記第1光源と同種の第2光源を備え、
前記上部光源は、前記載置部の上方に設置され、前記第1光源とは異種の第3光源をさらに備え、
前記下部光源は、前記載置部の下方に設置され、前記第3光源と同種の第4光源をさらに備える、
請求項1に記載の薬剤撮影装置。 - 前記第1光源および/または第2光源は、薬剤の刻印の撮影に用いられ、
前記第3光源および/または第4光源は、薬剤の印刷の撮影に用いられる、
請求項2に記載の薬剤撮影装置。 - 前記第3光源および第4光源から前記載置部までの距離は、前記第1光源および第2光源から前記載置部までの距離よりも大きい、
請求項2または3に記載の薬剤撮影装置。 - 前記第1光源および第2光源は、直接光源であり、
前記第3光源および第4光源は、拡散光源である、
請求項2~4のいずれか1項に記載の薬剤撮影装置。 - 前記第3光源および第4光源は、偏光フィルターを備え、当該偏光フィルターを通った光が薬剤に到達するように構成されている、
請求項2~5のいずれか1項に記載の薬剤撮影装置。 - 前記第1光源は第1リング照明により構成され、
前記第3光源からの光は、前記第1リング照明のリング内を通って、薬剤に到達し、
前記第2光源は第2リング照明により構成され、
前記第4光源からの光は、前記第2リング照明のリング内を通って、薬剤に到達する、
請求項2~6のいずれか1項に記載の薬剤撮影装置。 - 前記第3光源は前記第1カメラよりも低い位置で、かつ、前記載置部よりも側方に設置され、
前記第4光源は前記第2カメラよりも高い位置で、かつ、前記載置部よりも側方に設置される、
請求項2~7のいずれか1項に記載の薬剤撮影装置。 - 前記上部光源は第1リング照明を備え、
前記載置部を上から平面視した場合、前記第1カメラの撮影領域は、前記第1リング照明のリングの内側を含み、
前記下部光源は第2リング照明を備え、
前記載置部を下から平面視した場合、前記第2カメラの撮影領域は、前記第2リング照明のリングの内側を含む、
請求項1~8のいずれか1項に記載の薬剤撮影装置。 - 前記載置部には、透明な底部を備える載置用アイテムがセットされ、
前記第1リング照明は、前記透明な底部よりも高い場所に位置し、かつ、前記載置用アイテムの上端よりも低い場所に位置する、
請求項9に記載の薬剤撮影装置。 - 前記載置部には、透明な筒状の部材を備える載置用アイテムがセットされ、
前記載置用アイテムが前記載置部にセットされる際、前記筒状の部材は、前記第1リング照明のリングの内側に挿入される、
請求項9または10に記載の薬剤撮影装置。 - 前記上部光源は複数のバー照明を備え、
前記下部光源も複数のバー照明を備える、
請求項1~11のいずれか1項に記載の薬剤撮影装置。 - 前記バー照明の少なくとも1つは、薬剤撮影装置の前後方向と平行に設置される、
請求項12に記載の薬剤撮影装置。 - 前記第1カメラはカラー画像を撮影可能であり、
前記第2カメラもカラー画像を撮影可能である、
請求項1~13のいずれか1項に記載の薬剤撮影装置。 - 前記載置部、第1カメラ、第2カメラ、上部光源、および下部光源は、ケースに収納され、
前記ケースの前面の少なくとも1部分は、前記載置部より高い位置で開閉可能である、
請求項1~14のいずれか1項に記載の薬剤撮影装置。 - 前記ケースの外側正面は、前記載置部より高い位置に、下から上に行くに従って薬剤撮影装置の背面との距離が小さくなるような傾斜部を有する、
請求項15に記載の薬剤撮影装置。 - 前記第1カメラより低くかつ前記第2カメラよりも高い位置で、薬剤撮影装置の内部空間は、薬剤撮影装置の正面および左右方向の外部空間に連通している、
請求項1~16のいずれか1項に記載の薬剤撮影装置。 - 前記載置部には、底部に透明な平板を備える載置用アイテムがセットされる、
請求項1~17のいずれか1項に記載の薬剤撮影装置。 - 前記載置部には、透明な底部を有する載置用アイテムがセットされ、
前記透明な底部には、リング状の不透明な部材が設置される、
請求項1~18のいずれか1項に記載の薬剤撮影装置。 - 前記載置部には、透明な底部を有する載置用アイテムがセットされ、
前記透明な底部には、上面に凹部を有する不透明の部材が設置される、
請求項1~19のいずれか1項に記載の薬剤撮影装置。
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US15/129,798 US10969218B2 (en) | 2014-03-31 | 2015-03-31 | Medicine photographing device |
| JP2016511926A JP6607185B2 (ja) | 2014-03-31 | 2015-03-31 | 薬剤撮影装置 |
| CN201580028679.8A CN106415251B (zh) | 2014-03-31 | 2015-03-31 | 药剂拍摄装置 |
| AU2015239178A AU2015239178B2 (en) | 2014-03-31 | 2015-03-31 | Medicine photographing device |
| KR1020167027035A KR102276711B1 (ko) | 2014-03-31 | 2015-03-31 | 약제 촬영 장치 |
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JP2014-071130 | 2014-03-31 | ||
| JP2014071130 | 2014-03-31 | ||
| JP2014126029 | 2014-06-19 | ||
| JP2014-126029 | 2014-06-19 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2015152225A1 true WO2015152225A1 (ja) | 2015-10-08 |
Family
ID=54240545
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/JP2015/060090 Ceased WO2015152225A1 (ja) | 2014-03-31 | 2015-03-31 | 薬剤撮影装置 |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US10969218B2 (ja) |
| JP (5) | JP6607185B2 (ja) |
| KR (1) | KR102276711B1 (ja) |
| CN (1) | CN106415251B (ja) |
| AU (1) | AU2015239178B2 (ja) |
| WO (1) | WO2015152225A1 (ja) |
Cited By (23)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017134869A1 (ja) * | 2016-02-02 | 2017-08-10 | フロイント産業株式会社 | 固形製剤用テンプレート作成方法、固形製剤用テンプレート作成プログラムを記録したコンピュータが読み取り可能な記録媒体、固形製剤印刷検査方法、及び固形製剤印刷検査装置 |
| WO2017183533A1 (ja) * | 2016-04-19 | 2017-10-26 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| JP2018079240A (ja) * | 2016-11-18 | 2018-05-24 | 株式会社Screenホールディングス | 印刷装置およびバリデーション方法 |
| WO2018173649A1 (ja) | 2017-03-23 | 2018-09-27 | 富士フイルム株式会社 | 薬剤認識装置、薬剤認識方法、及び薬剤認識プログラム |
| JP2018186857A (ja) * | 2017-04-28 | 2018-11-29 | キヤノンマーケティングジャパン株式会社 | 情報処理システム、情報処理システムの制御方法、およびプログラム |
| WO2019039015A1 (ja) * | 2017-08-25 | 2019-02-28 | 富士フイルム株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| WO2019039016A1 (ja) * | 2017-08-25 | 2019-02-28 | 富士フイルム株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| WO2019039301A1 (ja) * | 2017-08-22 | 2019-02-28 | 富士フイルム株式会社 | 薬剤識別装置、画像処理装置、画像処理方法及びプログラム |
| WO2019044439A1 (ja) * | 2017-08-31 | 2019-03-07 | 富士フイルム株式会社 | 薬剤監査装置、画像処理装置、画像処理方法及びプログラム |
| WO2020045169A1 (ja) * | 2018-08-28 | 2020-03-05 | 株式会社湯山製作所 | 薬剤充填装置及び薬剤回収方法 |
| WO2020044933A1 (ja) * | 2018-08-31 | 2020-03-05 | 富士フイルム富山化学株式会社 | 対象物照合装置及び対象物照合方法 |
| WO2020162263A1 (ja) | 2019-02-07 | 2020-08-13 | 富士フイルム富山化学株式会社 | 薬剤照合装置、薬剤照合方法及び薬剤照合システム |
| JP2020156746A (ja) * | 2019-03-26 | 2020-10-01 | 沖電気工業株式会社 | 薬剤鑑別装置、薬剤撮影装置及び薬剤撮影方法 |
| JP2020182525A (ja) * | 2019-04-26 | 2020-11-12 | 株式会社湯山製作所 | 薬剤撮影補助装置、薬剤撮影装置、薬剤鑑別方法及び薬剤鑑別システム |
| WO2021065658A1 (ja) * | 2019-10-01 | 2021-04-08 | 富士フイルム富山化学株式会社 | 薬剤照合装置、薬剤照合システム、薬剤管理方法及びプログラム |
| JP2021100678A (ja) * | 2017-04-14 | 2021-07-08 | 株式会社湯山製作所 | システム |
| JP2022025439A (ja) * | 2020-07-29 | 2022-02-10 | 富士フイルム富山化学株式会社 | 画像処理装置、薬剤識別装置及び画像処理方法 |
| JP2022040849A (ja) * | 2020-08-31 | 2022-03-11 | 富士フイルム富山化学株式会社 | 薬剤候補表示方法及びプログラム、薬剤識別装置、薬剤識別システム |
| JP2022540709A (ja) * | 2019-07-19 | 2022-09-16 | ベクトン・ディッキンソン・ロワ・ジャーマニー・ゲーエムベーハー | 薬剤ポーションを測定し、検証する方法およびコンピュータプログラム製品 |
| JP2022154078A (ja) * | 2021-03-30 | 2022-10-13 | 沖電気工業株式会社 | 制御装置および薬剤鑑別システム |
| JP2023105994A (ja) * | 2022-01-20 | 2023-08-01 | 株式会社湯山製作所 | 薬剤判別ソフトウェア |
| JP2024041377A (ja) * | 2022-09-14 | 2024-03-27 | 富士フイルム富山化学株式会社 | 携帯端末装置、携帯端末装置の表示方法及びプログラム |
| US12394513B2 (en) | 2019-07-19 | 2025-08-19 | Becton Dickinson Rowa Germany Gmbh | Measuring and verifying drug portions |
Families Citing this family (17)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6009888B2 (ja) | 2012-09-27 | 2016-10-19 | 富士フイルム株式会社 | 薬剤検査装置及び方法 |
| US9940439B2 (en) * | 2013-11-29 | 2018-04-10 | Atabak Reza Royaee | Method and device for identification and/or sorting of medicines |
| KR102322987B1 (ko) * | 2015-06-26 | 2021-11-09 | (주)제이브이엠 | 약포 검사 장치 및 약포 검사 방법 |
| CN107084992B (zh) * | 2017-04-20 | 2020-04-21 | 佛山市南海区广工大数控装备协同创新研究院 | 一种基于机器视觉的胶囊检测方法及系统 |
| KR102175160B1 (ko) * | 2018-03-12 | 2020-11-06 | 민팃(주) | 다중 파장 광원을 이용하여 촬영하는 중고 단말기의 가치평가를 위한 외관 촬영 분석 시스템 |
| JP7035933B2 (ja) * | 2018-09-21 | 2022-03-15 | 東芝ライテック株式会社 | 検知装置 |
| EP3922232B1 (en) * | 2019-02-08 | 2022-11-23 | FUJIFILM Toyama Chemical Co., Ltd. | Medicine identification system, medicine identification device, medicine identification method, and program |
| JP7323156B2 (ja) * | 2019-06-06 | 2023-08-08 | 株式会社トーショー | 錠剤寸法測定プログラムおよび錠剤寸法測定システムおよび錠剤寸法測定方法 |
| US20230060088A1 (en) | 2020-01-27 | 2023-02-23 | Nippon Suisan Kaisha, Ltd. | Noodle-shaped body aggregate and method of producing same |
| US12027247B2 (en) | 2020-05-29 | 2024-07-02 | Cvs Pharmacy, Inc. | System and method for imaging pharmacy workflow in a virtual verification system |
| JP7424628B2 (ja) * | 2020-07-22 | 2024-01-30 | 株式会社トーショー | 薬剤判別ソフトウェア及び薬剤判別装置 |
| JP2022021724A (ja) * | 2020-07-22 | 2022-02-03 | 株式会社トーショー | 薬剤判別ソフトウェア |
| KR102594144B1 (ko) * | 2021-05-20 | 2023-10-24 | 연세대학교 원주산학협력단 | 어플리케이션을 이용한 약제 정보 제공장치 및 그 방법 |
| JP2024044885A (ja) * | 2022-09-21 | 2024-04-02 | 富士フイルム富山化学株式会社 | 撮影補助装置及び撮影補助方法 |
| JP7752597B2 (ja) * | 2022-12-26 | 2025-10-10 | 富士フイルムメディカル株式会社 | 薬剤識別装置、薬剤識別方法及びプログラム |
| KR20250021009A (ko) * | 2023-08-04 | 2025-02-11 | 주식회사 메딜리티 | 약포 검수 장치 및 방법 |
| CN120079598B (zh) * | 2025-05-07 | 2025-07-29 | 国药集团工业有限公司 | 一种药片次品分选设备及其分选方法 |
Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004167158A (ja) * | 2002-11-22 | 2004-06-17 | Glory Ltd | 薬剤認識装置 |
| WO2004112685A1 (ja) * | 2003-06-19 | 2004-12-29 | Yuyama Mfg. Co., Ltd. | 薬剤監査装置 |
| JP2008018230A (ja) * | 2006-06-14 | 2008-01-31 | Tafutei:Kk | 分包薬剤の検薬方法と検薬装置 |
| JP2010117331A (ja) * | 2008-11-14 | 2010-05-27 | Waseda Univ | 粒状物品種検査装置 |
| JP2012165876A (ja) * | 2011-02-14 | 2012-09-06 | Karon:Kk | 一包化薬剤の監査装置 |
| JP5033267B1 (ja) * | 2012-03-30 | 2012-09-26 | 株式会社Windy | 薬剤検査システム |
| US8345989B1 (en) * | 2009-02-16 | 2013-01-01 | Parata Systems, Llc | Illumination station for use in pharmaceutical identification system and methods therefor |
| JP2013066533A (ja) * | 2011-09-21 | 2013-04-18 | Twin Life Kk | 薬剤照合装置 |
| JP2013144100A (ja) * | 2011-04-28 | 2013-07-25 | Yuyama Manufacturing Co Ltd | 薬剤鑑査装置、及び薬剤分包装置 |
| JP2014053791A (ja) * | 2012-09-07 | 2014-03-20 | Panasonic Corp | 画像処理装置、画像処理プログラムおよび画像撮影装置 |
| JP2014221134A (ja) * | 2013-05-14 | 2014-11-27 | ファルメディコ株式会社 | 一包化薬剤鑑査装置 |
Family Cites Families (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH05245186A (ja) | 1992-03-02 | 1993-09-24 | N T T Data Tsushin Kk | 製剤識別装置 |
| JPH05337168A (ja) | 1992-06-10 | 1993-12-21 | N T T Data Tsushin Kk | 自動錠剤包装機 |
| JPH0916681A (ja) | 1995-06-26 | 1997-01-17 | Bunkichi Kato | 薬剤鑑別装置 |
| JPH09253163A (ja) | 1996-03-19 | 1997-09-30 | Tokyo Shokai:Kk | 薬剤監査支援システム |
| US5960104A (en) * | 1996-08-16 | 1999-09-28 | Virginia Polytechnic & State University | Defect detection system for lumber |
| JP4345148B2 (ja) * | 1999-07-30 | 2009-10-14 | 株式会社サタケ | 米粒品位判別装置 |
| KR20000077034A (ko) * | 1999-04-22 | 2000-12-26 | 사따께 사또루 | 입상물의 품질을 평가하기 위한 장치 및 방법 |
| JP3074756U (ja) * | 2000-06-23 | 2001-01-26 | 株式会社大谷口調剤薬局 | 薬剤用分包紙 |
| US6850872B1 (en) * | 2000-08-30 | 2005-02-01 | Microsoft Corporation | Facial image processing methods and systems |
| WO2008038775A1 (en) | 2006-09-29 | 2008-04-03 | Yuyama Mfg. Co., Ltd. | Medicine management guidance support system |
| US7959763B2 (en) * | 2008-02-20 | 2011-06-14 | Honeywell International Inc. | Apparatus and method for correcting basis weight measurements using surface topology measurement data |
| DE202008014487U1 (de) * | 2008-10-31 | 2009-01-22 | Mmi Ag | Petrischale für Zellkultivierung und Mikroskopie |
| KR20120012130A (ko) | 2010-07-30 | 2012-02-09 | 에스케이 텔레콤주식회사 | 복약관리 서비스 장치 및 방법, 복약관리 서비스를 위한 클라이언트 단말 및 서버 |
| JP5645019B2 (ja) | 2011-03-04 | 2014-12-24 | 学校法人兵庫医科大学 | 薬剤を識別するための器具およびその利用 |
| JP5725363B2 (ja) | 2011-09-27 | 2015-05-27 | 株式会社ダイフク | 調剤監査装置 |
| CN102508356B (zh) * | 2011-09-30 | 2014-09-10 | 浙江大学 | 基于光学投影的无透镜显微成像方法及其装置 |
-
2015
- 2015-03-31 AU AU2015239178A patent/AU2015239178B2/en active Active
- 2015-03-31 US US15/129,798 patent/US10969218B2/en active Active
- 2015-03-31 JP JP2016511926A patent/JP6607185B2/ja active Active
- 2015-03-31 KR KR1020167027035A patent/KR102276711B1/ko active Active
- 2015-03-31 CN CN201580028679.8A patent/CN106415251B/zh active Active
- 2015-03-31 WO PCT/JP2015/060090 patent/WO2015152225A1/ja not_active Ceased
-
2019
- 2019-02-14 JP JP2019024898A patent/JP6753479B2/ja active Active
- 2019-10-24 JP JP2019193769A patent/JP6939865B2/ja active Active
-
2020
- 2020-05-29 JP JP2020093857A patent/JP2020157077A/ja active Pending
-
2021
- 2021-11-05 JP JP2021180746A patent/JP7238942B2/ja active Active
Patent Citations (11)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2004167158A (ja) * | 2002-11-22 | 2004-06-17 | Glory Ltd | 薬剤認識装置 |
| WO2004112685A1 (ja) * | 2003-06-19 | 2004-12-29 | Yuyama Mfg. Co., Ltd. | 薬剤監査装置 |
| JP2008018230A (ja) * | 2006-06-14 | 2008-01-31 | Tafutei:Kk | 分包薬剤の検薬方法と検薬装置 |
| JP2010117331A (ja) * | 2008-11-14 | 2010-05-27 | Waseda Univ | 粒状物品種検査装置 |
| US8345989B1 (en) * | 2009-02-16 | 2013-01-01 | Parata Systems, Llc | Illumination station for use in pharmaceutical identification system and methods therefor |
| JP2012165876A (ja) * | 2011-02-14 | 2012-09-06 | Karon:Kk | 一包化薬剤の監査装置 |
| JP2013144100A (ja) * | 2011-04-28 | 2013-07-25 | Yuyama Manufacturing Co Ltd | 薬剤鑑査装置、及び薬剤分包装置 |
| JP2013066533A (ja) * | 2011-09-21 | 2013-04-18 | Twin Life Kk | 薬剤照合装置 |
| JP5033267B1 (ja) * | 2012-03-30 | 2012-09-26 | 株式会社Windy | 薬剤検査システム |
| JP2014053791A (ja) * | 2012-09-07 | 2014-03-20 | Panasonic Corp | 画像処理装置、画像処理プログラムおよび画像撮影装置 |
| JP2014221134A (ja) * | 2013-05-14 | 2014-11-27 | ファルメディコ株式会社 | 一包化薬剤鑑査装置 |
Cited By (61)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2017134869A1 (ja) * | 2016-02-02 | 2017-08-10 | フロイント産業株式会社 | 固形製剤用テンプレート作成方法、固形製剤用テンプレート作成プログラムを記録したコンピュータが読み取り可能な記録媒体、固形製剤印刷検査方法、及び固形製剤印刷検査装置 |
| JP2017138693A (ja) * | 2016-02-02 | 2017-08-10 | フロイント産業株式会社 | 固形製剤用テンプレート作成方法、固形製剤用テンプレート作成プログラムを記録したコンピュータが読み取り可能な記録媒体、固形製剤印刷検査方法、及び固形製剤印刷検査装置 |
| JP2022130740A (ja) * | 2016-04-19 | 2022-09-06 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| AU2022203243B2 (en) * | 2016-04-19 | 2024-03-28 | Yuyama Mfg. Co. Ltd. | Image Processing Program and Image Processing Apparatus |
| JP7381954B2 (ja) | 2016-04-19 | 2023-11-16 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| CN109069346A (zh) * | 2016-04-19 | 2018-12-21 | 株式会社汤山制作所 | 图像处理程序和图像处理装置 |
| KR20180137492A (ko) * | 2016-04-19 | 2018-12-27 | 가부시키가이샤 유야마 세이사쿠쇼 | 화상 처리 프로그램, 및, 화상 처리 장치 |
| KR102481315B1 (ko) * | 2016-04-19 | 2022-12-23 | 가부시키가이샤 유야마 세이사쿠쇼 | 화상 처리 프로그램, 및, 화상 처리 장치 |
| WO2017183533A1 (ja) * | 2016-04-19 | 2017-10-26 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| KR102355337B1 (ko) * | 2016-04-19 | 2022-01-24 | 가부시키가이샤 유야마 세이사쿠쇼 | 화상 처리 프로그램, 및, 화상 처리 장치 |
| JPWO2017183533A1 (ja) * | 2016-04-19 | 2019-02-28 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| KR20210158394A (ko) * | 2016-04-19 | 2021-12-30 | 가부시키가이샤 유야마 세이사쿠쇼 | 화상 처리 프로그램, 및, 화상 처리 장치 |
| JP2021121327A (ja) * | 2016-04-19 | 2021-08-26 | 株式会社湯山製作所 | 画像処理プログラム、および、画像処理装置 |
| EP3446673A4 (en) * | 2016-04-19 | 2019-10-02 | Yuyama Mfg. Co., Ltd. | PICTURE PROCESSING PROGRAM AND PICTURE PROCESSING DEVICE |
| JP2018079240A (ja) * | 2016-11-18 | 2018-05-24 | 株式会社Screenホールディングス | 印刷装置およびバリデーション方法 |
| JPWO2018173649A1 (ja) * | 2017-03-23 | 2019-12-12 | 富士フイルム富山化学株式会社 | 薬剤認識装置、薬剤認識方法、及び薬剤認識プログラム |
| US11574141B2 (en) | 2017-03-23 | 2023-02-07 | Fujifilm Toyama Chemical Co., Ltd. | Drug recognizing apparatus, drug recognizing method, and drug recognizing program |
| WO2018173649A1 (ja) | 2017-03-23 | 2018-09-27 | 富士フイルム株式会社 | 薬剤認識装置、薬剤認識方法、及び薬剤認識プログラム |
| EP3603604A4 (en) * | 2017-03-23 | 2020-04-01 | FUJIFILM Toyama Chemical Co., Ltd. | MEDICINE RECOGNITION DEVICE, MEDICINAL RECOGNITION METHOD, AND MEDICINAL RECOGNITION PROGRAM |
| JP7120370B2 (ja) | 2017-04-14 | 2022-08-17 | 株式会社湯山製作所 | システム |
| JP7255651B2 (ja) | 2017-04-14 | 2023-04-11 | 株式会社湯山製作所 | 薬剤仕分装置 |
| JP2021100678A (ja) * | 2017-04-14 | 2021-07-08 | 株式会社湯山製作所 | システム |
| JP2022000245A (ja) * | 2017-04-14 | 2022-01-04 | 株式会社湯山製作所 | 薬剤仕分装置 |
| JP2018186857A (ja) * | 2017-04-28 | 2018-11-29 | キヤノンマーケティングジャパン株式会社 | 情報処理システム、情報処理システムの制御方法、およびプログラム |
| WO2019039301A1 (ja) * | 2017-08-22 | 2019-02-28 | 富士フイルム株式会社 | 薬剤識別装置、画像処理装置、画像処理方法及びプログラム |
| JPWO2019039301A1 (ja) * | 2017-08-22 | 2020-07-27 | 富士フイルム富山化学株式会社 | 薬剤識別装置、画像処理装置、画像処理方法及びプログラム |
| JPWO2019039015A1 (ja) * | 2017-08-25 | 2020-09-24 | 富士フイルム富山化学株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| WO2019039015A1 (ja) * | 2017-08-25 | 2019-02-28 | 富士フイルム株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| WO2019039016A1 (ja) * | 2017-08-25 | 2019-02-28 | 富士フイルム株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| WO2019039302A1 (ja) * | 2017-08-25 | 2019-02-28 | 富士フイルム株式会社 | 薬剤検査支援装置、画像処理装置、画像処理方法及びプログラム |
| US11423246B2 (en) | 2017-08-25 | 2022-08-23 | Fujifilm Toyama Chemical Co., Ltd. | Medicine inspection assistance device, image processing device, image processing method, and program |
| WO2019044439A1 (ja) * | 2017-08-31 | 2019-03-07 | 富士フイルム株式会社 | 薬剤監査装置、画像処理装置、画像処理方法及びプログラム |
| US11341357B2 (en) | 2017-08-31 | 2022-05-24 | Fujifilm Toyama Chemical Co., Ltd. | Medicine inspection device, image processing device, image processing method, and program |
| JPWO2019044439A1 (ja) * | 2017-08-31 | 2020-09-03 | 富士フイルム富山化学株式会社 | 薬剤監査装置、画像処理装置、画像処理方法及びプログラム |
| JPWO2020045169A1 (ja) * | 2018-08-28 | 2021-08-10 | 株式会社湯山製作所 | 薬剤充填装置及び薬剤回収方法 |
| WO2020045169A1 (ja) * | 2018-08-28 | 2020-03-05 | 株式会社湯山製作所 | 薬剤充填装置及び薬剤回収方法 |
| WO2020044933A1 (ja) * | 2018-08-31 | 2020-03-05 | 富士フイルム富山化学株式会社 | 対象物照合装置及び対象物照合方法 |
| JP7112500B2 (ja) | 2018-08-31 | 2022-08-03 | 富士フイルム富山化学株式会社 | 対象物照合装置及び対象物照合方法 |
| JPWO2020044933A1 (ja) * | 2018-08-31 | 2021-08-10 | 富士フイルム富山化学株式会社 | 対象物照合装置及び対象物照合方法 |
| US11494581B2 (en) | 2018-08-31 | 2022-11-08 | Fujifilm Toyama Chemical Co., Ltd. | Object collating device and object collating method |
| WO2020162263A1 (ja) | 2019-02-07 | 2020-08-13 | 富士フイルム富山化学株式会社 | 薬剤照合装置、薬剤照合方法及び薬剤照合システム |
| JP7343019B2 (ja) | 2019-03-26 | 2023-09-12 | 沖電気工業株式会社 | 薬剤鑑別システム及び制御装置 |
| JP7143802B2 (ja) | 2019-03-26 | 2022-09-29 | 沖電気工業株式会社 | 薬剤鑑別装置、薬剤撮影装置及び薬剤撮影方法 |
| JP2022168241A (ja) * | 2019-03-26 | 2022-11-04 | 沖電気工業株式会社 | 薬剤鑑別システム、薬剤撮影装置及び薬剤撮影方法 |
| JP2020156746A (ja) * | 2019-03-26 | 2020-10-01 | 沖電気工業株式会社 | 薬剤鑑別装置、薬剤撮影装置及び薬剤撮影方法 |
| JP2020182525A (ja) * | 2019-04-26 | 2020-11-12 | 株式会社湯山製作所 | 薬剤撮影補助装置、薬剤撮影装置、薬剤鑑別方法及び薬剤鑑別システム |
| JP2023054062A (ja) * | 2019-04-26 | 2023-04-13 | 株式会社湯山製作所 | 薬剤撮影補助装置、薬剤撮影装置、薬剤鑑別方法及び薬剤鑑別システム |
| JP2022540709A (ja) * | 2019-07-19 | 2022-09-16 | ベクトン・ディッキンソン・ロワ・ジャーマニー・ゲーエムベーハー | 薬剤ポーションを測定し、検証する方法およびコンピュータプログラム製品 |
| US12394513B2 (en) | 2019-07-19 | 2025-08-19 | Becton Dickinson Rowa Germany Gmbh | Measuring and verifying drug portions |
| JP7427684B2 (ja) | 2019-10-01 | 2024-02-05 | 富士フイルム富山化学株式会社 | 薬剤照合システム、薬剤管理方法及びプログラム |
| JPWO2021065658A1 (ja) * | 2019-10-01 | 2021-04-08 | ||
| WO2021065658A1 (ja) * | 2019-10-01 | 2021-04-08 | 富士フイルム富山化学株式会社 | 薬剤照合装置、薬剤照合システム、薬剤管理方法及びプログラム |
| US12254974B2 (en) | 2019-10-01 | 2025-03-18 | Fujifilm Medical Co., Ltd. | Medicine collation device, medicine collation system, medicine management method, and program |
| JP7437259B2 (ja) | 2020-07-29 | 2024-02-22 | 富士フイルム富山化学株式会社 | 画像処理装置、薬剤識別装置、画像処理方法及び薬剤識別方法 |
| JP2022025439A (ja) * | 2020-07-29 | 2022-02-10 | 富士フイルム富山化学株式会社 | 画像処理装置、薬剤識別装置及び画像処理方法 |
| JP7374869B2 (ja) | 2020-08-31 | 2023-11-07 | 富士フイルム富山化学株式会社 | 薬剤候補表示方法及びプログラム、薬剤識別装置、薬剤識別システム |
| JP2022040849A (ja) * | 2020-08-31 | 2022-03-11 | 富士フイルム富山化学株式会社 | 薬剤候補表示方法及びプログラム、薬剤識別装置、薬剤識別システム |
| JP2022154078A (ja) * | 2021-03-30 | 2022-10-13 | 沖電気工業株式会社 | 制御装置および薬剤鑑別システム |
| JP2023105994A (ja) * | 2022-01-20 | 2023-08-01 | 株式会社湯山製作所 | 薬剤判別ソフトウェア |
| JP7769208B2 (ja) | 2022-01-20 | 2025-11-13 | 株式会社湯山製作所 | 薬剤撮影装置 |
| JP2024041377A (ja) * | 2022-09-14 | 2024-03-27 | 富士フイルム富山化学株式会社 | 携帯端末装置、携帯端末装置の表示方法及びプログラム |
Also Published As
| Publication number | Publication date |
|---|---|
| JP2022010060A (ja) | 2022-01-14 |
| JP6939865B2 (ja) | 2021-09-22 |
| JP7238942B2 (ja) | 2023-03-14 |
| KR102276711B1 (ko) | 2021-07-13 |
| AU2015239178B2 (en) | 2019-12-05 |
| US20170264867A1 (en) | 2017-09-14 |
| KR20160138079A (ko) | 2016-12-02 |
| JPWO2015152225A1 (ja) | 2017-04-13 |
| JP6753479B2 (ja) | 2020-09-09 |
| JP2020157077A (ja) | 2020-10-01 |
| JP2020011122A (ja) | 2020-01-23 |
| CN106415251B (zh) | 2020-05-19 |
| US10969218B2 (en) | 2021-04-06 |
| JP2019076787A (ja) | 2019-05-23 |
| JP6607185B2 (ja) | 2019-11-20 |
| CN106415251A (zh) | 2017-02-15 |
| AU2015239178A1 (en) | 2016-11-17 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| JP7238942B2 (ja) | 薬剤判別ソフトウェア | |
| JP6879298B2 (ja) | 画像処理プログラム、および、画像処理装置 | |
| US20170305589A1 (en) | Inspection assistance system and tablet packaging device | |
| CN104077584B (zh) | 图像检查系统和图像检查方法 | |
| EP3845214A1 (en) | Medicine loading device and medicine recovery method | |
| JP2023054062A (ja) | 薬剤撮影補助装置、薬剤撮影装置、薬剤鑑別方法及び薬剤鑑別システム | |
| JP6548584B2 (ja) | 調剤監査装置及び方法、並びにプログラム | |
| JP7769208B2 (ja) | 薬剤撮影装置 | |
| JP7424628B2 (ja) | 薬剤判別ソフトウェア及び薬剤判別装置 | |
| JP2022021724A (ja) | 薬剤判別ソフトウェア | |
| JP2019154622A (ja) | 画像処理システム | |
| JP2018190085A (ja) | 情報処理システム、情報処理システムの制御方法、およびプログラム | |
| JP2005352249A (ja) | 資料提示装置 | |
| JP2023105994A5 (ja) | 薬剤撮影装置 | |
| JP2018186857A (ja) | 情報処理システム、情報処理システムの制御方法、およびプログラム |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 15772185 Country of ref document: EP Kind code of ref document: A1 |
|
| ENP | Entry into the national phase |
Ref document number: 2016511926 Country of ref document: JP Kind code of ref document: A |
|
| ENP | Entry into the national phase |
Ref document number: 20167027035 Country of ref document: KR Kind code of ref document: A |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2015239178 Country of ref document: AU Date of ref document: 20150331 Kind code of ref document: A |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 15772185 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 15129798 Country of ref document: US |