[go: up one dir, main page]

WO2016203689A1 - Dispositif de capture d'images - Google Patents

Dispositif de capture d'images Download PDF

Info

Publication number
WO2016203689A1
WO2016203689A1 PCT/JP2016/002080 JP2016002080W WO2016203689A1 WO 2016203689 A1 WO2016203689 A1 WO 2016203689A1 JP 2016002080 W JP2016002080 W JP 2016002080W WO 2016203689 A1 WO2016203689 A1 WO 2016203689A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
plant
light
image sensor
filter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2016/002080
Other languages
English (en)
Japanese (ja)
Inventor
悠馬 小林
小金　春夫
一寛 柳
山田　英明
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Intellectual Property Management Co Ltd
Original Assignee
Panasonic Intellectual Property Management Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Intellectual Property Management Co Ltd filed Critical Panasonic Intellectual Property Management Co Ltd
Publication of WO2016203689A1 publication Critical patent/WO2016203689A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A01—AGRICULTURE; FORESTRY; ANIMAL HUSBANDRY; HUNTING; TRAPPING; FISHING
    • A01G—HORTICULTURE; CULTIVATION OF VEGETABLES, FLOWERS, RICE, FRUIT, VINES, HOPS OR SEAWEED; FORESTRY; WATERING
    • A01G7/00—Botany in general
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/27—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands using photo-electric detection ; circuits for computing concentration
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
    • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
    • G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
    • G01N21/359—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light using near infrared light

Definitions

  • the present disclosure relates to an imaging apparatus that images a plant.
  • an image sensor having a plurality of observation wavelength regions is used to capture a spectrum image of the crop, and a normalized vegetation index (NDVI: Normalized Difference Vegetation Index) based on the spectrum image. ), And it is known to estimate protein content and the like (see Patent Document 1).
  • NDVI Normalized Difference Vegetation Index
  • An object of the present invention is to provide an image pickup apparatus that prevents the main body from being broken and erroneously recognizing the growth status of a plant that is an image pickup target.
  • the present disclosure is an imaging apparatus that captures an image of a plant and calculates a growth index of the plant based on the image, and splits the light incident from the plant through the incident surface, and the light dispersed from the plurality of output surfaces.
  • An emitting prism disposed so as to face the first emitting surface, an infrared cut filter used for capturing a visible light image of the plant, and arranged to face the second emitting surface, and the growth of the plant
  • a first image sensor that receives a light emitted from the first emission surface via an optical filter used for imaging an image used for calculating an index and an infrared cut filter, and images a visible light image.
  • a second image sensor that receives light emitted from the second emission surface via the optical filter and captures an image used for calculating a growth index of the plant, and a visible light image and the calculated Represents plant growth index And an output unit for outputting an image, an image pickup device.
  • the present disclosure is an imaging device that captures an image of a plant and calculates a growth index of the plant based on the image, and captures a reflected light incident from the plant through an incident surface to capture a visible light image of the plant
  • the light used for the light is emitted from the first emission surface, and the light used for calculating the growth index of the plant is emitted from the second emission surface, and the light emitted from the first emission surface is received.
  • a first image sensor that picks up a visible light image
  • a second image sensor that receives light emitted from the second light exit surface, and picks up an image used to calculate a growth index of the plant
  • visible light An image pickup apparatus comprising: an image and an output unit that outputs an image used for calculation of a plant growth index.
  • a visible light image and an image used for calculating a growth index of a plant can be simultaneously captured, and a user has a failure of the apparatus main body or a growing situation of a plant that is an imaging target
  • the visible light image and the image used for calculating the growth index of the plant can be acquired simultaneously, so that the growth index can be reflected in the real-time visible light image.
  • the block diagram which shows an example of the internal structure of the surveillance camera of this embodiment The figure which shows an example of a schematic structure of an imaging part Graph showing examples of spectral characteristics of various filters Flow chart showing an example of imaging procedure Flow chart showing an example of automatic exposure control procedure Flow chart showing an example of color temperature correction control procedure
  • the figure which shows an example of IR image and R image which are displayed side by side on the screen of a monitor A block diagram showing an example of an internal configuration of a surveillance camera system of a modified example
  • FIG. 1 is a block diagram showing an example of the internal configuration of the surveillance camera 10 of the present embodiment.
  • the monitoring camera 10 images a plant that is a subject and outputs the captured image.
  • the monitoring camera 10 includes a lens 11, an optical module 13, an imaging unit 15, a delay unit 17, a CPU 25, an image processing unit 28, and a transmission unit 29.
  • the lens 11 collects the reflected light from the plant to be monitored, and forms the optical image on the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r through the prism 21.
  • the optical module 13 has a diaphragm (also referred to as iris) 13z as an example of a diaphragm unit that adjusts the amount of light from the plant incident through the lens 11, and the degree of opening of the diaphragm 13z according to a diaphragm control signal from the CPU 25. (Opening as an example of the amount of restriction) is adjusted.
  • the imaging unit 15 takes an image by spectroscopically reflecting reflected light from a plant incident through the lens 11 and the optical module 13 into visible light, IR light, and red light.
  • the imaging unit 15 includes a prism 21, an infrared cut filter 23c that transmits visible light, an IR filter 23i that transmits infrared light or near infrared light (IR), an R filter 23r that transmits light having a red wavelength, and a reduction filter.
  • An ND filter 24 having a role as an optical filter, a color image sensor 22c, an IR image sensor 22i, and an R image sensor 22r are included.
  • FIG. 2 is a diagram illustrating an example of a schematic configuration of the imaging unit 15.
  • the directions of the light that is, the reflected light of the plant
  • the prism 21 splits the light incident through the incident surface 21w in three directions, and emits the light dispersed in the three directions from the output surfaces 21z, 21y, and 21x.
  • An IR (infrared light or near infrared light) filter 23i and an IR image sensor 22i are arranged on the side facing the emission surface 21z.
  • the IR filter 23i is a filter that transmits infrared light or near-infrared light (see symbol d in FIG. 3).
  • the IR image sensor 22i receives the IR light that has passed through the IR filter 23i and captures an IR image.
  • the ND filter 24, the infrared cut filter 23c, and the color image sensor 22c are disposed on the side facing the emission surface 21y.
  • the ND filter 24 reduces the amount of incident light.
  • the infrared cut filter 23c is a visible light filter (color filter) that cuts (shields) infrared light or near-infrared light (see symbol f in FIG. 3).
  • the color image sensor 22c receives visible light that has passed through the infrared cut filter 23c, and captures a visible light image.
  • the amount of light emitted from the exit surface 21y toward the color image sensor 22c that receives visible light is less than the amount of light emitted from the other exit surfaces 21z and 21x. In this case, since it is not necessary to reduce the light, the ND filter 24 may be omitted.
  • the R filter 23r is a filter that transmits red light (that is, light having a red wavelength) (see symbol c in FIG. 3).
  • the R image sensor 22r receives light in the vicinity of 660 nm that has passed through the R filter 23r, and captures an R image.
  • the monitoring camera 10 captures an IR image and an R image in order to calculate an NDVI (Normalized Difference Vegetation Index) that is an index for observing the growth state of the plant.
  • NDVI Normalized Difference Vegetation Index
  • PRI Photochemical Reflectance Index
  • a filter and an image sensor that collects and images light with a wavelength of 530 nm are arranged, and an image sensor that collects and images light with a wavelength of 570 nm and light with a wavelength of 570 nm is disposed on the side facing the emission surface 21 x of the prism 21. Is placed.
  • the prism 21 can emit near-infrared wavelength light in the direction of the exit surface 21z and red light in the direction of the exit surface 21x by refraction inside the prism 21, the monitoring camera 10 shown in FIG. Therefore, the IR filter 23i and the R filter 23r are unnecessary.
  • FIG. 3 is a graph showing an example of spectral characteristics of various filters.
  • the vertical axis of the graph represents transmittance (%), and the horizontal axis represents wavelength (nm).
  • the 530 nm filter has a sharp peak waveform (symbol a) at a light wavelength of 530 nm.
  • the 570 nm filter has a sharp peak waveform (symbol b) at a wavelength of 570 nm.
  • the R filter 23r has a peak waveform (symbol c) having a high transmittance centering on a wavelength of 660 nm.
  • the IR (infrared light or near-infrared light) filter 23i has a large transmittance waveform (symbol d) at a wavelength exceeding 750 nm.
  • the green (G) filter has a slightly large transmittance waveform (symbol “e”) at a wavelength of 530 nm to 630 nm with 550 nm as the center.
  • the infrared cut filter 23c having a role as a visible light filter is a filter that cuts (shields) infrared light or near infrared light when a visible light image (color image) is captured, and has a wavelength of 400 nm to 680 nm.
  • the blue (B) filter has a slightly large transmittance waveform (symbol g) at a wavelength of 400 nm to 500 nm with approximately 450 nm as the center.
  • the CPU 25 is configured by using, for example, a CPU (Central Processing Unit) or an MPU (Micro Processing Unit), and comprehensively controls each part of the monitoring camera 10.
  • the CPU 25 outputs an aperture control signal to the optical module 13 to adjust the total amount of light incident on the prism 21. By limiting the total amount of light incident on the prism 21, the ND filter 24 can be omitted before the color image sensor 22c.
  • the CPU 25 outputs an imaging signal to each of the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r to perform an imaging operation. At this time, the CPU 25 individually sets the charge accumulation time of the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r by controlling the opening / closing time of the shutter (electronic shutter), and sets the exposure amount. Adjustable.
  • the CPU 25 outputs a gain control signal to the image generation unit 28y in the image processing unit 28, and increases the magnitude of the visible light, the IR signal, and the R signal, for example, by increasing the amplification degree (gain) of the IR signal and the R signal. Align the thickness (brightness) to improve the balance.
  • CPU25 outputs a signal with respect to the arithmetic process part 28z, and performs calculations, such as NDVI.
  • the CPU 25 may be a digital signal processor (DSP: Digital Signal Processor) dedicated to image processing.
  • DSP Digital Signal Processor
  • the image processing unit 28 calculates a plant growth index and generates an image, and includes a calculation processing unit 28z and an image generation unit 28y.
  • the arithmetic processing unit 28z is based on the IR image captured by the IR image sensor 22i and the R image captured by the R image sensor 22r, and is an NDVI (Normalized Difference Vegetation Index) that is an index for observing the growth state described later. ), And PRI (Photochemical Reflectance Index), which is an index (photosynthesis index) indicating the degree of photosynthesis activity of plants, is calculated for each pixel.
  • the arithmetic processing unit 28z includes amplifiers that amplify imaging signals (IR signal and R signal) from the IR image sensor 22i and the R image sensor 22r, respectively.
  • the image generation unit 28y generates an NDVI image (or PRI image) using the NDVI (or PRI) calculated for each pixel by the calculation processing unit 28z, and the NDVI image (or PRI image) and a color image sensor.
  • the visible light image captured in 22c is output.
  • the image generation unit 28y has an amplifier that amplifies the pixel value (luminance) of the calculated NVDI image (or PRI image), and improves the balance with the luminance of the visible light image by amplifying the luminance of the NDVI image. .
  • the luminance of these images may be made uniform by amplifying (attenuating) the luminance of the visible light image. .
  • a delay device 17 is provided between the color image sensor 22c and the image generation unit 28y or the transmission unit 29.
  • the image processor 28 calculates NDVI based on the IR image captured by the IR image sensor 22i and the R image captured by the R image sensor 22r and generates the image
  • the delay unit 17 The time (delay time) that is delayed with respect to the color image (visible light image) captured by the image sensor 22c is corrected, and the NDVI image and the color image are synchronized.
  • the image processing unit 28 may output the IR image captured by the IR image sensor 22 i and the R image captured by the R image sensor 22 r to the transmission unit 29 as they are.
  • the transmission unit 29 as an example of the output unit transmits the color image and NDVI image (or PRI image) image data input from the image processing unit 28 to the monitor 30.
  • the transmission unit 29 transmits the IR image and R image input from the image processing unit 28 to the monitor 30 as they are.
  • the monitor 30 as an example of a display device is a separate device from the monitoring camera 10, and contrasts by arranging color images and NDVI images (or PRI images) on the screen based on the image data transmitted from the transmission unit 29. indicate.
  • the monitor 30 may display the color image and the NDVI image (or PRI image) in a comparative manner by switching without arranging them. In this case, the switching may be automatically performed by a user operation or a preset time interval.
  • the monitor 30 can also individually display the color image and the NDVI image output from the image processing unit 28.
  • the normalized vegetation index (NDVI) is an index used for observing the state of plant growth, and is calculated for each pixel value according to Equation (1).
  • L IR represents the luminance of the infrared light or near infrared light
  • L R represents the luminance of the red light.
  • the NDVI value calculated by Equation (1) is in the range of value 0 to value 1. The closer to 0, the closer to blue, the closer to blue, and the closer to value 1, the closer to green.
  • the CPU 25 requires an IR (infrared or near-infrared light) image of a plant and R (red) necessary for NDVI calculation. )
  • the opening of the aperture 13z is set to a fixed value so that the amount of light incident on the image sensor 22 is as constant as possible.
  • a photosynthesis index that is an index indicating the photosynthesis activity level of a plant may be used, and analysis can be performed in the same procedure as NDVI.
  • the photosynthesis index (PRI) is an index representing the photosynthesis activity level of a plant, and is calculated for each pixel value according to the mathematical formula (2).
  • L 530 represents the luminance of light having a wavelength of 530 nm
  • L 570 represents the luminance of light having a wavelength of 570 nm.
  • the PRI value calculated by Equation (2) is in the range of value 0 to value 1. The closer to value 0, the smaller the degree of photosynthesis activity, the smaller the value, and the closer to value 1, the greater the photosynthesis activity level. Expressed in large colors.
  • FIG. 4 is a flowchart showing an example of an imaging operation procedure.
  • the CPU 25 performs initial setting (S1). In this initial setting, exposure conditions and color temperature correction are automatically set.
  • FIG. 5 is a flowchart showing an example of the automatic exposure control procedure.
  • the color image sensor 22c images a plant as a subject in accordance with an instruction from the CPU 25 as an example of an exposure control unit (S11).
  • the image processing unit 28 detects an RGB value and a luminance value for each pixel unit (predetermined number of pixel groups) in the image captured by the color image sensor 22c (S12).
  • the RGB value is a numerical value that specifies the color represented by the luminance of each of the R, G, and B pixels included in the pixel unit.
  • the luminance value is the luminance of the entire pixel unit.
  • the image processing unit 28 detects, as a green component pixel unit, a pixel unit having a G value ratio higher than a predetermined value among a plurality of pixel units constituting the captured image, and reads a luminance value of the pixel unit (S13). ).
  • the image processing unit 28 reads an ideal G value (for example, a green luminance value detected in the daytime in fine weather) stored in the internal memory (S14).
  • the ideal G value may be any green luminance value that can be easily observed by the user, and is not limited to this, and can be arbitrarily set.
  • the image processing unit 28 controls the exposure conditions so that the luminance value of the pixel unit detected as the green component read in step S13 is equal to the ideal G value (S15).
  • the exposure condition can be controlled by adjusting the aperture of the diaphragm 13z, adjusting the shutter opening / closing time, or adjusting the gain of the imaging signal.
  • each exposure amount changes, and the color image sensor 22c, the IR image sensor 22i, R
  • the sizes of the imaging signals can be made uniform.
  • the image captured by the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r without being affected by the illuminance due to sunlight can be obtained in fine weather.
  • the green brightness is almost proportional to the illuminance of sunlight compared to the brightness of red, infrared light, or near infrared light, so the green component was used here. It is also possible to use components, infrared light components, or near infrared light components.
  • FIG. 6 is a flowchart showing an example of the color temperature correction control procedure.
  • the color image sensor 22c images a plant as a subject in accordance with an instruction from the CPU 25 (S21).
  • the image processing unit 28 detects an RGB value and a luminance value for each pixel unit (predetermined number of pixel groups) in the image captured by the image sensor 22 (S22).
  • the image processing unit 28 detects, as a green component pixel unit, a pixel unit having a G value ratio higher than a predetermined value among the plurality of pixel units constituting the captured image (S23). Further, the image processing unit 28 reads the R value and the B value in the pixel unit detected as the green component (S24).
  • the image processing unit 28 controls the pixel unit detected as the green component so that the R value and the B value become a predetermined ratio (S25).
  • S25 a predetermined ratio
  • the pixel unit detected as a green component is controlled so that the R value and the B value become a predetermined ratio
  • the R value and the B value captured in the daytime in fine weather are set to the R value in the evening.
  • Gain control is performed so as to lower the B value in the morning. As a result, the leaf color will not be bluish in the morning and will not be reddish in the evening.
  • the gain control may be performed so as to increase the G value and the B value instead of decreasing the R value, or the gain control may be performed so as to increase the G value and the R value instead of decreasing the B value. Also good.
  • the CPU 25 When the initial setting of the imaging operation is performed in step S1, the CPU 25 outputs imaging control signals to the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r, respectively.
  • the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r respectively capture and acquire a color image, an IR image, and an R image in accordance with the imaging control signal (S2).
  • the arithmetic processing unit 28z in the image processing unit 28 reads the IR image and the R image captured by the IR image sensor 22i and the R image sensor 22r, respectively, and calculates NDVI according to the above-described equation (1) (S3). ).
  • the image generation unit 28y in the image processing unit 28 generates an NDVI image based on the NVDI calculated by the calculation processing unit 28z, and the color image obtained from the color image sensor 22c via the delay unit 17. Are output to the transmission unit 29.
  • the transmission unit 29 converts the NDVI image and the color image into image data suitable for the display format of the monitor 30 and outputs the image data to the monitor 30 (S4).
  • the monitor 30 displays the NDVI image and the color image side by side on the screen.
  • the CPU 25 determines whether or not the imaging is finished (S5).
  • the end of imaging is determined by the user performing a predetermined operation on the monitoring camera 10, the timer reaching a predetermined time, or the like. If not, the CPU 25 returns to step S2. On the other hand, when it is the end of imaging, the CPU 25 ends this operation.
  • FIG. 7 is a diagram showing a color image GZ1 and an NDVI image GZ4 displayed side by side on the screen of the monitor 30.
  • the color image GZ1 and the NDVI image GZ4 are displayed side by side in a contrasting manner.
  • a color image GZ1 is displayed in which reflected light from the plant is captured through the infrared cut filter 23c.
  • an NDVI image GZ4 in which the NDVI value for each pixel calculated by the image processing unit 28 is expressed in a color ranging from blue to green is displayed.
  • the NDVI image GZ4 is expressed in stepped colors (for example, three levels of blue, light blue, and green) with respect to NDVI values in the range of value 0 to value 1. Thereby, the user can know the growth condition of a plant roughly.
  • the NDVI value is not limited to three levels, and may be expressed in an arbitrary color by dividing it into an arbitrary number of levels. For example, the NDVI value may be expressed in five levels such as blue, light blue, green, yellow, and red. .
  • the monitor 30 displays the color image GZ1 and the NDVI image GZ4 side by side on the screen for comparison, but the color image GZ1 and the NDVI image GZ4 may be displayed alternately for comparison.
  • the monitor 30 may superimpose the color image GZ1 and the NDVI image GZ4 and display them as a composite image, or may display the color images GZ1 and NDVI images GZ4 individually.
  • the monitor 30 operates as a real-time color monitor.
  • an operation button for requesting the monitoring camera 10 to transmit the image data of the IR image GZ2 and the R image GZ3 captured in the middle is provided on the screen of the monitor 30, and the user desires
  • the IR image GZ2 and the R image GZ3 may be displayed on the screen of the monitor 30 by pressing this operation button.
  • FIG. 8 is a diagram illustrating an example of the IR image GZ2 and the R image GZ3 displayed side by side on the screen of the monitor 30.
  • the user can view the IR image GZ2 and the R image GZ3 only when necessary, which improves convenience.
  • a color image, an NDVI image, an IR image, and an R image may be arbitrarily combined and displayed. For example, these four images may be displayed on one screen, or any one or three images may be displayed on one screen.
  • the prism 21 separates the light incident from the plant through the incident surface 21w, and emits the separated light from the plurality of emission surfaces 21z, 21y, and 21x.
  • the infrared cut filter 23c disposed so as to face the emission surface 21y is used for capturing a visible light image of a plant.
  • the IR filter 23i and the R filter 23r arranged so as to face the emission surfaces 21z and 21x, respectively, are used for capturing an image used for calculation of NDVI, which is an index for observing the growth state of plants.
  • the color image sensor 22c receives light emitted from the emission surface 21y via the infrared cut filter 23c, and captures a visible light image of the plant.
  • the IR image sensor 22i and the R image sensor 22r receive light emitted from the emission surfaces 21z and 21x via the IR filter 23i and the R filter 23r, respectively, and an IR image and R used for NDVI calculation. Take an image.
  • the transmission unit 29 transmits the visible light image and the NDVI image to the monitor 30.
  • a visible light image (color image) and a plant growth index (NDVI etc.) The image used for the calculation can be taken simultaneously. Thereby, the growth index of a plant can be estimated accurately.
  • the NDVI image obtained based on the IR image and the R image can be synchronized with the color image and displayed on the screen of the monitor 30 as a video (moving image). It is.
  • NDVI Normalized Difference Vegetation Index
  • PRI Photochemical Reflection Index
  • the NDVI image GZ4 is generated after the IR image GZ2 and the R image GZ3 are imaged and the NDVI is calculated, so that the interval between the image capturing time of the color image GZ1 and the generation time of the NDVI image GZ4.
  • the provision of the delay unit 17 can reduce the time difference between these images, and in particular, it is delayed by the time required for NDVI calculation and NDVI image generation.
  • the color image GZ1 and the NDVI image GZ4 can be displayed in synchronization.
  • the CPU 25 as an example of the exposure control unit includes a visible light image (color image) captured by the color image sensor 22c and an R image and IR captured by the R image sensor 22r to calculate an NDVI image.
  • a visible light image color image
  • the luminance of these images can be roughly aligned. Therefore, the brightness balance between the color image and the NDVI image displayed on the monitor screen is improved, and these images can be displayed so as to be easily compared.
  • the color image GZ1 imaged in a state where the exposure conditions are controlled is output to the monitor 30, a color image can be output without being affected by changes in the illuminance of sunlight. Therefore, even when it is cloudy, it is possible to obtain a color image that is captured in fine weather.
  • the ND filter 24 is disposed between the infrared cut filter 23c and the color image sensor 22c disposed on the side facing the emission surface 21y of the prism 21, it is incident on the color image sensor 22c.
  • the amount of visible light to be suppressed can be suppressed, and the balance of the amount of light with IR light and R light can be made uniform.
  • the transmission unit 29 outputs the color image GZ1 and the image (NDVI image, PRI image) representing the calculated plant growth index to the monitor 30 in contrast, so that the leaf is a leaf having a high activity level. Regardless, it is possible to prevent the user from misrecognizing and cutting (leaf cutting) when the leaf has withered.
  • FIG. 9 is a block diagram illustrating an example of an internal configuration of the monitoring camera system 5 according to the modification.
  • the surveillance camera system 5 includes a surveillance camera 10A and a PC 50.
  • the image processing unit 28A in the monitoring camera 10A performs image processing on the images picked up by the color image sensor 22c, the IR image sensor 22i, and the R image sensor 22r to obtain a visible light image, an IR image, and an R image.
  • Image data such as a 530 nm image and a 570 nm image is transmitted to the PC 50 via the transmission unit 29.
  • the image processing unit 28A since the image processing unit 28A does not perform NDVI or PRI calculation, the image data of the NDVI image or PRI image is not transmitted.
  • the PC 50 is a general-purpose computer device, and includes a CPU 51, a memory 54, a communication unit 52, an operation unit 53, and a monitor 55.
  • the PC 50 receives the image data transmitted from the monitoring camera 10A via the communication unit 52, the PC 50 performs NDVI or PRI calculation and NDVI image generation as shown in the above-described embodiment, and also performs monitoring. Exposure control and color temperature correction control are performed on the camera 10A.
  • the configuration of the monitoring camera 10A can be simplified, and the remote control of the monitoring camera 10A by the PC 50 becomes possible.
  • the present disclosure can capture a visible light image and an image used for calculating a plant growth index at the same time, even if the configuration is inexpensive, and the user can malfunction the device main body or cause an error in the growth status of the plant to be imaged. It is useful as an imaging device that prevents recognition.

Landscapes

  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • General Physics & Mathematics (AREA)
  • Biochemistry (AREA)
  • Health & Medical Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Botany (AREA)
  • Forests & Forestry (AREA)
  • Ecology (AREA)
  • Environmental Sciences (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Engineering & Computer Science (AREA)
  • Mathematical Physics (AREA)
  • Theoretical Computer Science (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

La présente invention concerne la capture simultanée d'une image de lumière visible et des images utilisées pour calculer l'indice de croissance d'une plante, même à l'aide d'une configuration peu coûteuse et le fait d'empêcher un utilisateur de reconnaître par erreur une panne d'un corps principal de dispositif et l'état de croissance de la plante, c'est-à-dire l'objet dont une image doit être formée. Dans une caméra de surveillance (10), un prisme (21) disperse la lumière provenant d'une plante, ladite lumière y étant incidente par l'intermédiaire d'une surface d'incidence et émet la lumière dispersée à partir d'une pluralité de surfaces d'émission. Un capteur d'image en couleur (22c) reçoit, par l'intermédiaire d'un filtre de coupure infrarouge (23c), la lumière émise par une des surfaces d'émission et capture une image de lumière visible d'une plante. Un capteur d'image IR (22i) et un capteur (22r) d'image R reçoivent respectivement, par l'intermédiaire d'un filtre IR (23i) et d'un filtre R (23r) respectivement, la lumière émise par les surfaces d'émission et capturent une image IR et une image R qui sont utilisées pour calculer un indice de végétation par différence normalisée (NDVI), c'est-à-dire un indice permettant observer l'état de croissance de la plante. Une unité de transmission (29) transmet, à un moniteur (30), l'image de lumière visible et une image NDVI.
PCT/JP2016/002080 2015-06-19 2016-04-19 Dispositif de capture d'images Ceased WO2016203689A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2015-124253 2015-06-19
JP2015124253A JP2017009396A (ja) 2015-06-19 2015-06-19 撮像装置

Publications (1)

Publication Number Publication Date
WO2016203689A1 true WO2016203689A1 (fr) 2016-12-22

Family

ID=57545791

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2016/002080 Ceased WO2016203689A1 (fr) 2015-06-19 2016-04-19 Dispositif de capture d'images

Country Status (2)

Country Link
JP (1) JP2017009396A (fr)
WO (1) WO2016203689A1 (fr)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019003400A1 (fr) * 2017-06-29 2019-01-03 日本電気株式会社 Dispositif de calcul de coefficient, procédé de calcul de coefficient et support d'enregistrement dans lequel est enregistré un programme de calcul de coefficient
US20210304368A1 (en) * 2018-08-10 2021-09-30 Sony Corporation Information processing device, information processing method, and program

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6765494B1 (ja) 2019-10-31 2020-10-07 パナソニックｉ−ＰＲＯセンシングソリューションズ株式会社 ３板式カメラ
KR20250134867A (ko) 2024-03-05 2025-09-12 한국기술교육대학교 산학협력단 초분광 카메라

Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2007143490A (ja) * 2005-11-29 2007-06-14 Yamaguchi Univ 気球空撮マルチバンドセンシングにより植生を診断する方法
JP2008518229A (ja) * 2004-10-25 2008-05-29 アールピー ベンチャーズ テクノロジー オフィス アーベー マルチスペクトル及びハイパースペクトル撮像を行うシステム
JP2009058443A (ja) * 2007-08-31 2009-03-19 National Institute For Environmental Studies 土壌中の根圏要素の自動分類方法
US20090309960A1 (en) * 2008-06-13 2009-12-17 Bosoon Park Portable multispectral imaging systems
JP2010043979A (ja) * 2008-08-13 2010-02-25 Yuichi Kamata 分光画像計測装置
WO2012063241A1 (fr) * 2010-11-11 2012-05-18 Avi Buzaglo Yoresh Système et procédé de détection de champs de mines
JP2013538334A (ja) * 2010-07-08 2013-10-10 エフ・イ−・アイ・カンパニー 視覚画像化および赤外画像化を行なう荷電粒子ビーム処理システム
JP2014132266A (ja) * 2013-01-07 2014-07-17 Ricoh Co Ltd 露光条件及びフィルタ位置を使用したマルチモード光照射野撮像システム
JP2014183788A (ja) * 2013-03-25 2014-10-02 Sony Corp 情報処理システム、および情報処理システムの情報処理方法、撮像装置および撮像方法、並びにプログラム

Patent Citations (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008518229A (ja) * 2004-10-25 2008-05-29 アールピー ベンチャーズ テクノロジー オフィス アーベー マルチスペクトル及びハイパースペクトル撮像を行うシステム
JP2007143490A (ja) * 2005-11-29 2007-06-14 Yamaguchi Univ 気球空撮マルチバンドセンシングにより植生を診断する方法
JP2009058443A (ja) * 2007-08-31 2009-03-19 National Institute For Environmental Studies 土壌中の根圏要素の自動分類方法
US20090309960A1 (en) * 2008-06-13 2009-12-17 Bosoon Park Portable multispectral imaging systems
JP2010043979A (ja) * 2008-08-13 2010-02-25 Yuichi Kamata 分光画像計測装置
JP2013538334A (ja) * 2010-07-08 2013-10-10 エフ・イ−・アイ・カンパニー 視覚画像化および赤外画像化を行なう荷電粒子ビーム処理システム
WO2012063241A1 (fr) * 2010-11-11 2012-05-18 Avi Buzaglo Yoresh Système et procédé de détection de champs de mines
JP2014132266A (ja) * 2013-01-07 2014-07-17 Ricoh Co Ltd 露光条件及びフィルタ位置を使用したマルチモード光照射野撮像システム
JP2014183788A (ja) * 2013-03-25 2014-10-02 Sony Corp 情報処理システム、および情報処理システムの情報処理方法、撮像装置および撮像方法、並びにプログラム

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019003400A1 (fr) * 2017-06-29 2019-01-03 日本電気株式会社 Dispositif de calcul de coefficient, procédé de calcul de coefficient et support d'enregistrement dans lequel est enregistré un programme de calcul de coefficient
JPWO2019003400A1 (ja) * 2017-06-29 2020-03-26 日本電気株式会社 係数算出装置、係数算出方法、及び、係数算出プログラム
US20210304368A1 (en) * 2018-08-10 2021-09-30 Sony Corporation Information processing device, information processing method, and program
US12056851B2 (en) * 2018-08-10 2024-08-06 Sony Group Corporation Information processing device, information processing method, and program

Also Published As

Publication number Publication date
JP2017009396A (ja) 2017-01-12

Similar Documents

Publication Publication Date Title
JP6872137B2 (ja) 信号処理装置および信号処理方法、並びにプログラム
JP6055681B2 (ja) 撮像装置
JP5545016B2 (ja) 撮像装置
US20100245826A1 (en) One chip image sensor for measuring vitality of subject
JP5259381B2 (ja) 撮像装置および撮像方法
WO2016203689A1 (fr) Dispositif de capture d'images
JP6484504B2 (ja) 撮像装置
WO2012073507A1 (fr) Système, dispositif, procédé et programme de mesure d'un indice d'une aire de feuille
JP5564812B2 (ja) 植物体の生育変化の連続測定方法
JP2017011459A (ja) 撮像装置及び画像処理方法
WO2016080130A1 (fr) Appareil d'observation
JP5375168B2 (ja) 調整装置及び調整方法、並びに撮像装置
US11398060B2 (en) Information processing device, information processing method, and program
JP2015210124A (ja) 農業用監視カメラ
US12411390B2 (en) Imaging apparatus and lens apparatus including lens sections with different angles of view
CN116888455A (zh) 信息处理装置、成像系统、信息处理方法及程序
JP5991603B1 (ja) 撮像装置
JP5906755B2 (ja) 撮像装置、撮像方法、及びプログラム
US12372404B2 (en) Illuminant correction in an imaging system
JP5033741B2 (ja) 色特性変換係数の決定方法およびプリズムセット、ならびに撮像装置
JP2020193859A (ja) 画像処理装置、撮像システム、画像処理方法、および、プログラム
JP2017009395A (ja) 撮像装置及び表示制御方法
JPH04357441A (ja) 温室内作物の評価装置
JP7254440B2 (ja) 画像処理装置、撮像装置、画像処理方法、および、プログラム
WO2016203690A1 (fr) Dispositif de capture d'image et procédé de traitement d'image

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16811170

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16811170

Country of ref document: EP

Kind code of ref document: A1