WO2019045091A1 - Information processing device, counter system, counting method, and program storage medium - Google Patents

Abstract

The information processing apparatus 40 includes an extraction unit 41 and a counting unit 42 in order to provide a technique capable of suppressing an increase in time required for measurement processing of the number of objects even if the number of objects to be measured is large. The extraction unit 41 extracts a predetermined feature amount that changes in accordance with the number of objects to be measured from the captured image in which the object to be measured is captured. The counting unit 42 detects the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount by machine learning and the number of objects.

Description

Information processing apparatus, counting system, counting method and program storage medium

The present invention relates to a technique for measuring the number of objects using an imaging device.

In order to improve fish farming techniques, it is practiced to monitor the growth of fish in culture. Patent Document 1 discloses a configuration for measuring the number of fish. That is, in the configuration in Patent Document 1, the camera captures the fish in the ginger from the side of the ginger, and the information processing apparatus tracks the fish by analyzing the captured image taken, and the tracking result is obtained. Use to count fish in ginger.

Further, according to Patent Document 2, the camera captures the fish in the room from the upper side of the room containing the fish, the computer detects the fish shadow from the captured image captured, and detects it as a fish shadow in the captured image A configuration is shown to determine the presence and number of fish shadows based on the area of the selected area.

JP, 2016-110381, A JP, 2008-171196, A

In the configuration of Patent Document 1, by analyzing a captured image, a fish is detected and the fish in the ginger is counted using a result of tracking the fish. In the configuration of Patent Document 2, a fish shadow is detected from a captured image, and the number of fish shadows is determined based on the area of a region detected as a fish shadow in the captured image. Thus, in both the configuration of Patent Document 1 and the configuration of Patent Document 2, a fish is detected and the number of fish is measured using the detection result.

By the way, in the photographed image, there may be fish which do not appear due to overlapping of fish. Also, due to the turbidity of water, fish away from the camera may not appear or may become unclear. For this reason, there is a fish which is not detected from a photography picture, and there is a possibility that the problem that the number of fish can not be measured precisely may arise. Moreover, when measuring the number of very many fish, it is feared that processing time will take much with the method of detecting a fish and measuring the said detected fish.

The present invention has been devised to solve the above problems. That is, the main object of the present invention is to suppress the increase in time required for the process of measuring the number of objects even if the number of objects to be measured is large when the number of objects is measured using a captured image by the imaging device In addition, it is to provide the technology which raises measurement accuracy.

In order to achieve the above object, one aspect of an information processing apparatus according to the present invention is:
An extraction unit that extracts a predetermined feature amount that changes according to the number of objects to be measured from a captured image in which the object to be measured is captured;
A counting unit that detects the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model that is relationship data between the feature amount and the number of objects by machine learning; Equipped with

One aspect of the counting system according to the present invention is
A photographing device for photographing a photographing space in which an object to be measured exists;
An information processing apparatus configured to measure the number of objects to be measured in the imaging space based on an image captured by the imaging apparatus;
The information processing apparatus is
An extraction unit that extracts a predetermined feature amount that changes according to the number of objects to be measured from a captured image in which the object to be measured is captured;
A counting unit that detects the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model that is relationship data between the feature amount and the number of objects by machine learning; Equipped with

One aspect of the counting method according to the present invention is
And extracting a predetermined feature amount that changes according to the number of objects to be measured from the captured image in which the object to be measured is captured,
The number of objects to be measured is detected from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount and the number of objects by machine learning.

One aspect of a program storage medium according to the present invention is
A process of extracting, from a photographed image in which an object to be measured is photographed, a predetermined feature amount that changes according to the number of objects to be measured;
Processing for detecting the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount and the number of objects by machine learning; Stores computer programs to be executed by a computer.

According to the present invention, when measuring the number of objects using a captured image by the imaging device, it is possible to suppress an increase in time required for measurement processing of the number of objects even if the number of objects to be measured is large. , Measurement accuracy can be improved.

It is a block diagram simplifying and showing composition of a counting system of a 1st embodiment concerning the present invention. It is a figure explaining an example of the state where the camera which is an imaging device in a 1st embodiment is put into production. It is a figure showing an example of the photography range of the camera in a 1st embodiment. It is a figure explaining the arrangement | positioning form of the camera in 1st Embodiment. It is a figure showing the example of the photography picture by the camera arranged at the sea bottom in relation to the number of fish in a ginger. Furthermore, it is a figure showing the example of the photography picture by a camera in relation to the number of fish in a ginger. Furthermore, it is a figure showing the example of the photography picture by a camera in relation to the number of fish in a ginger. It is a figure explaining an example of a learning model for number detection. It is a figure explaining the generation method of the learning model for number detection. It is a figure explaining another example of the learning model for number detection. It is a flowchart explaining the counting process of the information processing apparatus in 1st Embodiment. It is a figure explaining other arrangement forms of a camera. It is a figure showing the other example of the imaging | photography range of a camera. It is a figure relating the example of the photography picture by the camera arranged at the ginger rim to the number of fish in ginger. Furthermore, it is a figure showing the example of the photography picture by a camera in relation to the number of fish in a ginger. Furthermore, it is a figure showing the example of the photography picture by a camera in relation to the number of fish in a ginger. It is a block diagram which simplifies and represents the structure of the counting system of 2nd Embodiment which concerns on this invention. It is a figure explaining the arrangement | positioning form of the camera in 2nd Embodiment. It is a block diagram simplifying and showing composition of an information processor of other embodiments concerning the present invention. It is a block diagram which simplifies and represents the structure of the counting system of other embodiment which concerns on this invention.

Hereinafter, an embodiment according to the present invention will be described with reference to the drawings.

First Embodiment
FIG. 1 is a block diagram showing a simplified configuration of a counting system according to a first embodiment of the present invention. The counting system 10 in the first embodiment is a system that measures the number of fish in a ginger that is an object to be measured. The counting system 10 includes a camera 11 which is a photographing device and an information processing device 12.

The camera 11 has a waterproof function, and as shown in FIG. 2, the camera 11 is disposed in the ginger 25 in which the fish 26 are cultured. In the first embodiment, the camera 11 is disposed at the center of the bottom of the water (including the position near the bottom) in the production bowl 25. The orientation of the lens of the camera 11 disposed at such a position is directed to the water surface (upward). Also, the camera 11 has a shooting range (field of view) as shown in FIG. That is, the shooting range of the camera 11 is a range in which the side (peripheral edge) of the ginger 25 can be photographed in consideration of the size of the ginger 25, and the camera 11 photographs the water in the ginger 25 as a photographing space .

Although the method in particular of arrange | positioning the camera 11 in water is not limited, the example is described next. That is, each of the cameras 11 is supported and fixed on the metal plate 20 as a supporting member as shown in FIG. 4 so that the direction of the lens is upward (the direction facing the upper side of the substrate surface of the metal plate 20). Be done. The metal plate 20 on which the camera 11 is supported and fixed is connected to the buoy 22 which is a floating body by a plurality of (four) ropes 21 which are wire members. Further, the opposite end side of the buoy 22 in each rope 21 is connected to the weight 23.

When the arrangement structure of the camera 11 having such a configuration is introduced into the water (raw water 25), the buoy 22 floats to the water surface, and the weight 23 sinks to the water bottom side, whereby the metal plate 20 is a rope 21 is suspended in water. Further, the weight 23 prevents the arrangement position of the metal plate 20 (in other words, the camera 11) from being largely changed. As described above, the method of arranging the camera 11 in water by the metal plate 20, the rope 21, the buoy 22, and the weight 23 has a simple structure and is easy to be compact and lightweight. From this, it becomes easy to move the camera 11 to another ginger 25.

The camera 11 thus disposed in the water shoots the fish 26 in the ginger 25 from the ventral side. For example, the fish 26 in the image captured by the camera 11 is an image as shown in FIGS. 5A to 5C.

Although the camera 11 is a photographing device having a function of photographing a moving image, a photographing device that intermittently photographs, for example, a still image at each setting time interval without adopting a moving image photographing function is adopted as the camera 11 You may Further, the calibration of the camera 11 is performed by an appropriate calibration method in consideration of the environment of the ginger 25, the type of fish to be measured, and the like. Here, the description of the calibration method is omitted.

Further, as a method of starting photographing by the camera 11 and a method of stopping photographing, an appropriate method taking into consideration the performance of the camera 11, the environment of the production 25, and the like is adopted. For example, a fish observer (operator) manually starts shooting before the camera 11 enters the ginger 25 and stops shooting manually after the camera 11 is withdrawn from the ginger 25. When the camera 11 has the function of wireless communication or wired communication, the camera 11 is communicably connected to an operating device capable of transmitting information for controlling the start and stop of shooting. Then, the photographing start and the photographing stop of the camera 11 in the water may be controlled by the operation of the operation device by the observer.

The captured image captured by the camera 11 as described above may be captured by the information processing apparatus 12 by wired communication or wireless communication, or may be stored in the portable storage medium and then stored in the portable storage medium to process the information processing apparatus from the portable storage medium It may be incorporated into T.12.

The information processing apparatus 12 generally includes a control device 13 and a storage device 14 as shown in FIG. The information processing apparatus 12 is connected to an input device (for example, a keyboard or a mouse) 16 which inputs information to the information processing apparatus 12 by an operation of an observer, for example, and a display device 17 which displays information. Furthermore, the information processing device 12 may be connected to an external storage device 15 separate from the information processing device 12.

The storage device 14 has a function of storing various data and a computer program (hereinafter also referred to as a program), and is realized by a storage medium such as a hard disk device or a semiconductor memory, for example. The storage device 14 included in the information processing device 12 is not limited to one, and multiple types of storage devices may be included in the information processing device 12. In this case, a plurality of storage devices are collectively referred to. It is referred to as a storage device 14. The storage device 15 also has a function of storing various data and computer programs as the storage device 14 and is realized by a storage medium such as a hard disk device or a semiconductor memory, for example. When the information processing device 12 is connected to the storage device 15, appropriate information is stored in the storage device 15. Further, in this case, the information processing apparatus 12 appropriately executes the process of writing and reading information in the storage device 15, but in the following description, the description of the storage device 15 is omitted.

In the first embodiment, the storage device 14 stores the image captured by the camera 11 in association with information identifying the captured camera, shooting date and time, information related to the shooting condition such as weather information, etc. Be done.

The control device 13 is configured by, for example, a processor such as a CPU (Central Processing Unit). The control device 13 can have the following functions, for example, by the CPU executing a computer program stored in the storage device 14. That is, the control device 13 includes an extraction unit 30, a counting unit 31, and a display control unit 32 as functional units.

The display control unit 32 has a function of controlling the display operation of the display device 17. For example, when the display control unit 32 receives a request to reproduce a photographed image of the camera 11 from the input device 16, the display control unit 32 reads the photographed image of the camera 11 according to the request from the storage device 14 and displays the photographed image. Display on

For example, when detecting that the request for measuring the number of fish has been input by the operation of the input device 16 by the observer during the reproduction of the photographed image by the camera 11, the extraction unit 30 determines a predetermined feature amount from the photographed image Have the ability to extract Here, the feature amount is a feature amount used in a learning model for number detection stored in the storage device 14. The learning model for detecting the number is a model used in the process of detecting (counting) the number of fish in the ginger 25 from the photographed image taken by the camera 11 disposed as shown in FIG. It is the related data of quantity and the number of fish. The learning model for detecting the number is generated by machine learning using teacher images (teacher images) as a large number of photographed images obtained by photographing the fish in the ginger 25 by the camera 11 in a state where the number of fish is known. 5A-5C, an example of a captured image in the ginger 25 by the camera 11 is represented in association with the number of fish in the ginger 25. FIG. As shown in FIGS. 5A to 5C, the brightness of the photographed image, the number of fish shadows, and the like change according to the number of fish. Thus, an element that changes according to the number of fish is set as the feature amount.

There are various methods for machine learning that generates a learning model for detecting the number of fish, and an appropriate method of machine learning that takes into consideration the aspect of the required learning model and the measurement accuracy of fish etc. is a method for generating a learning model for detecting the number of fish Will be adopted.

The learning model for number detection may be, for example, an aspect as shown in FIG. 6A or an aspect as shown in FIG. 7, and a method for generating the learning model as described above. It is set appropriately along with the setting of. The learning model in FIG. 6A is a model in which the number of fish (the number of fish) changes continuously according to the change in the feature value extracted from the teacher data. This model is obtained, for example, by regression analysis using measurement points P representing the relationship between a large number of feature amounts and the number as shown in FIG. 6B obtained from teacher data.

In the learning model of FIG. 7, a combination of a plurality of different feature amounts M and N extracted from the teacher image is grouped according to the number of fish in the production 25 in the teacher image in which the combination of the feature amounts M and N is extracted ( It is a model classified into classes.

The extraction unit 30 extracts feature amounts used in the above-described learning model for number detection from the captured image. For extraction of this feature quantity, for example, a deep learning framework used for generating a learning model is used as an extractor.

The counting unit 31 collates the feature quantity extracted from the photographed image by the extracting unit 30 with the learning model for detecting the number of fish in the storage unit 14, and the number of fish corresponding to the extracted feature quantity from the learning model for detecting the fish quantity It has a function to count as the number of fish to be measured.

By the way, the transparency of water and the brightness of the photographed image change depending on the photographing environment such as the season and the weather. In consideration of this, the counting unit 31 externally receives information (environmental information) of the photographing environment such as the season and the weather. Then, the counting unit 31 has a function of correcting the number of fish detected from the learning model according to the imaging environment, using the received information of the imaging environment and the data for correction stored in advance in the storage device 14 May be provided. Alternatively, a learning model may be generated for each shooting environment, and a learning model associated with information on the shooting environment may be stored in the storage device 14. In this case, the counting unit 31 detects the number of fish using a learning model corresponding to the received information of the imaging environment.

Furthermore, in fish farming, for example, fish are divided according to their age, and are farmed in ginger 25 of size (diameter and depth of ginger) according to age. In such a case, a plurality of different learning models associated with the age of the fish (fish size) and the size of the ginger are generated. The counting unit 31 may detect the number of fish using a learning model according to information of fish age (fish size) and ginger size received from the outside.

The counting system 10 of the first embodiment is configured as described above. Next, an example of the counting process of the information processing apparatus 12 in the first embodiment will be described based on the flowchart of FIG.

For example, when the extractor 30 of the information processing device 12 detects that a request to count fish to be measured has been input by the operation of the input device 16 by the observer (step S101), the image captured by the camera 11 is stored. Acquired from the device 14. Then, the extraction unit 30 extracts a feature amount set in advance from the acquired image captured by the camera 11 (step S102).

Thereafter, the counting unit 31 collates the extracted feature quantity with the learning model for detecting the number, and detects (counts) the number of fish corresponding to the extracted feature quantity from the learning model as the number of fish to be measured ( Step S103). Then, the counting unit 31 causes the display control unit 32 to display the measured number of fish, for example. The information processing apparatus 12 can measure the number of fish to be measured from the captured image and output the measured number of fish by such processing.

In the counting system 10 according to the first embodiment, the extraction unit 30 and the counting unit 31 of the information processing device 12 detect the number of fish to be measured from the photographed image by using a learning model for detecting the number by machine learning. Since the learning model by machine learning can improve the detection accuracy using the model by increasing the number of teacher data, the information processing apparatus 12 can use the learning model by machine learning to obtain an object. The accuracy of counting can be easily enhanced. In addition, since the information processing apparatus 12 extracts the feature amount of the captured image and detects the number of objects (fish) to be measured based on the feature amount, the number of fish in the captured image is measured one by one. In comparison, even if the number of fish increases, it is possible to suppress an increase in the time required for measurement processing. Moreover, since the information processing apparatus 12 measures the number of fish based on the feature quantity extracted from the photographed image instead of measuring the number of fish one by one, the photographing is caused due to the overlapping of the fish and the turbidity of the water. Even if there are fish that can not be detected in the image, the number of fish can be detected (counted) with high accuracy.

<Modification example>
In the configuration described above, the camera 11 is disposed at the bottom of the water (a position near the bottom of the water). Instead of this, for example, a camera 35 disposed as shown in FIG. 9 may be used. That is, as shown in FIG. 9, the camera 35 is fixed to the metal plate 20 in the horizontal orientation such that the lens orientation is parallel to the substrate surface of the metal plate 20 as the support member. In other words, the camera 35 is disposed sideways so as to be parallel to the water surface in a state of being introduced into the water (raw water 25). FIG. 10 is a diagram illustrating an example of the relationship between the shooting range of the horizontally oriented camera 35 and the ginger 25 when the ginger 25 is viewed from the upper side. As shown in FIG. 10, the horizontally oriented camera 35 is disposed at the periphery of the ginger 25 and photographs the fish in the ginger 25 from the periphery (side surface) of the ginger 25. The camera 35 has a field of view in which almost the entire production area 25 can be photographed. In addition, the depth position (height position) of the horizontally oriented camera 35 in water is the middle position between the bottom of the water and the water surface, and in this case, the depth position tends to be crowded depending on the type of fish. It is a depth position etc. which are easy to be crowded, and it is considered as a depth position suitable for the number of fish (number of fish) detection.

When the camera 35 is disposed as described above, the camera 35 shoots the fish in the ginger 25 from the side. In FIGS. 11A to 11C, examples of captured images including fish captured by the horizontally oriented camera 35 are shown for each number of fish. As described above, when the camera 35 is disposed sideways, a learning model for detecting the number is generated by using a photographed image taken by the camera 35 disposed similarly as teacher data. Further, the extraction unit 30 extracts, from the image captured by the horizontally oriented camera 35, the feature amount used in the learning model for number detection generated as such. Furthermore, the counting unit 31 detects the number of fish by collating the feature quantity extracted by the extraction unit 30 with a learning model for detecting the number of fishes based on a photographed image by the horizontally oriented camera 35.

As described above, even in the case where the fish in the ginger 25 are photographed from the peripheral portion by the horizontally oriented camera 35, the measurement target is obtained using the learning model by machine learning and the feature quantity extracted from the photographed image. By detecting the number of fish, the counting system 10 can obtain the same effect as the effect described above.

Second Embodiment
The second embodiment according to the present invention will be described below. In the description of the second embodiment, the same reference numerals are given to the same name parts as the constituent parts constituting the counting system of the first embodiment, and the duplicate explanation of the common parts is omitted.

FIG. 12 is a block diagram schematically showing the configuration of the counting system of the second embodiment. The counting system 10 of the second embodiment is provided with a camera 35 in addition to the configuration of the first embodiment. That is, the counting system 10 of the second embodiment uses the plurality of cameras 11 and 35. For example, as shown in FIG. 13, one camera 11 is disposed upward (toward the water surface) at the center of the bottom of the bottom of the production line 25, and another camera 35 is disposed at the bottom of the production line 25. It is disposed laterally on the periphery. The depth position of the horizontally oriented camera 35 is, for example, a position at an intermediate portion between the bottom of the water and the water surface, or a depth position where it is easy to swarm depending on the type of fish. Yes, and the appropriate depth position for number detection. The cameras 11 and 35 are disposed in water using the rope 21 and the buoy 22 as in the first embodiment, but the rope 21 and the buoy 22 are not illustrated in FIG. There is.

Each of the cameras 11 and 35 has a field of view capable of capturing the entire production 25 and captures the inside of the production 25 from different directions. The cameras 11 and 35 are imaging devices each having a function to capture a fish by a moving image, but as described in the first embodiment, for example, a time interval for setting a still image is not provided without having a moving image capturing function. An imaging device that captures images intermittently may be adopted as the cameras 11 and 35 each time.

In the counting system of the second embodiment, the information processing apparatus 12 detects the number of fish using the captured images of the cameras 11 and 35 captured at the same time. Taking this into consideration, in order to make it easy to obtain an image taken by the camera 11 taken at the same time and an image taken by the camera 35, it is also possible It is preferable to take a picture. For example, light that is emitted for a short time by automatic control or manually by the observer (worker) may be used as a mark used for time alignment, and the cameras 11 and 35 may capture the light. Accordingly, based on the light captured in the captured image by the cameras 11 and 35, it becomes easy to perform time alignment (synchronization) of the captured image by the camera 11 and the captured image by the camera 35.

In the second embodiment, as described above, the captured images of the cameras 11 and 35 captured at the same time are used. In consideration of this, the display control unit 32 of the control device 13 in the information processing device 12 has a function of controlling the display device 17 such that the display images of the cameras 11 and 35 are displayed side by side in two-screen display. Equipped with In addition, the display control unit 32 has a function that allows the observer to adjust the reproduction frame of each photographed image by the cameras 11 and 35 by using the time alignment mark as described above simultaneously photographed by the cameras 11 and 35. Equipped with Furthermore, the display control unit 32 may have a function of switching between one-screen display for displaying one of the captured images by the cameras 11 and 35 and dual-screen display for displaying both the captured images by the cameras 11 and 35. . When such a switching function is provided, the display control unit 32 further has a function of causing the display device 17 to display a display for receiving an instruction for switching by the observer. The display for receiving the switching instruction may be, for example, in the form of an icon, may be characters, or may be in the form of a radio button. Aspects are employed.

In the second embodiment, a learning model for detecting the number is generated by machine learning using both captured images of the cameras 11 and 35 captured simultaneously. That is, a learning model for detecting the number is generated by machine learning using teacher images (teacher images) as a large number of captured images simultaneously captured by the cameras 11 and 35 in a state in which the number of fish in the ginger 25 is known. . As in the first embodiment, a learning model for detecting the number of fish is relationship data between the feature quantity extracted from the photographed image and the number of fish, and is stored in the storage device 14.

The extraction unit 30 has a function of extracting a feature value used in a number detection learning model from both an image captured by the camera 11 and an image captured by the camera 35 captured simultaneously.

The counting unit 31 collates the feature quantity extracted by the extracting unit 30 from the images captured simultaneously with the cameras 11 and 35 with the learning model for detecting the number of fish in the storage device 14 and extracts the feature quantity extracted from the learning model. It has a function to detect the number of fish corresponding to as the number of fish to be measured.

The remaining configuration of the counting system 10 according to the second embodiment is similar to that of the counting system 10 according to the first embodiment. The counting system 10 according to the second embodiment can increase the amount of information used when detecting the number of fish in the ginger 25 by using the images taken by the plurality of cameras 11 and 35, so the number of fish can be increased. Detection accuracy can be further improved.

<Modification example>
In addition to the configuration of the second embodiment as described above, the counting system 10 may have the following configuration. That is, the counting system 10 detects the number of fish in the ginger 25 using mode 1 in which the number of fish in the ginger 25 is detected using the image photographed by the camera 11 at the bottom of the water and the image photographed by the cameras 11 and 35 It may have a configuration to switch between mode 2 and That is, the storage device 14 stores a learning model for number detection (learning model for mode 1) generated by machine learning using an image captured by the camera 11 at the bottom of the water. In addition, the storage device 14 stores a learning model for detecting the number of rays (learning model for mode 2) generated by machine learning using images captured by the camera 11 at the bottom of the water and the camera 35 at the periphery of the ginger. Furthermore, the control device 13 includes a switching unit 34 represented by a dotted line in FIG. 12 as a functional unit. When a request to switch the mode is issued, for example, by the operation of the input device 16 by the observer, the switching unit 34 switches the number detection mode from mode 1 to mode 2 or vice versa in response to the request. Are provided to the extracting unit 30 and the counting unit 31. The extracting unit 30 and the counting unit 31 operate in mode 1 or mode 2 in accordance with an instruction from the switching unit 34. That is, in mode 1, the extraction unit 30 and the counting unit 31 function in the same manner as the functions described in the first embodiment. In the case of mode 2, the extraction unit 30 and the counting unit 31 function in the same manner as the functions described in the second embodiment.

As described above, when the counting system 10 has a configuration capable of switching between mode 1 and mode 2, for example, the observer detects the number of fish if the photographed image of the camera 35 is defective for the fish number detection due to some problem. Mode is switched from mode 2 to mode 1. Thereby, even when the photographed image of the camera 35 is not good for the number detection, the counting system 10 can detect the number of fish in the ginger 25.

Furthermore, the counting system 10 may have the following configuration. That is, the counting system 10 may be configured to operate in a mode which is alternatively selected from the following three modes 1-1, 1-2, and 2. The mode 1-1 is a mode in which the number of fish in the ginger 25 is detected using an image captured by the camera 11 at the bottom of the water. Mode 1-2 is a mode in which the number of fish in the ginger 25 is detected using an image captured by the camera 35 at the periphery of the ginger. Mode 2 is a mode for detecting the number of fish in the ginger 25 using images taken by the camera 11 at the bottom of the water and the camera 35 at the periphery of the ginger.

When the counting system 10 can operate in three modes 1-1, 1-2, 2, the storage device 14 includes a learning model for mode 1-1 and a learning model for mode 1-2. A learning model for mode 2 is stored. The learning model for mode 1-1 is a learning model for number detection generated by machine learning using an image captured by the camera 11 at the bottom of the water. The learning model for mode 1-2 is a learning model for number detection generated by machine learning using an image captured by the camera 35 at the periphery of ginger. The learning model for mode 2 is a learning model for number detection generated by machine learning using images captured by the camera 11 at the bottom of the water and the camera 35 at the periphery of the ginger.

The control device 13 is provided with a switching unit 34. The switching unit 34 switches the number detection mode to a mode based on the received information, for example, when the information representing the mode after switching is received by the operation of the input device 16 by the observer. A function of instructing the counting unit 31 is provided. The extraction unit 30 and the counting unit 31 function to detect the number of fish in the raw fish 25 using a learning model corresponding to the mode instructed by the switching unit 34.

As described above, by providing the configuration capable of operating in the modes 1-1, 1-2, 2, it is possible to acquire a captured image from one of the cameras 11 and 35, or to detect the number of captured images of one of the cameras 11 and 35. Even if it is inappropriate, the counting system 10 can detect the number of fish in the production 25. Thereby, the counting system 10 can improve the convenience.

<Other Embodiments>
The present invention is not limited to the first embodiment, and various embodiments can be adopted. For example, in the counting system 10 according to the first and second embodiments, the functions of the extracting unit 30 and the counting unit 31 based on one shot image (a pair of shot images by the cameras 11 and 35 in the second embodiment) The calculated value according to is output as it is as the number of objects to be measured (finalized value). Instead of this, for example, the counting unit 31 measures the number of fish (the number of objects to be measured) calculated based on one photographed image (a plurality of photographed images in the second embodiment) as a measurement value of the number of fish As a storage device 14 may be provided. Then, the counting unit 31 further reads a predetermined number of measured values (for example, a plurality of measured values based on a plurality of (multiple sets of) captured images within the set imaging time) from the storage device 14 A function may be provided to calculate, for example, the average value of the measurement values as the determined value of the number of fish. By providing the counting unit 31 with such a function, the counting system 10 can improve the measurement accuracy of the object to be measured.

FIG. 14 shows a simplified configuration of the information processing apparatus according to another embodiment of the present invention. The information processing apparatus 40 in FIG. 14 includes an extraction unit 41 and a counting unit 42 as functional units. The information processing device 40 constitutes a counting system 50 together with the photographing device 51 as shown in FIG. The photographing device 51 has a configuration for photographing a photographing space in which an object to be measured exists.

The extraction unit 41 of the information processing apparatus 40 has a function of extracting a predetermined feature amount that changes in accordance with the number of objects to be measured from a photographed image in which the object to be measured is photographed. The counting unit 42 has a function of detecting the number of objects to be measured from the learning model by collating the extracted feature amounts with a learning model which is relationship data between the feature amount by machine learning and the number of objects. ing.

When the information processing apparatus 40 and the counting system 50 have the above-described configuration and measure the number of objects using a captured image by the imaging apparatus, the number of objects to be measured is at most the number of objects. It is possible to suppress an increase in the time required for measurement processing of Moreover, the information processing device 40 and the counting system 50 measure the number of objects to be measured based on the feature amount extracted from the captured image. Therefore, the information processing apparatus 40 and the counting system 50 can accurately detect (count) the number of objects to be measured even if there is an object to be measured that can not be detected in the captured image due to overlapping of objects or the like.

The present invention has been described above by taking the above-described embodiment as an exemplary example. However, the present invention is not limited to the embodiments described above. That is, the present invention can apply various aspects that can be understood by those skilled in the art within the scope of the present invention.

This application claims priority based on Japanese Patent Application No. 2017-169793 filed on Sep. 4, 2017 and Japanese Patent Application No. 2017-224834 filed on November 22, 2017, The entire disclosure is incorporated herein.

Reference Signs List 10, 50 counting system 11, 35 camera 12, 40 information processing device 30, 41 extraction unit 31, 42 counting unit 51 imaging device

Claims (9)

An extraction unit that extracts a predetermined feature amount that changes in accordance with the number of objects to be measured from a photographed image in which the object to be measured is photographed;
Counting means for detecting the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount and the number of objects by machine learning; An information processing apparatus comprising: The extraction unit extracts the feature amount from a plurality of photographed images in which objects to be measured are respectively photographed from different directions.
The information processing apparatus according to claim 1, wherein the counting unit detects the number of objects to be measured based on the learning model by machine learning using captured images respectively captured from the different directions. Information on shooting environment is associated with the learning model,
The information processing according to claim 1 or 2, wherein the counting unit detects the number of objects to be measured from the learning model associated with the information of the photographing environment according to the photographing environment of the photographed image. apparatus. The counting means receives environment information of the shooting of the photographed image from the outside, and corrects the number of objects of the measurement object detected from the learning model according to the shooting environment of the photographed image. The information processing apparatus according to 2. The information processing apparatus according to any one of claims 1 to 4, wherein the learning model is a model in which the number of objects changes in accordance with a change in the feature value. The information processing apparatus according to any one of claims 1 to 4, wherein the learning model is a model in which the number of objects is associated with the group of feature amounts. A photographing device for photographing a photographing space in which an object to be measured exists;
The counting system comprising: the information processing apparatus according to any one of claims 1 to 6, wherein a photographed image photographed by the photographing apparatus is used. And extracting a predetermined feature amount that changes according to the number of objects to be measured from the captured image in which the object to be measured is captured,
A counting method for detecting the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount and the number of objects by machine learning. A process of extracting, from a photographed image in which an object to be measured is photographed, a predetermined feature amount that changes according to the number of objects to be measured;
A process of detecting the number of objects to be measured from the learning model by collating the extracted feature amount with a learning model which is relationship data between the feature amount and the number of objects by machine learning; A program storage medium storing a computer program to be executed by a computer.

Images