JP2020009083A - Apparatus, system and program for processing information - Google Patents

Abstract

To provide an apparatus for processing information adapted to manage articles with greater simplicity.SOLUTION: An apparatus for processing information 40 comprises a photographic information acquiring section 411, an identification information detecting section 412, and an existence-location specifying section 413. The photographic information acquiring section 411 receives an image the flying object has photographed and photographic information associated with information indicative of a location the flying object has photographed, from the flying object flown through an arrangement location of the article. The identification information detecting section 412 detects identification information of the article from an image included in the photographic information. The existence-location specifying section 413 specifies an existence location of the article from the identification information the identification information detecting section 412 has detected and the location the flying object has photographed included in the photographic information the detecting means was to detect.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an information processing apparatus, an information processing system, and an information processing program for performing information processing relating to article management.

  2. Description of the Related Art In recent years, in order to more efficiently manage articles, a system such as a WMS (Warehouse Management System) that manages inventory in a warehouse or the like using a computer has been used.

  Such an inventory information processing system is disclosed in, for example, Patent Document 1. In the inventory information processing system disclosed in Patent Literature 1, the actual number of inventory measured by the user in the inventory work is compared with the number of inventory managed by the master, and the comparison result satisfies a predetermined condition. Next, an alarm is notified to the user. Thereby, the user can easily specify the article in which the stock quantity is abnormal.

JP 2011-197948 A

  By using a general technique such as the technique disclosed in Patent Document 1 described above, inventory management can be facilitated. However, the actual measurement of the actual number of inventory in the warehouse is performed manually by visual observation by a user, scanning using a barcode scanner, or the like, which is a burden on the user. In particular, when the warehouse is large, or when the ceiling height of the warehouse is high and goods are stacked in multiple stages, work at heights may occur, increasing the burden on the user and increasing the work time. Had become.

  The present invention has been made in view of such a situation, and an object of the present invention is to provide an information processing device, an information processing system, and an information processing program for more easily managing articles.

In order to achieve the above object, an information processing device of one embodiment of the present invention
From a flying object that has flown at the location of the article, receiving means for receiving shooting information in which an image captured by the flying object is associated with information indicating a position where the flying object is captured,
Detecting means for detecting identification information of the article from an image included in the photographing information;
From the identification information detected by the detection unit and the position where the flying object is captured in the imaging information that is the detection target by the detection unit, the identification unit that identifies the location of the article,
Is provided.

  According to the present invention, articles can be managed more easily.

1 is a schematic diagram illustrating an example of an overall configuration of an information processing system according to an embodiment of the present invention. 1 is a schematic diagram illustrating an example of a configuration in which an information processing system according to an embodiment of the present invention is overlooked. It is a block diagram showing an example of composition of an inventory management device concerning one embodiment of the present invention. It is a block diagram showing an example of composition of a drone concerning one embodiment of the present invention. It is a block diagram showing an example of composition of a base unit concerning one embodiment of the present invention. 1 is a block diagram illustrating an example of a configuration of an information processing device according to an embodiment of the present invention. 6 is a flowchart illustrating a flow of a data matching process in the information processing system according to the embodiment of the present invention. It is an image figure showing an example of display of the matching result of data matching processing in the information processing system concerning one embodiment of the present invention.

Hereinafter, an example of an embodiment of the present invention will be described with reference to the accompanying drawings.
[System configuration]
FIG. 1 is a schematic diagram illustrating an overall configuration of an information processing system S according to the present embodiment. As shown in FIG. 1, the information processing system S includes an inventory management device 10, a drone 20, a base device 30, and an information processing device 40. In the drawing, a shelf 53 in a place where a product to be managed by the information processing system S is installed (here, as an example, a warehouse) is also illustrated.

On the shelf 53, a manager of a warehouse or the like arranges a plurality of pallets 51, which are storage containers for articles to be managed, in a plurality of stages. Further, a pallet label 52 for identifying an article in the pallet is attached to each of the pallets 51. The pallet label 52 may be any label. However, in the present embodiment, the pallet label 52 is assumed to be a pallet label in which a management number (hereinafter, referred to as “article identification information”) for identifying an article in a warehouse is described in a two-dimensional code. I do.
In the drawings, for convenience of illustration, only one pallet 51 and one pallet label 52 are denoted by reference numerals, and the other pallets 51 and other pallet labels 52 are not denoted by reference numerals.

  The inventory management device 10 and the information processing device 40 are communicably connected to each other directly or via a network (not shown). Similarly, the drone 20 and the base device 30 are communicably connected to each other directly or via a network. Similarly, the base device 30 and the information processing device 40 are communicably connected to each other directly or via a network. Communication between these devices may be performed in accordance with an arbitrary communication method, and the communication method is not particularly limited. The network is realized by, for example, any one of the Internet, a LAN (Local Area Network), and a mobile phone network, or a combination of these. Note that one device may perform communication in accordance with a plurality of communication methods. For example, the base device 30 may conform to both a communication method for performing wired communication with the drone 20 and a communication method for performing wireless communication with the information processing device 40.

  The inventory management device 10, the base device 30, and the information processing device 40 are realized by an electronic device having an information processing function, such as a personal computer, a server device, or a device unique to the present embodiment. The drone 20 is realized by a drone having a photographing function.

  FIG. 2 is a schematic diagram illustrating an example of a configuration in which the information processing system S according to the present embodiment is overlooked. As shown in FIG. 2, shelves 53 are arranged in a plurality of rows (corresponding to shelves 53a to 53e in the figure). The pallets 51 to which the pallet labels 52 are attached are arranged in the left and right rows in the drawing of each shelf 53 in the vertical direction in the drawing. That is, the articles stored on the pallet 51 to which the pallet label 52 is attached are arranged side by side in the horizontal direction and stacked in the vertical direction. Then, a drone 20 and a base device 30 corresponding to the drone 20 are arranged corresponding to each of the left and right columns in these figures. For example, the drone 20a and the base device 30a are arranged corresponding to the left column in the drawing of 53a. Also, for example, the drone 20b and the base station 30b are arranged corresponding to the right column in the drawing of 53a and the left column in the drawing of 53b.

  The information processing system S having such a configuration performs a data matching process. Here, the data matching process is to specify the actual existence position of the article stored in each pallet 51 based on the photographing of the drone 20, and to include the actual existence position of the identified article and the management information. It refers to a series of processes that collate the managed arrangement positions.

  Specifically, in the data matching process, the drone 20 flies over the section where the shelves 53 are installed in the warehouse, and photographs each pallet 51 of each stage installed on the shelves 53 corresponding to the drone 20 itself. I do. Then, the drone 20 generates shooting information in which the shot image is associated with the position information at the time of shooting. When the shooting is completed, the drone 20 moves to the installation location of the base device 30 and transmits shooting information to the base device 30. The base device 30 transmits the received photographing information to the information processing device 40. Upon receiving the photographing information, the information processing device 40 detects the pallet label 52 by image-analyzing the received photographing information, and decodes the two-dimensional code described in the detected pallet label 52 to perform article identification. Detect information. In addition, the information processing device 40 determines the actual existence position of each of the pallets 51 (articles stored in the pallets 51) based on the detected article identification information and the position information included in the imaging information to be detected. Identify. Further, the information processing device 40 obtains inventory information of each of the pallets 51 (articles stored in the pallet 51) managed by the inventory management device 10 through communication with the inventory management device 10. Finally, the information processing device 40 determines the actual existence position of each of the pallets 51 (the items stored in the pallets 51) specified based on the photographing information, and the arrangement position of the management items included in the stock information. Matches and outputs the result of this match.

By performing the data collation processing described above, in the present embodiment, it is possible to eliminate the need for labor such as manual visual inspection and manual bar code scanning. Further, even if the warehouse is large-scale or the ceiling height of the warehouse is high, the present embodiment can be applied.
That is, according to the present embodiment, it is possible to more easily manage the articles.

The configuration illustrated in FIG. 1 is merely an example of the present embodiment, and the present embodiment is not limited to this configuration. For example, the number of each device and the number of shelves 53 included in the information processing system S are not limited to those illustrated, and may be any number. Further, for example, the articles stored in the pallet 51 may be arbitrary. Further, for example, the pallet label 52 may be directly attached to the article.
Next, the configuration of each device described above will be described in detail with reference to FIGS.

[Configuration of Inventory Management Device 10]
Next, the configuration of the inventory management device 10 will be described with reference to the block diagram of FIG. As shown in FIG. 3, the inventory management device 10 includes a CPU (Central Processing Unit) 11, a ROM (Read Only Memory) 12, a RAM (Random Access Memory) 13, a communication unit 14, a storage unit 15, An input unit 16 and a display unit 17 are provided. These units are bus-connected by signal lines, and mutually transmit and receive signals.

The CPU 11 executes various processes according to a program recorded in the ROM 12 or a program loaded from the storage unit 15 into the RAM 13.
The RAM 13 also appropriately stores data and the like necessary for the CPU 11 to execute various processes.

The communication unit 14 performs communication control for the CPU 11 to perform communication with another device included in the information processing system S.
The storage unit 15 is configured by a semiconductor memory such as a DRAM (Dynamic Random Access Memory) and stores various data.

The input unit 16 includes various buttons and a touch panel, or an external input device such as a mouse and a keyboard, and inputs various information in accordance with a user's instruction operation.
The display unit 17 includes a liquid crystal display or the like, and displays an image corresponding to the image data output from the CPU 11.

When the inventory management device 10 operates, the inventory information management unit 111 functions in the CPU 11 as shown in FIG.
In one area of the storage unit 15, a stock information storage unit 151 is set.

  The stock information storage unit 151 stores stock information of articles in a warehouse managed by the information processing system S. This stock information is, for example, the same information as stock information managed in a general WMS. More specifically, for example, data such as article identification information, the number of articles in stock, and identification information (location information) of each position where the articles are arranged are stored as inventory information in, for example, a table format.

The inventory information management unit 111 includes a function of managing inventory information stored in the inventory information storage unit 151. The inventory information management unit 111 is configured to output inventory information based on, for example, a user operation received by the input unit 16 or data received from another device (not shown) used by the user via the communication unit 14. The management is performed by updating the stock information stored in the storage unit 151 to the latest content. That is, the inventory management device 10 realizes a function as a so-called WMS.
When receiving a request for inventory information from the information processing device 40, the inventory information management unit 111 reads out the latest inventory information from the inventory information storage unit 151. Then, the inventory information management unit 111 transmits the read latest inventory information to the information processing device 40 as a response to the inventory information request.

[Configuration of Drone 20]
Next, the configuration of the drone 20 will be described with reference to the block diagram of FIG. As shown in FIG. 4, the drone 20 includes a CPU 21, a ROM 22, a RAM 23, a communication unit 24, a storage unit 25, a photographing unit 26, a driving unit 27, a sensor unit 28, and a battery 29. Have. These units are bus-connected by signal lines, and mutually transmit and receive signals.

  Here, the functions of the CPU 21, the ROM 22, the RAM 23, the communication unit 24, and the storage unit 25 as hardware are the same as the hardware functions of the units having the same names but differing only in the codes provided in the inventory management device 10. It is. Therefore, duplicate description will be omitted.

  The photographing unit 26 is configured by a camera including an optical lens, an image sensor, and the like, and photographs the periphery of the drone 20 (for example, the periphery including the pallet 51 and the pallet label 52 arranged on the shelf 53). The image obtained by the photographing of the photographing unit 26 is converted into a digital signal and output to, for example, the CPU 21 or the like.

  The drive unit 27 is driven using electric power supplied from a battery 29 described later. The drone 20 can fly in space by the driving of the driving unit 27. The drive unit 27 is configured by, for example, a set of a propeller that generates lift and thrust and a motor that rotates the propeller.

  The sensor unit 28 is a sensor for detecting a distance from another object (for example, a shelf 53, a bottom surface or a wall surface of a warehouse). The distance detected by the sensor unit 28 is converted into a digital signal and output to, for example, the CPU 21 or the like. The sensor unit 28 includes, for example, a sensor that detects a distance using radio waves in a microwave band, and a sensor that detects a distance using an ultrasonic wave. In addition, the sensor unit 28 may include an acceleration sensor, an angular velocity sensor, and the like in order to detect a moving distance, a moving direction, and the like of the drone 20.

  The battery 29 stores electric power and supplies the electric power to the driving unit 27 and other parts of the drone 20. In addition, the battery 29 stores the consumed power again by receiving power supply from the base device 30.

When the drone 20 operates, as shown in FIG. 4, in the CPU 21, a schedule management unit 211, a flight control unit 212, and a shooting information generation unit 213 function.
In one area of the storage unit 25, a schedule storage unit 251, a position detection information storage unit 252, and a shooting information storage unit 253 are set.

  The schedule storage unit 251 stores a schedule for performing photographing or the like by the drone 20. For example, a time zone during which the drone 20 should take an image while flying is stored as a schedule. The time period during which the drone 20 should take an image while flying can be arbitrarily set, but may be set to a time period during which the user does not work in the warehouse. For example, a nighttime or early morning time zone may be set. Thus, it is possible to perform photographing or the like by the drone 20 without disturbing a user who works in the warehouse.

  The position detection information storage unit 252 stores information for the drone 20 to detect its own current position. For example, in the arrangement as shown in FIG. 2, the respective positional relations between the respective base devices 30, the respective shelves 53, and markers (for example, markers on a ladder (ladder)) arranged on the floor of a warehouse or the like. , Information indicating the number of stages of each shelf 53, identification information (location information) of each position in the warehouse, and the like are stored as information for detecting the current position. These pieces of information are represented by, for example, coordinates in a three-dimensional coordinate system common to the pieces of information.

  The shooting information storage unit 253 stores the shooting information generated by the shooting information generation unit 213. Here, as described above, the shooting information is information in which a shot image is associated with position information at the time of shooting (for example, information on a two-dimensional position or information on a three-dimensional position).

The schedule management unit 211 manages the execution of shooting and the like by the drone 20 based on the schedule stored in the schedule storage unit 251. For example, when a predetermined time zone set in the schedule has arrived, the schedule management unit 211 instructs the flight control unit 212 to start flying and imaging by the drone 20.
In addition, the schedule management unit 211 can stop the flight and the imaging by giving an instruction to the flight control unit 212 at a time other than the predetermined time zone set in the schedule. In this case, the schedule management unit 211 instructs the flight control unit 212 to cause the drone 20 to receive power from the base device 30 corresponding to the drone 20 and store the power consumed by the battery 29 again. Can be.

  The flight control unit 212 starts execution of photographing and the like of the drone 20 based on an instruction from the schedule management unit 211. In this case, the flight control unit 212 causes the drone 20 to autonomously fly around the shelf 53 corresponding to the drone 20 and also photographs the shelf 53 by the photographing unit 26. Here, the flight control unit 212 realizes an autonomous flight based on the information for detecting its current position stored in the position detection information storage unit 252 and the detection result by the sensor unit 28. Specifically, the drone 20 is flying by calculating the moving distance and the moving direction from the position of the base device 30 corresponding to the drone 20 that is the position where the flight starts, based on the detection result by the sensor unit 28. Identify the current 3D position. Then, the flight control unit 212 performs autonomous control based on the current three-dimensional position of the drone 20 and the positional relationship between each base device 30 and each shelf 53 stored in the position detection information storage unit 252. Realize the flight. The flight control unit 212 detects a marker placed on the floor of a warehouse or the like by analyzing the image captured by the capturing unit 26 (or by the sensor unit 28), and based on the detection result of the marker. Thus, the current three-dimensional position where the drone 20 is flying may be corrected.

  Further, the flight control unit 212 controls the photographing unit 26 during the autonomous flight, so that the surroundings of the drone 20 (for example, the periphery including the pallet 51 and the pallet label 52 arranged on the shelf 53) are controlled at a predetermined cycle. ) To shoot. Then, the flight control unit 212 outputs the photographed image and information on the position at the time of photographing to the photographing information generating unit 213.

  The autonomous flight and photographing are performed until the entire periphery of the shelf 53 corresponding to the drone 20 is photographed. More specifically, pallets 51 and pallet labels 52 are arranged on the respective stages of the shelf 53 in a horizontal direction and stacked vertically. Therefore, the flight control unit 212, for example, the drone 20 shoots each stage of the shelf 53 as a shooting target, and when all stages are shot, ends the autonomous flight and shooting and responds to itself. It returns to the base device 30 which performs. Then, the drone 20 receives power supply from the base device 30 until a predetermined time zone arrives again and there is an instruction from the schedule management unit 211 again. The drone 20 may take images of all the stages of the shelf 53 at one time. However, each time one stage is photographed, the drone 20 returns to the base device 30 and receives power supply, and then takes a photograph of the next stage. It may be performed. By doing so, the capacity of the battery 29 can be reduced.

  The photographing information generating unit 213 generates photographing information by associating the photographed image input from the flight control unit 212 with information on the position at the time of photographing. Then, the shooting information generation unit 213 causes the shooting information storage unit 253 to store the generated shooting information.

[Configuration of Base Device 30]
Next, the configuration of the base device 30 will be described with reference to the block diagram of FIG. As illustrated in FIG. 5, the base device 30 includes a CPU 31, a ROM 32, a RAM 33, a communication unit 34, a storage unit 35, and a power supply unit 36. These units are bus-connected by signal lines, and mutually transmit and receive signals.

  Here, the hardware functions of the CPU 31, the ROM 32, the RAM 33, the communication unit 34, and the storage unit 35 are the same as those of the above-described inventory management device 10 and the drone 20, which have the same names but different codes. Equivalent to function. Therefore, duplicate description will be omitted.

  The power supply unit 36 is a part that supplies power to the drone 20. The base device 30 obtains electric power from a home power supply in a warehouse. Then, power is supplied to the drone 20 by converting the power into a voltage or the like suitable for supplying power to the drone 20. The power supply to the drone 20 is continued after the autonomous flight and the photographing by the drone 20 are completed and until the autonomous flight and the photographing by the drone 20 are performed again (or until the battery 29 is sufficiently charged).

When the base device 30 operates, as illustrated in FIG. 5, the imaging information relay unit 311 and the power supply control unit 312 function in the CPU 31.
In one area of the storage unit 35, a shooting information storage unit 351 is set.

The shooting information storage unit 351 stores shooting information acquired from the drone 20.
The photographing information relay unit 311 transmits the photographing information acquired from the drone 20 to the information processing device 40. That is, the photographing information relay unit 311 relays the photographing information. The relay of the photographing information can be performed at an arbitrary timing. As an example, the photographing information relay unit 311 communicates with the drone 20 while receiving the power supply from the power supply unit 36 after the drone 20 completes the automatic flight and the photographing. However, the present invention is not limited to this, and the imaging information relay unit 311 may communicate with the drone 20, for example, while the drone 20 is performing automatic flight and imaging.
Then, the photographing information relay unit 311 acquires the photographing information generated by the drone 20 through this communication and stored in the photographing information storage unit 253. Further, the photographing information relay unit 311 causes the photographing information storage unit 351 to store the acquired photographing information. Further, the photographing information relay unit 311 transmits the photographing information stored in the photographing information storage unit 351 to the information processing device 40 at a predetermined timing. The predetermined timing may be immediately after acquiring the imaging information from the drone 20, or may be a timing at which the information processing device 40 requests the imaging information.

  The power supply control unit 312 is a part that controls power supply by the power supply unit 36 described above. Specifically, the power supply control unit 312 controls the above-described conversion of the voltage and the like and the start and end of power supply.

[Configuration of Information Processing Device 40]
Next, the configuration of the information processing apparatus 40 will be described with reference to the block diagram of FIG. As shown in FIG. 6, the information processing device 40 includes a CPU 41, a ROM 42, a RAM 43, a communication unit 44, a storage unit 45, an input unit 46, and a display unit 47. These units are bus-connected by signal lines, and mutually transmit and receive signals.

  Here, the functions as hardware of the CPU 41, the ROM 42, the RAM 43, the communication unit 44, the storage unit 45, the input unit 46, and the display unit 47 are provided in the inventory management device 10, the drone 20, and the base device 30 described above. This is equivalent to the function as hardware of each unit having the same name except for the sign. Therefore, duplicate description will be omitted.

When the information processing apparatus 40 operates, as shown in FIG. 6, in the CPU 41, the photographing information acquisition unit 411, the identification information detection unit 412, the location identification unit 413, the inventory data acquisition unit 414, the data matching unit 415 function.
In one area of the storage unit 45, a shooting information storage unit 451 and a specific information storage unit 452 are set.

  The shooting information storage unit 451 stores shooting information of each drone 20 received from each base device 30.

  The specific information storage unit 452 stores the actual existence position of each of the pallets 51 (articles stored in the pallets 51) identified by the existence position identification unit 413 described below based on the photographing information.

  The photographing information acquisition unit 411 acquires photographing information of each drone 20 by receiving it from each base device 30, and stores the acquired photographing information of each drone 20 in the photographing information storage unit 451.

  The identification information detection unit 412 detects the pallet label 52 from the image by performing image analysis on the imaging information stored in the imaging information storage unit 451 using an existing image analysis technique. Further, the identification information detection unit 412 detects the article identification information by decoding the two-dimensional code described in the detected pallet label 52. Further, the identification information detection unit 412 associates the position information included in the imaging information to be detected with the article identification information. Then, the identification information detecting unit 412 outputs the associated position information and article identification information to the existing position specifying unit 413.

  The existence position specifying unit 413 specifies the actual existence position of each of the pallets 51 (the items stored in the pallets 51) based on the item identification information and the position information input from the identification information detection unit 412. That is, the existence position specifying unit 413 specifies that the article stored in the pallet 51 corresponding to the article identification information exists at the position corresponding to the position information. Further, the existence position specifying unit 413 causes the specific information storage unit 452 to store the actual position of each specified article.

  The inventory data acquisition unit 414 acquires the inventory information of the articles stored in each pallet 51 managed by the inventory management device 10 by communicating with the inventory management device 10. For example, the inventory data acquisition unit 414 requests the inventory management device 10 for current inventory information of the article. Further, the inventory data acquisition unit 414 outputs the current inventory information of the article returned from the inventory management device 10 to the data matching unit 415 in response to the request. The current inventory information of the article may be voluntarily transmitted from the inventory management device 10 without requiring a request from the inventory data acquisition unit 414.

  The data matching unit 415 includes the actual existence position of the article stored in each pallet 51 identified by the existence position identification unit 413 based on the shooting information and the article management information input from the inventory data acquisition unit 414. The positions of the managed articles are compared, and the result of the comparison is output. The output of the matching result is realized by, for example, displaying on the display unit 47, printing on a paper medium using another terminal (not shown) used by the user, or a printer (not shown). A specific example of the output matching result will be described later with reference to FIG.

[Data matching process]
Next, the flow of the data matching process executed by the information processing system S will be described with reference to the sequence diagram of FIG. As described above, the data matching process is to specify the actual existence position of the article stored in each pallet 51 based on the photograph of the drone 20, and to store the actual existence position of the identified article and the management information. This refers to a series of processes for collating the included management arrangement positions and the like.
The data matching process is periodically performed when the operation of the information processing system S starts. As a premise of the data reconciliation process, the inventory information management unit 111 also periodically manages the inventory information.

In step S11, the base device 30 supplies power to the drone 20.
In step S12, the drone 20 determines whether a predetermined time zone for performing autonomous flight and photographing has arrived. If the predetermined time period has arrived, it is determined as Yes in step S12, and the process proceeds to step S13. On the other hand, when the predetermined time zone has not arrived, No is determined in step S12, and the power supply in step S11 is continued.

In step S13, the drone 20 generates shooting information by performing autonomous flight and shooting.
In step S <b> 14, the drone 20 determines whether or not all the positions of the shelf 53 to be photographed have been photographed and the generation of the photographing information based on the photographing has been completed. When the generation of the photographing information is completed, Yes is determined in step S14, and the process proceeds to step S15. On the other hand, if the generation of the shooting information has not been completed, No is determined in step S14, and the generation of the shooting information in step S13 continues.

In step S15, the drone 20 returns to the base device 30 corresponding to itself, and transmits the imaging information generated in step S13 to the base device 30.
In step S16, the base device 30 transmits the imaging information received in step S15 to the information processing device 40.

In step S17, the base device 30 performs power supply to the drone 20 again.
In step S18, the information processing device 40 detects article identification information by performing image analysis or the like on the photographing information received in step S16.

In step S19, the information processing device 40 specifies the actual existence position of the article stored in each pallet 51 based on the article identification information detected in step S18 and the corresponding position information.
In step S20, the information processing device 40 requests the stock management device 10 for current stock information of the article.

In step S21, the inventory management device 10 transmits the current item inventory information to the information processing device 40 as a response to the request in step S20.
In step S22, the information processing apparatus 40 includes the actual existence position of the article stored in each pallet 51 specified in step S19 and the inventory information of the article transmitted from the inventory management apparatus 10 in step S21. The arrangement positions of the items on the management are collated.
In step S23, the information processing device 40 outputs the result of the abutment performed in step S23.

By performing the above-described data matching processing, in the present embodiment, it is possible to eliminate the need for labor such as manual visual inspection and manual bar code scanning. Further, even if the warehouse is large-scale or the ceiling height of the warehouse is high, the present embodiment can be applied.
In the present embodiment, since the drone 20 performs autonomous flight using a sensor or the like, data matching processing is performed in an indoor warehouse or the like where it is difficult to perform positioning or the like by GPS (Global Positioning System). be able to.

  Further, in the present embodiment, since the pallet label 52 generally used in the management of articles in the warehouse is read and used, there is no need to separately prepare a module such as an RFID (Radio Frequency IDentifier). That is, according to the present embodiment, the data matching process can be performed at low cost. In addition, in the present embodiment, since a two-dimensional code is used instead of a one-dimensional barcode that needs to be photographed with high precision in order to perform decoding, an image photographed during flight can be photographed with such high precision. Even if the decoding has not been performed, decoding can be performed.

Furthermore, in the present embodiment, since it is not necessary to perform processing such as detection of a two-dimensional code by image analysis and decoding of the detected two-dimensional code in the drone 20, it is possible to suppress the arithmetic processing capability required for the drone 20. Can be. Accordingly, the power consumption of the drone 20 can be reduced, and the drone 20 itself can be easily reduced in size.
That is, according to the present embodiment, it is possible to more easily manage the articles.

[Example of output of processing result of data matching process]
Next, with reference to FIG. 8, an example of the output of the result of the data matching process will be described. Here, FIG. 8 is an image diagram showing an example of the display of the result of the data matching process in the information processing system S.
As shown in FIG. 8, this display example includes three display areas, a display area AR1, a display area AR2, and a display area AR3.

  A first operation button is displayed in the display area AR1. The first operation button is a user interface for the user to instruct printing of the result of the comparison. The user performs an operation of pressing the first operation button when the user wants to print the matching result.

  A second operation button is displayed in the display area AR2. The second operation button is a user interface for the user to instruct output of the data of the matching result in a predetermined format (here, for example, a CSV (comma-separated values) format). The user performs an operation of pressing the second operation button when the user desires to output the result data in a predetermined format. The output destination of the data may be the storage unit 45 included in the information processing apparatus 40, or may be output to another terminal (not shown) used by the user as described above.

  In the display area AR3, the matching result is displayed in a predetermined format (in this example, a table format). Here, the reconciliation result indicates, for example, whether or not the article exists at a position corresponding to the arrangement position of the article on management included in the stock information of the article managed by the stock management device 10. Information, information indicating whether there is an article not included in the stock information, and information indicating whether an article included in the stock information does not exist.

  Specifically, “item: DRONE_LOCATION NO.” Is information indicating the actual position of the article specified by photographing on the drone 20 in the data matching process. Also, “item: DRONE” _PALLET NO. "Is information indicating the article identification information specified by imaging on the drone 20 in the data matching process.

  On the other hand, “item: IPA_LOCATION NO.” Is a management arrangement position of the article included in the stock information of the article. “Item: IPA_PALLET NO.” Is information indicating the article identification information of the article on management included in the stock information of the article. It should be noted that since the same item is matched, “item: DRONE_PALLET NO.” And “item: IPA_PALLET NO.” Store the item identification information of the same item (that is, the same item identification information). .

“Item: IPA_PRODUCT CODE” stores a product number of an article.
Further, “item: IPA_SUB INVENTORY” stores status information of the article.

Further, “item: IPA_ARRIVED DATE” stores information indicating the date when the pallet 51 storing the articles arrives at the warehouse.
Further, “item: IPA_QUANTITY” stores the carton quantity of the article.

Further, “item: IPA_PACKAGES” stores the package quantity of the article.
Further, in “item: IPA_DAMAGE FLAG”, information indicating whether or not the article has damage such as a scratch or breakage is stored as a flag.

Further, “item: CHECKED DATE” stores information indicating a date on which the autonomous flight and shooting by the drone 20 were performed.
Further, “item: CHECKED TIME” stores information indicating a time zone in which the autonomous flight and imaging by the drone 20 are performed.

  Further, "item: RESULT" stores information indicating a result of the data matching process. The information indicating the matching result is information indicating whether or not the article exists at a position that matches the management arrangement position of the article included in the stock information of the article.

  “Item: RESULT ANALYSIS” stores information indicating a more detailed matching result obtained by analyzing the matching result in the data matching process. Information indicating a more detailed matching result is, for example, information “1: OK” indicating that an article is present at a position that matches the management arrangement position of the article included in the stock information of the article, The information “2: Wrong Location” indicating that an article exists at a position that does not match the management article placement position included in the article inventory information, or the management information included in the article inventory information Information "3: Missing" indicating that the article could not be found, information "4: Non-Stocked" indicating that an article that is not an administrative article included in the stock information of the article was found, "5: Non-Stock" indicates that an article which is not a management article included in the stock information of the article is found, but the kind of the article cannot be analyzed. d (Decode Failed) ", information indicating that the analysis of the two-dimensional code has failed," 6: Decode Failed ", and" 7: Non-Located "indicating that the location information has not been correctly assigned. Information, such as “Found Hold”, indicating that a reserved item exists at a position that does not match the management item placement position included in the item inventory information, or included in the item inventory information. Information indicating whether or not there is damage at a position that does not match the arrangement position of the managed item is “Found Damaged” indicating that there is an item stored as a flag.

  The user who has referred to the information indicating the result of the matching in the data matching process can know whether or not the article exists at an appropriate position according to the stock information for each article. Further, even if the article is not located at an appropriate position, the user can know that the article is located at another position. Further, the user can know that there is an article that is not included in the stock information in the first place. Thereby, for example, the user moves the article in the warehouse to an appropriate position, or corrects the stock information managed by the stock management apparatus 10 so that the stock information is the same as the actual article location. , And so on. In addition, the user can visually check the actual thing about the article that could not be analyzed. Note that the information processing device 40 may notify the user of the contents of such specific countermeasures in accordance with the result of the data matching process.

  Further, “item: FINAL RESULT” stores information indicating a result of a match when the user visually checks the position of the article. As described above, the user may visually check an article or the like that could not be analyzed in the data matching process. In such a case, information is stored in “item: FINAL RESULT”. The type of information stored in “item: RESULT ANALYSIS” is the same as the type of information such as “1: OK” stored in “item: RESULT” described above. Therefore, a duplicate description is omitted here.

  Further, “item: PICTURE” functions as a user interface for displaying an image photographed on the drone 20 in the data matching process. The user can cause the drone 20 to display an image photographed by photographing by performing an operation of checking a check box provided in “item: PICTURE”. Thereby, the user can refer to the images of the pallet 51 and the pallet label 52, and can visually recognize the state of the pallet 51 and specify the article identification information. Therefore, it is possible to reduce the trouble of the user visually confirming the actual product.

Although some embodiments of the present invention have been described above, these embodiments are merely examples and do not limit the technical scope of the present invention. The present invention can take various other embodiments, and various changes such as omissions and substitutions can be made without departing from the gist of the present invention. These embodiments and their modifications are included in the scope and gist of the invention described in this specification and the like, and are also included in the invention described in the claims and their equivalents.
For example, the embodiment of the present invention may be modified as in the following modified examples.

<First Modification>
In the above-described embodiment, the drone 20 has realized the autonomous flight by specifying the current position without using the GPS. However, the present invention is not limited thereto, and the drone 20 may realize autonomous flight using the positioning result by the GPS in an environment in which a signal from a satellite in the GPS can be received.

<Second modification>
In the above-described embodiment, the drone 20 generates the shooting information by performing the autonomous flight and shooting when a predetermined time zone has arrived. The invention is not limited thereto, and the drone 20 may generate the shooting information by performing the control flight and the shooting in response to an instruction from the user. Further, the drone 20 may fly in response to a user operation, instead of flying autonomously.

<Third Modification>
In the above embodiment, the photographing information relay unit 311 of the base device 30 transmits the photographing information acquired from the drone 20 to the information processing device 40. That is, the photographing information relay unit 311 relays the photographing information. However, the invention is not limited thereto, and the drone 20 and the information processing device 40 may be communicably connected to each other directly or via a network. Then, the drone 20 may transmit the shooting information to the information processing device 40 without passing through the base device 30.

  Further, the present invention is not limited to the above-described embodiment, and includes modifications and improvements as long as the object of the present invention can be achieved.

For example, the series of processes described above can be executed by hardware or can be executed by software. Further, each of the functional blocks described above may be configured by hardware alone, may be configured by software alone, or may be configured by a combination thereof.
In other words, the functional configurations illustrated in FIGS. 3, 4, 5, and 6 are merely examples, and are not particularly limited. That is, it is sufficient that the information processing system S has a function capable of executing the series of processes described above as a whole, and what kind of functional blocks are used to realize this function is particularly described in FIGS. However, the present invention is not limited to the examples shown in FIGS.

  For example, the functional configuration included in the present embodiment can be realized by a processor that executes arithmetic processing, and a processor that can be used in the present embodiment includes various types of processors such as a single processor, a multiprocessor, and a multicore processor. In addition to those constituted by a single processing device, the present invention also includes a combination of these various processing devices and a processing circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field-Programmable Gate Array).

When a series of processing is executed by software, a program constituting the software is installed in a computer or the like from a network or a recording medium.
The computer may be a computer embedded in dedicated hardware. Further, the computer may be a computer that can execute various functions by installing various programs, for example, a general-purpose personal computer.

  A recording medium including such a program may be provided to the user by being distributed separately from the apparatus main body in order to provide the program to the user, or provided to the user in a state where the recording medium is incorporated in the apparatus main body in advance. Is also good. The storage medium distributed separately from the apparatus main body is composed of, for example, a magnetic disk (including a floppy disk), an optical disk, or a magneto-optical disk. The optical disk is composed of, for example, a CD-ROM (Compact Disk-Only Memory), a DVD (Digital Versatile Disk), a Blu-ray (registered trademark) Disc (Blu-ray Disc), and the like. The magneto-optical disk is composed of an MD (Mini-Disk) or the like. The recording medium provided to the user in a state in which the program is pre-installed in the apparatus main body is, for example, the ROM 12 in FIG. 3, the ROM 22, in FIG. 4, the ROM 32 in FIG. 5, and the ROM 42 in FIG. The storage unit 15 shown in FIG. 3, the storage unit 25 shown in FIG. 4, the storage unit 35 shown in FIG. 5, and an auxiliary storage device such as a hard disk included in the storage unit 45 shown in FIG.

In this specification, the steps of describing a program recorded on a recording medium may be performed in chronological order according to the order, or in parallel or individually, even if not necessarily performed in chronological order. This also includes the processing to be executed.
Also, in this specification, the term system refers to an entire device including a plurality of devices and a plurality of means.

Reference Signs List 10 inventory management device 20 drone 30 base device 40 information processing device 11, 21, 31, 41 CPU
12, 22, 32, 42 ROM
13, 23, 33, 43 RAM
14, 24, 34, 44 Communication unit 15, 25, 35, 45 Storage unit 16, 46 Input unit 17, 47 Display unit 26 Imaging unit 27 Drive unit 28 Sensor unit 29 Battery 36 Power supply unit 51 Pallet 52 Pallet label 53 Shelf 111 Inventory information management unit 151 Inventory information storage unit 211 Schedule management unit 212 Flight control unit 213 Imaging information generation unit 251 Schedule storage unit 252 Position detection information storage unit 253 Imaging information storage unit 311 Imaging information relay unit 312 Power supply control unit 351 Imaging information Storage unit 411 Photographing information acquisition unit 412 Identification information detection unit 413 Location identification unit 414 Inventory data acquisition unit 415 Data matching unit 451 Photography information storage unit 452 Specific information storage unit S Information processing system

Claims (8)

From a flying object that has flown at the location of the article, receiving means for receiving shooting information in which an image captured by the flying object is associated with information indicating a position where the flying object is captured,
Detecting means for detecting identification information of the article from an image included in the photographing information;
From the identification information detected by the detection unit and the position where the flying object is captured in the imaging information that is the detection target by the detection unit, the identification unit that identifies the location of the article,
An information processing apparatus comprising: Acquisition means for acquiring management information on the article from management means at the location of the article,
The management information obtained by the obtaining unit, and a matching unit that matches the position of the article specified by the specifying unit, and outputs a result of the matching,
The information processing apparatus according to claim 1, further comprising: The result of the matching is information indicating whether the article is present at a position that matches the management information, information indicating whether the article not included in the management information is present, and the management information Including at least one of the information indicating whether there is no article included in the
The information processing device according to claim 2. The identification information of the article is provided as a two-dimensional code to the storage container or the article of the article,
The information processing apparatus according to claim 1. In the arrangement location of the articles, the articles are arranged side by side in the horizontal direction and are stacked and arranged in the vertical direction,
The information indicating the position photographed by the flying object is information indicating a two-dimensional position photographed by the flying object.
The information processing apparatus according to claim 1. An information processing system including the information processing device according to any one of claims 1 to 5 and the flying object,
The flying object is
Flight control means for controlling the flight of the aircraft at the location of the article,
Shooting means for shooting during the flight,
Generating means for generating shooting information in which the image shot by the shooting means is associated with information indicating a position where the flying object is shot;
Comprising,
Information processing system. The location of the article is divided into predetermined sections,
The flying object is arranged for each of the predetermined sections,
The information processing system according to claim 6. On the computer,
An acquisition function for acquiring shooting information in which an image taken by the flying object and information indicating a position where the flying object is taken from the flying object that has flown at the location where the article is located,
From an image included in the shooting information, a detection function of detecting identification information of the article,
From the identification information detected by the detection function and the position where the flying object is included in the imaging information that is the detection function as the detection target, a specification function of specifying the location of the article,
Information processing program that realizes.

Images