GB2638662A

GB2638662A - Improvements relating to robotic systems for picking and/or sorting objects

Info

Publication number: GB2638662A
Application number: GB2402021.6A
Authority: GB
Inventors: Ma Xiaoyan
Original assignee: Danu Robotics Ltd
Current assignee: Danu Robotics Ltd
Priority date: 2024-02-14
Filing date: 2024-02-14
Publication date: 2025-09-03
Also published as: GB202402021D0

Abstract

An object tracking system 1 for robotic systems (10 figure 3) for picking and/or sorting objects (16 figure 3), in particular waste items, a receives a plurality of data sets 2, each derived from an image frame 4 generated by a vision system 5. Each data set 2 comprises one or more data subsets 6, each comprising object identification data relating to an object (16 figure 3) of a class to be picked and/or sorted by the robotic system. The object tracking system 1 assigns a unique identifier such as a set of co-ordinates to each data subset 6 and compares, or outputs for comparison, the data sets 2 to determine whether they contain one or more of the data subsets 6 and determine a change in the unique identifier of said data subsets 6, said change being indicative of a change in position of the object (16 figure 3) to be picked and/or sorted, permitting the position of said object (16 figure 3) to be tracked. Also disclosed is a work scheduler 7 which receives a plurality of data sets 2, each comprising one or more data subsets 6 comprising object identification data relating to an object (16 figure 3) of a class to be picked and/or sorted by the robotic system (10 figure 3). The work scheduler 7 receives a unique identifier relating to each of the data subsets 6 from the object tracking system 1 and outputs one or more command signals to a robotic picker arrangement 20 of the robotic system (10 figure 3).

Description

IMPROVEMENTS RELATING TO ROBOTIC SYSTEMS FOR PICKING AND/OR SORTING OBJECTS

FIELD

This relates to improvements relating to robotic systems for picking and/or sorting objects, in particular but not exclusively waste items. More particularly, this relates to an object tracking system and method for a robotic system for picking and/or sorting objects, and associated systems and methods, and to a work scheduler system and method for a robotic system for picking and/or sorting objects, and associated systems and methods.

BACKGROUND

The extraction of recyclable materials from waste, such as household waste, textile waste, e-waste and construction waste, plays a significant role in meeting environmental targets, not least in terms of the reduction of material sent to landfill -and associated pollution and land use concerns -but also in the ability to supply materials without the need to extract, refine and/or process raw materials.

However, conventional methods for processing of waste in order to extract recyclable materials suffers from a number of drawbacks.

For example, many waste management companies rely on manual operatives to pick and/or sort waste items. While established/larger waste management companies can invest in material recovery facilities (MRFs) to process and recycle domestic waste, which may employ automation, MRFs still utilise human operatives in order to perform certain tasks.

However, it will be recognised that the manual processing of waste is profoundly inefficient, requires significant investment in personnel, and is inevitably subject to human error, which can result in reduced recycling performance.

For example, waste management companies are required to produce recyclable outputs with a high level of purity, not only to meet regulatory requirements but also to maintain resale value at a commercially viable level.

Moreover, the recyclable output generated from conventional processing methods often contains a high percentage of contaminants. In addition to the health and safety risk to operatives, the handling of contaminants results in a significant amount of material being rejected and either sent to landfill and/or requiring additional manual picking and/or sorting processes.

Thus, in addition to the direct environmental costs associated with conventional processing methods, the associated operational inefficiencies result in significant additional costs to the recycling and/or reuse companies.

Although currently, robotic waste sorting systems are being offered to the market, these are large in size, are expensive to install and limited in their capabilities. For example, conventional robotic systems utilising general purpose robots cannot pick out more than one object at a time. Moreover, conventional robotic system are not capable of objects which are located close to each other and/or overlay each other. As such, it is estimated that conventional robotic systems can only automate 10-20% of the manual sorting process.

SUMMARY

Aspects of the present disclosure relate to improvements relating to robotic systems for picking and/or sorting objects, in particular but not exclusively waste items. More particularly, aspects of the present disclosure relate to an object tracking system and method for a robotic system for picking and/or sorting objects, and associated systems and methods, and to a work scheduler system and method for a robotic system for picking and/or sorting objects, and associated systems and methods.

According to a first aspect, there is provided an object tracking system for a robotic system for picking and/or sorting objects, the object tracking system configured and/or operable to: (a) receive a plurality of data sets from one or more objection detection algorithms, wherein each data set is derived from an image frame generated by a vision system forming part of, coupled to or operatively associated with the robotic system, wherein the plurality of data sets includes a first data set from an image frame taken at a first time instance and a second data set from an image frame taken at a second, subsequent, time instance to said first data set, and wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which said robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) assign a unique identifier to each of said one or more data subsets; and (c) compare, or output for comparison, said first and second data sets to: determine whether they contain one or more of the data subsets; and determine a change in the unique identifier of said one or more data subsets, said change in the unique identifier being indicative of a change in position of said object to be picked and/or sorted, and thereby permitting the position of said object to be picked and/or sorted on said conveyor arrangement to be tracked.

The object tracking system may be configured and/or operable for use in a robotic system for picking and/or sorting objects and which comprises a robotic picker arrangement operatively associated with the conveyor arrangement. The robotic picker arrangement may comprise a plurality of robotic pickers. Each robotic picker may be configured to pick up a selected one or more of said objects from the conveyor arrangement.

In use, the object tracking system is configured and/or operable to track one or more objects to be picked and/or sorted, in particular embodiments waste items, as they are conveyed by the conveyor arrangement.

Beneficially, the object tracking system facilitates the accurate tracking of objects to be picked and/or sorted throughout their time on the conveyor arrangement, including in instances where the position of the object moves during the conveying process, thereby facilitating greater accuracy and/or efficiency of picking and/or sorting by the robotic picker arrangement. The object tracking system may facilitate the accurate and efficient tracking of the position and/or trajectory of multiple objects simultaneously. Alternatively or additionally, the object tracking system may identify instances where an object has fallen off the conveyor and/or have been removed by a manual operative or by the robotic picker arrangement, facilitating greater accuracy and/or efficiency of operation. Moreover, the present object tracking system may facilitate real time tracking of objects.

The object tracking system may be implemented in software.

The object tracking system may comprise or take the form of an object tracking algorithm.

The object tracking algorithm may utilise artificial intelligence.

The object tracking system may employ one or more of: a deep neural network; and a deep reinforcement learning algorithm.

As described above, the object tracking system is configured and/or operable to receive a plurality of data sets from one or more objection detection algorithms, wherein each data set is derived from an image frame generated by a vision system forming part of, coupled to or operatively associated with the robotic system.

The vision system may comprise a camera arrangement.

The camera arrangement may comprise one or more cameras.

The camera arrangement may comprise one or more RGB cameras.

Beneficially, the provision of one or more RGB cameras allows the system to

cover a long range of field of view.

At least part of the vision system may be disposed at an upstream location relative to the plurality of robotic pickers.

Part of the vision system may be disposed on the robotic picker arrangement. For example, part of the vision system may be disposed on a robotic arm of the robotic picker arrangement. Alternatively or additionally, part of the vision system may be disposed on a frame of a robotic picker of the robotic picker arrangement.

The object tracking system may comprise, may be coupled to or configured to communicate with a processing system.

The processing system may be configured and/or operable to implement (a) to (c) described above.

The processing system may be configured and/or operable to implement one or more of the object detection algorithms.

The processing system may be configured and/or operable to output one or more command signals to a robotic picker arrangement of the robotic system to position one or more robotic pickers of the robotic picker arrangement relative to the conveyor arrangement to permit said one or more robotic pickers to pick up the selected object to be picked and/or sorted from the conveyor arrangement.

The processing system may be configured and/or operable to receive sensor data relating to the objects being conveyed by the conveyor arrangement from a sensor arrangement forming part of, coupled to or operatively associated with the robotic system. The vision system may form or form part of the sensor arrangement.

The sensor arrangement may comprise a camera. The camera may comprise or take the form of a stereo camera. The camera may comprise or take the form of a 2D camera. The sensor arrangement may comprise a remote sensing device, e.g. LIDAR. The sensor arrangement may comprise an RGB sensor.

In particular embodiments, the sensor arrangement comprises a vision system including one or more camera, one or more remote sensing device, e.g. LIDAR, and one or more RGB sensor and the processing system may employ sensor fusion techniques, e.g. a sensor fusion algorithm.

The sensor arrangement may comprise one or more sensors configured to measure electrical resistance of objects on the conveyor arrangement.

The sensor arrangement may comprise one or more sensors configured to measure light refraction of objects on the conveyor arrangement.

The sensor arrangement may comprise one or more sensors configured to produce 3d point cloud data relating to objects on the conveyor arrangement.

At least part of the sensor arrangement may be disposed at an upstream location relative to the plurality of robotic pickers.

At least part of the sensor arrangement may be disposed on a frame, pole, upright member or the like. In particular embodiments, at least part of the sensor arrangement may be disposed on a frame. At least part of the frame extends over, or at least partially over, one or more conveyors of the conveyor arrangement. At least part of the frame extends over, or at least partially over, one conveyor. Alternatively, at least part of the frame extends over, or at least partially over, a plurality of conveyors of the conveyor arrangement.

The frame may comprise one or more ground engaging members. The one or more ground engaging members may comprise or take the form of an upright or substantially upright member, stanchion or the like. The frame may comprise a horizontal or substantially horizontal member. The horizontal or substantially horizontal member may be coupled to one or more of the ground engaging members. The horizontal or substantially horizontal member may be integrally formed with the one or more of the ground engaging members.

Part of the sensor arrangement may be disposed on the robotic picker arrangement. For example, part of the sensor arrangement may be disposed on a robotic arm of the robotic picker arrangement. The sensor arrangement may comprise one or more sensors disposed on the robotic arm. The one or more sensors may comprise or take the form of a camera.

Alternatively or additionally, part of the sensor arrangement may be disposed on a frame of a robotic picker of the robotic picker arrangement. The sensor arrangement may comprise one or more sensors disposed on the frame of the robotic picker. The one or more sensors may comprise or take the form of a camera.

In use, the sensor arrangement disposed on the robotic arm and/or the frame of the robotic picker may be utilised to supplement the data from the sensor arrangement disposed upstream of the robotic picker arrangement, thereby providing a more accurate indication of the position of the robotic picker and/or the object to be picked and/or sorted.

The processing system may be configured to interrogate said received sensor data using the object detection algorithm to determine from the received sensor data whether any one of the objects being conveyed by the conveyor arrangement corresponds to the predetermined class of objects to be picked and/or sorted by the robotic system.

The processing system may be configured to receive positional data relating to the object to be picked and/or sorted from the sensor arrangement.

The processing system may be configured to receive velocity data relating to the object to be picked and/or sorted from the sensor arrangement and/or the conveyor arrangement.

The processing system may be configured to interrogate said received positional and/or velocity data to determine a predicted position of the object to be picked and/or sorted as it passes the robotic picker arrangement.

As described above, the object tracking system is configured and/or operable to receive a plurality of data sets from one or more objection detection algorithms.

Beneficially, the use of an object detection algorithms permits a wide range of objects, e.g. waste items and/or contaminants lying on the conveyor, to be identified.

The object tracking system may be configured and/or operable to receive a plurality of data sets from a single objection detection algorithm or a plurality of objection detection algorithms. For example, a given objection detection algorithm may be utilised to identify and/or classify a particular class of objects. Alternatively, a given objection detection algorithm may be utilised to identify and/or classify a plurality of classes of objects.

One or more of the object detection algorithms may implement artificial intelligence. One or more of the object detection algorithms may employ: a deep neural network; and/or a deep reinforcement learning algorithm. At least one of the object detection algorithms may be trained on a labelled training set.

The data sets may relate to a single object, more particularly a single class of objects. However, in particular embodiments, the data sets may relate to a plurality of objects, more particularly classes of objects to be picked and/or sorted.

The plurality of data sets includes a first data set from an image frame taken at a first time instance and a second data set from an image frame taken at a second, subsequent, time instance to said first data set. However, it will be recognised that the plurality of data sets may include any number of further data sets, e.g. n data sets where n is greater than 2.

The data sets may comprise or take the form of still images or video images.

As described above, the object tracking system is configured and/or operable to assign a unique identifier to each of said one or more data subsets received from the objection detection algorithm.

The unique identifier may take a variety of different forms.

The unique identifier may comprise a set of co-ordinates.

As described above, each data subset comprises object identification data relating to an object being conveyed by a conveyor arrangement with which said robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system.

Each data subset may thus represent an individual object, facilitating tracking of the object as it is conveyed by the conveyor arrangement.

As described above, the object tracking system is configured and/or operable to compare, or output for comparison by a processing system, said first and second data sets.

The processing system may form part of the object tracking system.

Alternatively, the processing system may form part of the robotic system or may comprise a remote processing system.

The object tracking system may comprise, may be coupled to, or may be operatively associated with a work scheduler system.

The work scheduler system may be configured and/or operable to receive the object identification data relating to the objects being conveyed by a conveyor arrangement.

The work scheduler system may be configured and/or operable to receive the unique identifier relating to each of the objects being conveyed by a conveyor arrangement.

The work scheduler system may be configured to output one or more command signals to the robotic picker arrangement to position one of said robotic pickers relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.

The work scheduler system may be partially or wholly implemented in software.

The work scheduler system may comprise or take the form of a work scheduler algorithm.

The work scheduler system may implement artificial intelligence. The work scheduler system may employ one or more of: a deep neural network; and a deep reinforcement learning algorithm.

Beneficially, the work scheduler system may facilitate real time and/or adaptive scheduling of tasks to the robotic pickers of the robotic picker arrangement, thereby facilitating greater accuracy and/or efficiency of operations by permitting all relevant objects to be picked and/or sorted; in contrast to conventional, static, that simply receives and sends an instruction.

The present work scheduler system is intelligent in the sense that the object detection tracking system will send the real time information regarding an object, e.g. waste item, to the work scheduler system. It will gain knowledge about the object through object detection and tracking model, and then assign to the most appropriate picker rather than just send any job to any available picker. Secondly, the present work scheduler system is interactive, in the sense that it will not only send instructions to a robotic picker for picking out certain types of object, e.g. waste item, it may also receive feedback from the robotic pickers. For example, if one picker fails to pick up an object, it will let work scheduler system know, and the work scheduler system may reassign this task to another of the robotic pickers, thereby increasing the likelihood that all objects are picked out.

According to a second aspect, there is provided an object tracking method for a robotic system for picking and/or sorting objects, the method comprising the steps of: (a) receiving a plurality of data sets from one or more objection detection algorithms, wherein each data set is derived from an image frame generated by a vision system forming part of, coupled to or operatively associated with the robotic system, wherein the plurality of data sets includes a first data set from an image frame taken at a first time instance and a second data set from an image frame taken at a second, subsequent, time instance to said first data set, and wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which said robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system, and (b) assigning a unique identifier to each of said one or more data subsets; (c) comparing, or outputting for comparison by a processing system, said first and second data sets to: determine whether they contain one or more of the data subsets; and determine a change in the unique identifier of said one or more data subsets, said change in the unique identifier being indicative of a change in position of said object to be picked and/or sorted, and thereby permitting the position of said object to be picked and/or sorted on said conveyor arrangement to be tracked.

The method may be implemented by the object tracking system of the first aspect.

According to a third aspect, there is provided a robotic system for picking and/or sorting objects, comprising the object tracking system of the first aspect.

The robotic system may comprise a collaborative robotic picker arrangement operatively associated with the conveyor arrangement.

In use, the robotic system is installed relative to a conveyor arrangement such that the robotic picker arrangement of the robotic system is capable of picking up objects from the conveyor arrangement.

The robotic system may comprise or take the form of an integrated robotic picking and/or sorting system, e.g. a central operating system of the robotic system may be configured and/or operable to communicate high level instructions to each of the plurality of robotic pickers and receive feedback from them.

The robotic system may comprise or take the form of a distributive robotic picking and/or sorting system, e.g. the robotic pickers each form a component part of the robotic system instead of being an independent robotic system.

The robotic system may comprise or take the form of a modular robotic picking and/or sorting system, e.g. each of the plurality of robotic pickers may have its own local operating system and may be configured and/or operable to execute instructions sent by the central operating system of the robotic system and/or communicate with the central operating system.

The robotic system provides a number of significant benefits compared to conventional systems and techniques for picking and/or sorting objects. For example, the system is operable as one, integrated, system to sort different items, e.g. waste items, simultaneously. Rather than a collection of independent robots, the robotic pickers of the robotic system work as an organised team. Amongst other things, this provides benefits in terms of the greater flexibility that the robotic system can offer in comparison to conventional systems and methods. Each individual robotic picker may have its own speciality and each robotic picker may be individually designed to perform a number of unique picking tasks.

For example, in the waste processing and recycling sector a picker may be specialised to pick out wires, tapes and plastic bags. Another picker may be designed to pick out nappies. Another picker maybe designed to pick out batteries or other e-waste.

It will be understood that the robotic system may be configured and/or operable to pick and/or sort objects in a variety of sectors, including for example but not exclusively the construction sector, the e-waste sector and/or the textile sector. In the construction sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: waste wood; tarpaulins; metal bars; metal box sections; and/or rubble. In the e-waste sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: printed circuit boards; valves; wires; and/or electrical components such as capacitors, resistors, diodes, etc. In the textile sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: cotton materials; nylon materials; synthetic fabric materials; hemp materials, uniforms; and/or accessories such as belts.

Moreover, the robotic system can have any number of robotic pickers as required and may be configured as required for processing certain types of objects, e.g. particular types of waste items. The robotic system may thus be readily scalable, e.g. having as many robotic pickers as required while still being one system. The provision of a distributive system also means that the picking tasks are distributed appropriately among the pickers with picking tasks assigned to pickers in line with each picker's speciality. As such, all pickers are performing tasks simultaneously and in parallel.

Since the processing system of the robotic system may provide command signals to a plurality of robotic pickers, the robotic system is capable to operating the robotic pickers collaboratively. This facilitates a greater capacity in terms of the volume of objects that can be picked and/or sorted and/or a greater capacity in terms of the types of objects that can be picked and/or sorted at one time.

While each of the robotic pickers may be assigned a single class of objects to be picked and/or sorted, the provision of a collaborative robotic picker arrangement means that each of the robotic pickers can be assigned a plurality of classes of objects to be picked and/or sorted.

In particular embodiments, each robotic picker may be capable of picking and/or sorting all required classes of objects to be picked and/or sorted, the selected robotic picker assigned to a given object to be picked and/or sorted chosen by the processing system.

The robotic picker may be selected by the processing system according to a number of factors.

The processing system of the robotic system may be configured to receive positional data and/or operational status data relating to each of the robotic pickers. The processing system may interrogate the positional data and/or operational status relating to each of the robotic pickers and determine which of the robotic pickers to assign the selected object to be picked and/or sorted. For example, the processing system may interrogate the positional data and/or operational status relating to each of the robotic pickers and determine which of the robotic pickers is available at the predicted time the object passes the robotic picker arrangement and/or which robotic picker is closest to the object to be picked and/or sorted. The processing system may then assign the selected object to be picked and/or sorted to the selected one of the robotic pickers.

Beneficially, by working collaboratively as a team the robotic pickers may facilitate greater efficiency of operation, since the robotic pickers may be selected to reduce redundancy of each robotic picker and/or may be selected to reduce the travel distance to a given object to be picked and/or selected, thereby increasing response time and reducing energy use.

As described above, in the waste processing and recycling sector, human operatives are still currently involved in picking out contaminants, such as tapes, wires, nappies and plastic bags, and in verifying that different waste materials have been correctly sorted and, where necessary, carrying out remedial operations. As noted, such manual processes pose a significant health risk to operatives working in the vicinity of the waste processing system, both in terms of proximity to machinery and in terms of potential exposure to hazardous materials.

The robotic system may facilitate the efficient picking and/or sorting of such contaminants, thereby eliminating or at least reducing the exposure of personnel to these potentially hazardous materials. The robotic system may also facilitate greater efficiency in the identification of objects to be picked, thereby eliminating or at least reducing the need for manual verification. Greater efficiency in the identification of objects to be picked may reduce the presence of contaminants (i.e. objects which should have been picked out) in recyclables which may otherwise reduce their value and/or in some cases mean that they must be re-processed or in some cases render them unsuitable for further processing such that they must be sent to landfill.

As described above, the robotic system may comprise a robotic picker arrangement operatively associated with a conveyor arrangement for conveying objects to be sorted, and which comprises a plurality of robotic pickers each configured to pick up a selected one or more of said objects from the conveyor arrangement.

The robotic system may comprise, may be coupled to or operatively associated with the conveyor arrangement.

The conveyor arrangement may comprise one or more conveyors. At least of the conveyors may comprise or take the form of a conveyor belt.

The robotic picker arrangement may comprise any suitable number (greater than two) of the robotic pickers. For example, the system may comprise two robotic pickers, three robotic pickers, four robotic pickers, five robotic pickers, six robotic pickers, seven robotic pickers, eight robotic pickers or more than eight robotic pickers.

Beneficially, the robotic system can be easily scaled, such that the robotic system is highly flexible in terms of the size and/or type of facility in which the robotic system can be installed and/or employed. For example, the robotic system can be easily adapted in the event a given facility increases in size, without significant modification to the processing system infrastructure. Alternatively, the robotic system can be employed in facilities that were otherwise considered too small or remote to merit the investment needed for automation systems. In the case of waste management and/or recycling facilities, for example, the robotic system may be used in MRFs that were otherwise considered unsuitable for automation systems with the result that waste objects were transported to a more distant centralised facility requiring additional carbon footprint.

One or more of the robotic pickers may comprise or take the form of a floor-mounted robot.

One or more of the robotic pickers may comprise a frame. The robotic picker may be configured so that at least part of the frame extends over, or at least partially over, one or more conveyors of the conveyor arrangement. The robotic picker may be configured so that at least part of the frame extends over, or at least partially over, one conveyor. Alternatively, the robotic picker may be configured so that at least part of the frame extends over, or at least partially over, a plurality of conveyors of the conveyor arrangement.

The frame may comprise one or more ground engaging members. The one or more ground engaging members may comprise or take the form of an upright or substantially upright member, stanchion or the like. The frame may comprise a horizontal or substantially horizontal member. The horizontal or substantially horizontal member may be coupled to one or more of the ground engaging members.

One or more of the robotic pickers may comprise one or more robotic arms. The one or more robotic arms may be mounted on and carried by the frame.

The robotic picker may be configured to move, e.g. translate, the robotic arm relative to the frame. The robotic picker may be configured to move, e.g. translate, the robotic arm horizontally relative to the frame. Alternatively or additionally, the robotic picker may be configured to move, e.g. translate, the robotic arm vertically relative to the frame.

In use, the robotic picker may be configured to translate the robotic arm relative to the frame, so as to position the robotic arm laterally and/or vertically with respect to the conveyor arrangement.

The robotic picker may comprise an actuator arrangement for translating the robotic arm relative to the frame. The actuator arrangement may comprise or take the form of one or more linear actuator. The linear actuator may comprise or take the form of one or more belt driven linear actuator.

The one or more belt driven linear actuators may comprise a belt. The one or more belt driven linear actuators may comprise a first pulley wheel. The one or more belt driven linear actuators may comprise a second pulley wheel. The belt may be disposed on and around the first pulley wheel and the second pulley wheel.

The robotic picker may comprise a rail. The rail may comprise or define a linear slide bearing. The rail may form or form part of the horizontal or substantially horizontal member of the frame. The rail may form part of the actuator arrangement.

The robotic picker may comprise a drive arrangement. The drive arrangement may be coupled to or form part of the actuator arrangement. The drive arrangement may be operable under the control of the processing system.

The drive arrangement may comprise one or more drives. One or more of the drives may comprise or take the form of a motor. In particular embodiments, one or more of the drives may comprise or take the form of a servomotor.

The drive arrangement may comprise one or more drives, e.g. servomotors, configured to move the robotic arm from a first, vertical position to a second, vertical, position. More particularly, the one or more drives configured to move the robotic arm from the first, vertical, position to the second, vertical, position may move the horizontal or substantially horizontal member relative to the one or more ground-engaging members, so as to move the robotic arm from the first, vertical, position to the second, vertical, position. The one or more drives configured to move the robotic arm from the first, vertical, position to the second, vertical, position may define one or more first drives of the drive arrangement.

The drive arrangement may comprise one or more drives, e.g. servomotors, configured to move the robotic arm from a first, lateral, position to a second, lateral, position. More particularly, the one or more drives configured to move the robotic arm from the first, lateral, position to the second, lateral, position may move the robotic arm relative to the horizontal or substantially horizontal member. The one or more drives configured to move the robotic arm from the first, lateral, position to the second, lateral, position may define one or more second drives of the drive arrangement.

The drive arrangement may be configured to move the robotic arm vertically and/or laterally.

In some instances, the vertical and/or lateral movement may position the robotic arm at the selected location to pick up the object. In other instances, the robotic arm itself may complete the move to the required position to pick up the object.

The drive arrangement may be configured and/or operable to move the robotic arm vertically at a higher speed than when moving the robotic arm laterally.

In use, the drive arrangement may be operable to rapidly move the robotic arm from the first, vertical, position to the second, vertical, position and then move the robotic arm from the first, lateral, position to the second, lateral, position at a lower speed, i.e. a lower speed than the vertical movement.

Beneficially, this allows the system to move the robotic arm rapidly to the required location relative to the conveyor while also providing finer control over the final positioning of the robotic arm in order to accurately pick up the selected object to be picked and/or sorted.

Where the robotic arm itself completes the move to the required position to pick up the object, the drive arrangement may be configured and/or operable to move the robotic arm from the first, lateral, position to the second, lateral, position at a higher speed than the speed of movement of the robotic arm when completing the move to pick up the object.

The robotic picker may comprise a coupling arrangement for coupling the robotic arm to the actuator arrangement. The coupling arrangement may comprise or take the form of a carriage configured for coupling on the one hand to the actuator arrangement and on the other hand to the robotic arm. The robotic arm may be removably coupled to the carriage. Beneficially, this permits the robotic arm to be readily removed for repair and/or replaced by an alternative robotic arm.

The carriage may be disposed on the rail.

The robotic arm may comprise a first member. The robotic arm may comprise a second member. The second member may be coupled to and carried by the first member.

The robotic arm may comprise a manipulator. The manipulator may be coupled to and carried by the second member. The manipulator may be configured to pick up the object to be picked and/or sorted. The manipulator may comprise or take the form of a mechanical grasp. The manipulator may comprise or take the form of a vacuum gripper.

As described above, the system may comprise, may be coupled to or operatively associated with a sensor arrangement.

The sensor arrangement may comprise one or sensors configured to obtain the sensor data relating to the objects being conveyed by the conveyor arrangement.

The sensor arrangement may comprise one or more sensors configured to obtain the positional data relating to the object to be picked and/or sorted.

The sensor arrangement may comprise one or more sensors configured to obtain the velocity data relating to the object to be picked and/or sorted.

The sensor arrangement may comprise or take the form of a sensor array.

Each of the robotic pickers of the robotic picker arrangement may comprise an operating system.

Beneficially, the provision of robotic pickers each have an operating system facilitates distributed computing.

The robotic system may comprise a control system. The control system may comprise or take the form of hardware components configured to operate some or all of the processes of the processing system.

The control system may comprise one or more central processing units (CPU).

The control system may comprise one or more graphics processing units (GPU).

The control system may comprise one or more memory unit.

At least one of the CPUs, GPUs and memory units may be cloud-based.

Alternatively or additionally, at least one of the CPUs, GPUs and memory units may be local to the robotic system, that is may be disposed on the robotic system.

The control system may comprise or take the form of one or more Programmable Logic Controller (PLC).

The control system, or part of the control system, may form part of the robotic system.

The control system, or part of the control system, may be coupled to or operatively associated with the robotic system. For example, the control system may be located at one or more remote location. The remote location may comprise or take the form of a control room. Alternatively or additionally, the remote location may comprise or take the form of a mobile device such as tablet, mobile phone or the like.

Alternatively or additionally, the remote location may comprise or take the form of a data store, such as an online data store.

The robotic system may comprise a communication arrangement.

The communication arrangement may comprise or take the form of a wireless communication arrangement. The wireless communication arrangement may comprise a radio frequency communication arrangement. The communication arrangement may comprise or take the form of a transmitter or transceiver.

The communication arrangement may comprise or take the form of a wired communication arrangement. The wired communication arrangement may comprise or take the form of an electric wire and/or optical fibre communication arrangement.

The communication arrangement may comprise or take the form of a two-way communication arrangement. The communication arrangement may comprise or take the form of a transceiver.

In use, the processing system may receive information from the sensor arrangement and/or the conveyor arrangement, e.g. a control system of the conveyor arrangement, via the communication arrangement and communicate the one or more command signals to the robotic picker arrangement via the communication arrangement.

The robotic system may comprise one or more human machine interface. The human machine interface may comprise or take the form of one or more work stations. human machine interface may comprise or take the form of one or more graphical user interface. The human machine interface may comprise or take the form of a dashboard.

According to a fourth aspect, there is provided an object picking and/or sorting system comprising the object tracking system of the first aspect and/or one or more of the robotic systems according to the third aspect.

The object picking and/or sorting system may form part of a material recovery facility. Alternatively, the object picking and/or sorting system may take the form of a standalone system.

The object picking and/or sorting system may comprise, may be coupled to or operatively associated with a conveyor arrangement. Where the object picking and/or sorting system forms part of a material recovery facility, the object picking and/or sorting system may be coupled to or operatively associated with a conveyor arrangement of the material recovery facility. The conveyor arrangement may comprise one or more conveyors. At least of the conveyors may comprise or take the form of a conveyor belt.

The object picking and/or sorting system may comprise, may be coupled to or operatively associated with one or more bin, hopper or the like. Where the object picking and/or sorting system forms part of a material recovery facility, the object picking and/or sorting system may be coupled to or operatively associated with a bin, hopper or the like of the material recovery facility. The object picking and/or sorting system may comprise, may be coupled to or operatively associated with a plurality of the bins, hoppers or the like.

In use, the robotic system may be operable to pick up the selected one or more objects and place them in one of the bins, hoppers or the like.

According to a fifth aspect, there is provided a material recovery facility comprising one or more of the robotic systems according to the third aspect and/or one or more of the object picking and/or sorting systems according to the fourth aspect.

The material recovery facility may comprise a conveyor arrangement. The conveyor arrangement may comprise one or more conveyors. At least of the conveyors may comprise or take the form of a conveyor belt.

The material recovery facility may comprise one or more bin, hopper or the like. The material recovery facility may comprise a plurality of the bins, hoppers or the like.

According to a sixth aspect, there is provided a method for picking and/or sorting objects, using the robotic system of the third aspect and/or the object picking and/or sorting system according to the fourth aspect.

According to a seventh aspect, there is provided a work scheduler system for a robotic system for picking and/or sorting objects, the work scheduler system configured and/or operable to: (a) receive a plurality of data sets from one or more object detection algorithms, wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which the robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) receive a unique identifier relating to each of said one or more data subsets from an object tracking system; and (c) output one or more command signals to a robotic picker arrangement of the robotic system to position a robotic picker of the robotic picker arrangement relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.

The work scheduler system may be partially or wholly implemented in software.

The work scheduler system may comprise, may be coupled to, or may be operatively associated with the object tracking system of the first aspect.

According to an eighth aspect, there is provided work scheduler method for a robotic system for picking and/or sorting objects, the method comprising the steps of: (a) receiving a plurality of data sets from one or more object detection algorithms, wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which the robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) receiving a unique identifier relating to each of said one or more data subsets from an object tracking system; and (c) outputting one or more command signals to a robotic picker arrangement of the robotic system to position a robotic picker of the robotic picker arrangement relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.

According to a ninth aspect, there is provided a robotic system for picking and/or sorting objects, comprising the work scheduler system of the seventh aspect.

According to a tenth aspect, there is provided an object picking and/or sorting system comprising the work scheduler system of the seventh aspect and/or one or more of the robotic systems according to the ninth aspect.

According to an eleventh aspect, there is provided a material recovery facility comprising one or more of the robotic systems according to the ninth aspect and/or one or more object picking and/or sorting system according to the tenth aspect.

According to a twelfth aspect, there is provided a method for picking and/or sorting objects, using the robotic systems of the ninth aspect and/or the object picking and/or sorting system according to the tenth aspect.

According to another aspect, there is provided a processing system configured to implement one or more of the previous aspects.

The processing system may comprise at least one processor. The processing system may comprise and/or be configured to access at least one data store or memory. The data store or memory may comprise or be configured to receive operating instructions or a program specifying operations of the at least one processor.

The at least one processor may be configured to process and implement the operating instructions or program.

The at least one data store may comprise, and/or comprise a reader, drive or other means configured to access, optical storage or disk such as a CD or DVD, flash drive, SD device, one or more memory chips such as DRAMs, a network attached drive (NAD), cloud storage, magnetic storage such as tape or magnetic disk or a hard-drive, and/or the like.

The processing system may comprise a network or interface module. The network or interface module may be connected or connectable to a network connection or data carrier, which may comprise a wired or wireless network connection or data carrier, such as a data cable, powerline data carrier, Wi-Fi, Bluetooth, Zigbee, internet connection or other similar connection. The network interface may comprise a router, modem, gateway and/or the like. The system or processing system may be configured to transmit or otherwise provide the audio signal via the network or interface module, for example over the internet, intranet, network or cloud.

The processing system may comprise a processing apparatus or a plurality of processing apparatus. Each processing apparatus may comprise at least a processor and optionally a memory or data store and/or a network or interface module. The plurality of processing apparatus may communicate via respective network or interface modules. The plurality of processing apparatus may form, comprise or be comprised in a distributed or server/client based processing system.

According to another aspect, there is provided a computer program product configured such that when processed by a suitable processing system configures the processing system to implement one or more of the previous aspects.

The computer program product may be provided on or comprised in a carrier medium. The carrier medium may be transient or non-transient. The carrier medium may be tangible or non-tangible. The carrier medium may comprise a signal such as an electromagnetic or electronic signal. The carrier medium may comprise a physical medium, such as a disk, a memory card, a memory, and/or the like.

According to another aspect, there is provided a carrier medium, the carrier medium comprising a signal, the signal when processed by a suitable processing system causes the processing system to implement one or more of the previous aspects.

It will be well understood by persons of ordinary skill in the art that whilst some embodiments may implement certain functionality by means of a computer program having computer-readable instructions that are executable to perform the method of the embodiments. The computer program functionality could be implemented in hardware (for example by means of a CPU or by one or more ASICs (application specific integrated circuits)) or by a mix of hardware and software.

Whilst particular pieces of apparatus have been described herein, in alternative embodiments, functionality of one or more of those pieces of apparatus can be provided by a single unit, processing resource or other component, or functionality provided by a single unit can be provided by two or more units or other components in combination. For example, one or more functions of the processing system may be performed by a single processing device, such as a personal computer or the like, or one or more or each function may be performed in a distributed manner by a plurality of processing devices, which may be locally connected or remotely distributed.

The invention is defined by the appended claims. However, for the purposes of the present disclosure it will be understood that any of the features defined above or described below may be utilised in isolation or in combination. For example, features described above in relation to one of the above aspects or below in relation to the detailed description below may be utilised in any other aspect, or together form a new aspect.

BRIEF DESCRIPTION OF THE DRAWINGS

These and other aspects will now be described by way of example with reference to the accompanying drawings, of which: Figure 1 is a diagrammatic view of an object tracking system according to the

present disclosure;

Figure 2 is a diagrammatic view of a work scheduler system according to the present disclosure; Figure 3 shows a perspective view of a robotic system for picking and/or sorting objects according to the present disclosure; Figure 4 shows a diagrammatic view of the system topology of the robotic system shown in Figure 3; Figure 5 shows a first robotic picker of the system shown in Figure 3; Figure 6 shows an enlarged view of a robotic arm of the first robotic picker shown in Figure 5; Figure 7 shows a second robotic picker of the system shown in Figure 3; Figure 8 shows an enlarged view of a robotic arm of the second robotic picker shown in Figure 7; Figure 9 shows an enlarged view of the sensor arrangement of the robotic system; Figure 10 shows a perspective view of an alternative robotic system for picking and/or sorting objects according to the present disclosure; Figure 11 shows a perspective view of an alternative robotic system for picking and/or sorting objects; Figure 12 shows a perspective view of part of a robotic picker of the robotic system shown in Figure 11; Figure 13 shows a diagrammatic view of the system topology of the robotic system shown in Figure 11; Figure 14 shows a perspective view of an alternative robotic system for picking and/or sorting objects; Figure 15 shows a perspective view of an alternative robotic system for picking and/or sorting objects according to the present disclosure; Figure 16 shows an object picking and/or sorting system according to the present disclosure; and Figure 17 shows a Material Recovery Facility comprising robotic systems according to the present disclosure.

DETAILED DESCRIPTION OF THE DRAWINGS

Figure 1 of the accompanying drawings shows a diagrammatic view of an object tracking system 1 for a robotic system 10; 110; 210; 310; 410 for picking and/or sorting objects 16 (the robotic systems 10, 110, 210, 310, 410 are shown and described further below).

As shown in Figure 1, the object tracking system 1 is configured and/or operable to receive a plurality of data sets, generally denoted 2, from one or more objection detection algorithms 3, each data set 2 derived from an image frame 4 generated by a vision system 5. As shown, the vision system 5 may form part of, may be coupled to or operatively associated with a sensor arrangement (such as sensor arrangement 30) or may comprise a standalone system.

The plurality of data sets 2 includes at least a first data set 2t1 from an image frame 4 taken at a first time instance t1 and a second data set 2t2 from an image frame taken at a second, subsequent, time instance t2 to said first data set 2t1. However, it will be understood that the plurality of data sets 2 may include any number of data sets greater than 2). Since each data set 2 is derived from an image frame 4 generated by a video camera system which may produce images with e.g. a frame rate of 24 frames per second, there may be a significant number of data sets 2, represented in Figure 1 as 2tn.

Each data set 2 comprises one or more data subsets 6, each data subset 6 comprising object identification data relating to an object 16p being conveyed by a conveyor arrangement 12;112;212;312;412 with which the robotic system 10; 110; 210; 310; 410 is operatively associated and which object 16p has been selected by said one or more object detection algorithms 3 as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system 10; 110; 210; 310; 410.

The object tracking system 1 is configured and/or operable to assign a unique identifier to each of said one or more data subsets 6.

The object tracking system 1 is configured and/or operable to compare, or output for comparison, the data sets 2 to: determine whether they contain one or more of the data subsets 6; and determine a change in the unique identifier of the one or more data subsets 6, the change in the unique identifier being indicative of a change in position of said object 16p to be picked and/or sorted, and thereby permitting the position of said object 16p to be tracked. The object tracking system 1 is configured and/or operable to output object position tracking data.

The object tracking system 1 is configured and/or operable for use in a robotic system 10; 110; 210; 310; 410 for picking and/or sorting objects and which comprises a robotic picker arrangement 20; 120; 220; 320; 420 operatively associated with the conveyor arrangement 12;112;212;312;412. The robotic picker arrangement 20; 120; 220; 320; 420 comprises a plurality of robotic pickers 22a,22b; 122a,122b,122c,122d; 222; 322; 422. Each robotic picker 22a,22b; 122a,122b,122c,122d; 222; 322; 422 is configured to pick up a selected one or more of said objects 16p from the conveyor arrangement 12; 112; 212; 312; 412.

In use, the object tracking system 1 is configured and/or operable to track one or more objects 16p to be picked and/or sorted, in particular embodiments waste items, as they are conveyed by the conveyor arrangement 12;112;212;312;412.

Beneficially, the object tracking system 1 facilitates the accurate tracking of objects 16p to be picked and/or sorted throughout their time on the conveyor arrangement 12;112;212;312;412, including in instances where the position of the object 16p moves during the conveying process, thereby facilitating greater accuracy and/or efficiency of picking and/or sorting by the robotic picker arrangement 20; 120; 220; 320; 420. The object tracking system 1 facilitates the accurate and efficient tracking of the position and/or trajectory of multiple objects 16p simultaneously. The object tracking system 1 may identify instances where an object 16p has fallen off the conveyor arrangement 12; 112; 212; 312; 412 and/or have been removed by a manual operative or by the robotic picker arrangement 20; 120; 220; 320; 420, facilitating greater accuracy and/or efficiency of operation. Moreover, the present object tracking system 1 may facilitate real time tracking of the objects 16p.

Figure 2 of the accompanying drawings shows a diagrammatic view of a work scheduler system 7 for the robotic system 10; 110; 210; 310; 410 for picking and/or sorting objects 16.

The work scheduler system 7 is configured and/or operable to receive a plurality of data sets 2 from the object detection algorithm 3.

Each data set 2 comprises one or more data subsets 6, each data subset 6 comprising object identification data relating to an object 16p being conveyed by a conveyor arrangement 12; 112; 212; 312; 412 with which the robotic system 10; 110; 210; 310; 410 is operatively associated and which object 16p has been selected by the object detection algorithm 3 as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system 10; 110; 210; 310; 410.

The work scheduler system 7 is also configured and/or operable to receive a unique identifier relating to each of said one or more data subsets 6 from the object tracking system 1.

The work scheduler system 1 is also configured and/or operable to output one or more command signals to the robotic picker arrangement 20; 120; 220; 320; 420 of the robotic system 10; 110; 210; 310; 410 to position a robotic picker 22a,22b; 122a,122b,122c,122d; 222; 322; 422 of the robotic picker arrangement 20; 120; 220; 320; 420 relative to the conveyor arrangement 12; 112; 212; 312; 412 to permit said robotic picker 22a,22b; 122a,122b,122c,122d; 222; 322; 422 to pick up the selected object 16p to be picked and/or sorted from the conveyor arrangement 12; 112; 212; 312; 412.

Beneficially, the work scheduler system 7 facilitates real time and/or adaptive scheduling of tasks to the robotic pickers 22a,22b; 122a,122b,122c,122d; 222; 322; 422 of the robotic picker arrangement 20; 120; 220; 320; 420, thereby facilitating greater accuracy and/or efficiency of operations by permitting all relevant objects 16p to be picked and/or sorted; in contrast to conventional, static, that simply receives and sends an instruction.

The present work scheduler system 7 is intelligent in the sense that the object tracking system 1 will send the real time information regarding an object, e.g. waste item, to the work scheduler system 7. It will gain knowledge about the object through object detection and tracking model, and then assign to the most appropriate picker rather than just send any job to any available picker. Secondly, the present work scheduler system is interactive, in the sense that it will not only send instructions to a robotic picker for picking out certain types of object, e.g. waste item, it may also receive feedback from the robotic pickers. For example, if one picker fails to pick up an object, it will let work scheduler system know, and the work scheduler system may reassign this task to another of the robotic pickers, thereby increasing the likelihood that all objects are picked out.

As described above, the object tracking system 1 and work scheduler system 7 described above are configured and/or operable for use in a robotic system 10; 110; 210; 310; 410 for picking and/or sorting objects 16.

Referring first to Figure 3 of the accompanying drawings, there is shown a robotic system, generally denoted 10, for picking and/or sorting objects 16.

As shown, the robotic system 10 is operatively associated with a conveyor arrangement, generally denoted 12, comprising a conveyor 14 for conveying the objects 16, which as shown in Figure 3 includes objects 16p, e.g. waste items and/or recyclables, which are desired to be picked and/or sorted. The illustrated conveyor 14 takes the form of a belt conveyor. However, it will be recognised that the robotic system 10 may be operable with a range of conveyor types.

The conveyor arrangement 12 shown in Figure 3 forms part of a materials recovery facility MRF (see Figure 17). However, it will be understood that an alternative robotic system according to the present disclosure may comprise or may be provided in combination with a conveyor to form or form part of a standalone object picking and/or sorting system 1000 (see Figure 16).

In use, the robotic system 10 is operable to pick up the selected objects 16p from the conveyor 14 and deposit them in a selected bin or hopper (not shown).

As shown in Figure 3, the robotic system 10 comprises a collaborative robotic picker arrangement, generally denoted 20, comprising a plurality of robotic pickers 22a, 22b each configured to pick up one or more of the objects 16p from the conveyor 14.

Referring now also to Figure 4 of the accompanying drawings, the robotic system 10 further comprises a processing system 24. The processing system 24 is configured to receive object position tracking data from the object tracking system 1.

The processing system 24 is configured to output one or more command signals 36a, 36b, 38a, 38b to the robotic picker arrangement 20 to position one of said robotic pickers 22a; 22b relative to the conveyor 14 to permit the robotic picker 22a; 22b to pick up the selected object(s) 16p to be picked and/or sorted from the conveyor 14.

The robotic system 10 provides a number of significant benefits compared to conventional systems and techniques for picking and/or sorting objects 16. For example, since the processing system 24 of the robotic system 10 provides command signals 36a, 36b, 38a, 38b to a plurality of robotic pickers 22a, 22b, the robotic system 10 is capable to operating the robotic pickers 22a, 22b collaboratively. This facilitates a greater capacity in terms of the volume of objects 16p that can be picked and/or sorted and/or a greater capacity in terms of the types of objects 16p that can be picked and/or sorted at one time.

The provision of a collaborative robotic picker arrangement 20 means that each of the robotic pickers 22a, 22b can be assigned a plurality of classes of objects 16p to be picked and/or sorted. In the illustrated robotic system 10, each robotic picker 22a, 22b is capable of picking and/or sorting all required classes of objects 16p to be picked and/or sorted, the selected robotic picker 22a; 22b assigned to a given object 16p to be picked and/or sorted chosen by the processing system 24.

The robotic picker 22a; 22b may be selected by the processing system 24 according to a number of factors. The processing system 24 may be configured to receive positional data 40a, 40b and/or operational status data 42a, 42b relating to each of the robotic pickers 22a, 22b. The processing system may interrogate the positional data 40a, 40b and/or operational status data 42a, 42b relating to each of the robotic pickers 22a, 22b and determine which of the robotic pickers 22a, 22b to assign the selected object 16p to be picked and/or sorted.

Beneficially, by working collaboratively as a team the robotic pickers 22a, 22b facilitate greater efficiency of operation, since the robotic pickers 22a, 22b may be selected to reduce redundancy of each robotic picker 22a, 22b and/or may be selected to reduce the travel distance to a given object 16p to be picked and/or selected, thereby increasing response time and reducing energy use.

The robotic system 10 facilitates the efficient picking and/or sorting of such contaminants, thereby eliminating or at least reducing the exposure of personnel to these potentially hazardous materials. The robotic system 10 also facilitates greater efficiency in the identification of objects 16p to be picked, thereby eliminating or at least reducing the need for manual verification. Greater efficiency in the identification of objects 16p to be picked may reduce the presence of contaminants (i.e. objects 16p which should have been picked out) in recyclables which may otherwise reduce their value and/or in some cases mean that they must be re-processed or in some cases render them unsuitable for further processing such that they must be sent to landfill.

As described above, the robotic system 10 comprises a robotic picker arrangement 20 operatively associated with the conveyor 14 for conveying objects 16 to be sorted, and which comprises a plurality of robotic pickers 22a,22b each configured to pick up a selected one or more of said objects 16p from the conveyor 14.

In the illustrated robotic apparatus 10, the apparatus 10 comprises two robotic pickers 22a, 22b. However, it will be understood that the robotic apparatus 10 may comprise any suitable number (greater than two) of the robotic pickers 22a, 22b.

Beneficially, since the processing system 24 is configured to operate with a robotic picker arrangement 20 comprising a plurality of robotic pickers 22a, 22b, the robotic system 10 can be easily scaled, such that the robotic system 10 is highly flexible in terms of the size and/or type of facility in which the robotic system 10 can be installed and/or employed. For example, the robotic system 10 can be easily adapted in the event a given facility increases in size, without significant modification to the processing system infrastructure. Alternatively, the robotic system 10 can be employed in facilities that were otherwise considered too small or remote to merit the investment needed for automation systems. In the case of waste management and/or recycling facilities, for example, the robotic system 10 may be used in MRFs that were otherwise considered unsuitable for automation systems with the result that waste objects were transported to a more distant centralised facility requiring additional carbon footprint.

Figures 5 and 6 of the accompanying drawings show the robotic picker 22a.

As shown in Figure 5, the robotic picker 22a takes the form of a floor-mounted robot. The robotic picker 22a comprises a frame 44a that extends over the conveyor 14. The frame 44a comprises one or more ground engaging members 46a that take the form of an upright stanchions and a horizontal member 48a. The horizontal member 48a is coupled to and movable relative to the ground engaging members 46a.

As shown in Figure 5, the robotic picker 22a further comprises a robotic arm 50a mounted on and carried by the frame 44a.

In use, the robotic picker 22a is configured to translate the robotic arm 50a horizontally and vertically relative to the frame 44a, so as to position the robotic arm 50a laterally and vertically with respect to the conveyor 14.

The robotic picker 22a comprises an actuator arrangement, generally denoted 52a, for translating the robotic arm 50a relative to the frame 44a. In the illustrated robotic system 10, the actuator arrangement 52a comprises belt driven linear actuators 54a, 56a operable by servomotors 58a, 60a. The actuator 54a is configured to translate the robotic arm 50a horizontally/laterally with respect to the frame 44a. The actuator 56a is configured to translate the robotic arm 50a vertically with respect to the frame 44a. It will be recognised that while the robotic system 10 comprises actuators 54a, 56a for translating the robotic arm 50a horizontally and vertically, in alternative robotic systems according to the present disclosure the robotic system may comprise an actuator for translating the robotic arm horizontally only. In such embodiments, the robotic arm may perform all of the required vertical movement to pick up the selected object.

In use, the robotic system 10 is operable to rapidly move the robotic arm 50a from a first position relative to the frame 44a to a second position relative to the frame 44a and then complete the move to the required position to pick up the object 16p.

As shown in Figure 6, the robotic picker 22a comprises a coupling arrangement 62a for coupling the robotic arm 50a to the actuator 54a. In the illustrated robotic system 10, the coupling arrangement 62a takes the form of a carriage configured for coupling on the one hand to the actuator 54a and on the other hand to the robotic arm 50a. In the illustrated robotic system 10, the robotic arm 50a is removably coupled to the coupling arrangement 62a. Beneficially, this permits the robotic arm 50a to be readily removed for repair and/or replaced by an alternative robotic arm.

As shown in Figure 6, the robotic arm 50a of the robotic picker 22a takes the form of a 6-axis robot comprising a first member 64a rotatably coupled at a proximal end to the frame 44a via the coupling arrangement 62a and at a distal end to a second member 66a.

The robotic arm 50a further comprises a manipulator 68a. The manipulator 68a is coupled to and carried by the second member 66a. In the illustrated robotic apparatus 10, the manipulator 68a takes the form of a vacuum gripper configured to pick up the object 16p to be picked and/or sorted.

Figures 7 and 8 of the accompanying drawings show the robotic picker 22b.

As shown in Figure 7, the robotic picker 22b takes the form of a floor-mounted robot. The robotic picker 22b comprises a frame 44b that extends over the conveyor 14. The frame 44b comprises one or more ground engaging members 46b that take the form of an upright stanchions and a horizontal member 48b. The horizontal member is coupled to and movable relative to the ground engaging members 46b.

As shown in Figure 7, the robotic picker 22b further comprises a robotic arm 50b mounted on and carried by the frame 44b.

In use, the robotic picker 22b is configured to translate the robotic arm 50b horizontally and vertically relative to the frame 44b, so as to position the robotic arm 50b laterally and vertically with respect to the conveyor 14.

The robotic picker 22b comprises an actuator arrangement, generally denoted 52b, for translating the robotic arm 50b relative to the frame 44b. In the illustrated robotic system 10, the actuator arrangement 52b comprises belt driven linear actuators 54b, 56b operable by servomotors 58b, 60b. The actuator 54b is configured to translate the robotic arm 50b horizontally/laterally with respect to the frame 44b. The actuator 56b is configured to translate the robotic arm 50b vertically with respect to the frame 44b.

In use, the robotic system 10 is operable to rapidly move the robotic arm 50b from a first position relative to the frame 44b to a second position relative to the frame 44b and then complete the move to the required position to pick up the object 16p.

As shown in Figure 8, the robotic picker 22b comprises a coupling arrangement 62b for coupling the robotic arm 50b to the actuator 54b. In the illustrated robotic system 10, the coupling arrangement 62b takes the form of a carriage configured for coupling on the one hand to the actuator 54b and on the other hand to the robotic arm 50b. In the illustrated robotic system 10, the robotic arm 50b is removably coupled to the coupling arrangement 62b. Beneficially, this permits the robotic arm 50b to be readily removed for repair and/or replaced by an alternative robotic arm.

As shown in Figure 8, the robotic arm 50b of the robotic picker 22b takes the form of a 6-axis robot comprising a first member 64b rotatably coupled at a proximal end to the frame 44b via the coupling arrangement 62b and at a distal end to a second member 66b.

The robotic arm 50b further comprises a manipulator 68b. The manipulator 68b is coupled to and carried by the second member 66b. In the illustrated robotic apparatus 10, the manipulator 68b takes the form of a mechanic gripper configured to pick up the object 16p to be picked and/or sorted.

Referring again to Figures 3 and 4, and referring now also to Figure 9 of the accompanying drawings, the sensor arrangement 30 of the illustrated robotic system 10 comprises a vision system disposed on a frame 70 upstream of the robotic picker arrangement 20, the sensor 28a taking the form of a 2D camera, the sensor 28b taking the form of a remote sensing device, e.g. a LIDAR, and the sensor 28c taking the form of an RGB sensor. In use, the processing system 24 employs sensor fusion techniques, e.g. a sensor fusion algorithm.

As shown in Figure 4, the sensor arrangement 30 further comprises a sensor 72a in the form of camera disposed on the robotic arm 50a and a sensor 72b in the form of camera disposed on the robotic arm 50b. The sensor arrangement 30 of the illustrated robotic system 10 further comprises a sensor 74a in the form of a camera disposed on the frame 44a and a sensor 74b in the form of a camera disposed on the frame 44b.

In use, the sensors 72a, 72b, 74a, 74b are utilised to supplement the data from the sensors disposed upstream of the robotic picker arrangement 20, thereby providing a more accurate indication of the position of the robotic pickers 22a,22b and/or the object 16p to be picked and/or sorted.

As described above, the processing system 24 receives sensor data relating to the objects 16 being conveyed by the conveyor 14 from the sensor arrangement 30, the processing system 24 employing one or more object detection algorithms to the sensor data to determine whether any one of the objects 16 being conveyed by the conveyor 14 corresponds to a predetermined class of objects 16p to be picked and/or sorted by the robotic system 10.

Beneficially, the use of one or more object detection algorithms permits the robotic system 10 to identify a wide range of objects 16p, e.g. waste items and/or contaminants lying on the conveyor 14.

The processing system 24 implements artificial intelligence, the processing system 24 employing one or more of: a deep neural network; a deep reinforcement learning algorithm; and an object detection algorithm to process the received data.

As shown in Figure 3, the robotic system 10 comprises a communication arrangement, generally denoted 76. In the illustrated robotic system 10, the communication arrangement comprises a wireless communication arrangement in the form of a two way radio frequency communication arrangement. However, it will be recognised that the communication arrangement may alternatively or additionally comprise or take the form of a wired communication arrangement such as an electric wire and/or optical fibre communication arrangement and/or a one-way communication arrangement.

In use, the processing system 24 receives information from the sensor arrangement 30 and/or the conveyor 12 via the communication arrangement 76 and communicate the one or more command signals to the robotic picker arrangement 20 via the communication arrangement 76.

The communication arrangement 76 may also be utilised to communicate information to a remote location. In the illustrated robotic system 10, the remote location takes the form of a control room 78 and/or a mobile device 80.

The robotic system 10 further comprises a human machine interface in the form of a work station 82.

Various modifications may be made without departing from the scope of the invention as defined in the claims.

For example, Figure 10 of the accompanying drawings shows an alternative robotic system 110. The robotic apparatus 110 is similar to the system 10. As noted above, the robotic apparatus is readily scalable, the robotic apparatus 110 comprising a collaborative robotic picker arrangement 120 comprising four robotic pickers 122a, 122b, 122c, 122d operatively associated with conveyor 114 of conveyor arrangement 112 rather than two robotic pickers 22a, 22b as in the robotic system 10.

Figures 11, 12 and 13 of the accompanying drawings show an alternative robotic system 210 for picking and/or sorting objects 16.

As shown, the robotic system 210 is operatively associated with a conveyor arrangement, generally denoted 212, comprising a conveyor 214 for conveying the objects 16, which as shown in Figure 11 includes an object 16p, e.g. a waste item and/or recyclable, to be picked and/or sorted. The illustrated conveyor 214 takes the form of a belt conveyor. However, it will be recognised that the robotic system 210 may be operable with a range of conveyor types.

In use, the robotic system 210 is operable to pick up the selected object 16p from the conveyor 214 and deposit it in a selected bin or hopper (not shown).

The robotic system 210 comprises a collaborative robotic picker arrangement, generally denoted 220, comprising a plurality of robotic pickers 222 (for clarity and ease of reference only one of the robotic pickers 222 is shown).

As shown in Figure 13, the robotic system 210 further comprises a processing system 224. The processing system 224 is similar to the processing system 24 described above. The processing system 224 is configured to receive object position tracking data from the object tracking system.

The processing system 224 is configured to output one or more command signals 236a, 236b, 238a, 238b to the robotic picker arrangement 220 to position one of said robotic pickers 222 relative to the conveyor 214 to permit the selected robotic picker 222 to pick up the selected object(s) 16p to be picked and/or sorted from the conveyor 214.

As shown in Figures 11 and 12, the robotic picker 222 takes the form of a floor-mounted robot. The robotic picker 222 comprises a frame 244 that extends over the conveyor 214. The frame 244 comprises ground engaging members 246 that take the form of upright stanchions and a horizontal member 248. The horizontal member 248 is coupled to and movable relative to the ground engaging members 246.

The robotic picker 222 further comprises a robotic arm 250 mounted on and carried by the frame 244.

In use, the robotic picker 222 is configured to translate the robotic arm 250 horizontally, so as to position the robotic arm 250 laterally with respect to the conveyor 214.

The robotic picker 222 further comprises an actuator arrangement, generally denoted 252, for translating the robotic arm 250 relative to the frame 244. In the illustrated robotic system 210, the actuator arrangement 252 comprises or takes the form of a belt driven linear actuator.

As shown, the robotic picker 222 comprises a rotary drive 284, which in the illustrated system 210 takes the form of a motor. The rotary drive 284 is coupled to one of the ground engaging members 246 via a bracket 286. A first pulley wheel 288, which in operation defines a drive pulley of the actuator arrangement 252, is disposed on drive shaft 290 of the rotary drive 284, such that the first pulley wheel 288 is driven by the rotary drive 284.

A belt 292 is disposed around the first pulley wheel 288 and extends around a second pulley wheel 294, which in operation defines a driven pulley of the actuator arrangement 252. As shown, the second pulley wheel 294 is rotatably mounted to the other ground engaging member 246 via shaft 296 and bracket 298.

In the illustrated system, the horizontal member 248 comprises or takes the form of a rail which extends between the ground engaging members 246.

The robotic picker 222 comprises a coupling arrangement 262 for coupling the robotic arm 250 to the actuator arrangement 252. In the illustrated robotic system 210, the coupling arrangement 262 takes the form of a carriage slidably mounted to the horizontal member 248. The coupling arrangement 262 engages with and is configured to be driven by the belt 292.

As shown in Figures 11 and 12, the robotic arm 250 of the robotic picker 222 takes the form of a 6-axis robot and comprises a manipulator 268. In the illustrated robotic apparatus 210, the manipulator 268 takes the form of a gripper configured to pick up the object 16p to be picked and/or sorted.

In use, the rotary drive 284 and actuator arrangement 252 are operable to move the robotic arm 250 from a first, lateral, position to a second, lateral, position. Having moved the robotic arm 250 from the first position to the second position, the robotic arm 250 itself then completes the move to the required position to pick up the object 16p Beneficially, the system 210 is configured and/or operable to rapidly move the robotic arm 250 from the first position to the second position, with the robotic arm 250 providing a slower, more accurate, movement as the robotic arm 250 comes into proximity to the object 16p to be picked and/or sorted.

It will be understood that the robotic systems described herein may be configured and/or operable to pick and/or sort objects in a variety of sectors, including for example but not exclusively the construction sector, the e-waste sector and/or the textile sector. In the construction sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: waste wood; tarpaulins; metal bars; metal box sections; and/or rubble. In the e-waste sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: printed circuit boards; valves; wires; and/or electrical components such as capacitors, resistors, diodes, etc. In the textile sector, for example, the robotic system may be configured and/or operable to pick and/or sort objects such as: cotton materials; nylon materials; synthetic fabric materials; hemp materials, uniforms; and/or accessories such as belts.

By way of example, Figure 14 of the accompanying drawings shows a robotic system, generally denoted 310, for picking and/or sorting objects 16'.

As shown, the robotic system 310 is operatively associated with a conveyor arrangement, generally denoted 312, comprising a conveyor 314 for conveying the objects 16', which as shown in Figure 14 include an object 16p' in the form of an item of construction waste to be picked and/or sorted.

In use, the robotic system 310 is operable to pick up the selected object 16p' from the conveyor 314 and deposit it in a selected bin or hopper (not shown).

The robotic system 310 comprises a collaborative robotic picker arrangement, generally denoted 320, comprising a plurality of robotic pickers 322 (for clarity and ease of reference only one of the robotic pickers 322 is shown). As shown in Figure 14, the robotic system 310 substantially corresponds to the robotic system 210 described above. However, it will be understood that any of the robotic systems may be employed to pick and/or sort the objects 16' or other types of objects such as those from the e-waste sector and/or textile sectors.

Figure 15 of the accompanying drawings show a further alternative robotic system 410 for picking and/or sorting objects 16.

As shown, the robotic system 410 is operatively associated with a conveyor arrangement, generally denoted 412, comprising a conveyor 414 for conveying the objects 16, which as shown in Figure 15 includes an object 16p, e.g. a waste item and/or recyclable, to be picked and/or sorted. The illustrated conveyor 414 takes the form of a belt conveyor. However, it will be recognised that the robotic system 410 may be operable with a range of conveyor types.

In use, the robotic system 410 is operable to pick up the selected object 16p from the conveyor 414 and deposit it in a selected bin or hopper (not shown).

The robotic system 410 comprises a collaborative robotic picker arrangement, generally denoted 420, comprising a plurality of robotic pickers 422. In the illustrated system 410, the robotic pickers 422 are arranged in pairs.

As shown in Figure 15, the robotic picker 422 takes the form of a floor-mounted robot. The robotic picker 422 comprises a frame 444 that extends over the conveyor 414. The frame 444 comprises ground engaging members 446 that take the form of upright stanchions which are supported on pads and a horizontal member 448. As shown in Figure 15, in the illustrated system 410 the frame comprises two upright stanchions supported on a single pad. However, it will be recognised that each upright stanchion may be provided on a pad or no pads may be provided. The horizontal member 448 is coupled to and movable relative to the ground engaging members 446.

The robotic picker 422 further comprises a pair of robotic arms 450 mounted on and carried by the frame 444.

In use, the robotic picker 422 is configured to translate the robotic arms 450 horizontally, so as to position the robotic arms 450 laterally with respect to the conveyor 214.

The robotic picker 422 further comprises an actuator arrangement, generally denoted 452, for translating the robotic arms 450 relative to the frame 244. In the illustrated robotic system 410, the actuator arrangement 452 comprises or takes the form of the belt driven linear actuator described above with reference to the system 210.

Beneficially, the system 410 is configured and/or operable to rapidly move the robotic arm 450 from the first position to the second position, with the robotic arm 450 providing a slower, more accurate, movement as the robotic arm 450 comes into proximity to the object 16p to be picked and/or sorted.

Figure 16 of the accompanying drawings shows an object picking and/or sorting system 1000. As described above, whereas the robotic system 10 described above is operatively associated with a conveyor arrangement 12 comprising a conveyor 14, the object picking and/or sorting system 1000 comprises robotic system 1110 and a conveyor arrangement 1112 comprising a conveyor 1114. The robotic system 1110 corresponds to the robotic system 110 and comprises a robotic picker arrangement 1120 comprising four robotic pickers 1122a, 1122b, 1122c, 1122d. However, it will be understood that the robotic system 1110 may alternatively comprise or take the form of the robotic system 10.

Beneficially, the object picking and/or sorting system 1000 may provide a standalone system for picking and/or sorting objects 16.

As described above, the robotic systems 10, 110 are particularly beneficial for use in picking objects 16p in a material recovery facility (MRF). Figure 17 of the accompanying drawings shows a material recovery facility MRF comprising a plurality of the robotic systems, more specifically one of the two agent robotic systems 10 and one of the four agent robotic systems 110. However, it will be understood that the material recovery facility MRF may comprise one of the robotic systems 10 or 110, one or more of the object picking and/or systems 1000, or any combination of the robotic systems 10,110 and object picking and/or sorting systems 1000.

Claims

CLAIMS1. An object tracking system for a robotic system for picking and/or sorting objects, the object tracking system configured and/or operable to: (a) receive a plurality of data sets from one or more objection detection algorithms, wherein each data set is derived from an image frame generated by a vision system forming part of, coupled to or operatively associated with the robotic system, wherein the plurality of data sets includes a first data set from an image frame taken at a first time instance and a second data set from an image frame taken at a second, subsequent, time instance to said first data set, and wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which said robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system, and (b) assign a unique identifier to each of said one or more data subsets; (c) compare, or output for comparison, said first and second data sets to: determine whether they contain one or more of the data subsets; and determine a change in the unique identifier of said one or more data subsets, said change in the unique identifier being indicative of a change in position of said object to be picked and/or sorted, and thereby permitting the position of said object to be picked and/or sorted on said conveyor arrangement to be tracked.
2. The object tracking system of claim 1, wherein the object tracking system is implemented in software, the object tracking system comprising or taking the form of an object tracking algorithm.
3. The object tracking system of claim 2, wherein the object tracking algorithm utilises artificial intelligence.
4. The object tracking system of claim 1, 2 or 3, wherein the object tracking system comprises, is coupled to or configured to communicate with a processing system.
5. The object tracking system of claim 4, wherein the processing system is configured and/or operable to: implement (a) to (c); implement one or more of the object detection algorithms; and/or output one or more command signals to a robotic picker arrangement of the robotic system to position one or more robotic pickers of the robotic picker arrangement relative to the conveyor arrangement to permit said one or more robotic pickers to pick up the selected object to be picked and/or sorted from the conveyor arrangement.
6. The object tracking system of any preceding claim, wherein the plurality of data sets includes n data sets, where n is greater than 2.
7. The object tracking system of any preceding claim, wherein the object tracking system comprises, is coupled to or operatively associated with a work scheduler system, the work scheduler system configured and/or operable to: (a) receive a plurality of data sets from one or more object detection algorithms, wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which the robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) receive a unique identifier relating to each of said one or more data subsets from an object tracking system; and (c) output one or more command signals to a robotic picker arrangement of the robotic system to position a robotic picker of the robotic picker arrangement relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.
8. An object tracking method for a robotic system for picking and/or sorting objects, the method comprising the steps of: (a) receiving a plurality of data sets from one or more objection detection algorithms, wherein each data set is derived from an image frame generated by a vision system forming part of, coupled to or operatively associated with the robotic system, wherein the plurality of data sets includes a first data set from an image frame taken at a first time instance and a second data set from an image frame taken at a second, subsequent, time instance to said first data set, and wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which said robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system, and (b) assigning a unique identifier to each of said one or more data subsets; (c) comparing, or outputting for comparison, said first and second data sets to: determine whether they contain one or more of the data subsets; and determine a change in the unique identifier of said one or more data subsets, said change in the unique identifier being indicative of a change in position of said object to be picked and/or sorted, and thereby permitting the position of said object to be picked and/or sorted on said conveyor arrangement to be tracked.
9. A work scheduler system for a robotic system for picking and/or sorting objects, the work scheduler system configured and/or operable to: (a) receive a plurality of data sets from one or more object detection algorithms, wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which the robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) receive a unique identifier relating to each of said one or more data subsets from an object tracking system; and (c) output one or more command signals to a robotic picker arrangement of the robotic system to position a robotic picker of the robotic picker arrangement relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.
10. A work scheduler method for a robotic system for picking and/or sorting objects, the method comprising the steps of: (a) receiving a plurality of data sets from one or more object detection algorithms, wherein each data set comprises one or more data subsets, each data subset comprising object identification data relating to an object being conveyed by a conveyor arrangement with which the robotic system is operatively associated and which object has been selected by said one or more object detection algorithms as corresponding to a predetermined class of objects to be picked and/or sorted by the robotic system; (b) receiving a unique identifier relating to each of said one or more data subsets from an object tracking system; and (c) outputting one or more command signals to a robotic picker arrangement of the robotic system to position a robotic picker of the robotic picker arrangement relative to the conveyor arrangement to permit said robotic picker to pick up the selected object to be picked and/or sorted from the conveyor arrangement.
11. A robotic system for picking and/or sorting objects, the comprising: a collaborative robotic picker arrangement operatively associated with a conveyor arrangement for conveying objects to be sorted, wherein the robotic picker arrangement comprises a plurality of robotic pickers each configured to pick up a selected one or more of said objects from the conveyor arrangement; and at least one of: the object tracking system of any one of claims 1 to 7; and/or the work scheduler system of claim 9.
12. The robotic system of claim 11, wherein the robotic system comprises or takes the form of an integrated robotic picking and/or sorting system.
13. The robotic system of claim 11 or 12, wherein the robotic system comprises or takes the form of a distributive robotic picking and/or sorting system.
14. The robotic system of claim 11, 12 or 13, wherein the robotic system is modular.
15. The robotic system of any one of claims 11 to 14, wherein one or more of the robotic pickers comprises a frame and one or more robotic arms, the one or more robotic arms mounted on and carried by the frame.
16. The robotic system of claim 15, wherein said one or more robotic pickers comprises an actuator arrangement for translating the robotic arm relative to the frame, wherein the actuator arrangement comprises or takes the form of one or more belt driven linear actuator.
17. The robotic system of any one of claims 11 to 16, wherein one or more of the robotic pickers comprises a drive arrangement.
18. The robotic system of claim 17, wherein at least one of: the drive arrangement comprises one or more drives configured to move the robotic arm from a first, vertical, position to a second, vertical, position, wherein said one or more drives configured to move the robotic arm from the first, vertical, position to the second, vertical, position move the robotic arm by moving the horizontal or substantially horizontal member relative to the one or more ground-engaging member; and one or more drives configured to move the robotic arm from a first, lateral, position to a second, lateral, position, wherein said one or more drives configured to move the robotic arm from the first, lateral, position to the second, lateral, position move the robotic arm relative to the horizontal or substantially horizontal member.
19. The robotic system of claim 18, wherein the drive arrangement is configured and/or operable to move the robotic arm vertically at a speed higher than the speed at which the drive arrangement moves the robotic arm laterally.
20. The robotic system of any one of claims 16 to 19, wherein the robotic arm completes the movement required in order to pick up the object.
21. The robotic picker of claim 20, wherein the drive arrangement is configured and/or operable to move the robotic arm vertically and/or horizontally at a speed higher than the speed at which the robotic arm completes the movement required in order to pick up the object.
22. The robotic system of any one of claims 11 to 21, wherein the robotic system comprises, is coupled to or configured to communicate with a processing system.
23. The robotic system of claim 22, wherein the processing system of the robotic system, or part of the processing system of the robotic system, implements artificial intelligence, the processing system of the robotic system employing one or more of: a deep neural network; a deep reinforcement learning algorithm; and an object detection algorithm to process the received data.
24. The robotic system of claim 22 or 23, wherein the processing system of the robotic system is configured to receive positional data and/or operational status data relating to each of the robotic pickers, the processing system configured to interrogate the positional data and/or operational status relating to each of the robotic pickers and determine which of the robotic pickers to assign the selected object to be picked and/or sorted.
25. An object picking and/or sorting system comprising one or more of the robotic systems according to any one of claims 11 to 24.
26. A material recovery facility comprising one or more of the robotic systems according to any one of claims 11 to 24 and/or one or more object picking and/or sorting system according to claim 25.
27. A method for picking and/or sorting objects, using one or more of the robotic systems according to any one of claims 11 to 24 and/or the object picking and/or sorting system according to claim 25.
28. A processing system configured to implement the method of claim 8, 10 and/or 27.
29. A computer program product configured such that when processed by a suitable processing system configures the processing system to implement the method of claim 8, 10 and/or 27.
30. A carrier medium, the carrier medium comprising a signal, the signal when processed by a suitable processing system causes the processing system to implement the method of claim 8, 10 and/or 27.