MXPA06008354A - Item tracking and processing systems and methods - Google Patents
Item tracking and processing systems and methodsInfo
- Publication number
- MXPA06008354A MXPA06008354A MXPA/A/2006/008354A MXPA06008354A MXPA06008354A MX PA06008354 A MXPA06008354 A MX PA06008354A MX PA06008354 A MXPA06008354 A MX PA06008354A MX PA06008354 A MXPA06008354 A MX PA06008354A
- Authority
- MX
- Mexico
- Prior art keywords
- warning light
- stationary
- information
- items
- passive
- Prior art date
Links
Abstract
Systems and methods are provided for processing one or more items. The systems involve a data acquisition device and a display device. At least one data acquisition device and the display device may be mounted on frames having a see-through display and an orientation sensor. An item tracking system tracks the items to be processed. The orientation sensor determines the orientation and position of the wearer of the data acquisition device and the display device such that the wearer of the device may see information about or related to the items in the wearer’s field of view. In a see-through display, this information may appear to be proximately superimposed on the item. A method of using the invention includes viewing characteristic information about items on a display device and processing the items in accordance with the characteristic information.
Description
SYSTEMS AND METHODS OF TRACKING AND PROCESSING OF ITEMS
FIELD OF THE INVENTION
The field of the present invention includes the tracking and processing of articles. In particular, the present invention involves the communication of classification instructions to a person during the processing of packets.
BACKGROUND OF THE INVENTION
The manual classification or the article processing environment are easily described as a wide range of stimuli based on the event with dynamic physical activity. For example, the current state of package processing is one in which people process within manual sorting facilities by continuously reading the package information of each package label. Due to the information acquired, a range of type of decisions and activities is possible for each type of work (the "decision procedure per package"). The articles move between the work positions in the sorting facilities using a flexible group of conveyor belts, ramps, trays, bags, carts, etc. Processors of large items
scale, such as, for example, UPS, have a substantial investment in the various facilities, plant equipment configurations, and training necessary to provide the current status of the procedure. Any attempt to use technology to assist the decision-by-article procedure is hampered by the high cost of inserting technology into existing manual package processing environments. Challenges with the use of technology are also present in the form of space limitations, as well as, flow of items in a processing environment. The impacts in higher costs for the insertion of technology are found by providing stations to acquire electronically or read the data of the article and provide stations to display or generate classification instructions and / or article processing. The difficulty in minimizing these costs is that the accumulated exception fees for the processing of items are often very high. Factors contributing to this exception rate include errors in the digital scanning of tag codes, address validation problems, packet data availability and packet dimensional compliance. Consequently, a great expense is incurred in the processing of articles due to the need and exceptional processing in the handling capacities. Many conventional article processing systems use the exception areas for processing items above ground,
where exception items are physically removed from the processing system and management on a costly and labor-intensive basis. These above-ground areas can adversely affect the balance of processing facilities of the configuration, productivity, methods and total performance of the facilities. In some cases, the off-floor exception may have the ability to reduce the physical exception handling. These systems can use the acquisition and new item acquisition stations through instances of tag acquisition exceptions and instruction change exceptions that are handled electronically instead of manually. However, the use of the off-floor exception areas allowed by the acquisition and re-acquisition stations of fixed items imposes an early processing limit line and does not allow instructional changes after an article passed the new station. acquisition. Also, this method still requires equipment on the floor, which is considerable for both acquisition and new acquisition stations. The embodiments of the present invention overcome many of the present challenges in the matter, some of which were presented above.
BRIEF DESCRIPTION OF THE INVENTION
The modalities of the present invention provide computer-assisted decision-making capability for the processing of articles. In a specific application, one embodiment of the present invention tracks and provides processing instructions for articles within the handling procedures of article processing facilities. In other modalities, items are tracked and information on one or more items is provided to a person based on the location of the person and / or the location of one or more items. Generally, one embodiment of the present invention involves a system whereby the personnel and supervisors who handle the articles carry a group of transparent display lenses that superimpose the relevant messages approximately next to or on the actual tracked objects in the field of view. These lenses are attached to an information gathering device that captures and decodes information about the article, such as, for example, label images, and an orientation and position device that determines the orientation and position of the carrier, in such a way that You can determine what items are in the field of vision. The embodiments of the present invention involve a device for acquiring and displaying data comprised of an information gathering device for capturing data of an object, a
warning light detection device for capturing information about the orientation and position of a carrier, and a transparent warning display showing the instructions related to the object, each in communication with one or more computers. Another aspect of the present invention is a tracking system, such as, for example, an optical tracking system comprised of two or more fixed detectors, such as, for example, fixed cameras, one or more power sources, such as, for example, example, a light source, a passive warning light that is reactive to the energy of the power source, and a computer. The computer determines the location of the passive warning light from the information received from the fixed detectors, as the detectors receive the reflected or transmitted energy from the passive warning light. Yet another aspect of the present invention involves an item tracking system comprised of an information gathering device, such as, for example, an image device for capturing data of an object, a warning light detection device for capture information about the orientation and position of a carrier, a tracking system to follow a passive warning light applied to each object, and a transparent alert display that shows information related to the object, each in communication with one or more computers. One aspect of the present invention includes systems and methods for the use of tracking technology, such as, for example, optical tracking technology, to track the progress of a moving object to
through a complex installation in real time, such as, for example, the optical tracking of packages or parts in an assembly line or through a warehouse. Another aspect of the present invention includes systems and methods for using a transparent warning display to convey instructions or information to a person when searching for a particular object. These instructions could be for handling packages, handling luggage, assembling parts, navigating through marked points of advance, recovery and packing of items, inventory control and the like. Still another aspect of the present invention are systems and methods for calibrating an optical tracking system using fixed cameras and passive warning lights. Another aspect of the present invention provides a system for the processing of articles. The system comprises a tracking system that is configured to provide location information for each of the plurality of articles on a surface and a deployment device. The display device is for displaying the characteristic information for each of the plurality of articles in their respective locations. In a modality, the characteristic information is placed to indicate the relative position of the article on the surface, including placement of the characteristic information substantially close to a representation of the article. In another modality, only certain information
feature, such as, for example, a zip code of a package, is displayed instead of the package in the package position. The articles can be singled out or not singularized. These and other aspects of the various embodiments of the present invention are described more fully in the present description.
BRIEF DESCRIPTION OF THE DRAWINGS
Having thus described the present invention in general terms, reference will now be made to the accompanying drawings, which are not necessarily drawn to scale, and in which: Figure 1 is an example block diagram of one embodiment of the system of the present invention; Figure 2 is a mode of a data acquisition and display device; Figure 3 is a mode of an example data acquisition and display device as shown in a carrier; Figure 4 is an exemplary diagram of the use of fixed detectors, such as, for example, fixed cameras for a passive warning light location tracking application in one embodiment of the present invention; Figure 5A is an example diagram of the use of fixed detectors, such as, for example, fixed cameras in a tracking application.
location of passive warning light in one embodiment of the present invention, and having more detail than the embodiment shown in Figure 4; Figure 5B, is an example view of an image captured by a fixed camera in a passive warning light location tracking application, without a filter, in an embodiment of the present invention; Figure 5C, is an example view of an image captured by a fixed camera in a passive warning light location tracking application, with a filter, in an embodiment of the present invention; Figure 6 is an example illustration of the use of active warning lights to determine the position and orientation of a bearer of a data acquisition and display device in an embodiment of the present invention; Figure 7 is an example illustration of the use of passive warning lights in a modality of the present invention, in the form that said passive warning lights are used for the tracking of articles; Figures 8A, 8B and 8C are exemplary illustrations of the concept of passive warning light tracking in one embodiment of the present invention; Figure 9 is an example illustration of a person who obtains an article and places it at a retro-reflection point (ie, a passive warning light) on the article, however, in Figure 9, the light Passive warning can not be seen as it is below a person's thumb;
Figure 10 is an example illustration of a person covering and exposing a passive warning light with his thumb and causing a "flicker". Figures 11 and 12 are exemplary illustrations of the concept of acquiring article information (e.g., label information) in one embodiment of the present invention; Figure 13 is a flow chart describing the steps involved in the calibration of a fixed camera establishing the position and orientation of the fixed camera; Figure 14 is a mode of an article tracking system of the present invention and is an example illustration of the interfaces of said mode; Figure 15 shows an exemplary application of a system mode of the present invention in a packet classification facility; Figure 16 shows an acquirer pointing an objective that is displayed in the transparent display of the device for acquiring and displaying data on an article label and placing a passive adhesive warning light near the label to activate the capture of the image of the label through a camera; Figure 17 shows a high contrast copy of the captured image that is displayed on the transparent device of the acquirer,
so that if the captured image appears blurred, distorted or otherwise unclear, the acquirer can capture the image again; Figure 18 shows example packages on a conveyor belt that are within the field of view of the classifier and example superimposed handling instructions in a manner close to or on the packets that are assigned to that classifier in an embodiment of the present invention; Figure 19 is a flow chart describing the steps for a method of processing an article in a modality of the present invention; Figure 20 is also a flow chart describing the steps for a method of processing an article in another embodiment of the present invention; Figure 21 is a flow chart describing a method for displaying information on one or more items in a transparent display of a data acquisition and display device in an embodiment of the present invention; Figure 22 is a flow chart describing a method for displaying information in a transparent display of the device for acquiring and displaying data in another embodiment of the present invention; Figure 23 is a flowchart describing a method for tracking one or more items in one embodiment of the present invention;
Figure 24 is a flow chart describing a method for tracking one or more articles in another embodiment of the present invention; Figure 25 is a flowchart describing a method for tracking articles in one embodiment of the present invention; and Figure 26 is a flow chart describing a method for calculating the orientation and position of a bearer of a data acquisition and display device in a modality of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
The present invention will now be described more fully by reference hereinafter to the accompanying drawings, in which some, but not all, of the embodiments of the present invention are shown. In fact, the present invention can be represented in many different forms and should not be construed as limited to the embodiments set forth in the present disclosure; instead, these modalities are provided in such a way that their description will satisfy the applicable legal requirements. Similar numbers refer to similar elements through it. The embodiments of the present invention may be described below with reference to block diagrams and illustrations of flowcharts of methods, apparatuses (i.e., systems) and computer program products according to one embodiment of the present invention.
invention. It should be understood that each block of block diagrams and flowchart illustrations, and combinations of blocks in block diagrams and flowchart illustrations, respectively, can be implemented by computer program instructions. These computer program instructions can be loaded into a general purpose computer, special purpose computer, or other data processing devices that can be programmed to produce a machine, such that the instructions executed on the computer or another data processing apparatus that can be programmed creates means to implement the functions specified in the block or blocks of the flowchart. These computer program instructions can also be stored in a computer-readable memory that can be run by a computer or other data processing apparatus that can be programmed to operate in a particular way, such that the stored instructions in the memory that can be read by computer they produce an article of manufacture that includes instruction means that implement the function specified in the block or flowchart blocks. The computer program instructions can also be loaded into a computer or other data processing apparatus that can be programmed to produce a series of operation steps to be performed on the computer or other apparatus that can be
program to program a procedure implemented by computer, so that the instructions executed on the computer or other device that can be programmed provides the steps to implement the functions specified in the block or blocks of the flow chart. Accordingly, the blocks of the block diagrams and flowchart illustrations support the combinations of means for performing the specified functions, combinations of steps for performing the specified functions and program instruction means for performing the specified functions. It will also be understood that each block of the block diagrams and flowchart illustrations can be implemented by specific purpose hardware-based computing systems that perform the specified functions or steps, or combinations of hardware and specific purpose computation instructions. . Generally, the concepts of various modalities of the present invention relate to the systems and methods for the processing of singularized and non-singularized articles. The modalities of the systems and methods generally involve two subsystems, a data acquisition and deployment system and a tracking system, such as, for example, an optical tracking system. In one embodiment, the data acquisition and display system includes a group of protective glasses having one or more information collection devices, such as, for example, cameras, identification readers,
radio frequency (RFID), bar code readers, RF receivers, etc., or combinations thereof for data capture and display of transparent warnings to display data and track items. The articles can be singled out or non-singularized, and these can be stationary or moving. Data capture and tracking for this mode is initiated by directing at least one of the information collection devices in the goggles towards a tag or label on an article and initiating the tracking of the article by, for example, discovering a light of passive notice, such as, for example, a point of retro reflection located soon in each article. The data captured by the goggle collection device of the goggles are transmitted via a network to a local computer that records the data of the item and determines the instructions to be displayed in the warning display. The local computer can interface with one or more servers and business applications. In other modalities, the acquisition and deployment of data can be done through more than one device. For example, the information collection devices may be mounted on the goggles, or they may be separated from the protective goggles, such as mounted on the rod or to fixed bar code readers, RFID readers, cameras, etc. Additionally, in some embodiments, the deployment may be separate from the protective goggles, since it may be a fixed display or display panel, such as those well known in the art.
matter, or it may be a fixed display to a person by means other than protective goggles. The deployment can be of the type of those items that are seen through the display and the characteristic information about the items is displayed on or substantially next to the articles viewed. In other cases, a representation of one or more items may be displayed in the display and the characteristic information about the one or more items displayed in or near the representations. Additionally, the characteristic information can, in some cases, serve as the representation of the article. For example, in a package management application, the postal code of the packages can serve as the representation of the article, while also serving as characteristic information about the article. One mode of the tracking system is an optical tracking system that includes a series of fixed cameras, which tracks the passive warning lights through a sorting and charging facility and a passive warning light location tracking computer ( PBLT). When a user searches for a package through the goggles, one of the information collection devices of the goggles or a sensor device, such as a warning light detection device collects at least two of the light rays of active warning. By collecting these rays, the local computer has the ability to determine the user's location and the user's position. The optical tracking system has the ability to track the location of the passive warning lights identified
in a unique way and associate the information with each passive warning light. The PBLT computer sends information back to the local computer of the protective glasses through the network, such as, for example, a wireless network. Accordingly, items in the field of vision of the bearer will display their information in the warning display and will generally appear to be superimposed in a close-up manner around or on the real objects in the field of vision of the bearer. Such overlaid information can be applied to articles in a sequential or random manner, or it can be applied to all articles in the field of vision of the bearer or work area. In a modality, only the information relevant to the particular bearer will be superimposed on the articles. The articles can be singled out or non-singularized in the field of vision of the bearer. Other embodiments of the tracking system may involve the use of a conveyor such as, for example, the RFID tags that are attached to or associated with the articles to be tracked and where the location of said carriers is monitored by fixed detectors, as is known. in the matter. For example, the Patent of E.U.A. No. 6,661, 335 issued December 9, 2003, for Seal, incorporated herein by reference and prepared as a part thereof, describes a system and method for determining the position of an RFID carrier with respect to a sensor. .
One embodiment of a data acquisition and display system of the present invention comprises a group of protective goggles having a transparent display. The term "protective goggles" is used in a generic way and is intended to include any form of lenses (prescription or otherwise), protective or protective or even empty frames or other apparatus mounted to the head or body with the ability to have a deployment transparent and one or more information collection devices or sensors attached to it. The transparent display has the ability to display text and / or images without completely obstructing a line of sight of the wearer. This can be supported on the head or another part of the body, or in the alternative on a structure that allows a user to see a field of vision through the deployment. The data acquisition and display system in some embodiments is comprised of one or more information gathering devices such as, for example, cameras comprising an image capture camera for acquiring the label images and a light detection device warning that is used to acquire signals from active warning lights and tracking orientation and that are attached to protective goggles. In other embodiments, the label images are acquired by other means such as a fixed image acquisition station located on or adjacent to the conveyor belt. Protective goggles, in some embodiments, may include one or more orientation sensors that are used to track a
orientation of the carrier during moments of rapid head movements. Transparent deployment, information gathering devices and orientation sensors (if included) communicate with a local computer through a network that can be wired, wireless, optical or a combination of these. The local computer can communicate with one or more computers and / or different servers over a network and through a network interface. This network can also be wired, wireless, optical or a combination thereof. In other embodiments, the information collection devices may be RFID readers, bar code readers, RF receivers or transmitting receivers, or combinations thereof. The tracking system includes active light notices that provide a calculation reference for the system to determine the position and orientation of the data acquisition and display system bearers and the passive warning lights that are attached to or associated with each item of information. interest to provide a "record" activation for each item and to reduce the complexity of the three-dimensional tracking task. The tracking system additionally includes fixed detectors such as, for example, fixed cameras that are used to track an article associated with a passive warning light. An energy source such as, for example, a light source that is attached to each fixed detector and the energy is reflected back or returned to the fixed detector by the passive warning lights, in such a way
that fixed detectors will eliminate all items except those associated with passive warning lights. In one embodiment, the fixed detector is a fixed camera and the energy source is a light. A filter in each fixed camera passes the reflected light from the passive warning lights, so that it provides an image that shows only the passive warning lights associated with each item of interest. The tracking system provides information to a server or other processor that communicates with the local computer through a network and can provide information and instructions or receive information and instructions from one or more business applications. Figure 1 is a block diagram of one embodiment of the system 100 of the present invention. This embodiment is comprised of a data acquisition and display device that can be carried 102 combined with an optical tracking system 104. The optical tracking system 104 has the ability to track items that are associated with the passive warning lights 128, as these items move through all the facilities. The components of the data acquisition and display device 102 are adapted to be attached to a group of frames, lenses, guards, goggles, etc., 106 (hereinafter generically referred to as "protective goggles), which provide the ability to superimpose information on items that are being tracked closely around or on real objects (ie, tracked items)
that are within the field of vision of the wearer of protective goggles. This is because the optical tracking system 104 tracks the position information around the articles or objects having passive warning lights 128 associated with said items. This tracking occurs through the use of fixed cameras 108 and a PBLT computer 110. The item tracking information is provided to the data acquisition and display device 102. The data acquisition and display device 102 has a local computer 112 which calculates the position and orientation of the carrier. This is achieved through the use of active warning lights 114 having fixed, known locations and unique "signatures" and a warning light detecting device 116 such as, for example, a warning light camera and a light sensor. inertia comprising the components of the data acquisition and display device 102. The local computer 112 knows the location of the fixed active warning lights 114 and of the active warning lights 114 that are in the field of view of the light detection device Notice 116 (FOV) which has the ability to determine a position and orientation of the carrier. The information on the tracked items is provided to the local computer 112 from the optical tracking system 104 by means of one or more networks 120 and the network interfaces 122. Accordingly, certain information about the tracked items that are in the field of The view of the bearer can be displayed in a transparent display 1 8. This information may appear to be superimposed in a close form around or on the current article due to the viewing feature of the display 118.
The information displayed in the transparent display 118 around the tracked article is determined by the business applications 124 which interfaces with both the data acquisition and display device 102 and the optical tracking system 104 via the networks 120. For example, these business applications 124 may cause the sorting and loading instructions to appear on the articles, such that the data acquisition and display device carrier 102 does not have to read the entire article label or does not have to Read the instructions provided by the nearby screens, panels, CRTs, etc. Information on tracked items can be obtained through the information collection device 126, such as, for example, an image camera that obtains an image of the article label and registers the article to track the optical tracking system 104. The image of the label can be provided to the local computer 112 from the device of mage 126, where it is decoded and provided to business applications 124 via networks 120. Business applications 124 can combine the tag data with other information and indicate to the local computer 112 what information will be deployed in the transparent deployment 118. In other modalities,. the information about the tracking articles can be obtained by means of an information gathering device 126 such as, for example, a radio frequency identification reader (RFID). In one modality, the article's label can be a
RFID tag. As described above, the information gathering device 126 obtains the information from the label of an article and registers the article to track it by means of the optical tracking system 104. The information of the label can be provided to the local computer 112 from the information gathering device 126, wherein it is decoded and provided to the business applications 124 by means of the networks 120. The business applications 124 can combine the tag data with other information and indicate to the local computer 112 what information should be displayed in the transparent display 118. In other modes, other tracking systems may be used. For example, a tracking system that tracks RFID tags through the use of fixed RFID readers that can be used instead of an optical tracking system.
Data Acquisition and Deployment Device Figure 2 shows an embodiment of an example data acquisition and deployment device 200. The data acquisition and display device mode 200 shown in Figure 2 is comprised of five components, a set of protective frames or goggles 202, a transparent display 204, an information collection device such as an image camera 206, a warning light detection device and orientation sensor 208, and a local computer 210 having an interface Network (not shown). The deployment
204 may be, for example, the MicroOptic SV-3 VIEWER ™ as available from The MicroOptical Corporation of Westwood, Massachusetts, or similar devices that are available from Tek Gear, Inc., Winnipeg, Manitoba, Kaiser, or Electro -Optics, Inc., of Carisbad, California, among others. The transparent display 204 is used to display objects superimposed on the line of sight of real objects. The transparent display 204 could have a sufficient resolution to see the overlapping objects without causing excessive eye fatigue. In one embodiment, the resolution of the transparent display 204 may be, for example, a point format of 640 columns x 480 rows and has a FOV of at least 75 degrees. The transparent display 204 may be any monochromatic or color. In other embodiments, the deployment may be a device separate from the protective goggles through which the articles may be viewed or, in other embodiments, in which a representation of the article may be seen, wherein said representation may include the contour of the image of the articles, symbols that represent the articles or characteristic information about the articles. In one embodiment, the warning light detecting device 208 is a camera attached to the protective goggles 202 and is used to acquire the active warning lights 114 (to determine the position and orientation of the wearer), and to acquire warning lights. passive that are in the field of vision of the carrier. In one embodiment, the device
warning light detection 208 is a warning light camera which is comprised of a wide-band narrow-view camera (approximately 90 ° FOV) and orientation sensor. The warning light detection device 208 is used to acquire the warning lights (both active and passive) and the orientation sensor is used to track the orientation of the carrier. In the embodiment shown in Figure 2, the information collection device is an image camera 206 that is mounted on the protective glasses 202. The image camera 206, in one embodiment, is a visible light camera of the center of view which is used to acquire images of the label. The center of view visible light (also known as the image camera) 206 is used to acquire images and facilitate the registration of these images with a passive warning light. In other modalities, the image camera 206 can be separated from the protective glasses 202. Generally, the image camera 206 will have a depth of field that is set at approximately 30.48 cm to 76.2 centimeters and a FOV of approximately 28 degrees. The resolution of the image camera 206 in one embodiment is approximately 1500 x 1500 (2.25 million points). A frame frame capture sequence for the image camera 206 is activated by the discovery of a passive warning light in a target area in close proximity. The image camera 206 can capture up to 1000 images per hour.
The protective goggles 202 should provide the wearer with a
FOV enough in such a way that the wearer does not have to continually move his head back and forth. In one modality, this
FOV is provided by protective goggles 202 that have at least 75 degrees FOV, although other FOV grades may be used. The local computer 210 comprises a computer and network interface (not shown) that determines the orientation and determined position of the bearer from the images obtained from the warning light detection device and orientation sensors 208. The local computer 210 also performs the calculation of the view plane, which is a procedure that uses the three-dimensional position data for each relevant object, and determines the position and orientation of the carrier of the data acquisition and deployment device 200. The local computer 210 handles the symbology of Application deployment provided for each relevant object to determine what will be displayed in the transparent display 204 and where to display the information in such a way that it appears superimposed closely around or on the article. The local computer 210 performs the discovery of the passive warning light in close proximity and records, processes the information such as, capture of image from the camera of capture of magen 206, the calibration of detection device of warning light 208 and the image camera 206 with the transparent display 204, the calibration of the active warning lights 114 relating to the fixed cameras 108, the communications (generally wireless), and
decoding of codes that can be read by a machine, which has the capacity to significantly reduce the response time displayed by information about objects already registered. For example, system 100 is ready to display information about an object and the object becomes obscured for a short time and then appears again; the user registers the object again and quickly distinguishes the relevant information; the on-board decoding avoids the time to transfer the image through the communications network 120 to the business applications 124 for determining the display of information. In one embodiment, for example, the local computer 120 may be a low power consumption CPU of 250 MHz. The packaging of the local computer 210 may also contain a power source (not shown), which may be autonomous, such as, for example, batteries or other rechargeable, replaceable, reusable forms or renewable energy sources. In one embodiment, for example, the power source is 10-volts, 3 amps per battery hour. In the embodiment of Figure 3, the local computer 210 communicates with the devices mounted on the protective glasses 204, 206, 208 by means of a cable 212. However, in other modalities, said communication may occur wirelessly, through optical fibers, or combinations thereof. Figure 3 is a mode of the data acquisition and deployment device 302 as shown in a carrier
304. As shown in the embodiment of Figure 3, the data acquisition and display device 302 is comprised of a transparent display 306 that is adhered to or incorporated within a group of protective frames or goggles 308, and one or more collection devices. of information such as cameras, and orientation sensors 310 adhered to frames 308. Frames 308 are mounted on the head of a carrier 304, similar to a pair of protective glasses or goggles. A local computer 312 communicates with the transparent display 306, the information collection devices and the orientation sensors 310, the optical tracking system 104, and the business applications 124 over one or more networks.
Tracking system Figure 4, is an example diagram of the use of fixed cameras of fixed detectors in a warning light location tracking application in one embodiment of the present invention. Fixed detectors such as, for example, fixed cameras 402 are mounted at fixed positions in the vicinity of the objects of interest 404. The purpose of these cameras 402 is to continuously provide images to the procedure that calculates the current location of each object of interest. (also known as "articles") 404. Objects of interest 404 can be singled out (not
shown), or not singularized. Each object of interest 404 is associated with at least one passive warning light 406. Figure 5C is an example diagram of the use of fixed detectors such as, for example, fixed cameras 504 in a light location tracking application. of passive warning in a modality of the present invention and having more details than Figure 4. In this embodiment, an energy source such as, for example, a light source 502 is attached to each fixed camera 504 and aims at along the path path 506. The light source 502 is generally not visible to the human eye (e.g., infrared), although in other embodiments other visible or non-visible light sources may be used such as, for example, laser beams, colored lights or with different colors, ultraviolet lights, etc. The lenses 508 of the camera 504, in a manner as shown in Figure 5C, are coated with a filter 510 which is matched to the frequency of the light source 502. The purpose of the light source 502 and the filter 510 is to provide an image 512 that only shows passive warning lights 514 that are attached to or associated with each individualized or non-singularized item of interest 516, as shown by images 512, 518 of Figures 5C and 5B, respectively. In one embodiment, the fixed cameras 504 are inexpensive, video camera type cameras for the network that have a resolution of approximately 640 x 480 points. Figure 6 is an example illustration of the use of active warning lights 602 to determine the position and orientation of a carrier 304
of a data acquisition and deployment device 102 in a modality of the present invention. The active warning lights 602 provide a calculation reference for the local computer 112 to determine the position and orientation of a user carrying the device 102. In one embodiment, the active warning lights 602 are intermittent light sources which are each exceptionally recognized by the warning light detection device 116 of the data acquisition and display device 102. In other embodiments, the active warning light 602 can be any single magnetic, electrical, electronic, acoustic transmission source, optical transmission that is it can recognize by the warning light detection device 116 of the data acquisition and display device 102. Each active warning light 602 has a relative fixed position 604 such as, for example, three-dimensional coordinates x, y, and z. The relative fixed position 604 of each active warning light 602 is known to the local computer 112, therefore, the relative position and orientation of a carrier of the data acquisition and display device 102 can be calculated by the local computer 112 by determining which active warning lights 602 are in the FOV of the warning light detecting device 116 of the data acquisition and display device 102. Generally, the power source of the warning light 602 is of infrared light, although other visible sources or not visible can be used such as laser beams, colored lights or different colors, ultraviolet lights, etc. In addition, in some cases, each active warning light 602
it can use unique non-optical signals such as, for example, electronic, acoustic, magnetic transmissions, or other forms that provide a unique signal to determine the orientation and position of the carrier 304. In a mode where the active warning light 602 is a intermittent infrared light source and the warning light detecting device 116 is a warning light camera, each active warning light 602 is uniquely identified by an intermittent pattern that distinguishes each active warning light 602 from other sources of light and other active warning lights. For example, in one embodiment each active warning light 602 transmits a unique 11-bit identification repeat pattern. This pattern consists of a 3-bit preamble followed by an 8-bit ID value. For example, the preamble can be "001" and the ID value can be one of 88 values that do not start with or contain the string "001". Each bit pattern is divided into two transmitted bits. The status of the transmitted bit determines whether the warning light is on or off. The value of the transmitted bits is determined using a standard technique called "alternative brand inversion" or AMI. The AMI is used to ensure that the warning light has a reliable intermittent index. The AMI is generally coded, whereby an information bit "0" becomes "01" and an information bit "1" alternates between "11" and "00". The duration of the transmitted bit is slightly longer than the interval captured from the frame of the warning light camera 116. That is, in such a way that the light camera of
Notice 116 does not omit any intermittent status. Assuming, for example, 10 frames per second frame index, the bit transmitted will last approximately 110 milliseconds. Accordingly, the time for the cycle of the active warning light through the complete identification cycle is: 11 bits x 2 transmitted bits x 110 milliseconds = 2.4 seconds. The on / off cycle of each active warning light 602 is approximately 220 milliseconds. The warning light detecting device 116 of this mode has the ability to isolate the flashing light of the warning light 602 from the filtered background noise of all light sources not having the determined frequency. Figure 7 is an example illustration of the use of active warning lights 702 in one embodiment of the invention, such as passive warning lights 702 which are used for the tracking of articles 704. The passive warning light 702 is intended it is a low cost item that is linked to or associated with each item of interest 704. Its purpose is to provide a registration activation for each item 704 and to provide a reference point to help track the three-dimensional position of the magen data. , as obtained from the fixed cameras 504. In one embodiment, the passive warning light 702 is used once, the adhesive light reflector, such as the retro reflector of available 3M points from St Paul Minnesota. The retro-reflection causes the light of a certain location to be reflected back, without wide dispersion, in the light source. The light source 502 attached to each fixed camera 504 (previously described, see
Figure 5A) is reflected back to the fixed camera 504. Since most other strange sources of light (noise) will be from less reflective sources than the retro-reflective points, the image seen by the fixed camera 504 will be easily processed to eliminate most of the forms except for the passive warning lights 702. Generally, a passive warning light 702 having a diameter of approximately 1.27 centimeters will provide the necessary resolution for the fixed cameras 504 at a reasonable rate. In other embodiments, the passive warning light may be an RFID tag located on or associated with the article. An RFID modulated signal is returned from the passive RFID tag warning light when a given RF signal is present. In addition, said passive warning light overcomes the challenges associated with the passive warning light which must maintain a certain orientation towards a detector. For example, a passive RFID warning light could continue to be tracked if the item is thrown or if it is passed under some obstruction. As described above, in the U.S. Patent. No. 6,661, 335, incorporated in the present description in its entirety, describes a system and method for tracking a repeater relative to a sensor (e.g., a fixed detector). The procedure involved in the optical tracking system that knows the position of the passive warning lights 702 is two parts; a record of the passive warning light and the tracking of the passive warning light.
The concept of passive warning light tracking is illustrated in the embodiment shown in Figures 8A, 8B and 8C. The passive warning light tracking occurs once the passive warning light 806 has been detected by one or more fixed detectors such as, for example, fixed cameras 804, 804a. The three-dimensional calculated position 802 of the passive warning light 806 is determined from knowing the position and orientation of each fixed camera 804, 804a. The passive warning light location tracking system 110 calculates the position of the passive warning light from two-dimensional images (Figures 8B and 8C) of the fixed cameras 804, 804A that are interpolated to be synchronized in tracking time of the position of the passive warning light 806 relative to location 808, 808a of each of the fixed cameras 804, 804a. The system that tracks the passive warning light location 110 should keep track of a passive warning light 802 during periods of intermittent disappearance and when the passive warning lights 802 are visible only to a fixed camera 804 to provide consistent tracking. The two fixed cameras 804 first acquire a passive warning light 802 to initially determine the location of the passive warning light, although a "lock" is maintained while the passive warning light 802 is visible only to a fixed camera 804. The system The location tracking of the passive warning light 110 makes the deductions on the movement of the passive warning light which allows the blocking to be maintained during the time of disappearance. For example, passive warning light currents
associated with articles flowing along a conveyor system (as shown in Figures 5A and 5C) that has a high probability that it does not flow backward. The probable path of the passive warning light 802 is utilized by an algorithm of the passive warning light location tracking system 110 to track the unobserved passive warning light 802. It may also be possible to track the passive warning lights 802 which they flow under a passage conveyor observing a continuous flow. However, when the passive warning lights 802 fall out of view of all the fixed cameras 804 for a significant period of time, the location tracking system of the passive warning light 110 loses the article and the latter (the light of passive warning) has been essentially departed from the perspective of the location trail system of the passive warning light 110. Figures 9 and 10 provide exemplary illustrations of the concept of passive warning light registration, in one embodiment of the present invention. The registration of the passive warning light occurs when a passive warning light is being detected simultaneously by two or more fixed detectors and the location tracking system of the passive warning light 110 declares that the passive warning light is uncovered . In a mode having a passive warning light comprising reflective material and fixed detectors comprising fixed cameras, the location tracking system of the passive warning light which discovers a passive warning light when a prominent reflection (generally, a reflection infrared) "flashes" in the warning light detection device 116 (in this case,
a warning light camera). In Figure 9, a person carrying a data acquisition and display device 102 has obtained an article
902 and has placed a retro reflective point 904 (eg, a passive warning light) in the article 902. In the embodiment of Figure 9, the passive warning light 904 is not visible since it is below the thumb of the person.
In Figure 10, the person has moved their thumbs, thus exposing the passive warning light 904, and causing a "flicker". He
"Flicker" is a stable reflection of long duration (greater than about half a second). The "flicker" is also observed by the fixed cameras 108 of the optical tracking system 110. The local computer
112 of the data acquisition and display device 102 assigns the newly acquired passive warning light 904 a unique operation. The data acquisition and display device 102 notifies the passive warning light location tracking system 110 of the passive warning light 904 discovered and driving, as well as, the approximate location of the passive warning light uncovered 904. Location tracking system of the passive warning light 110 refers to the handling of the passive warning light discovered for the tracked passive warning light that was observed by the "flashing" in the fixed cameras 108. The optical tracking system 104 it supports the blocking of the passive warning light 904 for the data acquisition and display device 102, allowing the data acquisition and display device 102 to provide positive tracking feedback to the bearer. The system of
optical tracking 110 publishes, and continually updates, the three-dimensional position of the passive warning light 904 relative to the unique handling provided by the passive warning light 904. In other embodiments, the "blinking" procedure can be performed by the wipes between the passive warning light and the fixed cameras 108 and / or the image device 206, by adjusting the aperture of the cameras 108, 206 or by the "automatic flicker" or the passive warning lights flashing 904. FIGS. and 12, illustrate the concept of acquiring information from the article (e.g., label information) in one embodiment of the present invention. In this modality, the information collection device is an image camera 206. The image camera 206 of this embodiment of the data acquisition and display system 200 acquires the image 1102 of article 1104. The local computer 210 of the acquisition device and data display 200 receives the image 1102 from the image camera 206 and codes the codes that can be read by a machine (eg, image barcodes, etc.) and passes the image 1102 and decoded information to the handling of the passive warning light related to any of the associated business applications 124. These business applications 124 assign the relevant information that can be displayed that will be presented to the designated carriers of a data acquisition and deployment device 200, when the three-dimensional position of the passive warning light 904 is within the field of view of the transparent display and within the range. In another modality (no
shown) the "tag" is an RFID tag and the information collecting device 126 is an RFID reader. Still in other embodiments (not shown), the information article can be acquired by fixed devices or separate devices of the data acquisition and display device, such as devices known in the art. In the particular embodiment of Figure 11, an image of the acquired information 1102 is displayed on or close to the article 1104 to verify the acquisition of the information.
Orientation of the data acquisition and display device The local computer 112 uses the real-time information derived from the warning light detection device 116 to determine the orientation and position of the data acquisition and display device
102, and thus, any carrier of the device 102, relative to the active warning lights 114. The guidance information derived from the warning light detecting device 116 is augmented by the rotational sensors of three inert high degrees of freedom. sensitivity (DOF) (not shown separately from device 116). The orientation information is comprised of IDs of the active warning light and the two-dimensional position of the active warning light of the warning light detecting device 116. Additional information that is needed includes the three-dimensional reference locations of the warning light active against active warning light IDs. The active warning lights
multiple 114 are used to determine the position and orientation of the data acquisition and display device 102. The more active warning lights 114 used to calculate the position and orientation, the more accurate the measurement will be. Also, it may be possible for a particular active warning light ID value to be used for more than one active warning light in a particular installation. Accordingly, the data acquisition and display device 102 must have the ability to discard non-deterministic position values (e.g., positions that can not be resolved from the warning light images). Due to the relatively slow nature of the ID transmission sequence of the active warning light, the tracking design must accurately assume the identification of each active warning light 114 for each updated image capture frame. Once the active warning light 114 is identified, the data acquisition and display device 102 must "block" and track its movement (which is produced by the movement of the carrier) in the two-dimensional image plane. The only known tinkle or transmission index, the pattern or signal of the active warning lights 114 allows image processing to remove most of the energy sources from the image other than the active warning lights 114 by means of the use of a filter such as, for example, a narrow-pass filter. The remaining active warning lights are identified after observing a complete ID cycle (previously described). The extrapolated two-dimensional position of each identified active warning light 114 is
entered into the three-dimensional position and the orientation calculation procedure.
Inertia Navigation Because it can be difficult to track a movement of the wearer's head with the active warning lights 114 when the movements of the wearer's head is relatively rapid, the inertial sensors, in combination with the light detection device of Notice 116, can be used in these cases to determine the orientation of the head. Inertia navigation technology, in one mode, uses micro-machined accelerometers of semiconductor size to detect rotation. Such devices are commercially available from manufacturers such as, for example, InterSense, Inc. of Burlington, Massachusetts, among others. The inertial navigation sensors may replenish or supplement the orientation signal of the active warning light 114 during periods of rapid head movement.
Calibration of fixed detectors (positioning) The procedure of installing fixed detectors, such as, for example, fixed cameras 108 and establishing their known position in relation to other fixed cameras 108 is a multi-step procedure, by which, multiple cameras fixed 108 observe the same object and learn their position and relative orientation with each other. Referring to
flow chart of Figure 13, the following steps are involved in establishing a position and orientation of the detector: The procedure begins at step 1300. In step 1302, the first and second detectors to be calibrated are selected because they are installed adjacent to each other (with a normal separation distance for tracking). In step 1304, the tracking system 104 is placed in the calibration mode for the two fixed detectors of interest. In step 1306, a passive warning light 904 is placed within the vision of both fixed detectors and the passive warning light is covered or blocked and discovered several times in a manner that causes a "flickering" effect, thereby causing that the tracking system 104 calculate the relative possible positions and orientations of both fixed detectors relative to each other. In step 1308, the passive warning light 904 is again placed in a different location within the field of view of both fixed detectors and the "blinking" procedure of step 1306 is repeated. In step 1308, the procedure of flashing / re-positioning of the passive warning light is repeated until the tracking system 104 indicates that a simple single position is known by each fixed detector, which can be taken between two and four interactions of the blinking procedure / new placement. In step 1310, the third of the remaining fixed detectors is calibrated in a similar procedure of flashing / re-positioning until all fixed detectors are calibrated. If a fixed detector will not be calibrated during the flashing / re-positioning procedure, it may be installed incorrectly and
It needs to be repeated or installed again. The procedure ends in step 1312. When a new fixed detector is installed or an old fixed detector moves, the blinking / repositioning procedure is performed so that the new detector position is learned relatively for the detectors adjacent calibrated.
Calibration of the data acquisition and deployment device The data acquisition and display device 200 is calibrated in such a way that the alignment between the devices of the data acquisition and deployment display 200 is known. It is assumed that normal manufacturing tolerances and routine use will result in an amount of misalignment of the active warning light detecting device 208, the information gathering device, such as an image camera 206, and the transparent deployment 204. These devices require concurrent alignment to achieve better operating characteristics of the data acquisition and deployment device 200. The method requires first placing the data acquisition and display device 200 in the calibration mode to aim the camera. 206 image in a special pattern or barcode. A pattern of "strand of hair" is then displayed in the transparent display 204 and the strands of hair are pointed to the special calibration pattern. The transparent display 204 will then request successive tests to point the hair strands of the transparent display 204 until the
acquisition and display of data 200 has the ability to isolate the necessary precision in the alignment compensation for the image camera 206, the warning light detection device 208, and the transparent display 204. This calibration information will be retained by the Data Acquisition and Deployment Device 200 up to the next calibration mode procedure.
Calibration of active warning lights The position of each active warning light 114, in relation to fixed detectors, such as, for example, still camera 108, must be known, in such a way that the data acquisition and display device 102 can determine the position and orientation of a carrier relative to the active warning lights 114. The calibration procedure begins by attaching an active warning light 114 next to each of the three calibrated and adjacent fixed cameras 108 or having three lights warning devices 114 with known locations. The positions of these active warning lights are known from the positions of the fixed cameras 108. A fourth active warning light 114 is placed anywhere within the field of view of the warning light detecting device 116 together with the three initially placed active warning lights 114 having known locations. With the calibrated data acquisition and display device 102 which has been placed in its active warning light calibration mode, the wearer points the hair strands deployed in the transparent display 118 in FIG.
the fourth active warning light 114. The carrier is then cautioned to reposition the data acquisition and display device 102 (while still maintaining the three active warning lights 114 with the known locations and the fourth active warning light 114 in the field of view of the warning light detecting device 116) several times until a location for the fourth active warning light 114 is calculated by the local computer 112. This procedure is repeated as active warning lights are added 114 through the facilities. Anytime a new or moving active warning light is installed, this method of pointing and calibrating a data acquisition and display device 102 will determine the relative location of the active warning light 114. The warning light installer active 114 chooses the physical ID values for each active warning light 114. The installer should not use equivalent IDs in the active warning lights 114 which are adjacent to a common active warning light 114. One way to avoid this is to section the installation in grid areas of 3 x 3 repetition, zones "a" to "i". All active warning lights 114 installed in an area "a" are assigned to an ID from a group of IDs "a" previously determined, all the active warning lights installed in a zone "b" are assigned to an ID from a group of IDs "b" previously determined, etc. The size of each zone is a function of the number of active warning lights 114 that may be required at most in each zone. The 3 x 3 grid is repeated through the
facilities as often as necessary. The random nature of the active warning light locations, generally prevents any two zones within the facilities from having the exact relative positioning of the active warning lights 114 within each zone. Each active warning light 114 in an installation has a unique logical ID value (previously described) which is assigned to the combination of a physical ID value and a three-dimensional position. The active warning light installation procedure produces and assigns the logical ID value.
Component interfaces With reference to Figure 14, the optical tracking system 1402 of this mode is designed to be as independent as possible. A passive warning light location tracking computer ("PBLT") 1404 accepts all images from the fixed camera 1406 and, with the known relative position and orientation of the fixed cameras 1406, uses the images to determine the three-dimensional location of each tracked passive warning light 1408. The optical tracking system 1402 is comprised of one or more data receipts from the information gathering device 1412 of one or more data acquisition and display devices 1410 which indicates the registration of a passive warning light 1408 for tracking; the fixed cameras 1406 from which the PBLT 1404 reads all the images of each fixed camera 1406; a deposit of fixed camera locations 1414 that contains each ID, position and logical orientation of
fixed camera and is used to calculate the positions of all tracked passive warning lights 1408, and is updated when the PBLT 1404 is in fixed camera installation mode; object location deposit 1416, which stores the location of each passive warning light (or article) 1408 by the logical ID of the item (can be accessed through the business applications); and, a maintenance console (not shown in Figure 14), which is a user interface that provides information on the configuration of the optical tracking system 1402 and controls the installation mode for the fixed cameras 1406. The warning lights passives 1408, are generally associated with items (e.g., packages) 1432, such that articles can be tracked.
Application Interfaces Still referring to Figure 14, in addition to providing information to the carriers of a data acquisition and display device 1410, the optical tracking system 1402 has the ability to provide information to other business applications 1418. For example , in one embodiment, the business application receives a logical article ID and the decoded tag information of the article from the data acquisition and display device 1410. The business application 1418 converts the label information into display information and publishes the information to the data warehouse 1420 that contains the object ID information and the associated display information. Making a reference
cross-information of the object ID with the location repository of the object
1416 of the optical tracking system 1402, this information can be provided to a data acquisition and display device 1410 which, upon knowing this position and orientation as determined by the orientation calculation method of the local computer 1422, the information of deployment can be displayed in transparent display 1424, such that it is properly associated with the object. The orientation calculation procedure involves accessing a warning light location database 1426 that contains the known locations of the active warning lights 1428 and a unique identifier assigned to each of the active warning lights 1428, such as when a carrier of a data acquisition and display device 1410 detects certain active warning lights 1428 by its identifier assigned with the warning light detection device 1430 of the data acquisition and display device, the local computer has the capacity to calculate the orientation and position of the data acquisition and deployment device
1410. In another embodiment, the business application 1418 receives images of the objects and converts the images into display information. In other embodiments, the business application 1418 receives a logical ID value for the data acquisition and display device 1410 that provided the information, along with the decoded data of the tag. If the decoded data of the label is of the type defined by the
application to represent a work indicator, then the business application 1418 has the ability to discern which 1410 data acquisition and deployment device is assigned to each type of work and the display of the information is provided only for these acquisition devices and data display 1410. Finally, the business application 1418 receives a logical article ID with the item position from the optical tracking system 1402. The business application 1418 uses the position information to determine the status of certain items, times of project processing, measurement of the total production of items in a facility and the realization of other business decisions.
EXAMPLE OF SYSTEM OPERATION
An example method for applying a system mode of the present invention is its use in a packet classification facility as shown in Figure 15. In this example, a data acquirer ("acquirer") 1502 and a classifier of packages ("Classifier") 1504 carry and use a data acquisition and deployment device 200 in the performance of their tasks. However, in other embodiments, the step of acquiring article information may be performed by devices not connected to the data acquisition and display device 200, such as by a digital scanning system on a conveyor belt,
as they are known in the art. Others, such as supervisors and exception handlers, can also carry a data acquisition and deployment device 200, although those people are not described in this particular example. In a first step, the acquirer 1502 and the classifier 1504, each with a data acquisition and display device 200, turn on and point the information collection device, such as, for example, an image camera 206 to an index of special job configuration, pattern or barcode that is defined by the application. The selected business application, such as the one selected by the job configuration index, is notified by each data acquisition and deployment device 200 of the initialization and work configuration. Accordingly, the business application is alert to the data acquisition and deployment devices 200 that are participating in each work area. The acquirer 1502 is placed near the discharge area of the package container 1506 of the facilities and the images of the shipping label of each package 1508. As shown in Figure 16, the acquirer 1502 points to a target 1602 that is displayed in the transparent display 204 of the data acquisition and display device 200 and places a passive warning light, such as, for example, an adhesive reflection passive warning light 1604 near the label 1606. The passive warning light 1604 is covered and discovered by blinking the light in this way
passive warning 1604 in the passive light detection device 208 of the data acquisition and display device 200 and activating the capture of the label image by the image camera 206. In other embodiments (not shown), the label information may be captured by tag readers on the conveyor belt or other similar devices, as are known in the art. In a recording step, the optical tracking system 1402 detects the occurrence of a passive warning light 1604 through the fixed detectors, such as, for example, the fixed cameras 108 and receives a notification event from an acquisition device. and data display 200 allocating a logical ID value to passive warning light 1604. Optical tracking system 1402 begins to track passive warning light 1604 and sends a tracking blocking acknowledgment to the acquisition and deployment device. of data 200. As shown in Figure 17, in this embodiment, the high contrast copy of the captured image 1704 is displayed in the transparent display 204 of the acquirer 1502 to indicate that the information on the label has been captured. If the captured image 1704 appears blurred, distorted or otherwise unclear, the acquirer 1502 may again capture the image 1704. The transparent display 204 of the data acquisition and display device 200 will also display a confirmation to the acquirer 1502 that a Tracing procedure for the item has begun and that the acquirer 1502 can move to the next
package. If the acquirer 1502 does not receive the confirmation or if the images need to be captured again, then the passive warning light 1604 must once again be "blinked" in order to repeat the acquisition cycle. If the confirmation is received and the image does not need to be captured again, the article is placed in a conveyor system 1512 with the passive warning light 1604 facing the fixed cameras 108. Although the acquired packets 1508 is moved either singularly or non-singularized on the conveyor belt 1512, the application of The business uses data from the data tag acquired from the image to determine the appropriate handling instructions for each 1508 package. If the label has insufficient encoded data, then the image of the label is transferred to an input workstation. by keyboard. Using the image of the label, the data entry personnel by keyboard will collect the information necessary to manage the package. Each classifier 1504 carrying a data acquisition and display device 200 has a defined field of view (FOV) 1510, as shown in Figure 15. Once the one or more of the packets 1508 on the conveyor 1512 is within the FOV 1510 of the classifier, as shown in Figure 18, the classifier 1504 will see that the superimposed handling instructions 1804 of the pack 1802 float next to or around the packets 1802 that are assigned to that one.
classifier 1504. Classifier 1504 will load each of those packets 1508 in accordance with the superimposed handling instructions 1804. In one embodiment, tracked packages 1508 on conveyor belt 1512 that have somehow lost their operating instructions have a special indicator (not shown) imposed on them and which can be registered again by "flashing" their passive warning light 1604 thus causing overlapping driving instructions 1804 to appear to the carriers of the data acquisition and display device 200. In some embodiments, the tracked packets 1508 are not assigned to the immediate area of a sorter 1504 that has a special symbol (not shown) superimposed thereon. This indicates that the packet is being tracked, although it is not to load it in the immediate 1504 area of the classifier. In some embodiments, packages that do not have handling instructions or special symbols associated with them, provide an indication that the packet was not registered by the acquirer 1502 or that the packet has been launched or otherwise lost its passive warning light 1604. In one embodiment, the packet information is displayed sequentially as each packet 1508 enters field of view 1510 or work area of classifier 1504, while in other modes, information is displayed for all packets 1508. within the field of view 1510 or work area of the classifier 1504. The packets 1508 can be singled out or non-singularized.
Figure 19 is a flow chart describing the steps for a method of processing an article in an embodiment of the present invention. The steps include starting the procedure in step 1900. In step 1902, an item is viewed while carrying a data acquisition and display device that has a transparent display. Step 1904 involves the deployment processing instructions in the transparent display in such a way that the processing instructions appear next superimposed on the article. In step 1906, the items are processed according to the processing instructions. The procedure ends in step 1908. Said procedure described in Figure 19 can be used for mail and package processing, among other uses. Figure 20 is also a flow chart describing the steps for a method of processing an article in another embodiment of the present invention. The procedure in Figure 20 begins in step 2000. In step 2002, an item is tracked with a tracking system as the item's location changes. In step 2004, the orientation and position of a bearer of a data acquisition and display device having a transparent display is determined. In step 2006, it was determined which items are in the field of vision of the transparent deployment of the data acquisition and deployment device. In step 2008, an article is seen through the transparent deployment of the data acquisition and deployment device. In step 2010, the instructions for
relevant processing for the article are displayed in the transparent display in such a way that the processing instructions appear next superimposed on the article. In step 2012, the item is processed according to the processing instructions. The procedure ends in step 2014. Figure 21 is a flowchart describing a method for displaying information on one or more items in a transparent display of a data acquisition and display device in an embodiment of the present invention. The procedure begins in step 2100. In step 2102, the orientation and position information is captured on a bearer of the data acquisition and display device. In step 2104, a field of vision of the transparent display is determined from the orientation and position information captured. In step 2106, the information is displayed in the transparent display around the articles in the field of view of the transparent display, such that the information appears to be superimposed on the articles, when the articles are viewed through of the transparent display. The procedure ends in step 2108. Said procedure, as described in Figure 21, can be used for mail and package processing, among other uses. Figure 22 is a flow chart describing a method for displaying information in a transparent deployment of a data acquisition and display device in another embodiment of the present
invention. The procedure begins at step 2200. At step 2202, the data on an article is captured by, for example, an information gathering device, such as the image device 126. In step 2204, the information and instructions on The article is determined from the captured data. In step 2206, the orientation and position information on a bearer of the data acquisition and display device is captured by, for example, the warning light detecting device 116. In step 2208, a field of view of the display Transparency of the data acquisition and deployment device is determined from the orientation and position information captured. In step 2210, the information and instructions are displayed in the transparent display on the article in the field of vision of the transparent display, in such a way that the information and instructions appear to be superimposed next to the article when the article is seen through transparent deployment. The procedure ends in step 2212. Figure 23 is a flowchart describing a method of optical tracing of one or more articles in one embodiment of the present invention. The procedure starts at step 2300. In step
2302, an energy source is provided, such as, for example, a light, magnetic waves, electronic transmission, etc. In step 2304, a passive warning light, such as, for example, a retroreflection point or other comprised shape or retroreflective material is placed on or associated with an article. The passive warning light is activated by the power source or
said warning light reflects the energy of the energy source. In step 2306, two or more fixed detectors, such as, for example, fixed cameras having fixed relative locations to each other are provided with each fixed camera having a defined field of view and having the ability to detect the transmitted or reflected energy of the passive warning light if the passive warning light is in the field of view of the fixed camera. In step 2308, the location of the passive warning light is calculated from the energy received by the two or more fixed cameras of the passive warning light as the location of the item changes. The procedure ends in step 2310. The procedure as described above can be used for the optical tracking of mail and packages, among other uses. Figure 24 is a flow chart describing an optical tracing method of one or more articles in another embodiment of the present invention. The procedure begins at step 2400. In step 2402, a power source is provided, such as, for example, light, magnetic waves, electronic transmission, etc. In step 2404, a passive warning light, such as, for example, a retroreflective point or another comprised shape or retroreflective material is placed on an article. The passive warning light is activated by the power source or said light source reflects the energy from the power source. In step 2406, two or more fixed detectors, such as, for example, fixed cameras that have known fixed locations in relation to each other, are provided with each of the fixed cameras that have a defined field of view and with the capacity
to detect the transmitted or reflected energy of the passive warning light, if the passive warning light is in the field of view of the fixed camera. In step 2408, the location of the passive warning light is calculated from the energy received by two or more fixed cameras from the passive warning light as the item location changes. In step 2410, a data acquisition and display device having a transparent display can provide an image device, such as, for example, an image camera or an RFID reader, a local computer, and a warning light detection device, such as, for example, a warning light camera. In step 4212, the image data on the article is captured with the image device. The image data may be, for example, a mailing label having both machine-readable and human-like elements or an RFID tag, or a combination thereof. In step 2414, information about the article is determined from the image data with the local computer. In step 2416, the orientation and position information about the data acquisition and display device is captured with the warning light detection device. In step 2418, a field of view of the transparent device is determined from the captured orientation and position information. In step 2420, it is determined whether the article is in the field of view of the transparent display from the location of the passive warning light. In step 2422, the information and instructions are displayed in the transparent display around the article, if the article is in the field of view of the display
transparent, so that the information and instructions appear to be superimposed next to the article, when the article is seen through the transparent display. The procedure ends in step 2424. Figure 25 is a flow chart describing a method for tracking articles in a modality of the present invention. The method begins with step 2500. In step 2502, a data acquisition and display device is provided having an information gathering device for capturing data about an item. The information collection device can be, for example, an image camera, an RFID reader, etc. The captured data may come from an email label and / or an RFID tag. An active warning light detection device is also provided for capturing orientation and position information on a data acquisition and deployment device bearer, a transparent display for displaying the information and instructions on the article, and a local computer on the computer. communication with the information collection device, the active warning light detection device and transparent deployment. A local computer decodes the data of the information gathering device, calculates the orientation and position of the bearer of the acquisition and display device of data from the orientation and position information captured by the active warning light detection device, and It provides information and instructions to be displayed in the transparent deployment on articles in the field of vision of the data acquisition and deployment device.
In step 2504 a tracking system is provided. The tracking system is comprised of a power source, such as, for example, a light. A passive warning light, such as, for example, a retroreflective point or an RFID tag is located in or associated with the article that is activated by the energy source or the passive warning light reflects the energy of the source of energy. Two or more fixed detectors are provided each having a defined field of view each having the ability to detect the energy transmitted or reflected from the passive warning light, if the passive warning light is in the field of view of the fixed detector . A passive warning light location tracking computer is in communication with the two or more fixed detectors. The passive warning light location tracking computer knows the location of each of the fixed detectors relative to the other fixed detectors and the passive warning light location tracking computer has the ability to calculate the location of the light of passive warning from the energy received by the two or more fixed detectors from the passive warning light as the location of the item changes. In step 2506, information on an item location is provided to the local computer from the tracking system, such that the local computer can determine which items are in the field of vision of the data acquisition and display device. In step 2508, information about those items in the field of view of the data acquisition and deployment device is
displayed in the transparent display, in such a way that the instructions and information appear superimposed next to the articles. The procedure ends in step 2510. Figure 26 is a flow chart describing a method for calculating the orientation and position of the bearer of the data acquisition and display device in an embodiment of the present invention. The procedure begins in step 2600. In step 2602, two or more unique active warning lights are provided that have known locations in relation to each other. In step 2604, a data acquisition and display device is provided having a warning light detection device with a defined field of view. In step 2606, two or more unique active warning lights within the field of view of the acquisition and data display device are detected by the warning light detection device. In step 2608, the location of the data acquisition and display device relative to the known location of the two or more unique active warning lights within the field of view of the warning light detecting device is determined. The method ends in step 2610. The embodiments of the present invention can be used in various applications in the classification and processing of packets and mail. For example, in one embodiment, certain people with classification / processing facilities may have the ability to see different information about the items that other carriers of the data acquisition and display device may have the ability to see. The
Examples include high value indicators, hazardous material indicators, and items that require special handling or adjustments. Security can also be facilitated through the use of system modalities since items are tracked constantly and their whereabouts are recorded by the system as they move through the facilities. And, as described above, the embodiments of the present invention can be used to track the flow of items through an installation, such that the flow can be improved or optimized. The embodiments of the present invention can also be used in applications other than packet and mail classification and processing. Many applications that involve queuing and queuing can use system modalities. For example, air traffic controllers that manage ground traffic at an airport may have information about flights superimposed in close proximity around or on current airplanes as observed by a controller carrying a data acquisition and deployment device. . Similarly, operators of train yards and truck dispatchers can have information about trains or trucks, their contents, etc., displayed on current trains and / or trucks. Additionally, classification facilities other than mail classification and package facilities may make use of the embodiments of the present invention. For example, the modalities of the present invention may be used in the classification of baggage at an airport, whereby,
the classification instructions can be displayed to the classifiers that carry the data acquisition and deployment device. The navigation and maintenance activities of complex facilities can also use the modalities of the present invention. A carrier of a data acquisition and deployment device may have the ability to view the instructions to guide them to a particular destination. Examples include libraries, warehouses, self-guided excursions, retail store-type facilities, etc. Routine maintenance of the apparatuses can be improved by having maintenance records that appear for the bearer of a data acquisition and display device when the bearer searches for the device in question. Many modifications and other embodiments of the present invention set forth in the present description will occur to those skilled in the art to which these inventions pertain, which have the benefit of the teachings presented in the foregoing descriptions and associated drawings. Accordingly, it should be understood that the inventions are not limited to the specific embodiments described and that modifications and other embodiments are intended to be included within the scope of the appended Claims. Although specific terms are used in the present description, they are used only in a generic and descriptive sense and not for purposes of limitation.
Claims (38)
1. - A data acquisition and display device, characterized in that it comprises: an active optical warning light detection device configured to capture orientation and position information on a carrier of the data acquisition and display device receiving unique optical signals from minus two active warning lights within a field of view of the active optical detection device, wherein each active warning light has a fixed, known, unique location and signature; and a transparent display that has a defined field of vision; and a communication computing device of said optical warning light detection device, said transparent deployment, and a passive warning light detection device, wherein said computing device is configured to track the location of one or more items non-stationary with a passive warning light located proximately in each of said one or more non-stationary articles as said passive warning light detection device receives the reflected energy from said warning lights located in each of said one or more non-stationary articles from a power source, wherein said computing device is configured to determine from the orientation and position information of the carrier of the device acquisition and display of data and the defined field of vision of the transparent display, which, if it exists, of the one or more non-stationary items each having a passive warning light device located next to it are in the field of viewing the transparent device and displaying information and instructions on the one or more non-stationary items each having a passive warning light device located next to it in the field of view of the transparent display, said information and instructions appear superimposed next on at least one or more of the non-stationary items.
2. The data acquisition and display device according to claim 1, further characterized in that it additionally comprises: an inertia sensor, wherein the inertial sensor provides orientation information of the acquisition and data display device during the movement of the data acquisition and deployment device.
3. The data acquisition and display device according to claim 1, further characterized in that it additionally comprises: an information gathering device for capturing data on the one or more items.
4. The data acquisition and display device according to claim 3, further characterized in that the The information collection device is comprised of a camera.
5. The data acquisition and display device according to claim 3, further characterized in that the information collection device is comprised of an RFID reader.
6. The data acquisition and display device according to claim 1, further characterized in that the one or more items are not singled out.
7. The data acquisition and display device according to claim 1, further characterized in that the one or more articles are singled out.
8. An item processing system, characterized in that it comprises: a data acquisition and display device, the data acquisition and display device is additionally comprised of: an information collection device for capturing data on one or more items not stationary; an active optical warning light detection device configured to capture the orientation and position information on a carrier of the data acquisition and display device receiving unique optical signals from at least two active warning lights within a field of vision of the active optical detection device, wherein each active warning light has a fixed, known location and a unique signature; a transparent display to display information and instructions on the one or more articles not stationary, said information and instructions appear superimposed in a close manner on at least one of the non-stationary items seen through the transparent display; and a local computer in communication with the information collection device, the active optical warning light detection device and transparent display, wherein the local computer decodes the data of the information collection device, calculates the orientation and position of the carrier of the data acquisition and display device from the orientation and position information captured by the active optical warning light detection device, and provides information and instructions to be displayed in the transparent display on one or more non-stationary articles viewed through transparent deployment; and a tracking system, wherein the tracking system is additionally comprised of: a power source; a passive warning light located next to each of the non-stationary articles, wherein said passive warning light reacts to the power source; two or more fixed detectors, each with the ability to detect the transmitted or reflected energy from each of the passive warning lights; and a passive warning light location tracking computer in communication with the two or more fixed detectors, wherein the location tracking computer of the passive warning light stores the location of each fixed detector in relation to the other fixed detectors and the passive warning light location tracking computer is configured to calculate the location of each passive warning light from the energy received by the two or more fixed detectors from each passive warning light, as the location of the one or more non-stationary items changes, wherein information on the location of the one or more non-stationary items is provided to the local computer from the tracking system, in such a way that the local computer can determine which items are in the field of vision of the data acquisition and deployment device and the information about those items can be displayed in the transparent display, in such a way that the instructions and information appear superimposed next to the one or more articles.
9. The article processing system according to claim 8, further characterized in that the data acquisition and display device further comprises: an inertia sensor, wherein the inertia sensor provides orientation information of the acquisition device and data deployment during the movement of the data acquisition and deployment device.
10. The article processing system according to claim 8, further characterized in that the information collection device is comprised of a camera.
11. The article processing system according to claim 8, further characterized in that the information collection device is comprised of an RFID reader.
12. - The article processing system according to claim 8, further characterized in that the passive warning light is comprised of a retroreflective material.
13. The article processing system according to claim 12, further characterized in that the energy source is comprised of a light.
14. The article processing system according to claim 8, further characterized in that the passive warning light is comprised of an RFID tag.
15. The article processing system according to claim 8, further characterized in that the two or more active optical warning lights are comprised of intermittent light sources.
16. The article processing system according to claim 8, further characterized in that the article tracking system is used for the classification and processing of mail and packages.
17. The article processing system according to claim 8, further characterized in that the one or more articles are not singled out.
18. The article processing system according to claim 8, further characterized in that the one or more articles are singled out.
19. - A method for processing articles, characterized in that it comprises: tracking one or more non-stationary items with a tracking system that communicates with a passive warning light detection device as it changes the one or more locations of the items stationary with a passive warning light located proximately in each of said one or more non-stationary articles as the passive warning light detection device receives the energy reflected from said passive warning lights located on each of said one or more non-stationary items from an energy source; determining the orientation and position of a carrier of a data acquisition and display device having a transparent display receiving unique optical signals from at least two active warning lights within a field of view of an active optical detection device, in where each active warning light has a fixed, known location and a unique signature; determining which of the one or more non-stationary items are in the field of vision of the transparent display of the data acquisition and deployment device; viewing at least one of the one or more non-stationary items through the transparent deployment of the data acquisition and display device; displaying the processing instructions relevant to at least one of the one or more non-stationary items, wherein said processing instructions appear superimposed in close fashion on the one or more non-stationary items; and process the one or more non-stationary items according to the processing instructions.
20. The method according to claim 19, further characterized in that said method is used for processing mail and packages.
21. A method for tracking one or more non-stationary articles, characterized in that it comprises: providing a source of energy; locating a passive warning light next to the one or more non-stationary items, wherein said passive warning light reacts to the power source; providing two or more fixed detectors having known fixed locations relative to each other, wherein each fixed detector has the ability to detect the transmitted or reflected energy from each passive warning light; calculating the location of each passive warning light from the energy received by the two or more fixed detectors of each passive warning light as the location of the one or more non-stationary items changes; provide a data acquisition and display device having a transparent display, an information collection device, a local computer, and an active optical warning light detection device; capture data about the one or more non-stationary items with the information collection device; determine the information about the one or more non-stationary items from the data captured with the local computer; capture the orientation and position information on the data acquisition and display device with the light detection device of active optical warning receiving unique optical signals from at least two active warning lights within a field of view of the active optical warning light detection device, wherein each active warning light has a known fixed location and a unique signature; determine a field of vision of a transparent deployment from the orientation and position information; determining whether at least one of the one or more of the non-stationary items is in the field of view of the transparent device from the location of the passive warning light; and display information and instructions on transparent deployment on at least one or more non-stationary items if the one or more non-stationary items are in the field of vision of the transparent display, in such a way that said information and instructions appear superimposed in a close manner on the one or more non-stationary articles that are seen through the transparent display.
22. The method according to claim 21, further characterized in that said method is used for mail and packet tracking.
23. The method according to claim 21, further characterized in that the capture of data on the one or more non-stationary items with the information collection device is performed with an image camera.
24. The method according to claim 21, further characterized by the capture of data on the one or more articles Non-stationary with the information collection device is done with an RFID reader.
25. A method for tracking non-stationary articles, characterized in that it comprises: providing a data acquisition and display device having an information collection device for capturing data on an article, an active optical warning light detection device for capturing orientation and position information on a carrier of the data acquisition and display device receiving unique optical signals from at least two active warning lights within a field of view of the active optical warning light detection device, wherein each Active warning light has a known, fixed location and a unique signature, a transparent display to display information and instructions on the item, and a local computer in communication with the information collection device, the active warning light detection device , and a transparent display, where the local computer ecodifies data from the information gathering device, calculates the orientation and position of the bearer of the acquisition and data display device from the orientation and position information captured by the active warning light detection device, and provides information and instructions to be displayed in the transparent display on at least one of the non-stationary articles in the field of vision of the data acquisition and display device; and provide a tracking system that has a power source, a passive warning light located in each non-stationary item that is reactive to the power source, two or more fixed detectors having the ability each to detect the transmitted or reflected energy of the passive warning light, and a light location tracking computer passive notice in communication with the two or more fixed detectors, wherein the passive warning light location tracking computer knows the location of each fixed detector in relation to the other fixed detectors and the warning light location tracking computer Passive has the ability to calculate the location of each passive warning light from the energy received by the two or more fixed detectors of the passive warning light as the locations of the non-stationary items change; provide information on the location of the one or more non-stationary items to the local computer from the tracking system, such that the local computer can determine which of the non-stationary items are in the field of vision of the acquisition and deployment device of data; displaying information on at least one of the non-stationary items in the field of view of the device for acquiring and displaying data in the transparent display, such that the instructions and information appear superimposed on the non-stationary article.
26. A system for the processing of articles, characterized in that it comprises: a stationary tracking system, configured to provide location information for each of a plurality of non-stationary items on a moving surface; Y a stationary display device for viewing the characteristic information for each of the plurality of non-stationary items in their respective locations.
27. The system according to claim 26, further characterized in that the characteristic information for each of the plurality of non-stationary articles is placed to indicate the relative position of the plurality of non-stationary articles on the surface.
28. The system according to claim 27, further characterized in that the characteristic information comprises a postal code.
29. The system according to Claim 26, further characterized by additionally comprising representations of the plurality of non-stationary items that are seen by the display device, wherein each display is positioned in relation to the plurality of the non-stationary articles on the moving surface and the characteristic information on the plurality of non-stationary items is placed next to the representation.
30. The system according to claim 29, further characterized in that each representation of the plurality of non-stationary items is comprised of characteristic information on that respective article.
31. - The system according to claim 30, further characterized in that the characteristic information comprises a postal code.
32.- The system according to claim 26, further characterized in that the stationary deployment device is a transparent deployment device and the characteristic information appears to be superimposed in close fashion on at least one of the plurality of non-stationary items seen through the deployment device.
33. The system according to claim 26, further characterized in that the stationary deployment device is a deployment monitor.
34. The system according to claim 26, further characterized in that the plurality of non-stationary articles is comprised of packets.
The system according to claim 26, further characterized in that the characteristic information is comprised of instructions for classifying the plurality of non-stationary articles.
36.- The system according to claim 26, further characterized in that the stationary tracking system is comprised of an optical tracking system.
37. - The system according to claim 26, further characterized in that the plurality of non-stationary items are not singled out. 38.- The system according to claim 26, further characterized in that the plurality of non-stationary articles are singled out.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10763440 | 2004-01-23 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| MXPA06008354A true MXPA06008354A (en) | 2006-12-13 |
Family
ID=
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP2244161B1 (en) | Item tracking and processing systems and methods | |
| US7561717B2 (en) | System and method for displaying item information | |
| US20250296118A1 (en) | Perception systems and methods for identifying and processing a variety of objects | |
| US11312570B2 (en) | Method and apparatus for visual support of commission acts | |
| US9852394B1 (en) | Light emission guidance | |
| US20090094140A1 (en) | Methods and Apparatus for Inventory and Price Information Management | |
| EP4235539A2 (en) | Robotic systems and methods for identifying and processing a variety of objects | |
| CN108460933B (en) | A kind of management system and method based on image procossing | |
| US12327159B2 (en) | Dynamic image annotation using infrared-identifiable wearable articles | |
| CN112934728B (en) | Airport luggage security check state tracking system and method | |
| MXPA06008354A (en) | Item tracking and processing systems and methods | |
| US12350713B2 (en) | Perception systems and methods for identifying and processing a variety of objects |