BE1029310B1 - SYSTEMS AND METHODS FOR ENHANCEMENT OF IMAGE CONTENT CAPTURED BY A MACHINE VIEW CAMERA - Google Patents

Abstract

Systems and methods for enhancing image content captured by a machine vision camera are disclosed herein. An exemplary method includes receiving an image captured by a machine vision camera that includes a plurality of items of information, determining boundaries of a bounding box for each corresponding item of information, and displaying a plurality of items corresponding to the corresponding items of information. The example method further includes: receiving a selection of an entry and determining coordinate boundaries of the bounding box and a secondary frame of the entry. The example method further includes displaying the image such that a center point of the secondary frame is located near the center point of a display area, and scaling the image such that at least one of a vertical pixel count and a horizontal pixel count of the secondary frame is within a vertical pixel count ratio threshold or a horizontal number of pixels of the display area.

Description

1 BE2022/5323

SYSTEMS AND METHODS FOR ENRICHING ONE OF

CAPTURED BY A MACHINE VIEW CAMERA

IMAGE CONTENT

BACKGROUND

Over the years, industrial automation has increasingly relied on machine vision components capable of

To support operators in a variety of tasks. In some

Implementations become machine-view components, such as

Cameras used to track moving objects, such as those traveling on conveyor belts past stationary cameras. Often these cameras are used in conjunction with backend software to capture images and determine a variety of parameters associated with objects moving by. A

Aspect of this requires an easy-to-use means of visualizing various elements on the screen of a user computing device running the backend software. There is therefore a need for improved systems and methods that provide such features.

SUMMARY

In one embodiment, the present invention sets out

Method for enhancing an image content recorded by a machine vision camera. The procedure may include:

Received, at an application running on a user computing device connected to a machine vision camera in a

in communication, an image captured by the machine vision camera, the image including a plurality of indicia, each of the plurality of indicia having a payload encoded therein; Identify each

indication in the picture; for each of the corresponding indicia in the image, determining bounds of a respective bounding box substantially enclosing the respective indicia in the image; Ads, on an interface of

Application, a plurality of entries, each of the plurality of

Entries each correspond to one item of the multiple items; Receiving, at the interface, a selection of one of the entries that selected one

9 BE2022/5323

results in an entry that has a corresponding indication; Determine, from the corresponding bounding box of the corresponding indication, an upper pixel coordinate limit, a lower pixel coordinate limit, a first side pixel coordinate limit, and a second side pixel coordinate

coordinate boundary; based on the upper pixel coordinate limit, the lower

pixel coordinate boundary, the first side pixel coordinate boundary and the second side pixel coordinate boundary, determining a secondary frame having an upper boundary, a lower boundary, a first lateral boundary and a second lateral boundary; View the image in one

display area of the interface such that a center point of the secondary frame is located within a predetermined distance threshold from a center point of the display area; and scaling the image so that at least one of (i) a first vertical pixel count between the upper bound and the lower bound is within a first predetermined

ratio threshold of a second vertical number of pixels of the display area or (ii) a first horizontal number of pixels between the first lateral

Boundary and the second lateral boundary within a second predetermined ratio threshold of a second horizontal number of pixels

display area is.

In a variation of this embodiment, the method may further include, for each corresponding indication in the image, displaying the corresponding

bounding box on an interface of the application.

In a further or further variation of this embodiment, at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is inclusive between 1:2 and 2:3.

In yet another or further variation of this embodiment, scaling the image includes scaling the image so that (1) the first vertical pixel count does not exceed the first predetermined ratio threshold of the second vertical pixel count, and (ii) the first horizontal

Pixel count does not exceed the second predetermined ratio threshold of the second horizontal pixel count.

3 BE2022/5323

In yet another or further variation of this embodiment, each of the plurality of entries includes a payload of the corresponding one

Declarations.

In yet another or further variation of this embodiment, the method further comprises displaying the corresponding one

bounding box corresponding to each of the multiple items of information appearing within a visible portion of the image displayed in the display area.

In yet another or further variation of this embodiment, the method further comprises masking a masked area in the

display area in response to receiving the selection, wherein the masked

area means an area outside of at least one of (i) the respective

secondary frame or (ii) the respective bounding box of the corresponding

information is.

In yet another or further variation of this embodiment, at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is user-definable such that a portion of the corresponding indication is excluded from the scaled image.

In yet another or further variation of this embodiment, the method further comprises displaying a miniature version of the image in the

Display area as an overlay covering part of the scaled image, with the thumbnail version of the image containing a specified area covering the scaled

picture represents.

In another embodiment, the present invention provides

Method for enriching an image content recorded by a machine vision camera. The procedure may include:

Received, at an application running on a user computing device connected to a machine vision camera in a

in communication, an image captured by the machine vision camera, the image including a plurality of indicia, each of the plurality of indicia having a payload encoded therein; Identify each

indication in the picture; for each of the corresponding indicia in the image, determining bounds of a respective bounding box that is substantially the

4 BE2022/5323 encloses the respective information in the image; Determine from the appropriate

bounding box of the corresponding information, a top pixel

coordinate boundary, a lower pixel coordinate boundary, a first side

pixel coordinate boundary and a second side pixel coordinate boundary for the

Respective indications, and based on the upper pixel coordinate limit, the lower pixel coordinate limit, the first side pixel coordinate limit and the second side pixel coordinate limit of the respective bounding box,

determining a respective secondary frame having an upper boundary, a lower boundary, a first lateral boundary and a second lateral boundary

has limitation for the respective indication; Ads, on an interface of

Application, a plurality of entries, each of the plurality of

entries corresponds to one item of the plurality of items; Receiving, at the interface, a selection of one of the entries that selected one

results in an entry that has a corresponding indication; Displaying the image in a display area of the interface such that a center point of each

secondary frame is located within a predetermined distance threshold from a center point of the display area; and scaling the image so that at least one of (i) a first vertical number of pixels between the upper boundary of the respective secondary frame of the corresponding indicia and the lower boundary of the respective secondary frame of the corresponding

indications within a first predetermined ratio threshold of a second vertical number of pixels of the display area or (2) a first horizontal number of pixels between the first lateral boundary of the respective

Secondary frame of the corresponding indication and the second lateral

boundary of the respective secondary frame of the corresponding indication is within a second predetermined ratio threshold of a second horizontal pixel count of the display area.

In a variation of this embodiment, the method may further include, for each corresponding indication in the image, displaying the corresponding

bounding box on an interface of the application.

In a further or further variation of this embodiment, at least one of the first predetermined ratio threshold or the second predetermined ratio threshold is inclusive between 1:2 and 2:3.

In yet another or further variation of this embodiment, scaling the image includes scaling the image so that (i) the first 5 vertical pixel count does not exceed the first predetermined ratio threshold of the second vertical pixel count, and (2) the first horizontal

Pixel count does not exceed the second predetermined ratio threshold of the second horizontal pixel count.

In yet another or further variation of this embodiment, each of the plurality of entries includes a payload of the corresponding one

Declarations.

In yet another or further variation of this embodiment, the method further comprises displaying the corresponding one

bounding box corresponding to each of the multiple items of information appearing within a visible portion of the image displayed in the display area.

In yet another or further variation of this embodiment, the method further comprises masking a masked area in the

display area in response to receiving the selection, wherein the masked

area means an area outside of at least one of (i) the respective

secondary frame or (ii) the respective bounding box of the corresponding

information is.

In yet another embodiment, the present

invention a machine vision system for enhancing one of a

Machine vision camera recorded image content ready. The

A machine vision system may include: a machine vision camera configured to capture an image including a plurality of indicia, each of the plurality of indicia having a payload encoded therein; and a user computing device executing an application, wherein the

User computing device with the machine vision system in one

Communication connection is established and configured for it: that of the

Machine vision camera to receive captured image in which each of the image

identifying information for each of the corresponding information in the image

6 BE2022/5323

determine boundaries of a respective bounding box that substantially enclose the respective indication in the image, display a plurality of entries on an interface of the application, each of the

plurality of items corresponding to a respective item of the plurality of items, receiving at the interface a selection of one of the items resulting in a selected item having a corresponding item, from the respective bounding box of the corresponding item an upper pixel coordinate limit, a lower pixel coordinate limit, a first

determine a side pixel coordinate boundary and a second side pixel coordinate boundary based on the upper pixel coordinate boundary, the lower pixel coordinate

coordinate boundary, the first side pixel coordinate boundary, and the second

lateral pixel coordinate boundary, determining a secondary frame having an upper boundary, a lower boundary, a first lateral boundary and a second lateral boundary, the image in a display area of the

Interface so as to indicate that a center point of the secondary frame is within a predetermined distance threshold from a center point of the

Display area is arranged, and to scale the image so that at least one of (i) a first vertical number of pixels between the upper limit and the lower limit within a first predetermined

ratio threshold of a second vertical number of pixels of the display area or (ii) a first horizontal number of pixels between the first lateral

Boundary and the second lateral boundary within a second predetermined ratio threshold of a second horizontal number of pixels

display area is.

In a variation of this embodiment is the

User computing device further configured to, for each respective

Indication in the image, the corresponding bounding box on a

View the application interface.

In a further or further variation of this embodiment, at least one of the first predetermined ratio threshold or the second predetermined ratio threshold is inclusive between 1:2 and 2:3.

7 BE2022/5323

In yet another or further variation of this embodiment, the user computing device is further configured to scale the image such that (i) the first vertical pixel count equals the first predetermined

ratio threshold of the second vertical pixel number does not exceed, and (2) the first horizontal pixel number exceeds the second predetermined one

ratio threshold of the second horizontal pixel number does not exceed.

BRIEF DESCRIPTION OF THE DRAWINGS

The accompanying drawings, in which like reference numerals refer to identical or functionally similar elements throughout the several views, together with the detailed description provided below, are incorporated in and constitute a part of the specification and serve to further illustrate embodiments of concepts, incorporating the claimed invention and explaining various principles and

Advantages of these embodiments.

FIG. 1 is an example system configured to enhance image content captured by a machine vision camera, in accordance with embodiments described herein.

FIG. 2A is a perspective view of FIG

imaging device of FIG. 1 according to described here

embodiments.

FIG. 2B is a block diagram of example logic circuitry for implementing example methods and/or operations described herein.

FIGs. 3A and 3B each represent an example

An application interface that illustrates a level of image enhancement that corresponds to the decoding of indications and displays

corresponds to payloads present in an image captured by a

machine view camera, according to embodiments of the present disclosure.

FIG. 4A and 4B each provide an example

Application interface illustrating a stage of image enhancement that corresponds to generating a secondary frame that essentially encloses information contained in an image captured by a

8 BE2022/5323

machine view camera, according to embodiments of the present disclosure.

FIG. 5A-5C each depict an example application interface illustrating a level of image enhancement that provides a

Scaling and/or otherwise emphasizing a selected indication within an image captured by a machine vision camera corresponds to FIG

Embodiments of the present disclosure.

FIG. 6 is a flow chart representative of a method for enhancing image content captured by a machine vision camera, according to embodiments described herein.

Those skilled in the art will recognize that elements in the figures differ from one another

Illustrated for simplicity and clarity and are not necessarily drawn to scale. For example, they can

Dimensions of some elements in the figures may be exaggerated relative to other elements to aid in an understanding of embodiments of the present invention.

Where appropriate, the apparatus and process components have been represented by conventional symbols in the drawings, only those specific details necessary for an understanding of the figures being shown

Embodiments of the present invention are essential to the

Revelation not to overload with details that are suitable for the

of ordinary skill in the art based on those given here

Description easy to understand.

DETAILED DESCRIPTION

Periodically, owners/operators of machine vision systems have a need for visual evaluation of images generated by the

imaging devices of the system were recorded. Here there is a

Need to zoom in on certain elements (such as barcodes) within the captured images for closer evaluation. This can be difficult to do in an automatic way, especially when there are multiple items of the same kind on the screen. Procedures described here address these difficulties and deliver

9 BE2022/5323 a solution that helps automate and simplify the zoom-in process.

1 illustrates an example imaging system 100 configured to capture an image captured by a machine vision camera

Enrich image content according to various disclosed herein

embodiments. In the exemplary embodiment of FIG. 1, imaging system 100 includes user computing device 102 and a

Imaging device 104 connected via a network 106 to the

User computing device 102 is in communication. In general, user computing device 102 and imaging device 104 may be capable of executing instructions to perform, for example, operations of the example methods described herein, such as that illustrated by FIGS

Flow charts of the drawings shown which of the present

description enclosed. The user computing device 102 is generally configured to allow a user/operator to

to create a machine view job for execution on the imaging device 104. Once created, the user/operator can then use the

Transmit/upload the machine view job over the network 106 to the imaging device 104 where the machine view job is then interpreted and executed. User computing device 102 may be one or more

User workstations include and may include one or more processors 108, one or more memories 110, a network interface 112, a

Input/Output Interface (I/O Interface) 114, a smart imaging

application 116 and an image enhancement application 128 . It is to be understood that a "machine view job" as referred to herein may include or be any suitable imaging job that performs any executable task, such as machine view tasks,

Barcode decoding tasks and/or any other tasks or

combinations thereof.

The imaging device 104 is connected via a network 106 to the

User computing device 102 connected and configured to

Interpret and execute machine view jobs created by the

user computing device 102 are received. In general, they can

10 BE2022/5323

Imaging device 104 via network 106 from the

User computing device 102 contain a job file containing one or more

Contains job scripts that define the machine view job and the

Image generating device 104 can configure images according to the

Record and/or analyze machine view jobs. For example, the

Image generating device 104 contain a flash memory, which for

Determining, storing or otherwise processing image generation

data/records and/or post-imaging data is used. The

Imaging device 104 may then receive, detect, and/or otherwise interpret a trigger that causes imaging device 104 to capture an image of the target object according to the configuration created via the one or more job scripts. After the images are captured and/or analyzed, the imaging device 104 may transmit the images, as well as any associated data, over the network 106 to the user computing device 102 for further analysis and/or storage. In various embodiments, the

Imaging device 104 may be a "smart" camera and/or otherwise configured to provide sufficient functionality

Image generating device 104 to obtain, interpret, and execute job scripts that define machine vision jobs, such as one or more job scripts contained in one or more job files, e.g

User computing device 102 can be obtained.

Generally speaking, the job file can be in a JSON

representation/data format of the one or more job scripts transmittable from user computing device 102 to imaging device 104 . The job file may also be loadable/readable by a C++ runtime engine or other suitable runtime engine running on the

Image forming device 104 is executed. In addition, the

Image forming device 104 operate a server (not shown) configured to search for job files from the

to look out for and receive user computing device 102 .

Additionally or alternatively, the one for looking out and receiving

11 BE2022/5323 servers configured by job files may be implemented as one or more cloud-based servers, such as a cloud-based computing platform.

For example, the server can be one or more cloud-based platforms such as MICROSOFT AZURE, AMAZON AWS, or the like.

In any event, the imaging device 104 may include one or more

processors 118, one or more memories 120, a network interface 120, an I/O interface 124, and an imaging assembly 126. The

Imaging assembly 126 may be a digital camera and/or a digital

video camera for taking or recording digital images and/or

recordings included. Each digital image may contain pixel data that can be analyzed by one or more tools, each configured to perform an image analysis task. The digital camera and/or digital video camera, for example, of the imaging assembly 126 as disclosed herein may be configured to take, capture, or otherwise generate digital images, and in at least some

Embodiments store such images in a memory (e.g. one or more memories 110, 120) of a corresponding device (e.g. the

user computing device 102, the imaging device 104).

For example, imaging assembly 126 may include a photorealistic camera (not shown) to capture, capture, or scan 2D image data. The photorealistic camera may be an RGB (RGB=Red, Green, Blue) camera for capturing 2D images containing RGB pixel data. In various embodiments, the

Imaging arrangement also contain a (not shown) 3D camera to record, capture or scan 3D image data. The 3D camera can use an infrared (IR) projector and a corresponding IR camera to record,

Capture or scan 3D image data/datasets included. In some

Embodiments, the photorealistic camera of

Imaging arrangement 126 2D images and associated 2D image data at the same or a similar time as the 3D camera of FIG

Record imaging assembly 126 such that imaging device 104 for a particular surface, object, area, or scene can have both sets of 3D images at the same or similar time.

12 BE2022/5323

Image data and 2D image data may have available. In different

In embodiments, the imaging assembly 126 may include the 3D camera and the photorealistic camera as a single imaging device configured to capture 3D depth image data concurrently with 2D image data. Consequently, the captured 2D images and the corresponding 2D image data can be depth-aligned with the 3D images and 3D image data.

In embodiments, the imaging assembly 126 may be configured to generate images of surfaces or areas of a predetermined

Search space or record of target objects within the predetermined search space. For example, each tool contained in a job script may also contain a region of interest (ROT) that corresponds to a specific area or target object that is being processed by the

Imaging assembly 126 is imaged. The one from the ROIs for everyone

Compound tools included in a specific job script

area, can thereby define the predetermined search space that the imaging assembly 126 can accommodate in order to carry out the job

enable scripts. The predetermined search space may be customized to include a field of view (FOV) that may be more or less than the composite area defined by the ROIs of all tools included in the particular job script. It should be noted that imaging assembly 126 may include 2D and/or 3D

Can record image data/datasets from a large number of areas, so that additional areas are also taken into account here in addition to the predetermined search areas. Additionally, in various embodiments, the imaging assembly 126 may be configured to include other sets of

Image data in addition to the 2D/3D image data, such as greyscale

image data or amplitude image data, each of which can be depth-aligned with the 2D/3D image data.

The imaging device 104 can also use the 2D image data/

Data sets and/or 3D image data sets for use by others

devices (e.g., client computing device 102, an external server). For example, the one or more processors 118 may

13 BE2022/5323

Process image data or datasets captured, scanned or captured by the imaging assembly 126 . The processing of

Image data can generate post-imaging data metadata simplified

data, normalized data, results data, status data, or alarm data, such as that from what was originally scanned or captured

image data was determined. The image data and/or the post-imaging data may be sent to the user computing device 102 on which the

Smart imaging application 116 is run for viewing, manipulation, and/or other interaction. In other embodiments, the

Image data and/or the post-imaging data are sent to a server for storage or further manipulation. As described herein, the user computing device 102, the imaging device 104, and/or the external server or other centralized processing unit and/or memory may store such data and may also send the image data and/or the post-imaging data to another application running on one

user device, such as a mobile device, a tablet, a handheld device, or a desktop device.

Each of the one or more memories 110, 120 may be one or more types of volatile and/or non-volatile, fixed and/or removable memory, such as read-only memory (ROM), electronically programmable read-only memory (EPROM), memory with random access (RAM), an erasable electronically programmable

Read-only memory (EEPROM) and/or hard drives, flash memory, MicroSD

Maps and others include. In general, a computer program or computer-based product, application, or code (such as the Smart

Imaging Application 116 or other computational commands described herein) on a computer-usable storage medium or tangible, non-transitory computer-readable medium (e.g., standard random access memory (RAM), optical disk, USB drive (Universal Serial Bus) or the like) are stored, in which such computer-readable program code or such computer instructions are embodied, wherein the computer-readable program code or the

Computer commands may be installed or otherwise adapted to be controlled by the

14 BE2022/5323 to be executed on one or more processors 108, 118 (e.g. in

connection with the corresponding operating system in the one or more memories 110, 120) to the machine-readable instructions, methods,

enable, implement or carry out any process, element or constraint as required for the various flowcharts, illustrations,

Diagrams, figures and/or other disclosure illustrated, illustrated or described herein. In this regard, the program code may be implemented in any desired programming language and may be

Machine code, assembler code, byte code, interpretable source code or the like (e.g. via Golang, Python, C, C++, C#, Objective-C, Java, Scala,

ActionScript, JavaScript, HTML, CSS, XML, etc.) must be implemented.

In the one or more memories 110, 120, a

Operating System (OS) (e.g., Microsoft Windows, Linux, Unix, etc.) capable of enabling the functionalities, apps, methods, or other software discussed herein. The one or the several

Storage 110 may also include smart imaging application 160 and/or the

store image enhancement application 128 that may be configured to store the

To allow construction/building of the machine view job as in

Further described here. Additionally or alternatively, the smart

Imaging application 116 and/or image enhancement application 128 may also be stored in the one or more memories 120 of the imaging device 104 and/or in an external database (not shown) accessible to the user computing device 102 via the network 106 or otherwise as in communication is. The memory(s) 110, 120 may also store machine-readable instructions representing one or more applications, one or more software components, and/or one or more

Application Programming Interfaces,

APIs) that can be implemented to use the

enable features, functions, or other disclosures described herein, such as any methods, processes, elements, or

limitations as applied to the various flow charts, illustrations,

diagrams, figures and/or other disclosure provided herein are illustrated, illustrated or described. For example, at least some of the

15 BE2022/5323

Applications, software components or API a machine view-based

Image generation application such as smart imaging application 116 and/or image enhancement application 128 may be included and otherwise be part of, each of which may be configured to enable their various functionalities discussed herein. It should be noted that one or more other applications in

can be considered and executed by one or more processors 108,118.

The one or more processors 108, 118 can be connected to one or more memories 110, 120 via a computer bus suitable for transferring electronic data, data packets or other electronic

signals to or from the one or more processors 108, 118 and the one or more memories 110, 120 to implement the machine-readable instructions, methods, processes, elements or constraints as defined for the various flowcharts, illustrations, diagrams ,

Figures and/or other disclosures provided herein are illustrated, illustrated or described to be implemented or performed.

The one or more processors 108, 118 can be

Interfaces with the one or more memories 110, 120 via the

computer bus to run the operating system (OS). The one or more processors 108, 118 can also have

Interfaces with the one or more memories 110, 120 via the

computer bus to store the data stored in the one or more memories 110, 120 and/or the external database(s) (e.g. a relational database such as Oracle, DB2, MySQL or a NoSQL based database such as MongoDB), read, update, delete or otherwise access or interact with it. The data stored in the one or more memories 110, 120 and/or an external database may include all, part or any of the data or information described herein including, for example, machine view job images (e.g Images generated by the imaging device 104 in response to the execution of a job

16 BE2022/5323

scripts included) and/or other appropriate information.

The network interfaces 112, 122 can be configured to

Communicate (e.g., send and receive) data over one or more external/network ports to one or more networks or local terminals, such as network 106 described herein. In some embodiments, the network interfaces 112, 122 can be a

Client-server platform technology, such as ASP.NET, Java J2EE, Ruby on Rails, Node.js, contain a web service or online API used for

Receive and respond to electronic requests. The network interfaces 112, 122 can use the client-server platform

implement technology that communicates with the one or more memories 110, 120 (including the applications, components,

API(s), data, etc. stored herein) to implement the machine-readable instructions, methods, processes, elements, or constraints specified for the various flowcharts, illustrations,

diagrams, figures and/or other disclosures provided herein are illustrated, illustrated or described.

According to some embodiments, the

Network interfaces 112, 122 one or more transceivers (e.g. WWAN,

WLAN, and/or WPAN transceivers) containing or interacting with them, functioning according to the IEEE standard, 3GPP standard or other standards, and which can be used in the reception and transmission of data via external/network connections that are connected to the network 106. In some embodiments, network 106 may include a private network or a local area network (LAN). Additionally or alternatively, network 106 may be a public network, such as

Example the Internet, include. In some embodiments it can

Network 106 routers, wireless switches, or other such wireless

Contain connection points that are connected to the user computing device 102 (via the network interface 112) and the imaging device 104 (via the

Network interface 122) via wireless communication based on one or more different wireless standards, for example as not

17 BE2022/5323 limiting example include IEEE 802.11a/b/c/g (WIFD, the BLUETOOTH standard or the like.

The I/O interfaces 114, 124 may include or implement operator interfaces configured to provide information and/or input from an administrator or an operator

administrator or operator. An operator interface may provide a screen (e.g., via user computing device 102 and/or imaging device 104) that a user/operator may further use to display any images, graphics, text, data, features, pixels, and/or others to visualize suitable visualizations or information.

For example, user computing device 102 and/or the

Imaging device 104 is at least partially a graphical

Graphical User Interface (GUT) for displaying images,

Graphics, text, data, features, pixels and/or other appropriate

Include, implement, access, render, or otherwise display any visualization or information on the screen. The I/O interfaces 114, 124 can also include I/O components (e.g., connectors, capacitive or resistive touch-sensitive input panels, buttons, knobs, lights, LEDs, any number of keyboards, mice, USB drives, optical

drives, monitors, touch screens, etc.) that contain the

User computing device 102 and/or imaging device 104 are directly/indirectly accessible or connected to. According to some

embodiments, an administrator or user/operator can access the

Access user computing device 102 and/or image generation device 104 to create jobs, view images or other information,

make changes, enter answers and/or choices and/or perform other functions.

As described above, in some

In embodiments, user computing device 102 may perform the functionality described herein as part of a "cloud" network or otherwise communicate with other hardware or software components within the cloud to send, retrieve, or otherwise analyze data or information described herein.

18 BE2022/5323

2A is a perspective view of the

Imaging device 104 of FIG. 1 as described herein

embodiments. The imaging device 104 includes a housing 202, an imaging aperture 204, a user interface panel 206, a dome

Switch/knob 208, one or more light emitting diodes (LEDs) 210 and attachment point(s) 212. As previously mentioned, the

Imaging device 104 may receive job files from a client computing device (e.g., client computing device 102) that contains the

Image generating device 104 hereafter interpreted and executed. The one in the

Commands contained in the job file may include device configuration settings (also referred to hereinafter as "imaging settings") effective to configure the imaging device 104 prior to the

stop capturing images of a target object.

For example, the device configuration settings may contain commands for setting one or more settings related to the

Imaging aperture 204 related. As an example, assume that at least a portion of the intended analysis corresponding to a machine vision job requires the imaging device 104 to perform the

Brightness of a captured image is maximized. To implement this

If required, the job file may contain device configuration settings to increase the aperture size of the imaging aperture 204 . The

Imaging device 104 may interpret these commands (e.g., via one or more processors 118) and adjust the aperture size accordingly

Enlarge imaging aperture 204. In this way, the

Image generating device 104 can be configured to automatically set its own configuration and optimally adapt to a specific machine view

job. Additionally, for example but without limitation, imaging device 104 may include one or more bandpass filters, one or more polarizers, one or more DPM diffusers, one or more C-

Mount lenses and/or one or more C-mount liquid lenses have, or otherwise be configurable to have, over the received

Illuminating through, or otherwise affecting, imaging aperture 204.

19 BE2022/5323

User interface panel 206 may include dome switch/button 208 and one or more LEDs 210 and may thereby enable a variety of interactive and/or display features. In general it can

User interface panel 206 allow a user to

Trigger and/or adjust imaging device 104 (e.g., via dome switch/button 208) and detect (e.g., via LED(s) 210) when one or more functions, errors, and/or others

Actions have been taken or taken place with respect to the imaging device 104. For example, the release function of a dome

Switch/button (e.g., dome switch/button 208) allow a user to capture an image using imaging device 104 and/or a trigger configuration screen

User application (e.g. the smart imaging application 116, the

Image Enhancement Application 128). The trigger-

Configuration screen may allow the user to set one or more

Configure triggers for the imaging device 104 that may be stored in memory (e.g., the one or more memories 110, 120) for use in later developed machine vision jobs as discussed herein.

As another example, the setting function of a dome

Switch/knob (e.g., dome switch/knob 208) allow a user to automatically and/or manually adjust the configuration of the imaging device 104 according to a preferred/predetermined configuration and/or an imaging configuration screen

User application (e.g. the smart imaging application 116, the

Image Enhancement Application 128). The imaging

Configuration screen may allow the user to set one or more

Configurations of the imaging device 104 (eg, aperture size,

exposure time, etc.) stored in memory (e.g., the one or more memories 110, 120) for use in later developed

Machine View jobs can be saved as discussed herein.

To extend this example, and as further discussed herein, a

User the imaging configuration screen (or more generally the

smart imaging application 116 and/or the image enhancement application 128)

20 BE2022/5323 to use two or more configurations of

create imaging settings for imaging device 104 .

The user can then choose these two or more configurations of

Save imaging settings as part of a machine view job, which is then transmitted to the imaging device 104 in a job file containing one or more job scripts. One or more jobs

Scripts can then use the processors (e.g. one or more processors 118) of the

Instruct image forming device 104 to automatically and sequentially

adjust imaging settings of the imaging device according to one or more of the two or more configurations of imaging settings after each successive image capture.

The attachment point(s) 212 may enable a user to

Imaging device 104 on a mounting device (e.g. a

imaging tripod, a camera mount, etc.), a structural surface (e.g., a warehouse wall, a warehouse ceiling, a building pillar, etc.), other accessories, and/or any other suitable one

connecting devices, structures or surfaces to be attached and/or removably attached. For example, the imaging device 104 can be optimally mounted on a fixture in a logistics center, a

manufacturing facility, warehouse, and/or other facility to image and thereby monitor the quality/consistency of products, packages, and/or other items as they move through the FOV of imaging device 104 . Additionally, the attachment point(s) 212 may allow a user to attach the imaging device 104 to a wide variety of

to connect accessories including, without limitation, one or more external lighting devices, one or more

attachment devices/brackets and the like.

In addition, the imaging device 104 may have multiple

Contain hardware components that are contained in the housing 202, the one

Enable connection to a computer network (e.g., network 106).

For example, imaging device 104 may include a network interface (e.g., network interface 122) that allows the

91 BE2022/5323

Imaging device 104 allows for being connected to a network, such as a Gigabit Ethernet connection and/or a dual

Gigabit Ethernet connection. Furthermore, the image generation device 104

Transceivers and/or other communications components as part of

Network interface included to communicate with other devices (e.g. the

User computing device 102) for example via Ethernet/IP, PROFINET,

Communicate with Modbus TCP, CC-Link, USB 3.0, RS-232, and/or any other suitable communication protocol or combinations thereof.

2B is a block diagram used for an example

logic circuitry capable of implementing, for example, one or more components of the example imaging device 104 of FIG. 2A. The example logic circuit of FIG. 2B is one

Processing platform 230 capable of executing instructions to

Example to implement operations of the example methods described herein as illustrated by the flow charts of the drawings that accompany the present specification. Other exemplary

Logic circuits capable of implementing operations of the example methods described herein, for example, include Field

Programmable Gate Arrays (FPGAs) and Application Specific Integrated Circuits (ASICS).

The example processing platform 230 of FIG. 2B includes a

Processor 232, such as one or more microprocessors, controllers, and/or any suitable type of processor. The exemplary

Processing platform 230 of Figure 2B includes memory (e.g., volatile

memory, non-volatile memory) 234 accessible to processor 232 (e.g., via a memory controller). The example processor 232 interacts with the memory 234 to obtain, for example, machine-readable instructions stored in the memory 234 that are used for

example correspond to the operations represented by the flowcharts of the present disclosure. The memory 234 also contains the

smart imaging application 116 and optionally image enhancement application 128, each of which can be accessed by example processor 232. the smart

99 BE2022/5323

Imaging application 116 and/or image enhancement application 128 may be rule-based commands, artificial intelligence (AI), and/or a

Machine learning based model and/or any other suitable one

Algorithm architecture, or a combination thereof, used for

example is configured to receive a signal from a machine vision camera (e.g. the

Image generating device 104) to enrich recorded image content. To the

As an illustration, the example processor 232 may access the memory 234 to run the smart imaging application 116 and/or the

Run Image Enhancement Application 128 when the

Imaging device 104 captures (via imaging assembly 126) an image containing a plurality of indicia, each of which encodes a payload. Additionally or alternatively, machine-readable instructions corresponding to the example operations described herein may be stored on one or more removable media (e.g., compact disc, DVD, removable flash memory, etc.) compatible with the

Processing platform 230 can be connected to access the machine-readable instructions stored thereon.

The example processing platform 230 of FIG. 2B also includes a network interface 236 for enabling communication with other machines over, for example, one or more networks. The example network interface 236 includes any suitable type of

Communication interface(s) (e.g. wired and/or wireless

Interfaces) configured to do so, according to any suitable one

Protocol(s) (e.g. Ethernet for wired communications and/or

IEEE 802.11 for wireless communications).

The example processing platform 230 of FIG. 2B also includes

Input/Output (I/O) interfaces 238 to enable receipt of

user input and to communicate output data to the user.

Such user input and communications can include, for example, any number of keyboards, mice, USB drives, optical

drives, monitors, touch screens, etc.

3A illustrates an example application interface 300 that includes an example image 314 generated by an imaging device 104

23 BE2022/5323. The example application interface 300 may be a

Part of a smart imaging application (e.g., smart imaging application 106), an image enhancement application (e.g., image enhancement application 128), and/or any other suitable application, or combinations thereof. For example, the exemplary

Application interface 300 on an interface a

user computing device (e.g., user computing device 102) as a

Result of which are reproduced that the imaging device a

machine view job and may be formatted according to commands included as part of the smart imaging application 106 . The special ones

Image renderings and/or other aspects of the exemplary

Application interface 300 may be determined and displayed according to commands included as part of image enhancement application 128 as described herein.

In some cases, each in the example

Application interface 300 displayed image a barcode, such as the

barcode 302 and the barcode 304. Depending on how a machine view job is configured, the application (e.g. the image enrichment application 128) can receive from the imaging device decoded barcode data that is associated with one of the barcodes 302/304 (they can also as "barcode

result data”). This information can be displayed at an appropriate location within the interface. In the illustrated interface 300, the data decoded from barcode 302 is displayed as a character string 306 and the data decoded from barcode 304 is displayed as a character string 308 within entry window 310 (in Figs

Figures 3A and 3B indicated as "View Results").

As illustrated in Figure 3A, the exemplary

Application interface 300 additionally a setting part 316 and a

Filmstrip portion 318. Settings portion 316 may generally allow a user to configure certain actions to be included as part of the

machine view jobs, barcode decoding jobs and/or any other suitable executable job run by the

Image forming device is running. For example, the user can

24 BE2022/5323

Enable the "decode all" option shown in FIG. 3A to configure the indication decoder included as part of the machine view job to decode any decodable indication identifiable within the example image 314 . As a result, the indication decoder can decode each of the payloads from the barcodes 302, 304 and the results of the

Display decoding within entry window 310. Filmstrip portion 318 may contain all of the images captured by the imaging device during a single execution of the machine view job. For example, as a target moves past the imaging device, the

Imaging device may capture one or more images of the target object, and each of those captured images may be displayed within filmstrip portion 318.

FIG. 3B illustrates another example application interface 330 that includes another example image 320 generated by a

Image forming device 104 was recorded. This sample image 320 includes multiple indicia (e.g., Quick Response (QR) codes), and multiple of these

Indications 322, 324 may be decoded by the indication decoder included as part of the machine view job provided by the

Image forming device is running. Those decoded from the indications 322

Data is displayed as a string 326 and the data decoded from the indication 324 is displayed as a string 328 within the

Entry window 310 is displayed. In this way, as a part of

Indication decoding performed in machine view jobs described in the present disclosure may be configured to generate a payload from any suitable indicia, such as barcodes, QR codes,

data matrices etc. to decode.

According to some aspects of the present invention, the

Application (e.g., image enhancement application 128) provides a means for a user to select a desired item and the application to do so

Image automatically centers around this indication and zooms in on this indication to a specified zoom level. Implementing this functionality can be particularly difficult due to the fact that the information is in a large

Variety of shapes and sizes (e.g. barcodes 302, 304 and indicia 322, 324)

25 BE2022/5323 and that depending on the operating environment, the dimensions of the

Information as it appears on the captured image can vary greatly.

In some implementations, the application can achieve this through the following. To identify which item the user wants to zoom in on, the user can select the specific item by clicking a specific

entry from entry window 310. This can be done by a hover

Hovering a mouse pointer over a line associated with the payload containing the specification in question and then clicking a mouse button to

making the selection happen. A similar functionality can be done, for example, via a keyboard or any other input device that is in the

Entry window 310 allows selection of a specific entry associated with a desired item. In other cases, the user can make a selection by using the mouse (or any other

input device) over the desired indication in the display area 312 and then makes the selection by clicking a mouse button. It should be borne in mind that throughout the present disclosure

References to input devices, such as a mouse, should not be construed as

limitations, but that other input devices are also contemplated within the scope of this disclosure. For the

For example, it should be taken into account that in the event that the application is run on a mobile device such as a tablet or a notebook that has touch screen capabilities, the finger of a

User and the corresponding input functions can work over a screen in the same way as the input functions of a computer mouse.

Before or after selecting a desired indication determines the

Applying the bounds of a bounding box that subsequently substantially encloses at least some of the information in the image. In some

Implementations where the determination before choosing the desired

When an indication is made, the application may be configured to display at least one bounding box around each corresponding indication that is visible in the image presented in the display area 312 .

26 BE2022/5323

In general, each bounding box can be one of a number of

There are picture elements (pixels) that correspond to the outer edges of the respective information. Consequently, each point of the bounding box then has an xy

Pixel coordinate that is within the coordinate system of the image. From this, and as discussed here, the application (e.g. the

Image enhancement application 128) for each desired bounding box, the highest pixel coordinate value in the vertical direction (x-axis) (also referred to as the upper pixel coordinate limit), the lowest

pixel coordinate value in the vertical direction (x-axis) (also referred to as the lower pixel coordinate limit), the pixel coordinate value of the far side (e.g. the left side) in the horizontal direction (y-axis) (also referred to as the first side pixel coordinate boundary) and the pixel

Coordinate value of the other far side (e.g. the right side) in the horizontal direction (y-axis) (also called the second side pixel

Coordinate limit is called) determine. If the application has this

Data features so it can allow a secondary frame for whatever you want

Derive information, with the secondary frame not out of shape or

Orientation of the indication is derived, but from its coordinate boundaries.

This gives the advantage that the secondary frame can be oriented in a way that suits the display area, which is what most

Implementations would result in the secondary frame having a roughly square or rectangular shape with the top and bottom sides extending along a respective single height coordinate and the two perpendicular sides extending along a respective single width coordinate.

An example of such a secondary frame is shown in both Figures 4A and 4B as 412 and 422, respectively. 4A provides an example

Application interface 410 containing secondary frame 412 . As illustrated in FIG. 4A, the displayed image may contain multiple items of information, and more than one of them (e.g., the barcode contained in the secondary frame 412 and the barcode below the secondary frame 412) may be decodable. In this case, the image-enhancing application can automatically recognize and decode any information contained in the image,

27 BE2022/5323 and can display the payload resulting from the decoding. In particular

aspects, the image enhancement application may use the secondary frame 412 in

determine in response to the user selecting information contained in the secondary frame 412 . Additionally or alternatively, the

Image enhancement application automatically creates the secondary frame 412 and an im

substantially determine the secondary frame framing the other indicia in response to the decoding of the respective indicia. Of course it can be in both

cases, the image enhancement application determines the secondary frame(s) based on coordinate boundaries corresponding to the decoded indications.

Alternatively, in some aspects, the displayed image may contain multiple pieces of information, but only one of them (e.g., the barcode contained in secondary frame 412) may be decodable. In this case, the image enhancement application can automatically recognize and decode the indication illustrated in the secondary frame 412 . After that, the

Image enrichment application the secondary frame 412 based on the

Determine coordinate boundaries corresponding to the decoded specification.

In yet another example, FIG. 4B illustrates an example

Application interface 420 containing secondary frame 422 . As in

4B, the displayed image may contain portions of multiple pieces of information, but only one of them (e.g., the one in the

Secondary frame 422 contained QR code) is fully decodable. In this

In this case, the image enhancement application can automatically recognize and decode the information shown within the secondary frame 422 . After that, the

Image enrichment application the secondary frame 422 based on the

Determine coordinate boundaries corresponding to the decoded specification.

In any case, after the secondary frame has been determined, the application (e.g., image enhancement application 128) may be further configured to reposition the image in the display area such that the

The center of the secondary frame associated with the item of interest (e.g., the item previously selected for viewing/analysis) is placed within a threshold distance from the center of the display area. In some aspects, the threshold distance may be zero and the center of the secondary frame may be the center of the

28 BE2022/5323

overlay display area. In other implementations, a

Non-zero threshold distance (which could be expressed by pixels, for example) can be implemented. Ultimately, the result of such positioning is that the secondary frame (and hence the indication associated with it) is at or visually near the center of the

display area is displayed.

For example, and as illustrated in FIG. 5A, the

Image enrichment application the example application interface 500 in

displaying in response to receiving a selection of an indication from a user and repositioning the image within the display area such that the indication is substantially centered within the display area. The

Image enrichment application may receive a message that a user has selected the indication 502 within the image and may proceed to render the secondary frame 504 based on different coordinate boundaries (eg.

B. upper pixel coordinate limit, lower pixel coordinate limit, first page

pixel coordinate boundary, second side pixel coordinate boundary) corresponding to indication 502.

In general, as previously mentioned, the image enhancement application can reposition the image containing the indication 502 such that the distance 506c between the two centers 5064, 506b is at least less than a

threshold distance is. When the image-enhancement application repositions the image, the application can also use the center 5064 of the

Compare the secondary frame to the center 506b of the display area to determine whether to reposition the image to more optimally reduce the distance 506c between the two centers 5064, 506b. To this

way, the image-enhancement application can use the 502 statement returned by the

User has been selected as close as possible to the center point of the

Position the display area (e.g. the distance 506c between the two is omitted

centers 5064, 506b).

Furthermore, when the image-enhancement application repositions the image, the application may also scale the viewpoint (up or down) so that the secondary frame 504 fills a predetermined space of the

Display window occupied. For example, the one from the

29 BE2022/5323

Image-enhancement application scaling can be expressed as a ratio of the pixels occupied by the secondary frame 504 in the vertical direction to the vertical pixel count of the display area. Therefore, if the desired ratio is 1:2 and the secondary frame 504 has a height of 200

pixels, while the display area has a height of 1000 pixels, the

Viewpoint scaled 2.5 times, so the secondary frame 504 then occupies 500 pixels. The image enhancement application can be the same or similar

Use the procedure along the horizontal axis.

Of course, it should be borne in mind that if that

Aspect ratio of the secondary frame (z. B. the secondary frame 504) with the

aspect ratio of the display area does not match, the horizontal ratio of the secondary frame to the display area may not be equal to the vertical ratio of the secondary box to the display area. If therefore the

Image enrichment application scales the image in certain aspects, the

Application scale the viewpoint so that both the horizontal ratio of secondary frame to display area and the vertical ratio of

Secondary frame to display area at or below desired one

threshold is. This can help prevent cases where a relatively narrow but tall viewpoint is based on a level

Ratio is scaled without regard to a perpendicular ratio.

For example, a display area of 1000 by 2000 requires

pixels and a secondary frame of 400 by 100 pixels, scaling the image to a point where the ratio of secondary frame to display area is 1:2, scaling the image by 10. However, such an enlargement would cause the secondary frame (and therefore the information displayed therein) increases to a height of 4000 pixels; what outside of

display options of the display area. Therefore, in this case, the

Image enhancement application will constrain a scaling of the image to 1.25, causing the secondary frame to grow to dimensions of 500 by 125 pixels, thereby meeting the 1:2 threshold requirement along the vertical axis. Alternatively, in certain

Aspects a user can configure the image enrichment application to

30 BE2022/5323 the image is scaled so that part of the selected information is not in the

display area exists after the image has been scaled.

For example, as illustrated in FIG. 5A, the

Image enrichment application horizontal distances 508 between the vertical ones

sides of the secondary frame 504 and the vertical edges of the

Determine the display area and vertical distances 509 between the horizontal sides of the secondary frame 504 and the horizontal edges of the display area. It is assumed that the desired aspect ratio for the

Specification 502 is 1:2 relative to the display area. In this example, the

Image enrichment application then scale the image so that the total length of the horizontal spaces 509 is equal to the length of one vertical side of the

Secondary frame 504 and the total length of the vertical distances 508 equal to the length of a horizontal side of the secondary frame 504 is. Of course, it should be understood that the image enhancement application can scale the image to any suitable aspect ratio, as previously described.

In some cases, such as in Figures 5B and 5C, before/after scaling, the area outside the selected indicia may be masked to emphasize the selected indicia. This mask can be outside the secondary box or outside the bounding box of the selected information. The mask can be transparent, opaque, color-changing, blurry, or any other type that puts the information of interest in the focus of the user's attention.

For example, as illustrated in FIG. 5B, the

Image Enhancement Application Display an example application interface 510 in which a selected indication 512 and a masked background portion 514 are shown. The user can configure the image enhancement application to automatically track the masked background portion 514

completion of image scaling and/or at any other point after the user has selected the selected indication 512 .

Additionally or alternatively, the image enhancement application may be a

Provide a variety of graphical information to enable a user to

31 BE2022/5323 understand what information is currently displayed and where the information is located within the displayed image.

As an example, FIG. 5C provides an exemplary

Application interface 520 showing the selected indication 512, the masked background portion 514, and a thumbnail 522 showing a

Scaled image indicator 524 includes. Thumbnail 522 can generally do that

Display the original image from which the displayed image was generated (e.g. via

repositioning, scaling, masking), and the scaled image viewer 524 can provide a graphical display of the displayed image as part of the original image

Show reference by a user. The image enrichment application can automatically scale the image to fit the displayed one after selecting the specification

generate the image and display the thumbnail image 522 and the scaled image indicator 524 so that the user does not become disoriented as to where the displayed image and the selected indication 512 are relative to the original image.

Further, in certain aspects, in response to the user selecting the selected indication 512, the image enhancement application may within the

Display area that minimizes the original image into the thumbnail 522, a

Render animation, and then generate scaled image indicator 524 as an overlay over thumbnail 522.

6 is a flow diagram illustrating a method 600 for enhancing image content captured by a machine vision camera, in accordance with embodiments described herein. Method 600 instructs

receiving an image captured by a machine vision camera (block 602). The image can be received on an application running on a

User computing device running with a machine view

Camera is communicatively coupled, and the image can be a plurality of

contain information (e.g. barcodes, QR codes, etc.). Additionally, a payload may be encoded in each of the plurality of indicia.

The method 600 may also include identifying the particular indicia in the received image (block 604). Accordingly, for each corresponding indication in the image, the method 600 may include determining boundaries of a corresponding bounding box that substantially encloses the respective corresponding indication in the image (block 606). For the

392 BE2022/5323

Example, the image enrichment application by identifying the outermost

Coordinates of the indicia defining the outermost boundary of the indicia within the image, the boundaries of a corresponding one

Create a bounding box that matches a single specification. To this

Thus, in certain aspects, the bounding box can be of any suitable shape to substantially enclose the disclosure.

The method 600 may also include displaying a plurality of

entries, each of the plurality of entries corresponding to a respective one of the plurality of entries (block 608). In certain aspects, each of the plurality of entries includes a payload of the corresponding information. A user may interact with the interface to indicate a selection of one or more of the items and/or information displayed. As such, method 600 may include receiving a selection of one of the entries at the interface, resulting in a selected entry having a corresponding indication (block 610).

In certain aspects, the application (e.g. the

Image enhancement application) masking an area of the display area after a user has selected an entry/indication. In this way, the method 600 can mask a masked area in the

Display area included in response to receiving the selection. In these

In other aspects, the masked area may be an area outside of at least one of (i) the respective secondary frame or (ii) the corresponding one

be the bounding box of the relevant disclosure.

The method 600 can also include determining a top pixel

coordinate boundary, a lower pixel coordinate boundary, a first side

pixel coordinate boundary and a second side pixel coordinate boundary (block 612). The image enrichment application can do this

Determine coordinate boundaries based on the corresponding bounding box of the corresponding specifications. Based on these coordinate boundaries, the image enhancement application can determine a secondary frame having a top boundary, a bottom boundary, a first side boundary, and a second side boundary (block 614).

33 BE2022/5323

The method 600 can also include displaying the image in a

Contain the display area of the interface so that a center point of the

secondary frame is placed within a predetermined distance threshold from a center point of the display area (block 616). In certain aspects, for each corresponding indication in the image, the image enhancement application can display the corresponding bounding box on an interface of the application. In some aspects, the

Image enrichment application will display the appropriate bounding box corresponding to the majority of the information contained within a visible portion of the

image displayed in the display area.

The method 600 may also include scaling the image so that at least one of (i) a first vertical pixel count between the upper bound and the lower bound is within a predetermined

ratio threshold of a second vertical number of pixels of the display area or (ii) a first horizontal number of pixels between the first lateral

Boundary and the second lateral boundary within a second predetermined ratio threshold of a second horizontal number of pixels

display area (block 618). In certain aspects, at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is inclusive between 1:2 and 2:3. In some aspects, the image enhancement application can scale the image so that (i) the first vertical pixel count matches the first predetermined

Ratio threshold of the second vertical pixel number does not exceed, and (ii) the first horizontal pixel number exceeds the second predetermined one

ratio threshold of the second horizontal pixel number does not exceed.

In addition, at least one of the first is predetermined

Ratio threshold and the second predetermined

Ratio threshold user-definable, so part of the appropriate

Information from the scaled image is excluded. Additionally or alternatively, the image enhancement application may present a miniature version of the image in the display area as an overlay covering part of the scaled image. In these aspects, the thumbnail version of the image includes a specified portion that represents the scaled image.

34 BE2022/5323

ADDITIONAL CONSIDERATIONS

The description given above refers to a block diagram of the accompanying drawings. Alternative implementations of the through the

The example depicted in the block diagram includes one or more additional or alternative elements, processes, and/or devices. Additionally or alternatively, one or more of the exemplary blocks of

diagrams can be combined, separated, rearranged or omitted. through the

Components shown in blocks of diagram are represented by hardware, software,

firmware and/or any combination of hardware, software and/or

Firmware implemented. In some examples, at least one of the by the

Components shown blocks implemented by a logic circuit. The

Term "logic circuitry" as used herein is expressly defined as a physical device containing at least one hardware component capable (for example, of operating according to a predetermined

Configuration and/or execution stored machine-readable

commands) is configured to control one or more machines and/or

perform operations of one or more machines. Examples of a

Logic circuit include one or more processors, one or more co-

Processors, one or more microprocessors, one or more controllers, one or more digital signal processors (DSPs), one or more application specific integrated circuits (ASICs), one or more field

Programmable gate arrays (FPGAs), one or more microcontrollers (MCUs), one or more hardware accelerators, one or more specialty

computer chips and one or more SoC (system-on-a-chip) devices. Some example logic circuits, such as ASICs or FPGAs, are specifically configured hardware to perform operations (eg

Example of one or more of the operations described here and by the

flowcharts of this disclosure, if any, are shown).

Some example logic circuits are hardware that is machine-readable

Executes commands to perform operations (e.g. one or more of the

Operations described here and by the flowcharts of these

disclosure, if any, are shown). Some example logic circuits include a combination specific

35 BE2022/5323 configured hardware and hardware that executes machine-readable commands.

The description given above refers to various operations described herein and flowcharts that may accompany the

to illustrate the course of these operations. Any such flowcharts are representative of example methods disclosed herein. In some

Examples implement those represented by the flowcharts

Process the devices represented by the block diagrams. alternative

Implementations of example methods disclosed herein may include additional or alternative operations. Furthermore, operations of alternative implementations of the methods disclosed herein may be combined, separated, rearranged, or omitted. In some examples, the operations described herein are executable by machine-readable instructions (for example

software and/or firmware) stored on a medium (e.g., a tangible machine-readable medium) through execution by one or more logic circuits (e.g., processor(s)). In some

Examples are the operations described here by one or more

Configurations of one or more specifically designed logic circuits (e.g. ASIC(s)) are implemented. In some instances, the operations described herein are more specifically constructed through a combination

Logic circuit(s) and machine-readable instructions stored on a medium (for example a tangible machine-readable medium).

Execution implemented by a logic circuit or logic circuits.

As used herein, the terms "tangible machine-readable medium," "non-transitory machine-readable medium," and "machine-readable storage device" are each expressly construed as one

Storage medium (e.g. a platter of a hard disk drive, a DVD, a

compact disc, flash memory, read-only memory, random access memory, etc.) on which machine-readable instructions (e.g.

program code in the form of, for example, software and/or firmware) for any suitable period of time (e.g., permanently, over an extended period of time).

Period of time (e.g. during a period associated with the machine-readable instructions

program is running), and/or a short period of time (e.g., while the machine-readable instructions are cached and/or during a

36 BE2022/5323

buffering process)) are saved. Further, as used herein, the terms “tangible machine-readable medium,” “non-transitory machine-readable medium,” and “machine-readable storage device” are each expressly defined to exclude propagated signals.

This means that none of the terms "tangible machine-readable medium", "non-transitory machine-readable medium" and "machine-readable

Storage device” as defined in any claim herein

Patents are used to be read by an expanding

signal to be implemented.

In the description given above, specific

embodiments described. However, one of ordinary skill in the art will recognize that various modifications and changes can be made without departing from the scope of the invention as set forth in the claims below. Accordingly, they should

The specification and figures are to be regarded in an illustrative rather than a restrictive sense, and all such modifications are intended to be included within the scope of the present teachings. Additionally, the described embodiments/examples/implementations should not be construed as mutually exclusive, but instead should be construed as potentially combinable where such combinations are permitted in any way. In other words, any in any of the previously mentioned

Embodiments/examples/implementations disclosed features in any of the others mentioned above

embodiments/examples/implementations.

The advantages, benefits, solutions to problems and any

Element(s) that can cause or make appear more pronounced an advantage, advantage, or solution are not to be construed as critical, required, or essential features or elements of any or all claims. The invention claimed is solely by the appended

Claims defined, including any changes made while the present application is pending, and all equivalents of these claims as granted. For the sake of clarity

37 BE2022/5323 and a concise description, features are described here as part of the same or separate embodiments, but it should be understood that the

Scope of the invention may also include embodiments that

Combinations of all or some of the features described. It should be understood that the embodiments shown are the same or similar

have components unless described as different.

Also, throughout this document, terms indicating a relationship, such as first and second, top and bottom, and the like, may be used merely to distinguish one entity or action from another entity or action, without thereby implying any actual such relationship or order between such entities or actions is required or assumed. The terms "comprises", "comprising", "has", "having", "includes", "including", "includes", "including" or any other variation thereof are intended to cover non-exclusive existence such that a process, a method, article or device that comprises, has, comprises, comprises a list of elements, comprises not only those elements but may also comprise other elements not expressly listed or relevant to such process, method, inherent in such an article or device. If one

element "comprises...a", "has...a", "has...a... has", "contains...a" precedes the existence of additional identical elements in the

process, procedure, article or device without further ado

Constraints that the item includes, has, has, contains. The words "a/an" are defined as one or more unless explicitly stated otherwise herein. The terms "substantially," "essential," "approximately," "about," or any version thereof are defined to approximate what is understood by one skilled in the art, and in one non-limiting embodiment, the

Term defined as being in a range within 10%, in another embodiment within 5%, in another embodiment within 1%, and in another embodiment within 0.5% thereof. As used herein, the term "coupled" is defined as connected, although not necessarily directly or not

38 BE2022/5323 necessarily mechanical. A device or structure that is “configured” in a particular way is configured in at least that way, but may also be configured in ways that are not listed.

The Summary of the Disclosure is provided to allow the reader to quickly ascertain the nature of the technical disclosure

to make an impression. It is submitted with the understanding that it is not

to interpret or limit the scope or meaning of the claims. In addition to this is detailed in the previous

Description to see that different characteristics in different

Embodiments have been combined for the purpose of more streamlined disclosure. This method of disclosure should not be interpreted to mean that the claimed embodiments are intended to require more features than are expressly recited in each claim.

Rather, as the following claims reflect, the

Subject of the invention disclosed in less than all features of a single

embodiment. Thus the following claims are hereby incorporated into the Detailed Description, with each claim standing on its own as a separately claimed subject matter. The mere fact that certain measures are recited in different claims does not indicate that a combination of these measures cannot also be used to advantage. Many variations will be apparent to those skilled in the art. All variants are to be understood as included within the scope of the invention, which is defined in the following claims.

Claims (20)

39 BE2022/5323 CLAIMS A method of enhancing image content captured by a machine view camera, the method comprising: receiving, at an application executing on a client computing device that is in communication with a machine view camera, a view captured by the machine view camera an image, the image including a plurality of indicia, each of the plurality of indicia having a payload encoded therein; identifying each item in the image; for each of the corresponding indicia in the image, determining bounds of a respective bounding box substantially enclosing the respective indicia in the image; displaying, on an interface of the application, a plurality of items, each of the plurality of items corresponding to a respective one of the plurality of items; receiving, at the interface, a selection of one of the entries that results in a selected entry having a corresponding indication; determining from the corresponding bounding box of the corresponding indication an upper pixel coordinate boundary, a lower pixel coordinate boundary, a first side pixel coordinate boundary and a second side pixel coordinate boundary; based on the upper pixel coordinate boundary, the lower pixel coordinate boundary, the first side pixel coordinate boundary and the second side pixel coordinate boundary, determining a secondary frame having an upper boundary, a lower boundary, a first lateral boundary and a second has lateral limitation; displaying the image in a display area of the interface such that a center point of the secondary frame is located within a predetermined distance threshold from a center point of the display area; and 40 BE2022/5323 Scaling the image so that at least one of (i) a first vertical pixel number between the upper boundary and the lower boundary is within a first predetermined ratio threshold of a second vertical pixel number of the display area, or (ij) a first horizontal pixel number between the first lateral boundary and the second lateral boundary is within a second predetermined ratio threshold of a second horizontal pixel count of the display area. 2. The method of claim 1, further comprising: for each corresponding indication in the image, displaying the corresponding bounding box on an interface of the application. 3. The method of claim 1 or 2, wherein at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is inclusive between 1:2 and 2:3. 4. The method of any preceding claim, wherein scaling the image includes scaling the image so that (i) the first vertical pixel count does not exceed the first predetermined ratio threshold of the second vertical pixel count, and (ii) the first horizontal pixel count the second predetermined ratio threshold of the second horizontal pixel number does not exceed. 5. The method according to any one of the preceding claims, wherein each of the plurality of entries contains a payload of the corresponding information. 6. The method of any preceding claim, further comprising: displaying the corresponding bounding box corresponding to each of the plurality of indicia appearing within a visible portion of the image displayed in the display area. 7. The method according to any one of the preceding claims, further comprising: 41 BE2022/5323 masking a masked area in the display area in response to receiving the selection, the masked area being an area outside at least one of (i) the respective secondary frame or (ij) the respective bounding box of the corresponding indications. A method according to any preceding claim, wherein at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is user definable such that a portion of the corresponding indication is excluded from the scaled image. 9. The method of claim 1, further comprising: displaying a thumbnail version of the image in the display area as an overlay covering a portion of the scaled image, the thumbnail version of the image including a specified area representing the scaled image. 10. A method of enhancing image content captured by a machine view camera, the method comprising: receiving, at an application executing on a user computing device that is in communication with a machine view camera, a view captured by the machine view camera an image, the image including a plurality of indicia, each of the plurality of indicia having a payload encoded therein; identifying each item in the image; for each of the corresponding indicia in the image: determining boundaries of a respective bounding box substantially enclosing the respective indicia in the image, determining from the corresponding bounding box an upper pixel coordinate boundary, a lower pixel coordinate boundary, a first side pixel coordinate boundary and a second side pixel coordinate boundary for the respective indication, and 42 BE2022/5323 based on the upper pixel coordinate boundary, the lower pixel coordinate boundary, the first side pixel coordinate boundary and the second side pixel coordinate boundary of the respective bounding box, determining a respective secondary frame having an upper border, a lower border , has a first lateral boundary and a second lateral boundary for the respective indication; displaying, on an interface of the application, a plurality of items, each of the plurality of items corresponding to a respective one of the plurality of items; receiving, at the interface, a selection of one of the entries that results in a selected entry having a corresponding indication; displaying the image in a display area of the interface such that a center point of the respective secondary frame is located within a predetermined distance threshold from a center point of the display area; and scaling the image so that at least one of (i) a first vertical pixel count between the upper boundary of the respective secondary frame of the corresponding indicia and the lower boundary of the respective secondary frame of the corresponding indicia is within a first predetermined ratio threshold of a second vertical pixel count of the display area, or ( 2) a first horizontal pixel count between the first lateral boundary of the respective secondary frame of the corresponding indicia and the second lateral boundary of the respective secondary frame of the corresponding indicia is within a second predetermined ratio threshold of a second horizontal pixel count of the display area. 11. The method of claim 10, further comprising: for each corresponding indication in the image, displaying the corresponding bounding box on an interface of the application. 43 BE2022/5323 12. The method of claim 10 or 11, wherein at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is inclusive between 1:2 and 2:3. The method of any of claims 10-12, wherein scaling the image includes scaling the image so that (i) the first vertical pixel count does not exceed the first predetermined ratio threshold of the second vertical pixel count, and (2) the first horizontal pixel count the second does not exceed a predetermined ratio threshold of the second horizontal number of pixels. 14. The method according to any one of claims 10-13, wherein each of the plurality of entries contains a payload of the corresponding information. The method of any one of claims 10-14, further comprising: displaying the corresponding bounding box corresponding to each of the plurality of indicia appearing within a visible portion of the image displayed in the display area. The method of any one of claims 10-15, further comprising: masking a masked area in the display area in response to receiving the selection, the masked area being an area outside at least one of (i) the respective secondary frame or (ij) the respective bounding box of the relevant disclosures. 17. A machine vision system for enhancing image content captured by a machine vision camera, the system comprising: a machine vision camera configured to capture an image including a plurality of indicia, each of the plurality of indicia encoding a payload is; and a user computing device executing an application, the user computing device being in communication with the machine vision system and configured to: 44 BE2022/5323 receive the image captured by the machine vision camera, identify in the image each of the indicia, for each of the corresponding indicia in the image, determine boundaries of a respective bounding box that substantially encloses the respective indicia in the image, display on an interface of the application a plurality of items, each of the plurality of items corresponding to a respective one of the plurality of items, receiving at the interface a selection of one of the items resulting in a selected item having a corresponding item to determine from the respective bounding box of the corresponding indication an upper pixel coordinate limit, a lower pixel coordinate limit, a first side pixel coordinate limit and a second side pixel coordinate limit, on the basis of the upper pixel coordinate limit, the lower pixel coordinate coordinate boundary, the first side pixel coordinate boundary, and the second side pixel coordinate boundary, determine a secondary frame having a top boundary, a bottom boundary, a first side boundary, and a second side boundary, the image in a display area of the interface to indicate that a center point of the secondary frame is located within a predetermined distance threshold from a center point of the display area, and to scale the image so that at least one of (i) a first vertical number of pixels between the upper boundary and the lower boundary is within a first predetermined ratio threshold of a second vertical pixel number of the display area or (ij) a first horizontal pixel number between the first lateral boundary and the second lateral boundary is within a second predetermined ratio threshold of a second horizontal pixel number of the display area. 45 BE2022/5323 The system of claim 17, wherein the user computing device is further configured to: for each corresponding indication in the image, display the corresponding bounding box on an interface of the application. The system of claim 17 or 18, wherein at least one of the first predetermined ratio threshold and the second predetermined ratio threshold is inclusive between 1:2 and 2:3. The system of any of claims 17-19, wherein the user computing device is further configured to scale the image such that (i) the first vertical pixel count does not exceed the first predetermined ratio threshold of the second vertical pixel count, and (2) the first horizontal pixel count does not exceed the second predetermined ratio threshold of the second horizontal pixel count.