Search Results for "queueing"

Kueue is a set of APIs and controllers for job queueing. It is a job-level manager that decides when a job should be admitted to start (as in pods can be created) and when it should stop (as in active pods should be deleted). Use Kueue to build a multi-tenant batch service with quotas and a hierarchy for sharing resources among teams in your organization. Based on the available quotas, Kueue decides when jobs should wait and when and where they should run.

Asynq is a Go library for queueing tasks and processing them asynchronously with workers. It's backed by Redis and is designed to be scalable yet easy to get started. Client puts tasks on a queue. Server pulls tasks off queues and starts a worker goroutine for each task. Tasks are processed concurrently by multiple workers. Task queues are used as a mechanism to distribute work across multiple machines.

...The tool targets analysts who need one-click collection and normalized output to reduce manual lookups across registries and platforms. Recent releases added a reworked task model with queueing, resumable searches via cached progress, export format options, and a public API surface for custom keyword strategies. Documentation and issues discuss operational concerns such as rate limits, verification challenges, and use of proxies to reduce bans. The project is maintained under Apache-2.0 and is positioned for both single-shot queries and batch investigations.