Skip to content
calyprPublic

About

Funnel is a toolkit for distributed task execution via a simple, standard API.

Topics

Resources

Contributing

Security policy

Stars

143 stars

Watchers

14 watching

Forks

Repository files navigation

Tests Compliance Tests Status License: MIT Godoc GitHub Release Docker

Funnel is a toolkit for distributed, batch task execution, including a server, worker, and a set of compute, storage, and database backends. Given a task description, Funnel will find a worker to execute the task, download inputs, run a series of (Docker) containers, upload outputs, capture logs, and track the whole process.

Funnel is an implementation of the GA4GH Task Execution Schemas, an effort to standardize the APIs used for task execution across many platforms.

Funnel provides an API server, multiple storage backends (local FS, S3, Google Bucket, etc.), multiple compute backends (local, HTCondor, Google Cloud, etc.), and a web dashboard.

https://calypr.org/tools/funnel/

Deployment provisioning, manifests, service definitions, upgrades, and infrastructure operations are maintained by operators. This repository provides the Funnel application, container images, and configuration documentation; it does not provide maintained deployment automation.

Documentation source lives in docs/. Hugo templates, site configuration, and downloadable assets live in website/. Run make website to generate the site and search index in build/website/, or make website-dev to preview it locally. docs/internal/ is reserved for local design notes and is excluded from the published site.

About

Funnel is a toolkit for distributed task execution via a simple, standard API.

Topics

Resources

Contributing

Security policy

Stars

143 stars

Watchers

14 watching

Forks

Releases

Packages

Used by

Contributors

Languages