kiok Key Features
Discover the core capabilities of the workflow orchestration platform.
DAGs as Code
Define workflows in YAML, Python or Java; every format compiles once into a single DagSpec.
Scheduling & Date Templates
Cron schedules, manual triggers and catch-up of missed intervals, with #{ } date macros so each run works on the dates of its own interval.
Operators & Engine Integrations
Orchestrate shell, python and http tasks alongside Livy (Spark), Trino and Ontul jobs in one dependency-driven DAG.
Distributed Execution & HA
A master/worker cluster runs tasks in parallel on worker slots; leader and driver failover resume runs without re-running completed tasks.
Git Sync & Bundle Deployment
Sync DAGs automatically from multiple Git repositories, including private ones, or upload bundles for air-gapped environments.
Connections & Encryption
Credentials live in an encrypted connection store and are used only through ${conn} / ${secret} references; built-in KMS encrypts all cluster state at rest.
IAM & Single Sign-On
AWS IAM-style policies control access down to individual DAGs, with OIDC, SAML 2.0 and LDAP / Active Directory sign-in.
Monitoring & Logs
The admin UI shows run graphs, timelines, live task logs, metrics and cluster topology including the ZooKeeper ensemble.
Backup, Restore & Maintenance
Incremental S3 backups on a cron schedule with retention policies, plus a maintenance mode that stops new runs during restores or upkeep.
Use Cases
Data Pipeline Orchestration
Schedule and run ETL/ELT and analytics jobs with Livy (Spark), Trino, and Ontul operators, driven by task dependencies.
Job Automation
Automate recurring batch jobs reliably across a scalable worker fleet.
Workflow as Code
Version-control workflows in git and deploy them to the cluster with a single push.
Reliable Operations
Backup and restore (cron schedule, retention policy), leader failover, and encrypted state for production-grade reliability.
Considering kiok for your workflows?
Author. Schedule. Orchestrate.
Run your workflows on a distributed, secure orchestration platform.