kiok Key Features
Discover the core capabilities of the workflow orchestration platform.
DAGs as Code
Define workflows in YAML, Python, or Java — all compile once to a single DagSpec. Beyond shell, python, and http, built-in Livy (Spark), Trino, and Ontul operators orchestrate external engine jobs directly.
Flexible Scheduling
Cron schedules, on-demand triggers, and catchup to backfill missed intervals. #{ } date macros slide the date on every run, so a DAG compiled once executes with the right date each time.
Distributed Execution & Failover
A master/worker cluster runs tasks in parallel across per-worker task slots, and driver failover keeps runs alive through worker loss — without re-running completed tasks.
Git Deployment & Connections
Auto-sync DAGs from multiple git repositories (including private ones) or upload bundles for air-gapped clusters. Credentials live in an encrypted connection store, used only via ${conn}/${secret} references — never exposed in DAGs or git.
Built-in Security
Native KMS envelope encryption secures all cluster state at rest — metadata, IAM, connections, logs — and AWS IAM-style policies control access down to individual DAGs.
Observability & Operations
Watch live run graphs, streaming job logs, metrics, and cluster topology in the built-in admin UI, with incremental S3 backup and restore for production-grade operations.
Use Cases
Data Pipeline Orchestration
Schedule and run ETL/ELT and analytics jobs with Livy (Spark), Trino, and Ontul operators, driven by task dependencies.
Job Automation
Automate recurring batch jobs reliably across a scalable worker fleet.
Workflow as Code
Version-control workflows in git and deploy them to the cluster with a single push.
Reliable Operations
Backup and restore, leader failover, and encrypted state for production-grade reliability.
Considering kiok for your workflows?
Author. Schedule. Orchestrate.
Run your workflows on a distributed, secure orchestration platform.