orla

Orla is a runtime-adaptive execution layer for agentic workflows. Modern agentic applications combine many LLM calls, tool invocations, and heterogeneous backends, and developers usually wire these together by hand.

You point your agent at Orla as an OpenAI-compatible endpoint and tag each call with a stage, what the call is for rather than where to send it. Orla serves the call through the stage's current policy, records what happened, and lets an external optimizer update that policy as it learns. This loop tunes each stage's policy for cost and accuracy from production data, with no changes to your agent's code.

Three components participate. The agent issues stage-tagged calls and rates each result. Orla, the execution layer in the middle, applies each stage's policy to incoming calls and holds the shared record. The optimizer reads that record and revises a stage's policy whenever the data points to a better one, from a simple backend swap to a cheap-first rule that escalates to a stronger model only when a task fails.

Contributing

We welcome any and all open-source contributions to orla. Orla is designed to be a community-focused project and runs on individual contributions from amazing people around the world. This document provides guidelines and instructions for contributing to the project.

Getting Started

Install the orla daemon from source:

go install github.com/harvard-cns/orla/cmd/orla@latest

Or build it locally:

git clone https://github.com/harvard-cns/orla
cd orla
go build -o bin/orla ./cmd/orla

For your first stage and a tour of the runtime adaptation loop, see docs/quickstart.md.

Citation

If you use Orla for your research, we would greatly appreciate it if you cite our demo paper.

@misc{shahout2026orlalibraryservingllmbased,
      title={Orla: A Library for Serving LLM-Based Multi-Agent Systems}, 
      author={Rana Shahout and Hayder Tirmazi and Minlan Yu and Michael Mitzenmacher},
      year={2026},
      eprint={2603.13605},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2603.13605}, 
}

Contacting Us

• For technical questions and feature requests, please use GitHub Issues
• For security disclosures, please see SECURITY.md.