
autoagent
autonomous harness engineering
The Lens
By Erik Loyd, SaaS CEO and former COO/CFO of an AWS Premier Partner.
Updated Apr 2026
AutoAgent is a meta-agent framework: you give it a task, and it builds and iterates on an AI agent harness autonomously. It modifies the system prompt, tools, and orchestration, runs a benchmark, checks the score, keeps improvements, discards regressions, and repeats. Automated prompt engineering on steroids.
The human steers via a program.md directive in plain markdown. The meta-agent edits the actual agent.py code, runs it in Docker isolation, and hill-climbs on a 0-1 score. You write the goal, it does the iteration loop. Built by thirdlayer.inc, who are building a commercial product around self-configuring agents.
For AI engineers building complex agent systems who want to automate the tuning loop: this is worth watching. You need existing benchmark tasks in Harbor format and a working harness to start from. It does not build your first version, only improves it.
The catch: the README claims MIT but there is no LICENSE file in the repo. That is a red flag for production use. The commercial angle (thirdlayer.inc signup form in the README) suggests the open source version may not stay fully open.
Free vs Self-Hosted vs Paid
fully freeFree Tier
Claimed MIT license (no LICENSE file in repo). No paid features in the open source version.
Self-Hosted
Requires Docker, Python 3.10+, uv package manager, and LLM API keys. You need to write benchmark tasks in Harbor format.
Paid
None currently. The company (thirdlayer.inc) is building a commercial product around this concept.
Free for now, but missing LICENSE file and commercial company behind it raise questions.
What to do by team size
- Solo
- free
- Small team
- free
- Larger team
- free
Get tools like this every Wednesday
One featured tool, three on the radar. No fluff.
A low score is not a verdict on quality. Young and niche tools start low by design. How we calculate scores
About
- Owner
- kevin (User)
- Stars
- 4,564
- Forks
- 501
Explore Further
More tools in the directory
openclaw
Your own personal AI assistant. Any OS. Any Platform. The lobster way. 🦞
386.8k ★everything-claude-code
The agent harness performance optimization system. Skills, instincts, memory, security, and research-first development for Claude Code, Codex, Opencode, Cursor and beyond.
241.5k ★hermes-agent
The agent that grows with you
233.6k ★