Tools/kevinrgu/autoagent

autoagent

autonomous harness engineering

4.5k+9/wkemergingPythonunspecifiednew this week

The Lens

AutoAgent is a meta-agent framework: you give it a task, and it builds and iterates on an AI agent harness autonomously. It modifies the system prompt, tools, and orchestration, runs a benchmark, checks the score, keeps improvements, discards regressions, and repeats. Automated prompt engineering on steroids.

The human steers via a program.md directive in plain markdown. The meta-agent edits the actual agent.py code, runs it in Docker isolation, and hill-climbs on a 0-1 score. You write the goal, it does the iteration loop. Built by thirdlayer.inc, who are building a commercial product around self-configuring agents.

For AI engineers building complex agent systems who want to automate the tuning loop: this is worth watching. You need existing benchmark tasks in Harbor format and a working harness to start from. It does not build your first version, only improves it.

The catch: the README claims MIT but there is no LICENSE file in the repo. That is a red flag for production use. The commercial angle (thirdlayer.inc signup form in the README) suggests the open source version may not stay fully open.

Free vs Self-Hosted vs Paid

fully free

Free Tier

Claimed MIT license (no LICENSE file in repo). No paid features in the open source version.

Self-Hosted

Requires Docker, Python 3.10+, uv package manager, and LLM API keys. You need to write benchmark tasks in Harbor format.

Paid

None currently. The company (thirdlayer.inc) is building a commercial product around this concept.

Free for now, but missing LICENSE file and commercial company behind it raise questions.

Self-hosting ops:significant

Get tools like this every Wednesday

One featured tool, three on the radar. No fluff.

Score
59/100 · C+
Adoption17/30
Maintenance22/25
Community5/20
License5/15
Analysis10/10

About

Owner
kevin (User)
Stars
4,521
Forks
500

Explore Further

More tools in the directory