Claude Code is the fastest agent framework and nearly 3x the priciest

Composio ran DeepSeek V4 Flash through four agent frameworks on 30 tasks using Gmail, GitHub, Slack, and Notion. Claude Code was fastest at 122 seconds per task but most expensive at $0.195 per successful task, despite making the fewest tool calls and generating the least output. OpenCode was cheapest at $0.073, and Oh My Pi had the best success rate at 17/30 while being slowest at 272 seconds. Success rates clustered tightly, with only OpenCode trailing at 14/30, but cost varied nearly 3x and speed 2.2x purely on the wrapper around an identical model. Seven of the 30 tasks passed or failed based on which framework ran them.

View full digest for August 7, 2026