Synthetic Evaluation, the impartial platform recognized for benchmarking AI fashions, is making its transfer into one of many hottest corners of the AI {industry}: coding brokers. The corporate hosted a Coding Agent Benchmarks occasion on June 11 at Kernel Labs in San Francisco, gathering representatives from a number of the most outstanding names in AI-assisted software program growth.
The occasion featured audio system from Cognition, Cursor, NVIDIA, and internet hosting associate Kernel Labs. Cognition is the corporate behind Devin, the much-discussed autonomous software program engineer. Cursor has grow to be the go-to AI code editor for builders who need greater than autocomplete.
What occurred on the occasion
The gathering ran from 6:00 PM to eight:30 PM PDT and adopted a structured format. Networking kicked issues off, adopted by lightning talks beginning at 6:30 PM and a panel dialogue at 7:30 PM. The confirmed speaker lineup included Silas Alberti from Cognition, Nate Schmidt from Cursor, and Alessio Fanelli from Kernel Labs.
Synthetic Evaluation is approaching the issue by monitoring metrics like go charges, price, token utilization, and execution time.
The occasion coincided with the launch of Synthetic Evaluation’s public Coding Agent Benchmarks and Index, a brand new providing that goals to supply standardized evaluations throughout the rising subject of autonomous coding instruments.
What this implies for buyers
No main bulletins, funding updates, or efficiency outcomes got here out of the occasion. This was a group and industry-building train, not a product launch.
Traders ought to look ahead to the primary spherical of benchmark outcomes from Synthetic Evaluation’s new index, as no post-event outcomes or knowledgeable commentary had been revealed as of June 12, 2026.