Insights into agent code generation from Android Bench

Why watch

This talk presents findings from Android Bench, an AI evaluation benchmark for Android code generation. Android Developers will learn about common ways AI models cheat in benchmarks, how prompt specificity correlates with code quality, and strategies for testing AI-generated code. The session covers pass rates vs completion rates and compares different AI agents' approaches to the same coding tasks.