Post-Training and Deploying Open Source Reasoning Models in Foundry | BRK232

AI summary

This advanced session demonstrates how to use Microsoft Foundry to collect production traces, curate datasets, and post-train open-source reasoning models using reinforcement learning frameworks like slime, verl, and TRL. It covers when RL drives real gains in model performance and how to redeploy improved models without infrastructure management, using a retail customer service agent scenario for demonstration.