Soofi – What It Takes to Build a Sovereign Foundation Model
Session Abstract
An introduction of the challenges we faced when building the sovereign Open Source Foundation Model Soofi S. Take a glimpse behind the scenes of LLM development and learn about the latest state of research in terms of specialisation and self-improvement.
Session Description
Tom will provide insights into Pre-Training and Post-Training challenges from data preparation, infrastructure setup and actual training. In the second half of the session, he’s going to focus on how to specialise models for distinct use cases and open up a discussion with the audience. To wrap up the keynote he’ll share their latest research towards specialisation and self-improvement.
