this is going viral on chinese social media right now. exo is being used by a school in china to deploy private ai agents locally. they repurposed m1 ultra macs from their film lab, clustered them together with @exolabs, and ingested their entire school corpus including curriculums, reports, handbooks and class schedules. with this, each student and teacher has a personalised ai agent that is free and private, grounded to real school data.

China is way ahead on AI adoption. A school in Beijing has repurposed old macs to run personalised AI agents 100% locally using @exolabs The macs were previously used in their film studies lab, for video editing. They have ingested their entire corpus of school data: curriculums, reports, instructional materials and learning objectives - so it’s grounded to all their data in realtime. In order to get accurate answers, they need frontier models, which are BIG - memory is the constraint (not FLOPS). Apple devices with unified memory have a lot of high speed memory so stacking enough of them makes it possible to run massive models. A big concern of schools and parents is data privacy - when students or teachers use models in the cloud they are sending all their data in plaintext to the model provider. Even if schools have policies around this there’s always the risk someone accidentally copy-pastes sensitive data into the model - data leakage is inevitable.