George Hotz: “Sam Altman won’t tell you that GPT-4 has 220B parameters and is a 16-way mixture model with 8 sets of weights?”

Peter Xing
DataDrivenInvestor
Published in
38 min readJul 1, 2023

--

Tiny Corp, Twitter, AI Safety, Self-Driving, GPT, AGI & God | Lex Fridman Podcast #387 | GPT-4 Summary Insights

“Sam Altman won’t tell you that GPT-4 has 220B parameters and is a 16-way mixture model with 8 sets of weights?”

--

--

writer @datadriveninvestor, data & ai @microsoft, cofounder @transhumanismau, @transhumancoin, expert @singularityu, fmr emtech director @kpmg @deloitte