George Hotz Programming Can Tinygrad Whisper Amd Rant Giving Up On Amd Speech To Text

Date of stream 3 Jun 2023.. from $1499 buy https://comma.ai/shop/comma-three. Live-stream chat added as Subtitles/CC – English (Twitch Chat) – three-dot menu icon – Show transcript. . Source files:. – https://github.com/geohot/tinygrad. Follow for notifications:. – https://twitch.tv/georgehotz. Support George:. – https://twitch.tv/subs/georgehotz. Pre-order tinybox:. – https://buy.stripe.com/5kAaGL6lk9uX9nW144 (https://tinygrad.org/). . Chapters:. 00:00:00 intro. 00:01:20 motherboard. 00:02:06 we giving up on AMD. 00:02:45 AMD drivers, bad AMD patch. 00:04:35 Intel vs AMD driver patches. 00:07:17 3 editions of tinybox. 00:07:53 AMD driver will never be good. 00:08:32 kernel panic not acceptable, contact at AMD, capture mindshare. 00:09:55 should I buy AMD or Intel for ML. 00:12:05 top priority for gpu division at AMD. 00:12:55 Intel stable kernel driver, ROCm. 00:13:25 did not expect running AMD demo app in loop to crash the system. 00:13:40 Lisa Su respond to email, Jensen Huang. 00:14:10 would fix AMD, no docs, short AMD. 00:16:35 AMD does not care about their driver. 00:17:37 Pat Gelsinger trying to turn around Intel. 00:18:25 plan what to do, get tinygrad on mlperf. 00:19:13 3090 vs 4090, NVLink, price/perf/power, jetson orin. 00:20:25 how to fix AMD graphic division, callture. 00:21:20 Lisa Su do you want to compete against Nvidia. 00:22:05 meditation, Linus adding AMD GPU driver in kernel. 00:25:54 user space, driver need to be stable, internship at AMD. 00:27:23 bad culture, mediocre work not accepted, middle management. 00:28:25 pytorch team, facebook, fb product stupid, twitter bad development environment. 00:29:25 fire middle management tomorrow, Yann LeCun, Geoffrey Hinton. 00:30:12 whisper openai, ai safety, open ai bad practices, Sam Altman. 00:31:22 brand vs performance advertising, do not work at open ai Andrej Karpathy. 00:34:00 whisper.py, locked tinygrad bounties, Twitter needed help, trust Elon, neurolink. 00:36:00 AMD kernel driver 3 people team, hundred middle management, comma IPO. 00:38:45 finding the whisper model. 00:44:18 apology for Nvidia, how much we love Nvidia. 00:45:50 no safety checker, no alignment, don’t talk to the government. 00:54:00 writing whisper.py. 00:59:00 AI Drake, Lil Mabu, Lil Windex, music generator. 01:14:40 attention blocks. 01:25:40 class Whisper, bach, chiptune. 01:37:20 load, prep audio. 01:41:37 goal by the end of the weekend, talking and words on screen. 01:43:00 friendship with computers, 2030 girlfriend company, ai safety. 01:47:50 Sam Altman vibe, normies thoughts on ai. 01:49:00 Ford Foundation, inequality, power. 01:52:23 Industrial Society and Its Future. 02:03:00 life of homeless, oligarchy and not the oligarchy, us gov budget. 02:07:30 pizza, west needs god, jina, conspiracy theories, NGOs. 02:14:00 getting cancelled, military, taxation. 02:17:15 colonies on mars, moon, fusion, hyperloops, homeless. 02:20:20 challenging social contract, better soda, eugenics. 02:25:00 tinygrad welcomes good pull requests, good genes. 02:30:15 based department, being on plane guided by morons. 02:38:00 reading the bible, cultural catholic, quran. 02:45:45 pizza, power over nature, people. 02:50:55 England, losing all the money. 02:52:55 why Elon got so rich, worked hard, smart, did what it takes. 02:54:30 targeted campaign attack against Elon, Kanye West, Biden, Podcasts. 03:05:00 the primagen, dr disrespect, Martin Shkreli. 03:11:00 ADHD, tweakers, alcoholics. 03:17:00 sine wave, mozart. 03:21:00 qkv_attention. 03:39:30 TextDecoder. 03:46:45 languages. 03:54:20 tiktoken. 03:59:35 good contributors in tinygrad. 04:00:50 using comma three whisper llama. 04:02:20 attention block. 04:03:20 disktensor speed on mac. 04:06:45 dataset audio. 04:11:30 visualizing sound. 04:12:45 load_state_dict. 04:18:00 AssertionError can’t expand. 04:19:30 code working, love transformers. 04:21:10 commit whispering. 04:23:30 python capture audio. 04:31:10 hello twitch can you hear me. 04:32:35 how great is whisper. 04:43:20 pyaudio buffer size. 04:47:00 can’t pickle local object. 04:48:45 real time speech test, changing offset. 04:54:35 true dat, working, laggy. 04:55:20 key value cache. 04:57:45 testing and finding bugs . 05:04:44 not working anymore . 05:10:00 it works. 05:11:25 ai safety. 05:12:40 piping whisper into llama, output llama into say, sexy gan. 05:13:40 fixing bugs. 05:24:40 multiple times decoding. 05:31:00 need to merge speedups for realtime. 05:31:40 thank you for watching. 05:32:00 prison hierarchy. . Official George Hotz communication channels:. – https://geohot.com. – https://twitter.com/realGeorgeHotz. – https://instagram.com/georgehotz. – https://tinygrad.org. – https://geohot.github.io/blog. – https://twitch.tv/georgehotz. – https://github.com/geohot. . We archive George Hotz and comma.ai videos for fun.. Follow for notifications: . – https://twitter.com/geohotarchive. . Thank you for reading and using the SHOW MORE button.. We hope you enjoy watching George’s videos as much as we do.. See you at the next video.