| ▲ | thanhhaimai 2 hours ago |
| Opinions are my own. I think the biggest winner of this might be Google. Virtually all the frontier AI labs use TPU. The only one that doesn't use TPU is OpenAI due to the exclusive deal with Microsoft. Given the newly launched Gen 8 TPU this month, it's likely OpenAI will contemplate using TPU too. |
|
| ▲ | bastardoperator a few seconds ago | parent | next [-] |
| You think the company that just gave 40B to Anthropic is the winner? Interesting. |
|
| ▲ | bastawhiz 27 minutes ago | parent | prev | next [-] |
| Many labs use TPUs, but not exclusively. Most labs need more compute than they can get, and if there's TPU capacity, they'll adapt their systems to be able to run partially on TPUs. |
|
| ▲ | philippta 24 minutes ago | parent | prev | next [-] |
| In the recent Dwarkesh Podcast episode Jensen Huang (Nvidia) said that virtually nobody but Anthropic uses TPUs. How does that add up? |
| |
| ▲ | csunoser 14 minutes ago | parent | next [-] | | I am not sure what context Jensen said that. But midjourney uses tpu. Apple uses tpu. They are no other frontier labs that use it, but Google + Anthropic is 2 out of 3 frontier lab so..... You could reasonably say that "A majority of frontier labs uses TPU to train and serve their model." | |
| ▲ | sarchertech 18 minutes ago | parent | prev [-] | | Who is the other frontier lab other than Anthropic, OpenAI, and Google? I thought they were ahead of everyone else. |
|
|
| ▲ | maxclark 2 hours ago | parent | prev | next [-] |
| And almost by happenstance Apple. Turns out they have a great platform for inference and torched almost nothing comparatively on Siri. The Apple/Gemini deal is interesting, Google continues to demonstrate their willingness to degrade their experience on Apple to try and force people to switch. |
| |
| ▲ | GorbachevyChase 27 minutes ago | parent | next [-] | | They also degrade their own direct services with little warning or thought put into change management, so, to be fair, Apple may be getting the same quality of service as the rest of us. | |
| ▲ | bigyabai an hour ago | parent | prev [-] | | Apple is basically in the same boat as AMD and Intel. They have a weak, raster-focused GPU architecture that doesn't scale to 100B+ inference workloads and especially struggles with large context prefill. TPUs smoke them on inference, and Nvidia hardware is far-and-away more efficient for training. | | |
| ▲ | brcmthrowaway 27 minutes ago | parent [-] | | This doesn't get talked about enough - the GPU is weak, weak, weak. And anyone who can fix them will go to a serious AI company (for 2-3x the salary). | | |
| ▲ | jorvi 20 minutes ago | parent [-] | | The GPU is monstrously good. Depending on the workload, the M1 series GPU using 120W could beat an RTX 3090 using 420W. Same with the CPU. Linux compiled faster on an M1 than on the fastest Intel i9 at the time, again using only 25% of the power budget. And the M-series has only gotten better. It is kind of sad Apple neglects helping developers optimize games for the M-series because iDevices and MacBooks could be the mobile gaming devices. | | |
| ▲ | ethbr1 7 minutes ago | parent [-] | | Apples and limes. The context of this thread isn't consumer chips, but Apple's analog to an H/B200. |
|
|
|
|
|
| ▲ | VirusNewbie 2 hours ago | parent | prev | next [-] |
| OpenAI uses GCP. I don't know if they use TPUs. https://www.reuters.com/business/retail-consumer/openai-taps... |
|
| ▲ | PKop 25 minutes ago | parent | prev [-] |
| > Opinions are my own. Why does this need to be stated? Who else's would they be? |
| |
| ▲ | ehnto 21 minutes ago | parent | next [-] | | Some on this forum will be working for companies with conflicts of interest on the topic, and if an employees words were construed to be the opinions of the company that could be bad for that person. | |
| ▲ | abosley 8 minutes ago | parent | prev | next [-] | | The tech companies train their employees to say this in their social media guidance and training. | |
| ▲ | operatingthetan 24 minutes ago | parent | prev | next [-] | | At this point that phase is an attempt at status signaling. | | |
| ▲ | sghiassy 23 minutes ago | parent | next [-] | | Opinions are my own But I think you’re right | |
| ▲ | muyuu 16 minutes ago | parent | prev [-] | | it's hilarious though it's like people are LARPing a Fortune company CEO when they're giving their hot takes on social media reminds me of Trump ending his wild takes on social media with "thank for for your attention to this matter" - so out of place, it makes it really funny | | |
| ▲ | PretzelPirate 4 minutes ago | parent [-] | | > it's like people are LARPing a Fortune company CEO when they're giving their hot takes on social media At least in large tech companies, they have mandatory social media training where they explicitly tell employees to use phrases like "my views are my own" to keep it clear whether they're speaking on behalf of their employer or not. |
|
| |
| ▲ | jedberg 22 minutes ago | parent | prev | next [-] | | > Who's else would they be? Their employer? They may work at related company, and are required to say this. | |
| ▲ | xboxnolifes 12 minutes ago | parent | prev [-] | | Its to cover their ass in the event someone makes a stink and quotes them as if its a company opinion. |
|