Archive - AI Research & Strategy

Google TPU V6 Designs are Probably in China

We should act faster in potential espionage cases.

Mar 7 •

January 2024

The NYT vs. OpenAI Copyright Case: A Technical Introduction – Part II

Where we finish our quest to understand memorization in LLMs and how it applies to copyright infringement claims before we move on to the next parts.

Jan 11 •

The NYT vs. OpenAI Copyright Case: A Technical Introduction – Part I

Where we delve into the many claims in the case and ground them in AI literature around Memorization and Hallucination.

Jan 7 •

December 2023

Defining the Post-LLM Era

What is the "post-LLM era", why is it a thing, and are we in it?

Dec 24, 2023 •

The Great AI Weirding

Or how AI will put you in recursive rat races if you let it, and you probably will.

Dec 20, 2023 •

June 2023

The Data Center is the New VC

Glimpsing into the future of AI investing

Jun 29, 2023

April 2023

How to Understand the Post-LLM Era

A mental model for builders and investors

Apr 21, 2023 •

September 2022

An Argument for Modeling Consolidation

Or What Happens if Attention (and Transformer) Is All We Need?

Sep 14, 2022 •

August 2022

After Reboot, A Redux

Since it’s been a while, I will summarize key takeaways from the previous posts. This will set the stage for future posts, and, for the new readers, it…

Aug 29, 2022 •

November 2020

Ride the Hardware Lottery!

Issue #3: Why comparing models like GPT-3 with human brain/intelligence is flawed in a unique way.

Nov 9, 2020 •

August 2020

GPT-3 Turk’s Gambit and The Question of AI Automation

What’s in this issue: I continue our exploration in GPT-3 hype by considering a recent viral post as an example, leading us to critically examine the…

Aug 21, 2020 •

July 2020

GPT-3 and A Typology of Hype

What's in this issue: Here I try to deconstruct the buzz about GPT-3, and in trying to do that, I dig deeper into what hype means in the context of…

Jul 26, 2020 •

#nojs-banner { position: fixed; bottom: 0; left: 0; padding: 16px 16px 16px 32px; width: 100%; box-sizing: border-box; background: red; color: white; font-family: -apple-system, "Segoe UI", Roboto, Helvetica, Arial, sans-serif, "Apple Color Emoji", "Segoe UI Emoji", "Segoe UI Symbol"; font-size: 13px; line-height: 13px; } #nojs-banner a { color: inherit; text-decoration: underline; } This site requires JavaScript to run correctly. Please turn on JavaScript or unblock scripts