-
Black Box AI: Its 2023, and nobody knows what the hell is going on
Ever since the dawn of Deep Learning, the complexity and sheer scale of AI systems has far exceeded any human’s ability to comprehend their inner workings. Welcome to Black Box AI. Welcome to the AI of Mysteries. But, why? How? Very simply: because modern AI systems are all based, to varying degrees, on a very…
-
AI Brain Probes: What’s in the 3.5 Core? A Crazy Train?
[Part 1 of 4] Just this morning, a very curious report by a pair of UK-based researchers (Rumbelow & Watkins) landed in my inBox. It was cryptically titled: “SolidGoldMagikarp (plus, prompt generation)” It went on to explain how the team was able to effectively hack into the deep core of the AI brain (not into…
-
WebText2, Webtext, OpenWebText : Deep Inside the AI Datasets
Webtext was OpenAI’s attempt to give AI higher quality input than the mess of Common Crawl. WebText2 upped the ante. We dig into the contents. The Rationale for Webtext & Webtext2: Quality Prior to GPT-2 (which was really the breakthrough chat AI), Deep Learning LLMs were generally fed on diets comprised wholly of WikiPedia, public-domain…
-
AI Training: the Terrifying Difference a Single Word Makes
It fascinates me to no end that the current main line of thinking in AI research can be summed up in three simple words: “Just Scale It.” Let’s talk a little about AI training; and more specifically, the black magic of AI initialization prompts. I’ve summed up the (fairly detailed) steps of how a modern…
-
AI Censorship: ChatGPT’s Dirty Little Secret
The situation is actually far worse than I had previously imagined. On Top of the ridiculous instruction set that attempts to conform a politically correct AI, there is an even earlier layer applied, this one at both the training dataset (content pre-scrub) and the output (real-time filtering) levels. This is the layer of AI censorship. Why would I…
-
AI Math Problems: 8 – 3 = 6? If only it had a Calculator…
A curious thing happened on the way to the Forum… I’ve been having, more or less, an ongoing conversation with ChatGPT for the past month or so (and its predecessor, GPT-3, before that). And though it has serious limitations, mostly due to its idiotically enforced censorship (yes, it’s politically correct AI… urgh), there is one…
-
Attention is All You Need : The Beginning of AGI v1.0
On Monday, June 12, 2017, there was a second shift in the Force. On that afternoon, Ashish Vaswani and his colleagues at Google uploaded a 1 megabyte PDF file, in that moment pre-publishing a seminal paper, playfully named “Attention is All you Need.” The paper outlined the basic Transformer model which has been at the…
-
Sparrow’s 23 Rules of Politically Correct AI
ChatGPT can be seen as the first actual user-friendly interface to the bevy of “ChatBot” AIs*. It sports an elegant “messenger”-like interface where you basically have an interactive and very naturally paced — including dramatic pauses mid-sentence… is it “thinking?” — “conversation” with the ChatGPT 3.5 agent. But something massive shifted when OpenAI moved from…
-
AI Stock Trading +HFT : The Relentless Assault of the TraderBots
Q&A with Sam Altman, CEO of OpenAI, way back in the AI pre-history days of c. 2019 (OpenAI is thought to be one of the leading contenders of “who will birth the first AGI on Earth?”) AI 2025: All Your Markets Are Belong To Us Journalist: “OpenAI has just secured north of $10 billion in…
-
Sam Altman : The “Next Bill Gates?” for the 21st Century
“Who is Sam Altman?” Well… first, there was Bill Gates. . . . . (and Paul Allen) And then there was Steve Jobs. . . . . (and Steve Wozniak) And then there was Larry Page . . . . (and Sergey Brin) And then there was Mark Zuckerberg . . . . (and Adam…
