AI Engineer · Video summary
How AI is changing Software Engineering: A Conversation with Gergely Orosz, @pragmaticengineer
AI is reshaping software engineering, driving token maxing due to performance metrics and pushing companies to build custom AI infra, impacting team structures and engineer roles.
Watch on YouTube ↗Key takeaways
- 🎯Companies are measuring AI token output, leading to 'token maxing' where engineers generate tokens for metrics, potentially weaponized in performance evaluations.01:17
- 📈Historically, metrics like lines of code were gamed; AI token count follows a similar pattern, highlighting the challenge of measuring developer productivity with new tools.04:18
- 💡The push for AI adoption is often top-down, with leadership incentivizing usage even if the immediate benefits aren't clear, leading to behaviors like token maxing.07:17
- 📊Focus on how AI can enable non-technical collaborators to code, potentially creating broader team productivity gains beyond individual developer output.10:10
- 🚀Experiment with AI tools to understand their practical application and identify workflows where they genuinely enhance productivity, rather than just chasing metrics.11:13
- 🔍Understanding AI theory doesn't directly translate to better tool usage; proficiency comes from practice and workflow adaptation, not just theoretical knowledge.11:38
Chapters
- 0:00🤝 Introduction
- 0:35💡 What is Token Maxing?
- 1:55📈 Performance Evaluations
- 3:00🚀 Cultural Impact of Token Maxing
- 5:34🔍 AI Adoption Challenges
- 7:24🔄 Changing Role of Engineers
- 9:40📊 AI Productivity Studies
- 10:35🧑🤝🧑 Collaboration with Non-Technical Team Members
- 12:23🏢 Infrastructure Developments
- 14:19💼 The Pragmatic Engineer Journey
- 17:50🌍 Impact on the Tech Community
- 20:50👏 Closing Remarks
The digest
Keep reading in The Digest
The full 1-minute article, and every new episode from AI Engineer and the creators you follow.
Read the full digest — freeMore from AI Engineer
Training an LLM from Scratch, Locally — Angelos Perivolaropoulos, ElevenLabs
In this hands-on workshop, Angelos Perivolaropoulos from ElevenLabs guides participants through the process of training an LLM from scratch using basic libraries like Torch, emphasizing the importance of tokenization and model architecture in building effective language models.
Skill Issue: How We Used AI to Make Agents Actually Good at Supabase — Pedro Rodrigues, Supabase
In this workshop, AI Engineer Pedro Rodrigues discusses how to enhance agent performance at Supabase using skills—structured workflows that improve agent interaction and efficiency. He shares insights on creating, testing, and implementing these skills, highlighting their significance in the development of agent-friendly applications.
Ralph Loops: Build Dumb AI Loops That Ship — Chris Parsons, Cherrypick
In this workshop, AI Engineer Chris Parsons introduces Ralph Loops, a method for building simple AI workflows that enhance productivity by iteratively refining tasks, using real coding examples like a Pomodoro timer. Participants learn to implement these loops practically, emphasizing the importance of context and feedback in AI-assisted coding.
Mergeable by default: Building the context engine to save time and tokens — Peter Werry, Unblocked
In this video, Peter Werry from Unblocked discusses the importance of a context engine for AI agents, emphasizing how it optimizes task execution by providing relevant context and reducing cognitive load for users. He debunks common myths surrounding context engines and illustrates their effectiveness in enhancing productivity and understanding within organizations.
Context Is the New Code — Patrick Debois, Tessl
In this talk, Patrick Debois presents the concept that context is the new code, emphasizing the importance of creating, testing, and distributing context in the software development lifecycle, particularly when using AI coding agents. He advocates for a systematic approach to context development that involves generating reusable prompts, evaluating their effectiveness, and leveraging feedback to improve overall coding practices.
Mastering AI Pricing: Flexible & Agile Monetization — Mayank Pant, Stripe
In this video, Mayank Pant from Stripe discusses the challenges and strategies of AI pricing, emphasizing the need for hybrid pricing models that adapt rapidly to changing features and customer needs, allowing companies to maintain competitive margins while fostering customer trust and engagement.