Parhaat Training Data Podcastit (2024)

1
Why Vlad Tenev and Tudor Achim of Harmonic Think AI Is About to Change Math—and Why It Matters 39:45

4d ago39:45

39:45

Adding code to LLM training data is a known method of improving a model’s reasoning skills. But wouldn’t math, the basis of all reasoning, be even better? Up until recently, there just wasn’t enough usable data that describes mathematics to make this feasible. A few years ago, Vlad Tenev (also founder of Robinhood) and Tudor Achim noticed the rise …

1
Jim Fan on Nvidia’s Embodied AI Lab and Jensen Huang’s Prediction that All Robots will be Autonomous 49:13

11d ago49:13

49:13

AI researcher Jim Fan has had a charmed career. He was OpenAI’s first intern before he did his PhD at Stanford with “godmother of AI,” Fei-Fei Li. He graduated into a research scientist position at Nvidia and now leads its Embodied AI “GEAR” group. The lab’s current work spans foundation models for humanoid robots to agents for virtual worlds. Jim …

1
Founder Eric Steinberger on Magic’s Counterintuitive Approach to Pursuing AGI 51:15

18d ago51:15

51:15

There’s a new archetype in Silicon Valley, the AI researcher turned founder. Instead of tinkering in a garage they write papers that earn them the right to collaborate with cutting-edge labs until they break out and start their own. This is the story of wunderkind Eric Steinberger, the founder and CEO of Magic.dev. Eric came to programming through …

1
Crucible Moments Returns for S2: The ServiceNow Story ft. CEO Frank Slootman & Founder Fred Luddy 42:53

25d ago42:53

42:53

On Training Data, we learn from innovators pushing forward the frontier of AI’s capabilities. Today we’re bringing you something different. It’s the story of a company currently implementing AI at scale in the enterprise, and how it was built from a bootstrapped idea in the pre-AI era to a 150 billion dollar market cap giant. It’s the Season 2 prem…

1
Sierra Co-Founder Clay Bavor on Making Customer-Facing AI Agents Delightful 1:12:31

1M ago1:12:31

1:12:31

Customer service is hands down the first killer app of generative AI for businesses. The reasons are simple: the costs of existing solutions are so high, the satisfaction so low and the margin for ROI so wide. But trusting your interactions with customers to hallucination-prone LLMs can be daunting. Enter Sierra. Co-founder Clay Bavor walks us thro…

1
Phaidra’s Jim Gao on Building the Fourth Industrial Revolution with Reinforcement Learning 50:33

1M ago50:33

50:33

After AlphaGo beat Lee Sedol, a young mechanical engineer at Google thought of another game reinforcement learning could win: energy optimization at data centers. Jim Gao convinced his bosses at the Google data center team to let him work with the DeepMind team to try. The initial pilot resulted in a 40% energy savings and led he and his co-founder…

1
Fireworks Founder Lin Qiao on How Fast Inference and Small Models Will Benefit Businesses 39:18

2M ago39:18

39:18

In the first wave of the generative AI revolution, startups and enterprises built on top of the best closed-source models available, mostly from OpenAI. The AI customer journey moves from training to inference, and as these first products find PMF, many are hitting a wall on latency and cost. Fireworks Founder and CEO Lin Qiao led the PyTorch team …

1
GitHub CEO Thomas Dohmke on Building Copilot, and the the Future of Software Development 1:07:34

2M ago1:07:34

1:07:34

GithHub invented collaborative coding and in the process changed how open source projects, startups and eventually enterprises write code. GitHub Copilot is the first blockbuster product built on top of OpenAI’s GPT models. It now accounts for more than 40 percent of GitHub revenue growth for an annual revenue run rate of $2 billion. Copilot itself…

1
Meta’s Joe Spisak on Llama 3.1 405B and the Democratization of Frontier Models 42:07

2M ago42:07

42:07

As head of Product Management for Generative AI at Meta, Joe Spisak leads the team behind Llama, which just released the new 3.1 405B model. We spoke with Joe just two days after the model’s release to ask what’s new, what it enables, and how Meta sees the role of open source in the AI ecosystem. Joe shares that where Llama 3.1 405B really focused …

1
Klarna CEO Sebastian Siemiatkowski on Getting AI to Do the Work of 700 Customer Service Reps 51:35

2M ago51:35

51:35

In February, Sebastian Siemiatkowski boldly announced that Klarna’s new OpenAI-powered assistant handled two thirds of the Swedish fintech’s customer service chats in its first month. Not only were customer satisfaction metrics better, but by replacing 700 full-time contractors the bottom line impact is projected to be $40M. Since then, every compa…

1
Reflection AI’s Misha Laskin on the AlphaGo Moment for LLMs 1:07:04

2M ago1:07:04

1:07:04

LLMs are democratizing digital intelligence, but we’re all waiting for AI agents to take this to the next level by planning tasks and executing actions to actually transform the way we work and live our lives. Yet despite incredible hype around AI agents, we’re still far from that “tipping point” with best in class models today. As one measure: cod…

1
Microsoft CTO Kevin Scott on How Far Scaling Laws Will Extend 1:00:27

3M ago1:00:27

1:00:27

The current LLM era is the result of scaling the size of models in successive waves (and the compute to train them). It is also the result of better-than-Moore’s-Law price vs performance ratios in each new generation of Nvidia GPUs. The largest platform companies are continuing to invest in scaling as the prime driver of AI innovation. Are they rig…

1
Zapier’s Mike Knoop launches ARC Prize to Jumpstart New Ideas for AGI 55:12

3M ago55:12

55:12

As impressive as LLMs are, the growing consensus is that language, scale and compute won’t get us to AGI. Although many AI benchmarks have quickly achieved human-level performance, there is one eval that has barely budged since it was created in 2019. Google researcher François Chollet wrote a paper that year defining intelligence as skill-acquisit…

1
Factory’s Matan Grinberg and Eno Reyes Unleash the Droids on Software Development 59:10

3M ago59:10

59:10

Archimedes said that with a large enough lever, you can move the world. For decades, software engineering has been that lever. And now, AI is compounding that lever. How will we use AI to apply 100 or 1000x leverage to the greatest lever to move the world? Matan Grinberg and Eno Reyes, co-founders of Factory, have chosen to do things differently th…

1
LangChain’s Harrison Chase on Building the Orchestration Layer for AI Agents 49:50

3M ago49:50

49:50

Last year, AutoGPT and Baby AGI captured our imaginations—agents quickly became the buzzword of the day…and then things went quiet. AutoGPT and Baby AGI may have marked a peak in the hype cycle, but this year has seen a wave of agentic breakouts on the product side, from Klarna’s customer support AI to Cognition’s Devin, etc. Harrison Chase of Lang…

1
Introducing "Training Data" 1:26

4M ago1:26

1:26

Join us as we train our neural nets on the theme of the century: AI. Sequoia Capital partners Sonya Huang and Pat Grady host conversations with leading AI builders and researchers to ask critical questions and develop a deeper understanding of the evolving technologies and their implications for technology, business and society. The content of this…

1
#29 Celebrating CosmiQ Works 1:14:44

3+ y ago1:14:44

1:14:44

Founded in 2015 as part of IQT Labs, CosmiQ Works launched to focus on the geospatial analytics market and provide technical insights, targeted research, reports, and more. Over the past six years CosmiQ has produced many projects and insights that have helped the intelligence and academic communities better understand how geospatial can help tackl…

1
#28 Introducing the SpaceNet 7 Challenge: Multi-Temporal Urban Development 50:54

4y ago50:54

50:54

Satellite imagery analytics have numerous human development and disaster response applications, particularly when time series methods are involved. The Multi-Temporal Urban Development SpaceNet 7 Challenge focuses on developing novel computer vision methods for non-video time series data, asking participants to identify and track buildings in satel…

1
#27 SpaceNet 6: The Multi-Modal Extravaganza Family Hour 36:15

4y ago36:15

36:15

CosmiQ’s Jake Shermeyer and Daniel Hogan are joined by Capella Space’s Jason Brown and IEEE Geoscience and Remote Sensing’s (GRSS) Ronny Hänsch to once again discuss the SpaceNet 6 Dataset and post-challenge experiments. Learn more about data fusion and deep learning approaches that work to blend synthetic aperture radar (SAR) and optical imagery. …

1
#26 SpaceNet 6 Challenge Results: Multi-Sensor All-Weather Mapping 38:43

4y ago38:43

38:43

SpaceNet is a non-profit dedicated to accelerating open source, applied research in geospatial machine learning. In this episode, CosmiQ’s Ryan Lewis, Jake Shermeyer, and Daniel Hogan discuss the SpaceNet 6 Challenge where participants were asked to automatically extract building footprints with computer vision and AI algorithms using a combination…

1
#25 Evaluating SpaceNet 5 Challenge Results: Road Network Detection & Optimized Routing 54:14

4+ y ago54:14

54:14

Despite its application to myriad humanitarian and civil use cases, automated road network extraction from overhead satellite imagery remains quite challenging. However, the SpaceNet 5 challenge made significant progress in this field with top participants being able to extract both road networks and speed/travel time estimates for each roadway. On…

1
#24 Viewing the World Through a Straw 37:15

4+ y ago37:15

37:15

How can lessons from geospatial computer vision applications impact bio image analysis? CosmiQ’s Dr. Nick Weir and B.Next’s Dr. Dylan George explore the intersection of these two fields and why artificial intelligence (AI) has struggled to gain traction with both satellite imagery and medicine. Hear about their project that researched similarities …