41: Trino Puts On Its Hudi Trino Community Broadcast podcast

1+ y ago 1:43:00

Jaa

Sisällön tarjoaa Brian Olsen and Trino Community. Brian Olsen and Trino Community tai sen podcast-alustan kumppani lataa ja toimittaa kaiken podcast-sisällön, mukaan lukien jaksot, grafiikat ja podcast-kuvaukset. Jos uskot jonkun käyttävän tekijänoikeudella suojattua teostasi ilman lupaasi, voit seurata tässä https://fi.player.fm/legal kuvattua prosessia.

Trino's initial use case was around replacing the Apache Hive runtime. As data lakes grew into prominence, it became clear that having a faster query engine didn't solve all problems. The Hive model itself was a huge bottleneck and didn't provide features that companies needed akin to data warehouses and databases. Apache Hudi is a new table format created out of Uber that aims to address many of these issues and usher in a new generation of data lake.

Tune in as we speak to the Trino Hudi connector contributor Sagar Sumit and Grace Lu who uses Trino and Hudi at Robinhood to discuss the new Hudi connector and future plans!

- Intro Music: 0:00

- Intro: 0:32

- Releases: 14:43

- Concept of the episode: Intro to Hudi and the Hudi connector: 22:29

- Concept of the episode: Merge on read and copy on write tables: 28:28

- Concept of the episode: Hudi metadata table: 39:24

- Concept of the episode: Hudi data layout: 46:39

- Concept of the episode: Robinhood Trino and Hudi use cases: 51:12

- Concept of the episode: Current state and roadmap for the Hudi connector: 1:03:15

- Pull request of the episode: PR 14445: Fault-tolerant execution for PostgreSQL and MySQL connectors: 1:08:14

- Demo of the episode: Using the Hudi Connector: 1:13:34

Show Notes: https://trino.io/episodes/41.html

Show Page: https://trino.io/broadcast/

52 jaksoa