Episode 56
|
September 10, 2024
Discover the new Dremio capabilities designed to make your Apache Iceberg data lakehouse the most efficient, scalable, and manageable platform for analytics and AI. We’ll cover enhancements in performance, data ingestion, data processing, and federated query capabilities, aimed at helping you achieve the fastest, most scalable, and easiest to use lakehouse for all of your data.
Dremio unveiled new features in our latest release that enhance the creation, performance, and management of Apache Iceberg data lakehouses.
You will learn how Dremio delivers market-leading SQL query and write performance, improved federated query security and management as well as streamlined data ingestion by delivering:
– Live Reflections on Iceberg tables that will accelerate performance, ensure up-to-date data and reduce management overhead.
– Result Set Caching that can accelerate query performance up to 28X – Merge-on-Read that can enhance write and ingestion speed
– Auto Ingest Pipes that eliminate complex pipeline setup and maintenance
– User Impersonation for federated queries that allows for granular permissions, better access control, and user workload tracking
Watch or listen on your favorite platform
Watch on
YouTube
Listen on
Spotify
Listen on
Apple Podcasts
Listen on
YouTube Music
Listen on
Amazon Music
Listen on
iHeartPodcasts
Maeve Donovan
No Bio Available
Mark Shainman
Mark Shainman is a Principal Product Marketing Manager for Dremio. He has spent more than 20-years working in both the analytics as well as privacy, governance, and security space. He has worked with numerous data products and on numerous initiatives, including database migrations, data warehousing, big data, SQL on Hadoop, data lakes, federated query access, data cataloging, privacy compliance and, now, the data lakehouse.
Discover the power of the hybrid lakehouse! Join data expert David Loshin to explore how this strategy combines the scalability of data lakes with the performance of data warehouses, enabling flexibility and future-proofing your data ecosystem.
read more
Learn best practices for creating sustainable data architectures that emphasize efficiency and long-term maintainability. Discover strategies for optimizing workflows while exploring core design principles like security, cost optimization, and operational excellence. Ideal for professionals looking to enhance their data architecture skills!
read more
As AI adoption rises, data quality and reliability are crucial. This presentation shows how treating data as a product—with clear ownership, quality standards, and governance—ensures AI readiness. Discover practical strategies to overcome challenges like accessibility and governance, turning data into a strategic asset for AI innovation.
read more
