For the primary time ever, the Data Engineering Summit will likely be in person! Co-located with the leading Data Science and AI Training Conference, ODSC East, this summit will gather the leading minds in Data Engineering in Boston on April twenty third and twenty fourth. We’re currently hard at work on the lineup. In the meantime, try these recordings from last yr’s virtual Data Engineering Summit.
Thrive within the Data Tooling Tornado
Adam Breindel | Independent Consultant
In this talk, Adam Breindel, a number one Apache Spark instructor and authority on neural-net fraud detection, streaming analytics and cluster management code, will allow you to navigate the info tooling landscape.
In the rapidly changing data tooling landscape of 2023, organizations struggle to fulfill existing commitments and next-gen projects have an estimated failure rate as high as 85%. This session will explore the origin of those challenges (spoiler: outdated anti-patterns from Twentieth-century industry) and the adjustments you may make to unravel these issues.
Streaming Featurization with Ibis, Substrait and Apache Arrow
Wes Mckinney | CTO and Cofounder | Voltron Data
David Palaitis | Managing Director | Two Sigma
In this talk, Wes McKinney, creator of the Python pandas project and co-creator of Apache Arrow, and David Palaitis, an engineering manager with Two Sigma Investment, will exhibit how their organizations are working together to enhance featurization workflows.
Their approach utilizes the Ibis, Substrait, Arrow software stack, providing a whole solution for real-time streaming data processing, with Ibis providing high-level APIs for data processing and evaluation, Substrait providing a framework for machine learning, and Apache Arrow providing a high-performance data representation for each. This stack makes it possible to process large amounts of streaming data in real time, providing fast and accurate insights for decision-making.
Data-Planning to Implementation
Balaji Raghunathan | VP of Digital Experience | ITC Infotech
Over his 20+ year-long profession, Balaji Raghunatthan has worked with cloud-based architectures, microservices, DevOps, Java, .NET, and AWS. In this talk, Balaji will take you thru the technique of data planning to implementation, which is the technique of using data to develop and deploy a project or initiative. In short, data planning to implementation helps organizations make informed decisions and take motion based on insights obtained from data.
Building a Data Mesh: Strategies and Best Practices
Hajar Khizou | Lead Data Engineer | SustainCERT
Join data mesh and AI expert, Hajar Khizou for an exploration of the concept of information mesh architecture, a decentralized approach to organizing data and data infrastructure. In this talk, she is going to cover the important thing advantages, strategies, and best practices for implementing an information mesh, including designing data products, defining governance models, and ensuring data quality and consistency.
Joe Reis | CEO | Ternary Data
In this video, Joe Reis, CEO of Ternary Data, provides invaluable insights on navigating the recent economic climate and what it means for aspiring data engineers. Learn concerning the various profession entry points that may allow you to get your foot within the door.
Sign me up!
As any data engineering skilled knows, one of the best strategy to stay ahead of the curve is by maintaining with the most recent in all things related to data and data engineering. The best strategy to try this is by joining us at ODSC’s Data Engineering Summit and ODSC East.
At the Data Engineering Summit on April twenty fourth, co-located with ODSC East 2024, you’ll be on the forefront of all the key changes coming before it hits. So get your pass today, and keep yourself ahead of the curve.
This article was originally published at summit.ai
