Gehen Sie mit der App Player FM offline!
How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
Manage episode 517970010 series 2053958
The life sciences industry relies on data accuracy, regulatory insight and quality intelligence. Building a unified system that keeps these elements aligned is no small feat.
In this episode, we welcome Shankar Mahindar, Senior Data Engineer II at Redica Systems. We discuss how the team restructures its data platform with Airflow to strengthen governance, reduce compliance risk and improve customer experience.
Key Takeaways:
00:00 Introduction.
01:53 A focused analytics platform reduces compliance risk in life sciences.
07:31 A centralized warehouse orchestrated by Airflow strengthens governance.
09:12 Managed orchestration keeps attention on analytics and outcomes.
10:32 A modern transformation stack enables scalable modeling and operations.
11:51 Event-driven pipelines improve data freshness and responsiveness.
14:13 Asset-oriented scheduling and versioning enhance reliability and change control.
16:53 Observability and SLAs build confidence in data quality and freshness.
21:04 Priorities include partitioned assets and streamlined developer tooling.
Resources Mentioned:
https://www.linkedin.com/in/shankar-mahindar-83a61b137/
Redica Systems | LinkedIn
https://www.linkedin.com/company/redicasystems/
Redica Systems | Website
https://redica.com
https://airflow.apache.org/
https://www.astronomer.io/
https://www.snowflake.com/
https://aws.amazon.com/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
78 Episoden
How Redica Transformed Their Data With Airflow and Snowflake with Shankar Mahindar
The Data Flowcast: Mastering Apache Airflow ® for Data Engineering and AI
Manage episode 517970010 series 2053958
The life sciences industry relies on data accuracy, regulatory insight and quality intelligence. Building a unified system that keeps these elements aligned is no small feat.
In this episode, we welcome Shankar Mahindar, Senior Data Engineer II at Redica Systems. We discuss how the team restructures its data platform with Airflow to strengthen governance, reduce compliance risk and improve customer experience.
Key Takeaways:
00:00 Introduction.
01:53 A focused analytics platform reduces compliance risk in life sciences.
07:31 A centralized warehouse orchestrated by Airflow strengthens governance.
09:12 Managed orchestration keeps attention on analytics and outcomes.
10:32 A modern transformation stack enables scalable modeling and operations.
11:51 Event-driven pipelines improve data freshness and responsiveness.
14:13 Asset-oriented scheduling and versioning enhance reliability and change control.
16:53 Observability and SLAs build confidence in data quality and freshness.
21:04 Priorities include partitioned assets and streamlined developer tooling.
Resources Mentioned:
https://www.linkedin.com/in/shankar-mahindar-83a61b137/
Redica Systems | LinkedIn
https://www.linkedin.com/company/redicasystems/
Redica Systems | Website
https://redica.com
https://airflow.apache.org/
https://www.astronomer.io/
https://www.snowflake.com/
https://aws.amazon.com/
Thanks for listening to “The Data Flowcast: Mastering Apache Airflow® for Data Engineering and AI.” If you enjoyed this episode, please leave a 5-star review to help get the word out about the show. And be sure to subscribe so you never miss any of the insightful conversations.
#AI #Automation #Airflow #MachineLearning
78 Episoden
Alle Folgen
×Willkommen auf Player FM!
Player FM scannt gerade das Web nach Podcasts mit hoher Qualität, die du genießen kannst. Es ist die beste Podcast-App und funktioniert auf Android, iPhone und im Web. Melde dich an, um Abos geräteübergreifend zu synchronisieren.