Automate Data Pipelines with Metadata – Ashik Ali, Swedbank

Session Outline

Swedbank have implemented an automated framework to create, test and deploy new data pipelines to onboard data into a data lake. This has reduced the time to create these feeds from several days to just a few hours. This is a very strong showcase of the importance of metadata as a future catalyst in data integration.

Key Takeaways

  • Reduced time to market for data to be onboarded and available in data lake.
  • New data pipelines creation reduced from 3 days to 2 hours
  • Maintain standard coding and naming conventions across the platform
  • Scalability and maintainability of data lake feeds simplified

Add a comment

Leave a Reply