Effective Big Data Pipeline Design and Tuning with Apache Spark – Rockie Yang, KnockData


Having an effective big data pipeline brings business value constantly. The talk will share how to design big data pipeline more effectively and tuning the pipeline to make it work faster and more reliable.

Key Takeaways

  • Key design principle for big data pipeline with Apache Spark
  • How to tuning big data pipeline to make it work more smoothly
  • A real operational big data pipeline

Add comment