Effective Big Data Pipeline Design and Tuning with Apache Spark – Rockie Yang, KnockData


Having an effective big data pipeline brings business value constantly. The talk will share how to design big data pipeline more effectively and tuning the pipeline to make it work faster and more reliable.

Key Takeaways

  • Key design principle for big data pipeline with Apache Spark
  • How to tuning big data pipeline to make it work more smoothly
  • A real operational big data pipeline

Add comment

Highlight option

Turn on the "highlight" option for any widget, to get an alternative styling like this. You can change the colors for highlighted widgets in the theme options. See more examples below.


Instagram has returned empty data. Please authorize your Instagram account in the plugin settings .

Ivana Kotorchevikj

Categories count color


Small ads


  • Traffic lights
  • WoMo
  • Setra presentation
  • It never ends
  • stand still screening-smoking girl
  • Maria d'Odessa performs her art of make-up
  • Afro-deko-mono
  • Maria d'Odessa, touching
  • Maria d'Odessa au bâton de rouge-baiser

Social Widget

Collaboratively harness market-driven processes whereas resource-leveling internal or "organic" sources.