Apache Spark: optimizations tips

 

  

1. Don’t use collect. Use take() instead

2. Cache and Persist 

etc.. 

 https://medium.com/@msdilli1997/spark-optimization-techniques-681cb85d01f9

 Credits: M S Dillibabu on Medium