LDI La Donnée Intelligente AI & Data Engineering Get in Touch
AI, Data Engineering & MLOps

La donnée intelligente

Apache Spark & Apache Cassandra: Tips and optimizations

on July 06, 2021

 


 

In this article, I will discuss the implications of running Spark with Cassandra compared to the most common use case which is using a deep storage system such as S3 of HDFS.

The goal is to understand the internals of Spark and Cassandra so you can write your code as efficient as possible to really utilize the power of these two great tools.

I will give you some tips regarding Spark tuning and Cassandra optimizations so you can maximize performance and minimize costs. I assume you already have basic knowledge of Spark and Cassandra.

Credit & Read more: https://itnext.io/spark-cassandra-all-you-need-to-know-tips-and-optimizations-d3810cc0bd4e