Skip to main content

La donnée intelligente

Search This Blog

Simple GIT deployment strategy for Python or others app

on November 26, 2017

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

http://nicolasgallagher.com/simple-git-deployment-strategy-for-static-sites/

Follow instructions here for setting GIT and Password

Get link
Facebook
Twitter
Pinterest
Email
Other Apps

Comments

Post a Comment

Popular Posts

How To Break DAG Lineage in Apache Spark — 3 Methods

How To Break DAG Lineage in Apache Spark — 3 Methods In this post, I will introduce you to 3 methods how you can Brak DAG Lineage in Apache Spark. It’s very possible that 1 of them you weren’t even aware of! Check if you know all 3 methods which, depending on the conditions and requirements, can save you a lot of time! What is DAG? Apache Spark Break DAG Lineage Why do we need to break DAG Lineage? Where to see the DAG graph? How do break DAG Lineage? #1: Checkpoint #2: LocalCheckpoint #3: ReCreate DataFrame / DataSet Read more: https://medium.com/@bigdataetlcom/how-to-break-dag-lineage-in-apache-spark-3-methods-6d53f9cc1dab Credits: Big Data Etls in Medium.com Photo by <a href="https://unsplash.com/@conti_photos?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Fabrizio Conti</a> on <a href="https://unsplash.com/s/photos/mountain-climbing?utm_source=unsplash&utm_medium=referral&utm_content=creditCopyText">Un

Simple method for choosing the number of partitions in Spark

Simple Method to choose Number of Partitions in Spark At the end of this article, you will able to analyze your Spark Job and identify whether you have the right configurations settings for your spark environment and whether you utilize all your resources. Whenever you work on a spark job, you should consider 2 things. Avoid Spill Maximize Parallelism by utilizing all the cores. Read more: https://medium.com/analytics-vidhya/simple-method-to-choose-number-of-partitions-in-spark-75315c636a94 Credit: Tharun Kumar Sekar Photo by Fran Couto

Apache Iceberg reduced Amazon S3 cost by 90%

Apache Iceberg reduced Amazon S3 cost by 90% The new generation data lake table formats ( Apache Hudi , Apache Iceberg , and Delta Lake ) are getting more traction every day with their superior capabilities compared to Apache Hive . They enable cost-effective cloud solutions for big data analysis with ACID transactions, schema evolution, time travel, and more. Read more: https://medium.com/insiderengineering/apache-iceberg-reduced-our-amazon-s3-cost-by-90-997cde5ce931 Credit: Deniz Parmaksız Photo: Photo by Isaac Mitchell on Unsplash

Powered by Blogger