Spark技术分享

大数据技术分享 version:spark-1.6.0-cdh5.15.0 微信: thinktothings

重要说明

• 本站不在更新：原因是不是直接的md文件，方便在其它博客进行传播

• 请访问: https://github.com/opensourceteams/spark-scala-maven

Youtube视频分享

SparkContext原理分析

• SparkContext原理分析详情: https://thinktothings.gitbook.io/spark/~/drafts/-LSbX8Zc4xiraaF64UdJ/primary/yuan-ma-fen-xi/untitled

• Youtub视频(SparkContextSpark原理分析图解): youtube:https://youtu.be/3vUVwbEGf1E​

• Youtub视频(SparkContext源码分析详解): https://youtu.be/tUH7QnCcwgg​

Spark通信原理分析

• Spark通信原理分析详情:https://thinktothings.gitbook.io/spark/~/edit/drafts/-LSbX8Zc4xiraaF64UdJ/yuan-ma-fen-xi/spark-tong-xin-fa-jian-xiang-he-shou-jian-xiang

• Spark通信原理视频分享: youtube:https://youtu.be/3vUVwbEGf1E​

Master源码分析

• Master启动源码分析详情:https://thinktothings.gitbook.io/spark/yuan-ma-fen-xi/master-yuan-ma-fen-xi

• Master启动源码分析视频分享: youtube: https://youtu.be/74q1nddoaiY

• Master资源调度--Worker向Master注册源码分析(Youtube)： https://youtu.be/SFqXaIKt-yI

• Master资源调度--Worker向Master注册源码分析(文档详解):

  https://thinktothings.gitbook.io/spark/yuan-ma-fen-xi/master-zi-yuan-tiao-du-worker-xiang-master-zhu-ce

• Master资源调度--SparkContext向所有master注册(Youtube视频): https://youtu.be/AXxCnCc5Mh0​

• Master资源调度--SparkContext向所有master注册(文档详解): https://thinktothings.gitbook.io/spark/yuan-ma-fen-xi/master-zi-yuan-tiao-du-sparkcontext-xiang-suo-you-master-zhu-ce-registerapplication-xiao-xi

Worker源码分析

• Worker启动源码分析详情: https://thinktothings.gitbook.io/spark/yuan-ma-fen-xi/worker-yuan-ma-fen-xi

• Worker 启动源码分析视频分享: youtube: https://youtu.be/ll_Ae6rP7II​

Executor源码分析

• CoarseGrainedExecutorBackend启动源码分析(文档详解): https://thinktothings.gitbook.io/spark/yuan-ma-fen-xi/coarsegrainedexecutorbackend-qi-dong-yuan-ma-fen-xi

• CoarseGrainedExecutorBackend启动源码分析(Youtube视频) : https://youtu.be/1qg4UMPV3pQ