Advanced Analytics with Spark: Patterns for Learning from Data at Scale
CyberSecurity Summary
- Published
- June 27, 2026
- Duration
- 21:16
- Summary source
- description
- Last updated
- Jul 5, 2026
Discusses Explores how to use Apache Spark and the Scala programming language to perform complex data science …
Summary
Explores how to use Apache Spark and the Scala programming language to perform complex data science tasks at scale. The documentation focuses on record linkage, a data cleansing process used to identify duplicate records within massive datasets. It introduces fundamental Spark concepts, such as Resilient Distributed Datasets (RDDs) and DataFrames, while e…
Intelligent Report
Sign in to read teasers, or upgrade to Research Pro to commission intelligent report for this episode. Learn more →
Show notes
Explores how to use Apache Spark and the Scala programming language to perform complex data science tasks at scale. The documentation focuses on record linkage, a data cleansing process used to identify duplicate records within massive datasets. It introduces fundamental Spark concepts, such as Resilient Distributed Datasets (RDDs) and DataFrames, while emphasizing the importance of iterative analysis. Readers learn to manage the entire data pipeline, from initial preprocessing and schema infere