Notes by Louisa

Notes by Louisa

Notes by Louisa

Introduction
Chapter1 Python Cheatsheet
Chapter2 Java Cheatsheet
Chapter3 Algorithm
Chapter4 Model
Chapter5 Statistics and A/B Testing
Chapter6 SQL
Chapter7 Big Data and Spark
Chapter8 Code Walk-Throughs
Chapter9 Special Topics
Project: The Winning Recipes to an Oscar Award
Project: A Crime Analysis of the Last Decade NYC
Project: Predict User Type Based on Citibike Data
GeoSpark/GeoSparkVis for Geospatial Big Data
Single Scattering Albedo
Sea Ice Albedo Retrievals
Lidar Project

Powered by GitBook

On this page

Connect to Python
Create a SparkSession
Pandas Dataframe <-> Spark Dataframe
withColumn
Filter
Select
Groupby
Join
Cast
Onehot Encoder, StringIndexer
VectorAssembler
Pipeline
Split the data
cross validation
Tuning

Chapter7 Big Data and Spark

Introduction to Pyspark

PreviousChapter7 Big Data and Spark NextData Cleaning with Apache Spark

Last updated 4 years ago