Big Data Processing using Apache Spark and Amazon Web Services

Jul 24, 2021

--

Big Data Analytics

Aditya Kunar

Written by Aditya Kunar

I am a researcher at Generatrix- An AI-based privacy preserving data synthesizing platform. I have an avid passion for new and emerging technologies in AI & ML

More from Aditya Kunar

Object Detection with SSD and MobileNet

Aditya Kunar

Object Detection with SSD and MobileNet

1. Introduction

24 min readJul 6, 2020

--

1

CTAB-GAN: Effective Table Data Synthesizing

Aditya Kunar

CTAB-GAN: Effective Table Data Synthesizing

By Zilong Zhao, Aditya Kunar, Hiek Van der Scheer, Robert Birke & Lydia Y. Chen

5 min readJun 7, 2021

--

1

DTGAN: Differential Private Training for Tabular GANs

Aditya Kunar

DTGAN: Differential Private Training for Tabular GANs

By Aditya Kunar, Robert Birke, Zilong Zhao & Lydia Y. Chen

6 min readAug 2, 2021

--

See all from Aditya Kunar

Recommended from Medium

How I Built a Data Lakehouse With Delta Lake Architecture

Nicholas Leong

How I Built a Data Lakehouse With Delta Lake Architecture

Data Engineer Explains the Data Lakehouse Architecture

10 min readSep 18

--

4

Mastering Big Data Processing: A Comprehensive Guide to use SageMaker Processing with Spark…

Bruno Pistone

Mastering Big Data Processing: A Comprehensive Guide to use SageMaker Processing with Spark…

Authors: Bruno Pistone, Gabrielle Dompreh

16 min readMar 31

--

Lists

New_Reading_List

174 stories121 saves

Natural Language Processing

643 stories253 saves

Mastering DataFrames in PySpark

Roshmita Dey

Mastering DataFrames in PySpark

In the world of big data processing and analysis, PySpark has emerged as a powerful and flexible framework. At the core of PySpark’s data…

5 min readSep 3

--

The future of the data engineer — Part I

Analytics at Meta

The future of the data engineer — Part I

Introduction

10 min readApr 3

--

15

Discover the new Snowpark ML Toolkit + dbt Python models

Felipe Hoffa
in
Snowflake

Discover the new Snowpark ML Toolkit + dbt Python models

Let’s do some feature engineering, training, and inference with Snowpark ML and the dbt Python models. First with with 50k rows and then…

12 min readSep 20

--

1

Modern Data Streaming Architecture

TransUnion Technology

Modern Data Streaming Architecture

If you had to write software to identify all the red cars parked in a garage, it is a relatively simple (more traditional) software…

6 min readJun 27

--

See more recommendations

Help
Status
Writers
Blog
Careers
Privacy
Terms
About
Text to speech
Teams