spark streaming hld

In this walk-through we'll cover creating a high level design document for a new application that will convert event records from Amazon's Simple Email Service, to a database.

Motivation

Our goal is to use the data generated by SES data to answer the following questions:

As a data analyst:

• I can summarize success-rates by criteria such as region, type of email, etc.

• I can trace each recipient's experience across the entire journey from our initial send to each recipient's actions