Skip to content

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Latest commit

 

History

7 Commits

Folders and files

NameName
Last commit message
Last commit date
 
 
 
 

Repository files navigation

Data-Modeling

Datasets

For this project, I worked with one dataset: event_data. The directory of CSV files is partitioned by date. Here are examples of file paths to two files in the dataset:

event_data/2018-11-08-events.csv event_data/2018-11-09-events.csv

Project Steps

Below are steps to complete each component of this project.

Modeling NoSQL database or Apache Cassandra database Design tables to answer the queries outlined in the project template Write Apache Cassandra CREATE KEYSPACE and SET KEYSPACE statements Develop CREATE statement for each of the tables to address each question Load the data with INSERT statement for each of the tables Include IF NOT EXISTS clauses in your CREATE statements to create tables only if the tables do not already exist. We recommend you also include DROP TABLE statement for each table, this way you can run drop and create tables whenever you want to reset your database and test your ETL pipeline Test by running the proper select statements with the correct WHERE clause

Build ETL Pipeline

Implement the logic in section Part I of the notebook template to iterate through each event file in event_data to process and create a new CSV file in Python Make necessary edits to Part II of the notebook template to include Apache Cassandra CREATE and INSERT statements to load processed records into relevant tables in your data model Test by running SELECT statements after running the queries on your database

About

No description, website, or topics provided.

Resources

Stars

0 stars

Watchers

1 watching

Forks

Releases

Packages

Contributors