Commits

Branch selector

 master

User selector

All users

All time

Commit History

Commits on Jun 23, 2020

• cleaning up

  uhussain

  committed
  f917449

  Copy full SHA for f917449

Commits on Jun 22, 2020

• prototype is not main project

  uhussain

  committed
  bd1974d

  Copy full SHA for bd1974d

• remove duplicates

  uhussain

  committed
  d272160

  Copy full SHA for d272160

• Update readme

  uhussain

  committed
  f5ae613

  Copy full SHA for f5ae613

• organzing and cleaning

  uhussain

  committed
  41cd4f0

  Copy full SHA for 41cd4f0

• cleaning the readme

  uhussain

  committed
  41fc5f3

  Copy full SHA for 41fc5f3

• Cleaning script using pandas df

  uhussain

  committed
  5e994c0

  Copy full SHA for 5e994c0

• Prototype is not main project

  uhussain

  committed
  97b4cb8

  Copy full SHA for 97b4cb8

• Add the amazon textual analysis and cleanup

  uhussain

  committed
  eff4bf1

  Copy full SHA for eff4bf1

Commits on Jun 19, 2020

• Improving readme again

  uhussain

  committed
  34a0ff3

  Copy full SHA for 34a0ff3

• pipeline image

  uhussain

  committed
  d51faa7

  Copy full SHA for d51faa7

• Improving the Readme and updating cleaning code

  uhussain

  committed
  3fc138d

  Copy full SHA for 3fc138d

• getting ready to commit to master

  uhussain

  committed
  ac70027

  Copy full SHA for ac70027

• Setting up front-end with Dash

  uhussain

  committed
  4fd81d6

  Copy full SHA for 4fd81d6

Commits on Jun 17, 2020

• cleaning

  uhussain

  committed
  a158700

  Copy full SHA for a158700

• spark optimizations

  uhussain

  committed
  f0ef52b

  Copy full SHA for f0ef52b

Commits on Jun 14, 2020

• Get Product prices however possible - expected big output to s3

  uhussain

  committed
  107f047

  Copy full SHA for 107f047

Commits on Jun 11, 2020

• Need to get a list of files and give to spark

  uhussain

  committed
  4f9fb98

  Copy full SHA for 4f9fb98

Commits on Jun 10, 2020

• spark running, trying to filter on laptop products from walmart

  uhussain

  committed
  8cc9439

  Copy full SHA for 8cc9439

Commits on Jun 9, 2020

• basic spark on common crawl

  uhussain

  committed
  fb55a40

  Copy full SHA for fb55a40

• Restructuring repo and moving forward

  uhussain

  committed
  c45d60e

  Copy full SHA for c45d60e

• saveProducts in a table

  uhussain

  committed
  bca0fd0

  Copy full SHA for bca0fd0

Commits on Jun 8, 2020

• modular code to find products and save table in amazon dynamodb

  uhussain

  committed
  43ec701

  Copy full SHA for 43ec701

Commits on Jun 7, 2020

• Latest before trying spark

  uhussain

  committed
  03aa07e

  Copy full SHA for 03aa07e

Commits on Jun 5, 2020

• getting price of books is hard so we get ratings for all products where possible

  uhussain

  committed
  de40c8e

  Copy full SHA for de40c8e

Commits on Jun 4, 2020

• Basic product title,price working on amazon

  uhussain

  committed
  c301ca9

  Copy full SHA for c301ca9

• figure out how to run with spark

  uhussain

  committed
  f4123bf

  Copy full SHA for f4123bf

• finally a basic common crawler is working

  uhussain

  committed
  3c7e9b0

  Copy full SHA for 3c7e9b0

Commits on Jun 3, 2020

• still some issues getting the domain info

  uhussain

  committed
  3243d77

  Copy full SHA for 3243d77

• basic script to get links from common crawl

  uhussain

  committed
  5d606e1

  Copy full SHA for 5d606e1

• make it current

  uhussain

  committed
  4b2b31b

  Copy full SHA for 4b2b31b

Commits on Jun 2, 2020

• launching project repo with README and structure

  uhussain

  committed
  67f47b9

  Copy full SHA for 67f47b9