# Dark Web Data Dumps

A collection of structured data obtained from scraping the dark web.

## Why

Researchers need more data about the dark web.

The best resource we have right now are the [Black Market Archives](https://www.gwern.net/Black-market%20archives), scrapping of various marketplaces scrapped
by Gwern et al in 2013.

Much has changed since 2013, and complete web dumps, while useful for some research tasks, frustrate and complicate others.

Further, governments & corporations are already building out such data in private & for profit.

## Citing & Info

### This Resource
Sarah Jamie Lewis. Dark Web Data Dumps, 2016, 10 Dec 2016. Web. [access date] https://polecat.mascherari.press/onionscan/dark-web-data-dumps

### Valhalla Marketplace Listings October 2016
Sarah Jamie Lewis. Dark Web Data Dumps - Valhalla Marketplace Listings, 2016, October 2016. Web. [access date] https://polecat.mascherari.press/onionscan/dark-web-data-dumps/blob/master/valhalla-marketplace-listings-2016-10.csv

* Unique Entries: 16511
* Format: `Marketplace ID, Title, Vendor, Price, Vendor Specified Ship From Counter`

### Hansa Marketplace Listings December 2016
Sarah Jamie Lewis. Dark Web Data Dumps - Hansa Marketplace Listings, 2016, December 2016. Web. [access date] https://polecat.mascherari.press/onionscan/dark-web-data-dumps/blob/master/hansa-marketplace-listings-december-2016.csv

* Unique Entries: 14,544 (note that there are 14773 lines in the file, some of the IDs are duplicated)
* Format: `Timestamp (when the listing was scrapped), Marketplace ID, Title, Vendor, Price, Marketplace Category, Ships from Country`

### Hansa Marketplace Reviews December 2016
Sarah Jamie Lewis. Dark Web Data Dumps - Hansa Marketplace Reviews, 2016, December 2016. Web. [access date] https://polecat.mascherari.press/onionscan/dark-web-data-dumps/blob/master/hansa_reviews_december_2016.csv

* Unique Entries: 43841 (note that there are 51553 lines in the file, some reviews appear to be duplicated)
* Format: `Timestamp (when the listing was scrapped), Marketplace ID, Rating, Review Text, Delivery Speed, Redacted User Name, Time of Review`* 

Notes: 

* Rating is scrapped directly from the site: success (good) / default (neutral) & danger (bad)

# Supporting

If you would like to support this, and other dark web research, please [become a patron](https://www.patreon.com/sarahjamielewis)