You’re the person who has to create data for your Test and Dev environments. Let’s scrape data from Reddit!
You’re lucky enough to have Test environments but you don’t want to spend forever creating test data to use (because you’re not using live data right?). Let’s use SQL Server with Python to scrape data from Reddit to fill those tables.
We’ll go through;
1. What you’ll need installed to use Python with SQL Server.
2. Basics of the Python language (You don’t need to know Python in advance)
3. The python libraries we’ll use
4. I’ll give you the code and walk through it
5. I’ll then show you how you can apply this in your environment.
You can then go away and create your test data so you don’t have to worry about GDPR or any other data privacy issues!
Why I Want to Present This Session:
I’ve recently had to do this for some internal systems, why not share with the community so every body can benefit.
Latest posts by Rich Benner (see all)
- Scrape Reddit for Testing Data using SQL Server and Python - December 19, 2018
- Introducing Azure Data Studio - August 31, 2018
- Making Your Emergency Toolkit - April 12, 2018