You’re the person who has to create data for your Test environments. Let’s scrape data from reddit!
You’re lucky enough to have Test environments but you don’t want to spend forever creating test data to use (because you’re not using live data right?). Let’s use SQL Server with Python to scrape data from Reddit to fill those tables. We’ll go through;
1. What you’ll need installed to use Python with SQL Server.
2. Basics of the Python language
3. The python libraries we’ll use
4. I’ll give you the code and walk through it
5. I’ll then show you how you can apply this in your environment.
You can then go away and create your test data so you don’t have to worry about GDPR or any other data privacy issues!
Why I Want to Present This Session:
I’ve recently had to do this for some internal systems, why not share with the community so every body can benefit.
Latest posts by Rich Benner (see all)
- Choose your own adventure – performance edition - August 12, 2019
- Scrape Reddit for Testing Data using SQL Server & Python - March 5, 2019
- Making Your Emergency Toolkit - April 12, 2018