valiant thor
Filly
Mate of mine wants to start using python for scraping various things from websites , so I said read a few examples and watch a few vids off youtube then give it a go with the RP naps table which is easily obtainable.
The reason I said the naps table was RP dont like you scraping it and have put in little things that would make it a bit difficult for a newbie to scrape and would keep denying access.
Fair play he gave it several goes before he asked for an idiots guide to see where he was going wrong.
To cut a long story short Ive had a bit of free time today so knocked a guide up for him and thought I'd put it on here as well as there doesnt seem to be any basic guides on how to with Python on here, If it helps 1 person to get into scraping with python then its job done .
The out [29] is the return from line 35 where the output is proofed(you would delete that line after proofing)
Lines 6 & 8 are the important lines as RP will deny access if you just try and get access through via the . get (url) route.
Heres a screenshot of the csv file output it gives in Excel.
The reason I said the naps table was RP dont like you scraping it and have put in little things that would make it a bit difficult for a newbie to scrape and would keep denying access.
Fair play he gave it several goes before he asked for an idiots guide to see where he was going wrong.
To cut a long story short Ive had a bit of free time today so knocked a guide up for him and thought I'd put it on here as well as there doesnt seem to be any basic guides on how to with Python on here, If it helps 1 person to get into scraping with python then its job done .
The out [29] is the return from line 35 where the output is proofed(you would delete that line after proofing)
Lines 6 & 8 are the important lines as RP will deny access if you just try and get access through via the . get (url) route.
Heres a screenshot of the csv file output it gives in Excel.
Last edited:
