• Hi Guest Just in case you were not aware I wanted to highlight that you can now get a free 7 day trial of Horseracebase here.
    We have a lot of members who are existing users of Horseracebase so help is always available if needed, as well as dedicated section of the fourm here.
    Best Wishes
    AR

Scraping Utility for Those New to Scraping

Update

i have managed to scrape some very basic data in a very raw forn. I am adding tge convert to csv.

Anyone have anything they want scraping and i'll give it a go
 
here is what i scraped: its missing the headers :doh:

Python 2.7.3 (default, Apr 10 2012, 23:31:26) [MSC v.1500 32 bit (Intel)] on win32
Type "copyright", "credits" or "license()" for more information.
>>> ================================ RESTART ================================
>>>
07-03-2013 14:20 1m4f Sell Stks Xpres Maite 6.8
07-03-2013 14:20 1m4f Sell Stks Jack Dawkins 2.478096794246001
07-03-2013 14:20 1m4f Sell Stks General Tufto 102.64646475258137
07-03-2013 14:20 1m4f Sell Stks Goldmadchen 2.8996913
07-03-2013 14:20 1m4f Sell Stks Houdini Bright 13.281183384767003
07-03-2013 14:20 1m4f Sell Stks Isola Bella 70
07-03-2013 14:20 1m4f Sell Stks Theres No Rules 130
07-03-2013 14:50 6f Hcap Ring Of Fire 122.641396087
07-03-2013 14:50 6f Hcap Onceaponatime 10.840573395
07-03-2013 14:50 6f Hcap Bachelor Knight 64.43325208831348
07-03-2013 14:50 6f Hcap Ryedale Dancer 28.35119125612
07-03-2013 14:50 6f Hcap Sofias Number One 10.845303216134102
07-03-2013 14:50 6f Hcap Upper Lambourn 7.346341636475554
07-03-2013 14:50 6f Hcap Illustrious Lad 7.227236819845383
07-03-2013 14:50 6f Hcap Very First Blade 5.334908158441378
07-03-2013 14:50 6f Hcap Pull The Pin 4.769821368
07-03-2013 14:50 6f Hcap Captain Cavallo 29.56354707313585
07-03-2013 14:50 6f Hcap Ishi 16.505698329552544
07-03-2013 15:25 1m Hcap Icanboogie 23.98609261045232
07-03-2013 15:25 1m Hcap Birdy Boy 8.17720936
07-03-2013 15:25 1m Hcap Charlemagne Diva 19
07-03-2013 15:25 1m Hcap Naughtybychoice 5.778548505567233
07-03-2013 15:25 1m Hcap Conversing 5.856009580680402
07-03-2013 15:25 1m Hcap Rainford Glory 2.28
07-03-2013 15:55 1m Mdn Stks Running On Faith 230
07-03-2013 15:55 1m Mdn Stks Munaawib 370
07-03-2013 15:55 1m Mdn Stks Supastarqueen 493.7060512895486
07-03-2013 15:55 1m Mdn Stks Aura Bora 48.33010174555588
07-03-2013 15:55 1m Mdn Stks On With The Dance 4.717900308372773
07-03-2013 15:55 1m Mdn Stks Aryal 2.004276442
07-03-2013 15:55 1m Mdn Stks Santorini Sunset 46
07-03-2013 15:55 1m Mdn Stks Derby To Dubai 4.72800926419538
07-03-2013 15:55 1m Mdn Stks Solarmaite 60
07-03-2013 15:55 1m Mdn Stks Woodley Wonder 32.77991856137147
07-03-2013 16:30 7f Hcap Imprimis Tagula 21.692897844269176
07-03-2013 16:30 7f Hcap Masai Moon 13.218311330620391
07-03-2013 16:30 7f Hcap Rio Cobolo 16.17631735954427
07-03-2013 16:30 7f Hcap Alpha Tauri 15.584347590232642
07-03-2013 16:30 7f Hcap Caldercruix 7.4
07-03-2013 16:30 7f Hcap Only Ten Per Cent 6.0471815544465795
07-03-2013 16:30 7f Hcap Flying Pickets 19.76801346530788
07-03-2013 16:30 7f Hcap Tight Lipped 3.25
07-03-2013 16:30 7f Hcap Bitaphon 9.859910784687965
07-03-2013 17:00 5f Hcap Crown Choice 27.549194608746845
07-03-2013 17:00 5f Hcap Six Wives 17.507183121
07-03-2013 17:00 5f Hcap Dorback 4.423945349484047
07-03-2013 17:00 5f Hcap Rylee Mooch 9.81225955285452
07-03-2013 17:00 5f Hcap Gorgeous Goblin 7.271842790146987
07-03-2013 17:00 5f Hcap Royal Bajan 5.623133624
07-03-2013 17:00 5f Hcap Aubrietia 3.870475225
07-03-2013 17:30 1m3f Hcap Stanley Rigby 5.2
07-03-2013 17:30 1m3f Hcap Amana 14.499518578263835
07-03-2013 17:30 1m3f Hcap Toughness Danon 13.158036638110353
07-03-2013 17:30 1m3f Hcap Light The City 13.79594480056316
07-03-2013 17:30 1m3f Hcap Blue Maisey 49.077191266100854
07-03-2013 17:30 1m3f Hcap Blades Lad 25
07-03-2013 17:30 1m3f Hcap Dewala 1.933998990565339
07-03-2013 17:40 5f Mdn Stks Poyle Todream 230
07-03-2013 17:40 5f Mdn Stks Anrheg 70
07-03-2013 17:40 5f Mdn Stks Bapak Bangsawan 3.0794361631793077
07-03-2013 17:40 5f Mdn Stks Top Boy 1.71
07-03-2013 17:40 5f Mdn Stks Symphony Of Dreams 124.984891418
07-03-2013 17:40 5f Mdn Stks Nors The Panic 48.832448532
07-03-2013 17:40 5f Mdn Stks Chrisnickdave 30.388038555369718
07-03-2013 18:10 6f Sell Stks Whiskey Junction 24.686520912816032
07-03-2013 18:10 6f Sell Stks Dark Lane 6.827044322
07-03-2013 18:10 6f Sell Stks Athaakeel 10.465449908347363
07-03-2013 18:10 6f Sell Stks Frequency 5.2
07-03-2013 18:10 6f Sell Stks Proper Charlie 2.217508725
07-03-2013 18:10 6f Sell Stks The Dancing Lord 14.5
07-03-2013 18:40 7f Hcap Dingaan 17.5
07-03-2013 18:40 7f Hcap Royal Envoy 60
07-03-2013 18:40 7f Hcap Metropolitan Chief 22
07-03-2013 18:40 7f Hcap Jonnie Skull 9.920802648348268
07-03-2013 18:40 7f Hcap Media Jury 7.097649331
07-03-2013 18:40 7f Hcap Chester Deelyte 11.008987373682976
07-03-2013 18:40 7f Hcap Mousie 72.73865635883831
07-03-2013 18:40 7f Hcap Rise To Glory 7.056718082273436
07-03-2013 18:40 7f Hcap Zaroud 6.5375721685085955
07-03-2013 18:40 7f Hcap Under Par 3.8384869028895636
07-03-2013 19:10 1m Claim Stks Hillbilly Boy 2.483418779188206
07-03-2013 19:10 1m Claim Stks Shearian 5.4
07-03-2013 19:10 1m Claim Stks Misleading Promise 4.1224548004956905
07-03-2013 19:10 1m Claim Stks Minimee 6.548008327248389
07-03-2013 19:40 1m Hcap Cane Cat 35.24672141766175
07-03-2013 19:40 1m Hcap Sail Home 7
07-03-2013 19:40 1m Hcap Larghetto 44.111523778746346
07-03-2013 19:40 1m Hcap Travelling 3.8485755533352317
07-03-2013 19:40 1m Hcap Maggie Pink 14.5
07-03-2013 19:40 1m Hcap Big Sylv 3.171361671
07-03-2013 19:40 1m Hcap Spark Of Genius 5.666018384257988
07-03-2013 20:10 1m Hcap Pairumani Prince 12.5
07-03-2013 20:10 1m Hcap Black Dave 14.493830735
07-03-2013 20:10 1m Hcap Sennockian Star 3.892290944
07-03-2013 20:10 1m Hcap King George River 2.34
07-03-2013 20:10 1m Hcap Al Raqeeb 5.8
07-03-2013 20:40 1m1f Hcap Mr Chocolate Drop 21
07-03-2013 20:40 1m1f Hcap Scary Movie 4
07-03-2013 20:40 1m1f Hcap Gracchus 10.5
07-03-2013 20:40 1m1f Hcap Bubbly Braveheart 36
07-03-2013 20:40 1m1f Hcap Walter De La Mare 13.198083616583606
07-03-2013 20:40 1m1f Hcap King Of Windsor 69.00359562271944
07-03-2013 20:40 1m1f Hcap True Pleasure 26.2973635574989
07-03-2013 20:40 1m1f Hcap Apache Glory 8.928932600359296
07-03-2013 20:40 1m1f Hcap Tooley Woods 37.796620489
07-03-2013 20:40 1m1f Hcap Forster Street 26.80592416816158
07-03-2013 20:40 1m1f Hcap Arabela 18.75532233845676
07-03-2013 20:40 1m1f Hcap Thane Of Cawdor 4.8477242
07-03-2013 14:10 2m3f Hcap Hrd Pinerolo 6
07-03-2013 14:10 2m3f Hcap Hrd Knight Valliant 22.64568222619589
07-03-2013 14:10 2m3f Hcap Hrd River Music 40.934931031304025
07-03-2013 14:10 2m3f Hcap Hrd Funky Munky 30.313856855770574
07-03-2013 14:10 2m3f Hcap Hrd Fairynuff 13.00162699136563
07-03-2013 14:10 2m3f Hcap Hrd Dickie Henderhoop 11.71016236861324
07-03-2013 14:10 2m3f Hcap Hrd Launchpad 321.38933823532216
07-03-2013 14:10 2m3f Hcap Hrd Glasson Lad 9.010658592479304
07-03-2013 14:10 2m3f Hcap Hrd Mitchells Way 7.4
07-03-2013 14:10 2m3f Hcap Hrd Gonow 11.018063239373152
07-03-2013 14:10 2m3f Hcap Hrd Ronnie Rhino 26
07-03-2013 14:10 2m3f Hcap Hrd Seven Iron Sid 55
07-03-2013 14:10 2m3f Hcap Hrd Valleyofmilan 15.122208012462362
07-03-2013 14:10 2m3f Hcap Hrd Karinga Dandy 9.2282130366196
07-03-2013 14:40 2m5f Hcap Chs Wave Power 32.166815696455814
07-03-2013 14:40 2m5f Hcap Chs Hawaii Klass 39.0493719298255
07-03-2013 14:40 2m5f Hcap Chs Oil Burner 11.550675015695159
07-03-2013 14:40 2m5f Hcap Chs Ebony River 5.701305997422313
07-03-2013 14:40 2m5f Hcap Chs Wild Geese 12.14167944144941
07-03-2013 14:40 2m5f Hcap Chs Balding Banker 8.091916797438458
07-03-2013 14:40 2m5f Hcap Chs Kent Street 37.021277097
07-03-2013 14:40 2m5f Hcap Chs Highrate 13.290201532381577
07-03-2013 14:40 2m5f Hcap Chs Rudemeister 4.1
07-03-2013 14:40 2m5f Hcap Chs Tutchec 9.8
07-03-2013 14:40 2m5f Hcap Chs Alfred Oats 40
07-03-2013 15:15 2m3f Nov Hrd Ueueteotl 60
07-03-2013 15:15 2m3f Nov Hrd Two Oscars 620
07-03-2013 15:15 2m3f Nov Hrd Big Water 4.292426085707013
07-03-2013 15:15 2m3f Nov Hrd Scarlet Fire 15.014185200174794
07-03-2013 15:15 2m3f Nov Hrd Northern Oscar 337.876140576
07-03-2013 15:15 2m3f Nov Hrd Witness In Court 1.7116848956582746
07-03-2013 15:15 2m3f Nov Hrd Sorcier 58.4162013001522
07-03-2013 15:15 2m3f Nov Hrd Standintheband 49.105441622
07-03-2013 15:15 2m3f Nov Hrd Tiny Dancer 640.7840950292608
07-03-2013 15:15 2m3f Nov Hrd Old Devereux 200
07-03-2013 15:15 2m3f Nov Hrd Rocknrollrambo 16.430657316425936
07-03-2013 15:15 2m3f Nov Hrd Damascus Steel 233.84541056371486
07-03-2013 15:45 3m2f Hcap Chs Classic Cut 10.5
07-03-2013 15:45 3m2f Hcap Chs Camden George 26.162080691615117
07-03-2013 15:45 3m2f Hcap Chs Royal Mackintosh 21
07-03-2013 15:45 3m2f Hcap Chs Heez A Steel 8.4
07-03-2013 15:45 3m2f Hcap Chs Keeverfield 22.173817057765117
07-03-2013 15:45 3m2f Hcap Chs Etxalar 7.860541248107303
07-03-2013 15:45 3m2f Hcap Chs Overlady 15.971616662
07-03-2013 15:45 3m2f Hcap Chs Blazing Diva 10.3844207606389
07-03-2013 15:45 3m2f Hcap Chs Beau Dandy 6.127992155536775
07-03-2013 15:45 3m2f Hcap Chs Overquest 16.447878801871838
07-03-2013 15:45 3m2f Hcap Chs Bounds And Leaps 18.154714703
07-03-2013 15:45 3m2f Hcap Chs Bishophill Jack 13.315493993750863
07-03-2013 15:45 3m2f Hcap Chs Barnevelder 36.987995237
07-03-2013 16:20 2m1f Hcap Hrd My Idea 11.389959452836989
07-03-2013 16:20 2m1f Hcap Hrd Lucky Landing 9.6
07-03-2013 16:20 2m1f Hcap Hrd Sendiym 39.72765676664782
07-03-2013 16:20 2m1f Hcap Hrd Red Tyke 12.168481443
07-03-2013 16:20 2m1f Hcap Hrd Coverholder 3.7858808745027823
07-03-2013 16:20 2m1f Hcap Hrd Annas Arch 12
07-03-2013 16:20 2m1f Hcap Hrd Croco Bay 16.142178240861682
07-03-2013 16:20 2m1f Hcap Hrd Yorkist 21
07-03-2013 16:20 2m1f Hcap Hrd Teenage Dream 4.9
07-03-2013 16:20 2m1f Hcap Hrd Herons Mill 19.482702810508776
07-03-2013 16:50 2m Hcap Chs Tahiti Pearl 10.202710144
07-03-2013 16:50 2m Hcap Chs Diamond Frontier 8.4
07-03-2013 16:50 2m Hcap Chs Cabbyl Doo 27
07-03-2013 16:50 2m Hcap Chs Primrose Time 41.79523434550502
07-03-2013 16:50 2m Hcap Chs Sergeant Pink 19.034294315871072
07-03-2013 16:50 2m Hcap Chs Bogside 7.34115776133998
07-03-2013 16:50 2m Hcap Chs Saddle Pack 8.217797881376327
07-03-2013 16:50 2m Hcap Chs Gold Cygnet 63.93756627983879
07-03-2013 16:50 2m Hcap Chs Gleann Na Ndochais 5.4
07-03-2013 16:50 2m Hcap Chs Nowurhurlin 4.597876636
07-03-2013 17:20 2m1f NHF Bobs Lady Tara 4.246694906661823
07-03-2013 17:20 2m1f NHF Bardeli 6
07-03-2013 17:20 2m1f NHF Dancing Lamb 45.95263064241212
07-03-2013 17:20 2m1f NHF Tough Trade 28
07-03-2013 17:20 2m1f NHF Shipton 7.2
07-03-2013 17:20 2m1f NHF Jokers And Rogues 36.91740413828753
07-03-2013 17:20 2m1f NHF Cleve Cottage 6.6
07-03-2013 17:20 2m1f NHF Kukurudu 149.8120802855251
07-03-2013 17:20 2m1f NHF Be Wise 75
07-03-2013 17:20 2m1f NHF Jackson Joe 24.495288478232972
07-03-2013 17:20 2m1f NHF Simarthur 11.628483901837608
07-03-2013 17:20 2m1f NHF Devenish Island 11
07-03-2013 14:00 2m4f Hcap Hrd Iron Duke 60
07-03-2013 14:00 2m4f Hcap Hrd Solitary Palm 32.35684001528658
07-03-2013 14:00 2m4f Hcap Hrd Waarid 14.349643977556259
07-03-2013 14:00 2m4f Hcap Hrd Fashion Week 8.847208125203181
07-03-2013 14:00 2m4f Hcap Hrd Gleannacreim 9.335132580572392
07-03-2013 14:00 2m4f Hcap Hrd Ceepeegee 5.5
07-03-2013 14:00 2m4f Hcap Hrd Black Phantom 18
07-03-2013 14:00 2m4f Hcap Hrd Backhomeinderry 10.950688167878543
07-03-2013 14:00 2m4f Hcap Hrd Exiles Return 100
07-03-2013 14:00 2m4f Hcap Hrd Key To Milan 6.834759482
07-03-2013 14:00 2m4f Hcap Hrd The Wee Lass 28.696665642424527
07-03-2013 14:00 2m4f Hcap Hrd Royal Peak 8.4
07-03-2013 14:30 3m1f Nov Chs Danimix 9.565613066759528
07-03-2013 14:30 3m1f Nov Chs Palace Jester 4.2
07-03-2013 14:30 3m1f Nov Chs Ruben Cotter 1.541305504
07-03-2013 14:30 3m1f Nov Chs Midnight Whisper 55.21934264754978
07-03-2013 15:00 2m Hcap Hrd Chesil Beach Boy 15
07-03-2013 15:00 2m Hcap Hrd If In Doubt 2.939578762
07-03-2013 15:00 2m Hcap Hrd The Pier 8.672934790829746
07-03-2013 15:00 2m Hcap Hrd Tiger Otoole 20.968603606598556
07-03-2013 15:00 2m Hcap Hrd Dragons Den 14.802763500137994
07-03-2013 15:00 2m Hcap Hrd Mighty Monty 17.324127584
07-03-2013 15:00 2m Hcap Hrd Jumps Road 12.084083134276593
07-03-2013 15:00 2m Hcap Hrd Suerte Al Salto 4.626293969
07-03-2013 15:35 2m Mdn Hrd Chipless 1000
07-03-2013 15:35 2m Mdn Hrd Clouds Of Mist 170
07-03-2013 15:35 2m Mdn Hrd Barista 379.11608871944827
07-03-2013 15:35 2m Mdn Hrd Quails Hollow 13.420757631232485
07-03-2013 15:35 2m Mdn Hrd Lone Ranger 10.5
07-03-2013 15:35 2m Mdn Hrd Rayvin Black 26
07-03-2013 15:35 2m Mdn Hrd Swincombe Stone 24.732977202693
07-03-2013 15:35 2m Mdn Hrd Picklegend 186.06350229082832
07-03-2013 15:35 2m Mdn Hrd Brinestine 2.5066685925531873
07-03-2013 15:35 2m Mdn Hrd Fuhgeddaboudit 22
07-03-2013 15:35 2m Mdn Hrd Hugo Drax 65
07-03-2013 15:35 2m Mdn Hrd Chemistry Master 27.74698626435653
07-03-2013 15:35 2m Mdn Hrd Oscar Zulu 7.803736660244296
07-03-2013 15:35 2m Mdn Hrd Dont Be Late 8.005489057747718
07-03-2013 15:35 2m Mdn Hrd Special Friend 170
07-03-2013 16:05 2m Mdn Hrd Cloudy Start 408.123204709
07-03-2013 16:05 2m Mdn Hrd Karinga Dancer 2.36
07-03-2013 16:05 2m Mdn Hrd Bovs Castle 1000
07-03-2013 16:05 2m Mdn Hrd Just Spot 23.867785317
07-03-2013 16:05 2m Mdn Hrd Rule Of Thumb 75
07-03-2013 16:05 2m Mdn Hrd Lanarkshire 206.357638669
07-03-2013 16:05 2m Mdn Hrd Percy Lewis 788.1051616481692
07-03-2013 16:05 2m Mdn Hrd The Stout Italian 3.3
07-03-2013 16:05 2m Mdn Hrd Calusa Comet 60.21467368018143
07-03-2013 16:05 2m Mdn Hrd Even If 9.2
07-03-2013 16:05 2m Mdn Hrd Over The Rubicon 619.9254198855906
07-03-2013 16:05 2m Mdn Hrd Rode Runner 480
07-03-2013 16:05 2m Mdn Hrd Kentford Legend 14.702877304280555
07-03-2013 16:05 2m Mdn Hrd Corton Ridge 880
07-03-2013 16:05 2m Mdn Hrd Runaway Green 55
07-03-2013 16:05 2m Mdn Hrd Classical Twist 124.29806900611263
07-03-2013 16:40 2m Hcap Chs Sawpit Supreme 3.15
07-03-2013 16:40 2m Hcap Chs Next To Nowhere 7.683683009
07-03-2013 16:40 2m Hcap Chs Little Jimmy 1.7972035047558788
07-03-2013 17:10 2m5f Hcap Chs For The Staff 3
07-03-2013 17:10 2m5f Hcap Chs Arctic Watch 16.5
07-03-2013 17:10 2m5f Hcap Chs Whispering Jack 10.155914676143727
07-03-2013 17:10 2m5f Hcap Chs Sulpius 3.4624120032402823
07-03-2013 17:10 2m5f Hcap Chs Special Robon 5.6
07-03-2013 17:10 2m5f Hcap Chs Minella Ranger 26
07-03-2013 17:45 2m NHF Maire Rua 34.18824048453942
07-03-2013 17:45 2m NHF Fair Dreamer 21.125399188442387
07-03-2013 17:45 2m NHF Allons Zee 32
07-03-2013 17:45 2m NHF Quite By Chance 17.146195883734947
07-03-2013 17:45 2m NHF Mr Burbidge 18
07-03-2013 17:45 2m NHF Its April 49.07690222951583
07-03-2013 17:45 2m NHF Pure Oxygen 5.643551309465737
07-03-2013 17:45 2m NHF Dont Call Me Oscar 39.121436657479194
07-03-2013 17:45 2m NHF Generous June 44.911678419
07-03-2013 17:45 2m NHF Tamarton Tansy 82.896729918
07-03-2013 17:45 2m NHF Call Carlo 18.028542491
07-03-2013 17:45 2m NHF Toowoomba 11.5
07-03-2013 17:45 2m NHF Miner Distraction 34.921552156
07-03-2013 17:45 2m NHF Closing Ceremony 12.388893102283909
07-03-2013 17:45 2m NHF Flying Quest 75
07-03-2013 17:45 2m NHF Fourth Act 4.6
07-03-2013 17:45 2m NHF Mountain Of Mourne 55
>>>

i simply change the date and it gives me the above .... next step to save in CSV

After that i will look for all the links and hopefully do one massive dump into a csv file
 
TS
Can you give a brief explanation of what the above figures mean.
Are we looking at ratings derived from results and what are the significant figures we should be looking for?
 
TS
Are we talking past tense?
If so I would like to record the data from the flat turf season primarily the 2 year olds. This would then create the 3 year old database for next years classic generation. I believe it to be a relatively untapped area that could prove lucrative.
If anyone else requests your help please put them ahead of me as I have had a lot of help creating a scraper from Mr Damon which hopefully you may have seen.
:handgestures-thumbup:
 
Hi everyone,

This is definitely something I would like to learn a little more about but I am completely stumped as to were to start? I have downloaded the scraper by rpjd99 but when I start it I am just looking at a blank screen!! I have noticed I get a message saying that the macros are disabled and would I like to enable them so I clicked yes and then clicked on the 'view macros' option but I have no idea beyond that, any help would be greatfully received.

Smithy
 
Hi Smithy,

1. In the View Macros dialogue box, you should see two macros listed: Import_All_Elements and Import_Selected_Elements.
2. Highlight Import_All_Elements and click on the Edit button.
3. In the line that begins with myURL = , insert the address of the web page you want to have a look at. Make sure the address is between the quotes.
4. To run the macro, either press the F5 key or click on the little green arrow on the top left just under the menu bar.

Try that and let me know if you need any further help,

Ray
 
Hi Ray

Many thanks for your reply.

If I wanted to scrape the sporting life race card into excel is that possible using the utility?

If so do I select the race I want and copy the whole URL between the quotes and then run? The utility will then place all the info from the page into excel?

Sorry for the basic questions Ray.

Smithy
 
Hi Smithy,

The simple answer is yes... and no! If you want the utility to download the page and lay it out neatly in an Excel sheet as you see it in your browser, it won't do that for you directly.

Let me explain. The purpose of the first macro is to download the complete page (almost) as HTML code to an Excel sheet. You can see what this looks like in your browser by right-clicking on the page and selecting View Source. From what you scrape you can identify what lines of the HTML code you want in the InnerText/InnerHTML columns and refine those based on ID or Classname, so that all the lines you don't want will not be scraped when you run the second macro. When you've identified the lines you want, you code the conditions for accepting a line of HTML code in the second macro in order to download only the parts of the web page you want. After that you'll have to write Visual Basic code to lay it out and format the data as you want it. You can do it manually in Excel, but you'll get fed up quickly with doing that time after time.

The purpose of the utility was to help those who wanted to learn how to do it to write their own scraper. But you need to know how to code in Visual Basic to complete the macros to give you what you want.

There are other scrapers that are complete on this site, but I'm not sure if there's one for the Sporting Life. Try a search and see what you come up with. There's also a free add-on for Firefox called Firebug that will help you to scrape what data you want in a more user-friendly manner. My utility is for those who want to do their own coding.

Ray
 
here's an example of a quick SL scraper.

This should create a new file in your 'my documents' folder with the current day's racecards e.g. SLcards_15042013.xls.

Just click the button and count to five ;)


Added option to sort by meeting
 

Attachments

  • SLmacro.xls
    57 KB · Views: 77
:handgestures-thumbup: Thanks for this leftinthestalls

Is it possible for this to include owners which are seen on the SL site when you hover the mouse over the horses name?
 
Couple of changes have been made including Owner/Breeding info and splitting Days since last run.

Kev - this version any quicker?
 

Attachments

  • SLmacro_v1.01.xls
    68.5 KB · Views: 82
rpjd99 said:
For those not sure about scraping, the attached workbook uses two VBA macros to assist in starting.
Click to expand...

This is something I think I shall be looking into further. Can the macros within this file be used with earlier versions of Excel than Version 10 (I notice the filename extension is four characters)? I'm not sure there's been too much modification to VBA since Office 97 was released, but I have run across data handling problems caused by inconsistencies in later versions of Excel. Thanks.
 
Hi UK-21,

I've just tested it with Excel 2003 on an old PC and it opens okay after doing a file conversion, the later formats being just .zip files. Excel 97 has the same format as 2003, so it shouldn't pose any problems. If needs be, I can save it in .XLS format and upload it. Let me know.

Ray
 
You must log in or register to reply here.
Back
Top