%isHSrSSKrSSKrSSKJr SSKJr SSKJr SSKJ r SSK J r J r J r SSKJr SS KJr \"\5r"S S \5r"S S 5rg!\a Sr \=r r N8f=f)aHRNZ web scraper for extracting historical race data using Playwright. This scraper extracts race results from the HRNZ InfoHorse results archive. It respects rate limits and implements polite scraping practices. WARNING: Web scraping should only be used if official API access is not available. Always check HRNZ's Terms of Service and consider contacting them for official data access. N)datetime)Any)urljoin) BeautifulSoup)BrowserPageasync_playwright) get_logger)build_decodo_proxyc\rSrSrSrSrg)HRNZScraperErrorz'Base exception for HRNZ scraper errors.N)__name__ __module__ __qualname____firstlineno____doc____static_attributes__rB/root/tipsharks/tipsharks-elo-api/packages/hrnz_scraper/scraper.pyr r s1rr c\\rSrSrSrSrSrS S\4SjjrSr Sr S r S r S \ S \ 4S jrS \ S \\ \44SjrS\S \\ \44SjrS\ S \ S-4SjrS\S \\\ \44SjrS\S\S \\ \44Sjr\S\S \\ \44Sj5rS\S\\ \4S \\ \4S-4SjrS\ S \ S-4SjrSrg)! HRNZScraper$a@Scraper for HRNZ InfoHorse results archive using Playwright. This scraper extracts race meetings, races, and results from the publicly accessible HRNZ results archive at infohorse.hrnz.co.nz. Example: >>> async with HRNZScraper() as scraper: >>> meeting = await scraper.get_meeting_results('010741rs.htm') z-https://infohorse.hrnz.co.nz/datahrs/results/g@timeoutc:XlSUlSUlSUlg)zfInitialize HRNZ scraper. Args: timeout: Request timeout in milliseconds (default: 30000ms = 30s) Ng)r _playwright_browser_last_request_time)selfrs r__init__HRNZScraper.__init__4s  (, "%rcB# UR5IShvN U$N7f)zAsync context manager entry.N)_ensure_browserr s r __aenter__HRNZScraper.__aenter__?s!""$$$  %s c@# UR5IShvN gN7f)zAsync context manager exit.N)close)r exc_typeexc_valexc_tbs r __aexit__HRNZScraper.__aexit__Dsjjls c(# [c [S5eURck[5R5IShvN UlURR R SS9IShvN Ul[RS5 ggNPN"7f)z)Ensure Playwright browser is initialized.NzOplaywright is required for HRNZ scraping; install it or use the API ingest pathT)headlesszPlaywright browser initialized) r ImportErrorrstartrchromiumlaunchloggerinfor%s rr$HRNZScraper._ensure_browserHsz  #a  == %5%7%=%=%??D "&"2"2";";"B"BD"B"QQDM KK8 9 !?Qs!;BB/B-B.!BBc# URb)URR5IShvN SUlURb?URR5IShvN SUl[R S5 ggNXN$7f)zClose Playwright browser.NzPlaywright browser closed)rr)rstopr5r6r%s rr)HRNZScraper.closeSst == $--%%' ' ' DM    '""'') ) )#D  KK3 4 ( ( *s!+B B5B #B$#B B urlreturnc# UR5IShvN SSKnUR5UR- nX0R:a+[R "URU- 5IShvN [ RSU35 [5nU(a!URRUS9IShvN O!URR5IShvN nUR5IShvN nURXRSS9IShvN URS5IShvN UR5IShvN nUR5UlUUR!5IShvN UR!5IShvN $GNGN(NNNNNqN[N/N!UR!5IShvN UR!5IShvN f=f!["an[%SUS U35UeSnAff=f7f) zFetch page with rate limiting and wait for content. Args: url: URL to fetch Returns: Page HTML content Raises: HRNZScraperError: If request fails Nrz Fetching: )proxy networkidle)r wait_untilizFailed to fetch : )r$timerRATE_LIMIT_DELAYasynciosleepr5debugr r new_contextnew_pagegotorwait_for_timeoutcontentr) Exceptionr ) r r;rBelapsedr>contextpagerKes r_rate_limited_fetchHRNZScraper._rate_limited_fetch]s""$$$ ))+ 7 77 ** *-- 5 5 ?@ @ @ z#'( I&(Emm//e/<<<==4466  '//11D &ii\\miTTT++D111!% .*.))+'jjl""mmo%%C % A=61U2/ #%jjl""mmo%% I"%5cU"QC#@Aq H IsHFAH1F2H-G#<F=!G#FG#6F 7G#<F,F"F,2F$3F, F& F,%G#8F(9G#F*G#HHG#G# G#"F,$F,&F,(G#*G#,G GG GG  G## H-G??HHc # URS5(d[URU5nURU5IShvN n[ US5nUR U5nUR U5nXTS'XS'[RSURS5SURS 5S [U5S 35 U$N7f) a:Scrape results from a specific meeting page. Args: url: URL to meeting results page (e.g., '010741rs.htm' or full URL) Returns: Dictionary containing meeting and race data Example: >>> meeting = await scraper.get_meeting_results('102402rs.htm') >>> print(f"Found {len(meeting['races'])} races") httpNz html.parserraces source_urlzScraped meeting: venuez on datez - z races) startswithrBASE_URLrQr_parse_meeting_header _parse_racesr5r6getlen)r r;htmlsoup meeting_datarUs rget_meeting_resultsHRNZScraper.get_meeting_resultss~~f%%$---C--c22T=111$7 !!$' %W%(\"  0 0 9:;""6*+3s5zl& B #3sACCBCr`c0nURS5nU(a[URSS9nURSS5RSS5R5nXBS'[R SU35 URS S S 9nU(aGURSS9nXbS 'UR U5nU(aXrS '[R SU35 URS SS 9nU(akURS5n U (aSU RSS9n SU ;a"U RS5SR5n XS'[R SU 35 U$)zParse meeting header information from HRNZ page. HRNZ uses specific structure: - h1 tag for venue/club name - div.hrnz-content__date for date - h5 tag for meeting details Args: soup: BeautifulSoup object Returns: Meeting metadata h1Tstripz Incz Inc.rWz Found venue: divzhrnz-content__date)class_date_rawrXz Found date: zhrnz-field__meetingh5z at rnamezFound meeting name: )findget_textreplacergr5rF _parse_datesplit) r r`meetingrerWdate_div date_text parsed_date meeting_divrl meeting_names rr[!HRNZScraper._parse_meeting_headersMYYt_ KKdK+EMM&"-55grBHHJE$G  LL=0 199U+?9@  )))5I"+J **95K"- |K=9:ii.CiD !!$'B!{{{6 \)#/#5#5f#=a#@#F#F#HL". 3L>BCrdate_strNcrSSKnUR5RSS5n/SQnUHn[R"UR5U5nSU;a9SU;a3URR 5R nURUS9nUR S :aIUR S ::aURUR S -S9nOURUR S -S9nUR 5R5s $ [RS U35 g![a GM f=f)zParse date string into ISO format. Args: date_str: Date string in various formats Returns: ISO format date string (YYYY-MM-DD) or None rN  )z %A, %d %B %Yz %A, %d %Bz%d %B %Yz%d %Bz%d/%m/%Yz%d-%m-%Yz%d/%m/%yz%d-%m-%yz%Yz%y)yeard2iilzCould not parse date: ) rrgrpstrptimenowr~rX isoformat ValueErrorr5warning)r rzdtformatsfmtparsed current_years rrqHRNZScraper._parse_dates >>#++FC8  C !**8>>+;SAs?t3#%;;??#4#9#9L#^^^>F;;${{b(!'V[[45G!H!'V[[45G!H{{}..00#* /z:;   sCD'' D65D6c D/nURS5n[RS[U5S35 [ US5HupEUR XT5nU(apUR S5(aZ[US5S:aHURU5 [RSUS[UR S/55S 35 M[RS US 35 M U$![a&n[RS USU35 S nAMS nAff=f)zParse all races from meeting page. HRNZ results are in HTML tables. Each table represents one race. Tables have headers: PlacePl, BookBk, Horse, Barrier, Hcap, Stakes, etc. Args: soup: BeautifulSoup object Returns: List of race dictionaries tablezFound z tables on pagestartersrz Parsed race rAz starterszTable z had no starters, skippingzFailed to parse table N) find_allr5rFr^ enumerate_parse_race_tabler]appendrLr)r r`rUtablesidxrracerPs rr\HRNZScraper._parse_racessw' vc&k]/:;#FA.JC --e9DHHZ00Sj9I5JQ5NLL&LL&se2c$((:r2J.K-LIVLL6#.H!IJ/  !7uBqcBC sBC/C// D9DDr race_numbercVU/S.nURS5nU(avURSS9n[R"SU[R5nU(a:[ UR S55US'[ UR S55US 'URS 5nURU5nUHmn U RS S /5n [U 5S :aM'U RS 5(aM?URX5n U (dMYUSRU 5 Mo U$)zParse individual race table. Args: table: BeautifulSoup table element race_number: Race number (fallback if not in HTML) Returns: Race dictionary with starters )rrcaptionTrfzRace\s+(\d+).*?(\d+)mrr distance_mtrtdthr) rnroresearch IGNORECASEintgroupr_build_header_mapr^_parse_starter_rowr) r rrrr caption_textrace_info_matchrows header_maprowcellsstarters rrHRNZScraper._parse_race_table9s +;**Y' "++$+7L ii(, O&)/*?*?*B&C]#%()>)>q)A%B\"~~d#++D1 CLL$.E5zA~xx~~--e@GwZ ''0 rrcUHvnURS5nU(dM0n[U5H=upEURSS9nU(dMXCUR5R 5'M? U(dMtUs $ 0$)z0Build a header map from column names to indices.rTrf)rrrorglower)rrheadersrrheadertexts rrHRNZScraper._build_header_mapfsxCll4(GJ(1 T247:tzz|1134 2z!! rrrc:^^[T5S:ag0nS[S[S-4UU4SjjnU"S5=(d U"S5=(d TSnURS S 9nU(a`[R "S U5nU(a[ URS 55US 'O$UR5S;a S US'SUS 'OSUS 'U"S5=(d TSnURS5n U (aAU RS S 9US'U RSS5n URU 5n U (aXS'OURS S 9n U (aXS'U"S5=(d U"S5=(d TSn U RS S 9nU(a;[R "S U5nU(a[ URS 55US'U"S5=(d U"S5=(d TSnURS S 9nU(aUUR5S:XaSUS'O;[R "S U5nU(a[ URS 55US'[T5S :aTS RS S 9OSnU(a US:waUUS!'[T5S":aTS"RS S 9OSnU(a US:waUUS#'U"S$5nU(a~URS5nU(aKURS S 9nU(aUUS%'URSS5nURU5nU(aUUS&'OURS S 9nU(aUUS%'U"S'5nU(a~URS5nU(aKURS S 9nU(aUUS('URSS5nURU5nU(aUUS)'OURS S 9nU(aUUS('URS5(aU$g![a"n[RS*U35 SnAgSnAff=f)+aParse a single starter row from race table. HRNZ table structure (as of 2026): cells[0] = PlacePl (placing) cells[1] = BookBk (book number) cells[2] = Horse (with link containing UUID) cells[3] = Barrier cells[4] = Hcap (handicap) cells[5] = Stakes cells[6] = Fav (favorite odds) cells[7] = Time cells[8] = Margin cells[9] = Time/Margin Args: cells: List of table cells Returns: Starter dictionary or None Nlabelr<c>UR5nTHCnURS5nU(dMUR5R5U:XdMAUs $ TRU5nUbU[T5:aTU$g)Nz data-label)rr]rgr^)rtargetcell data_labelrrrs r_cell_by_label6HRNZScraper._parse_starter_row.._cell_by_labelsv!D!%,!7J!zj&6&6&8&>&>&@F&J# "!nnV,?sSZ'7 :%rPlacingPlacerTrfz(\d+)rplacing)DNSDNFDSQLRSCRNPdid_not_finishHorsera horse_namehrefrhhorse_idBarrierDrawbarrierHcapHCPrfr handicap_m race_timemarginDriver driver_name driver_idTrainer trainer_name trainer_idzError parsing starter row: )r^strrrormatchrrupperrnr] _extract_uuidrrLr5rF) r rrrr placing_cellpos_text pos_match horse_cell horse_link horse_href horse_uuidr barrier_cell barrier_text barrier_match hcap_cell hcap_text hcap_match time_text margin_text driver_cell driver_linkr driver_href driver_uuid trainer_cell trainer_linkr trainer_href trainer_uuidrPs `` rrHRNZScraper._parse_starter_rowvs.t <5zA~G c cDj  y)P^G-DPa $,,4,8HHHXx8 ),Y__Q-?)@GI&^^%)QQ04G,-)-GI&)-GI&(0J!03J4D4DQ4G0H -:=Uaa)))5RIY"_'0 $%(++$+7rK{b0$/!(2K)..s3 "-"6"6T"6"BK"1< ."-//&""=K"&"4"4["AK"/: ,"-"6"6T"6"BK"1< .))4L+005 #/#8#8t#8#DL#2>/#/#3#3FB#?L#'#5#5l#CL#0< -#/#8#8t#8#DL#2>/{{<(()  < LL6qc: ; ; r st  DD 4: H  y mm!Gds A A'&A'