iGhSrSSKJr SSKrSSKrSSKJr SSKJrJ r SSK J r SSK r SSK Jr SSKJrJrJrJrJr SS KJr SS KJrJr SS KJr SS KJr SS KJr \"5 \"\ 5r!\"5r"SSjjr$\"SS55r%\"SS55r&\ RN"SSSSS9r(\ RN"SSSSS9r)\ RN"SS\ RT"/SQSS 9S!S"9r+\ RN"S#SSS$S%9r,\ RZ"5S&5r.\.R_5\(\)\+\,\ RN"S'S\ R`"SS(5SS)S*9\ RN"S+\ RT"S,S-/SS 9S,SS.S/9S?S0j5555555r1\.R_5\(\)\,\ RN"S1SSS2S%9\ RN"S3SSS4S%9S@S5j555555r2\.R_5\(\)\+\,\ RN"S+\ RT"S,S-/SS 9S,SS6S/9\ RN"S1SSS2S%9\ RN"S3SSS4S%9SAS7j55555555r3SBS8jr4SCS9jr5SDS:jr6\ S;:Xa\."5 gg)EzBatch backfill CLI for historical TAB data ingestion and recomputation. Backfills data in monthly chunks with progress logging and error handling. Supports ingest-only, recompute-only, and full (ingest + recompute) modes. ) annotationsN) monthrange) dataclassfield)date)Console) BarColumnProgress SpinnerColumn TextColumnTimeElapsedColumn)Table) get_logger setup_logging) get_settings) get_session)IngestionServicecURSS9n[URUR5SnURUS9nX4$)z;Return (first_day, last_day) of the month containing *ref*.day)replaceryearmonth)reffirstlast_daylasts ;/root/tipsharks/tipsharks-elo-api/scripts/batch_backfill.py _month_boundsr #sC KKAK E#((CII.q1H ;;8; $D ;r date_fromdate_toc/nURSS9nXA::aURS- U-nURUS--nUS-S-n[Xe5Sn[ XeU5nUn [ X5nX::aUR X45 URn URn U S:XaSn U S- n OU S- n [ XS5nXA::aMU$)z}Split [date_from, date_to] into monthly (or multi-month) chunks. Each chunk is a (start, end) tuple inclusive on both ends. rr )rrrrrminappend) r"r# chunk_monthschunkscursorchunk_end_monthchunk_end_yearr chunk_end chunk_start next_month next_years r_iter_month_chunksr1+s')F   1  %F   ,,*\9"'<<)B.2n>qA(C   +  ! MM;2 3__ NN  J NI !OJiQ/-  0 Mr!c\rSrSr%SrS\S'S\S'SrS\S'S rS \S 'S rS \S 'S r S \S 'S r S \S'Sr S\S'Sr g) ChunkResultOz,Result of processing a single monthly chunk.rr.r-Fboolsuccessrintmeetingsracesstarterserrorsstr error_messageN) __name__ __module__ __qualname____firstlineno____doc____annotations__r6r8r9r:r;r>__static_attributes__r?r!rr3r3OsJ6OGTHcE3NHcFCOM3r!r3c\rSrSr%SrS\S'S\S'S\S'S\S'S \S 'S rS \S 'S rS \S'S rS \S'S r S \S'S r S \S'S r S \S'S r S \S'S r S \S'\"\S9rS\S'SSjrSrg)BackfillSummary]z%Aggregated summary of a backfill run.r=commandrr"r#categoryr5dry_runrr7 total_chunkssuccessful_chunks failed_chunkstotal_meetings total_racestotal_starters total_errorssnapshots_created)default_factoryzlist[tuple[str, str, str]]failed_detailsc *[SS9nURSSS9 URSSSS 9 URS UR5 URS URS UR 35 URS UR 5 URS[UR55 URS[UR55 UR(a$URS[UR5SS9 URS[UR55 URS[UR55 URS[UR55 UR(a$URS[UR5SS9 UR(a%URS[UR55 [ R#S5 [ R#U5 UR$(a[ R#S5 UR&(aa[ R#S[)UR&5S35 UR&H%up#n[ R#SUS USUS35 M' URS:Xa'UR$(d[ R#S5 g"URS:a$[ R#S URS!35 g"g")#z Render summary table to console.zBackfill SummarytitleMetriccyanstyleValuegreenright)r]justifyCommandz Date range to Categoryz Total chunkszSuccessful chunksz Failed chunksredzTotal meetingsz Total raceszTotal startersErrorszRating snapshots u6 [yellow]⚠ DRY RUN — no data was modified[/yellow]u [yellow]⚠ z chunk(s) failed:[/yellow]z [yellow]z: z [/yellow]ru3 [green]✓ Backfill completed successfully[/green]u [yellow]⚠ Completed with z failed chunk(s)[/yellow]N)r add_columnadd_rowrJr"r#rKr=rMrNrOrPrQrRrSrTconsoleprintrLrVlen)selftablecsceerrs rrkBackfillSummary.printpsJ./ 0 A i. lt~~&6d4<<.$IJ j$--0 nc$*;*;&<= )3t/E/E+FG    MM/3t/A/A+B%M P &D,?,?(@A mS)9)9%:; &D,?,?(@A    MM(C(9(9$:%M H  ! ! MM,c$2H2H.I J d e << MMS T    MMN3t/B/B+C*DD^_ `#22  2$d2$bYGH 3    "4<< MMP Q   ! # MM9$:L:L9MMfg h$r!r?N)returnNone)r@rArBrCrDrErMrNrOrPrQrRrSrTrlistrVrkrFr?r!rrHrH]s/ LO MM ML#sM3NCKNCL#s16t1LN.L#ir!rHz--fromTzStart date (YYYY-MM-DD))requiredhelpz--tozEnd date (YYYY-MM-DD)z --category)THGF)case_sensitivez=Racing category: T (Thoroughbred), H (Harness), G (Greyhound))defaulttyperwz --dry-runz)Show what would be done without executing)is_flagr|rwcg)zBatch backfill historical TAB data in monthly chunks.  Commands: ingest - Ingest data in monthly chunks recompute - Recompute ratings for a date range full - Run ingest + recompute sequentially Nr?r?r!rclirs r!z--chunk-monthszNumber of months per chunk)r|r} show_defaultrwz--sourcetabingestz Data source)r}r|rrwc H[U5n[U5n[5nU(aUR5OURRn [ XgU5n [ SUS3UUU U[U 5S9n [RSU SUSUS[U 5S3 5 U(a1[RS 5 [U 5 U R5 g [[5[S 5[5[S 5[5[S 9n U R!S[U 5S9n U GHEup[#XX5nU =R$S- slUR&(aU =R(S- slU =R*UR,- slU =R.UR0- slU =R2UR4- slU =R6UR8- slOdU =R:S- slU =R6S- slU R<R?[AU5[AU5URB45 U REU SSUSU3S9 GMH S S S 5 U R5 g !,(df  N=f)zIngest TAB data in monthly chunks. Splits the date range into monthly (or multi-month) chunks and ingests each chunk sequentially. Continues on chunk failure and reports summary. zingest ()rJr"r#rKrLrMz [bold]Ingesting data from rcz in z chunk(s)[/bold]6[yellow]DRY RUN — no data will be modified[/yellow] N([progress.description]{task.description}-[progress.percentage]{task.percentage:>3.0f}%rj Ingesting...totalr Ingesting advance description)#_parse_date_argrupperrdefault_categoryr1rHrlrjrk _show_chunksr r r r r add_task_do_ingest_chunkrMr6rNrPr8rQr9rRr:rSr;rOrVr'r=r>update)r"r#rKrLr(source start_dateend_datesettingseffective_categoryr)summaryprogresstaskr.r-results rrrs=@!+Jw'H~H-5)8<<;X;X  l CF6(!$#[ G MM /0 ,d8*DV 5E G OPV  => BC     s6{ C&, "K%k>PYF  A % ~~))Q.)&&&//9&##v||3#&&&//9&$$ 5$%%*%$$)$&&--%s9~v7K7KL OOD!:k]RVW`Va9bO c#'- : MMO;  s E&J J!z--clearz'Clear existing ratings before recomputez--learn-adjustmentsz3Learn barrier/handicap adjustments during recomputec 4[U5n[U5n[SUUSUSS9n[RSUSUS35 U(a[RS5 U(a[RS 5 U(a&[RS 5 UR5 g S S KJn [ 5n U"U UUUUS9n S S S 5 SUlW Ul[RSU S35 UR5 g !,(df  NF=f![azn SUl URR[U5[U5[U 545 [RSU 3SS9 [RSU S35 S n A NS n A ff=f)zRecompute ratings for a date range. Runs a single recompute over the full date range (no chunking since recompute is incremental and deterministic). recomputezN/Arrz [bold]Recomputing ratings from rcz[/bold]z=[yellow]Will clear existing ratings before recompute[/yellow]z8[yellow]Will learn barrier/handicap adjustments[/yellow]u6 [yellow]DRY RUN — no data will be modified[/yellow]Nrrecompute_ratingsclear_existinglearn_adjustmentsu [green]✓ ! rating snapshots created[/green]Recompute failed: Texc_infou [red]✗ Recompute failed: [/red])rrHrjrkpackages.core.ratings.recomputerrrNrT ExceptionrOrVr'r=loggererror) r"r#rLclearrrrrrsession snapshotses rrr!sn8!+Jw'H G MM +JrrrrrTrrr)r"r#rKrLrrrrrrrr)rrrr.r-rrrrrs rfullrqsDL!+Jw'H~H-5)8<<;X;X  a 8Fx}5#[ G MM !"4!5[ ,d8*Bs6{m3D F  OPV M"'R0):%C6 K   MM?@ => BC     s6{ C&, "K%k9>PYF  A % ~~))Q.)&&&//9&##v||3#&&&//9&$$ 5$%%*%$$)$&&--%s9~v7K7KL OOD!:k]RVW`Va9bO c#'- < MM?@  A% QR C I'-#(&7  )2G % MMK {2ST U  MMOi  L C LL-aS1DL A MM7s&A B B Cs=E(MM8 M'(M8 M$' M51M88 N<0N77N<c[R"U5$![a2 [R SUS35 [ R "S5 gf=f)z&Parse a YYYY-MM-DD string into a date.z[red]Error: Invalid date 'z'. Use YYYY-MM-DD format.[/red]rN)r fromisoformat ValueErrorrjrksysexit)values rrrsI!!%((  25'9XYZ  s9AAc,[SS9nURSSS9 URSSS9 URSSS9 [US 5H6unup4UR[ U5[ U5[ U55 M8 [ R U5 g ) z+Display the chunks that would be processed.zPlanned Chunks (DRY RUN)rX#dimr\Startr[EndrN)rrh enumeraterir=rjrk)r)rnidxrorps rrrs 2 3E S& WF+ U&)"61- Xb c#hBR1. MM%r!c .[XS9n[5n[XSS9n[R"UR XUS95upxn SSS5 SUlWUlWUlW Ul WRSUl [RS[U5[U5UUU URSS.S 9 U$!,(df  Nz=f![a?n S Ul[U 5Ul[R#S US US U 3SS9 Sn A U$Sn A ff=f)z1Ingest a single monthly chunk and return results.)r.r-)r)rKNTr;zChunk ingested)r.r-r8r9r:r;)extraFzChunk rcz failed: r)r3rrasyncioruningest_date_ranger6r8r9r:statsr;rinfor=rr>r) r.r-rKrrrservicer8r9r:rs rrr s[ FF ]g&w>G(/ ))+8)T) %HX " " h/  ";/ ^$$!--1   & M?].  "1v [Mi[ ! =  M s/ C 1B:A2C : CC D4DD__main__)rrrsztuple[date, date])r)r"rr#rr(r7rslist[tuple[date, date]]) r"r=r#r=rK str | NonerLr5r(r7rr=) r"r=r#r=rLr5rr5rr5)r"r=r#r=rKrrLr5rr=rr5rr5)rr=rsr)r)rrsrt) r.rr-rrKr=rr=rsr3)7rD __future__rrrcalendarr dataclassesrrdatetimerclick rich.consoler rich.progressr r r r r rich.tablerpackages.core.common.loggingrrpackages.core.common.settingsrpackages.core.storage.databaserpackages.core.storage.ingestionrr@rrjr r1r3rHoption _opt_from_opt_toChoice _opt_category _opt_dry_rungrouprrJIntRangerrrrrrr?r!rrs # ( [[C66<  H  ) 9:!!"!25!!H      5i5i 5it LL   "   ,,        oe < H  ||   4         1  %  uh' >   CC CC C  C  C  &CR     2     >  :: ::  :  :     :@   uh' >  $    2     >  dd dd d  d  dd    0dT ))))  )  )X zEr!