v1.44.0
Release adds AI usage summaries at the run level with token and cost tracking, displays recorded scores on timeline bars, and fixes a queue concurrency issue with capacity lease renewal.
Release Notes
-
#4736 feat(scores): show recorded scores on timeline bars
Scores recorded on a step now appear as a badge on that step's bar in the run
timeline, with a hover card listing each score and its value. -
#4758 feat(ai): add run-level AI usage summary
None (user-facing note on the UI PR).
-
#4759 feat(ui): show run AI usage summary
Run details now show a run-level AI usage summary (total tokens, cost, models used).
-
#4766 fix(queue): renew capacity leases before dispatch
Fixed an issue where steps using key queues could overlap despite a concurrency limit of one when a pre-acquired capacity lease expired before its first renewal.
Migration Notes
-
#4736 feat(scores): show recorded scores on timeline bars
Related
Changelog
🚀 Features
- (ai) Add run-level AI usage summary (#4758)
- (ui) Show run AI usage summary (#4759)
- (scores) Show recorded scores on timeline bars (#4736)
🐛 Bug Fixes
- (queue) Renew capacity leases before dispatch (#4766)
- (insights) Fix broken download with invalid dates (#4769)
- (connect) Track reply delivery outcomes (#4774)
🚜 Refactor
- (connect) Remove executor ACK RPC (#4751)
⚡ Performance
- (expressions) Avoid cloning event data per evaluation (#4762)
- (batching) Adding metrics for batching to capture redis memory usage and batch duration (#4763)
⚙️ Miscellaneous Tasks
Source: original entry ↗