Metadata
- Authors: Lee Richardson Alessandro Zito Dylan Greaves Jacopo Soriano
- Full Title:: Pareto Optimal Proxy Metrics
- Category:: 🗞️Articles
- URL:: https://arxiv.org/pdf/2307.01000.pdf?utm_source=substack&utm_medium=email
- Finished date:: 2024-04-19
Highlights
Existing literature on proxy metrics concentrates mainly on the estimation of the long-term impact from short-term experimental data. (View Highlight)
Existing literature on proxy metrics [9, 1] has focused more on predicting the long-term effect, (View Highlight)
there is a trade-off between sensitivity and directionality: the more we increase sensitivity, the less likely our metric will be related to the north star. (View Highlight)