1d ago
Add completion time as a metric
Right now, we use the following metrics to determine success and in this order: test passed, execution time and LOCs. Now, we'll use completion time as a metric to reward developers who complete challenges faster. This helps balance use cases where agents are used.
Completed