The Old WaysT
The Old Ways
1d ago

Add completion time as a metric

Right now, we use the following metrics to determine success and in this order: test  passed, execution time and LOCs. Now, we'll use completion time as a metric to reward developers who complete challenges faster. This helps balance use cases where agents are used.
CompletedCompleted

Completed
changed status toCompleted·yesterday
Progress
changed status toIn Progress·yesterday