Page MenuHomePhabricator

Implement tests for ranking method "aggregate-then-rank"
Closed, ResolvedPublic

Event Timeline

eisenman triaged this task as Normal priority.Mar 17 2020, 5:18 PM
eisenman created this task.
eisenman renamed this task from Implement unit tests to Implement tests for ranking method "aggregate-then-rank".Mar 31 2020, 9:12 PM
eisenman raised the priority of this task from Normal to High.
eisenman changed the edit policy from "All Users" to "challengeR (Project)".

The implemented tests cover:

  • For single-task challenges:
    • aggregate-than-rank by mean works with one algorithm for one case
    • aggregate-than-rank by mean works with two algorithms for one case (different orders in data frame, small values are better, large values are better)
    • different aggregation functions
    • different ties methods
    • invalid ties method
    • different NA treatment options
    • invalid NA treatment option
  • For multi-task challenges:
    • aggregate-than-rank by mean works with no missing data
    • different NA treatment options
    • invalid NA treatment option