Page MenuHomePhabricator

Implement tests for ranking method "aggregate-then-rank"
Open, HighPublic

Event Timeline

eisenman triaged this task as Normal priority.Mar 17 2020, 5:18 PM
eisenman created this task.
eisenman renamed this task from Implement unit tests to Implement tests for ranking method "aggregate-then-rank".Mar 31 2020, 9:12 PM
eisenman raised the priority of this task from Normal to High.
eisenman moved this task from Backlog to In Progress on the challengeR board.Mar 31 2020, 9:15 PM
eisenman changed the edit policy from "All Users" to "challengeR (Project)".

The implemented tests cover:

  • For single-task challenges:
    • aggregate-than-rank by mean works with one algorithm for one case
    • aggregate-than-rank by mean works with two algorithms for one case (different orders in data frame, small values are better, large values are better)
    • different aggregation functions
    • different ties methods
    • invalid ties method
    • different NA treatment options
    • invalid NA treatment option
  • For multi-task challenges:
    • aggregate-than-rank by mean works with no missing data
    • different NA treatment options
    • invalid NA treatment option
eisenman moved this task from In Progress to Done on the challengeR (v1.0) board.Apr 16 2020, 11:19 AM