Methods and open-source toolkit for analyzing and visualizing challenge results
Details
Details
Description
May 14 2020
May 14 2020
reinkea moved T27412: Description of variability of achieved rankings across tasks is missing in short report from v1.0 to Done on the challengeR board.
Apr 3 2020
Apr 3 2020
Apr 2 2020
Apr 2 2020
eisenman added a comment to T27253: Notify user when multi-task data set is interpreted as single-task data set.
At the meeting on 30/03/2020 we agreed that the messages should be extended to warn the user of that scenario. Since the column containing the tasks is unknown when the parameter "by" is not specified, an automatic detection can only be realized with a lot of effort.
eisenman closed T27254: Challenge attributes are arranged differently depending on sanity check as Wontfix.
In the meeting on 30/03/2020 we agreed that this issue won't be fixed. Cases can appear more than once per algorithm in bootstrapping and thus the sanity check has to be turned off. Performance reasons were also mentioned.
In the meeting on 30/03/2020 we agreed that this issue won't be fixed. Parameters have to be described properly to raise awareness of this scenario to the user.
Mar 31 2020
Mar 31 2020
eisenman moved T27237: Implement tests for ranking method "aggregate-then-rank" from Backlog to In Progress on the challengeR board.
eisenman triaged T27282: Implement tests for ranking method "test-then-rank" based on Wilcoxon signed rank test as High priority.
eisenman renamed T27237: Implement tests for ranking method "aggregate-then-rank" from Implement unit tests to Implement tests for ranking method "aggregate-then-rank".
eisenman added a comment to T27252: Multiple cases per algorithm are not detected when missing data was added before.
The given example is already available as a unit test.
eisenman moved T27244: Implement tests for the "challenge" class from In Progress to Done on the challengeR board.
Mar 30 2020
Mar 30 2020
aguilera added a comment to T27241: Readme improvements.
After discussing, the next steps have been decided:
eisenman moved T27252: Multiple cases per algorithm are not detected when missing data was added before from Backlog to In Progress on the challengeR board.
Mar 27 2020
Mar 27 2020
wiesenfa added a comment to T27241: Readme improvements.
There should be a team section where all of you are acknowledged
wiesenfa added a comment to T27256: Changes during sanity check can constradict NA handling option.
in my opinion this is a desirable feature
Mar 26 2020
Mar 26 2020
Mar 25 2020
Mar 25 2020
Mar 24 2020
Mar 24 2020
eisenman updated subscribers of T27252: Multiple cases per algorithm are not detected when missing data was added before.
eisenman updated the task description for T27252: Multiple cases per algorithm are not detected when missing data was added before.
eisenman triaged T27252: Multiple cases per algorithm are not detected when missing data was added before as High priority.
Mar 23 2020
Mar 23 2020
Mar 20 2020
Mar 20 2020
aguilera updated the task description for T27241: Readme improvements.
Mar 19 2020
Mar 19 2020
eisenman reopened T27236: Set up test infrastructure as "Open".
Make the task visible in the workboard column "Done".
eisenman moved T27244: Implement tests for the "challenge" class from Backlog to In Progress on the challengeR board.
Mar 18 2020
Mar 18 2020
aguilera updated subscribers of T27241: Readme improvements.
Mar 17 2020
Mar 17 2020
eisenman triaged T27237: Implement tests for ranking method "aggregate-then-rank" as Normal priority.
eisenman updated the task description for T27236: Set up test infrastructure.
eisenman moved T27236: Set up test infrastructure from Backlog to In Progress on the challengeR board.
eisenman edited Description on challengeR.
kislinsk created challengeR.