Page MenuHomePhabricator

wiesenfa (Manuel Wiesenfarth)
User

Projects

User Details

User Since
Mar 2 2020, 3:23 PM (23 w, 4 d)

Recent Activity

Fri, Aug 7

wiesenfa reassigned T27252: Multiple cases per algorithm are not detected when missing data was added before from wiesenfa to eisenman.
Fri, Aug 7, 2:49 PM · challengeR (v1.0)
wiesenfa added a comment to T27252: Multiple cases per algorithm are not detected when missing data was added before.

should work now, tests successful.
However warning is

Performance of not all algorithms is observed for all cases in task 'dummyTask'

despite being single task challenge. see also separate task

Fri, Aug 7, 2:47 PM · challengeR (v1.0)
wiesenfa committed rCHALLENGER4a2a4d181421: always check both for missings and duplicates (authored by wiesenfa).
always check both for missings and duplicates
Fri, Aug 7, 2:41 PM
wiesenfa created T27658: LaTeX Warning: There were undefined references.
Fri, Aug 7, 2:31 PM · challengeR (v1.0)
wiesenfa moved T27252: Multiple cases per algorithm are not detected when missing data was added before from Backlog to In Progress on the challengeR (v1.0) board.
Fri, Aug 7, 2:10 PM · challengeR (v1.0)
wiesenfa created T27657: single task challenge treated as multi task in sanity checks gives unuseful warnings.
Fri, Aug 7, 2:10 PM · challengeR (v1.0)
wiesenfa moved T27453: Create complete network plot in its function from Backlog to In Progress on the challengeR (v1.0) board.
Fri, Aug 7, 1:05 PM · challengeR (v1.0)
wiesenfa moved T27494: Check which files are still relevant from Backlog to In Progress on the challengeR (v1.0) board.
Fri, Aug 7, 1:03 PM · challengeR (v1.0)
wiesenfa moved T27407: Warnings are shown in multi-task challenge report for violin plot from Backlog to Done on the challengeR (v1.0) board.
Fri, Aug 7, 12:59 PM · challengeR (v1.0)
wiesenfa committed rCHALLENGER48b7e35505c6: handle warnings in violin (authored by wiesenfa).
handle warnings in violin
Fri, Aug 7, 12:57 PM
wiesenfa added a comment to T27494: Check which files are still relevant.
  • compareRanks() allows to compare 2 ranking lists and compute Kendall's tau, would leave it in package
  • benchmarkUtils allows to link with benchmark package (CRAN archived) which has some more features, but is not maintained anymore. might be dropped
Fri, Aug 7, 12:36 PM · challengeR (v1.0)
wiesenfa committed rCHALLENGER4520859fe0f3: ensure that challenge object is data.frame (authored by wiesenfa).
ensure that challenge object is data.frame
Fri, Aug 7, 12:10 PM
wiesenfa moved T27656: make sure data set is data.frame from In Progress to Done on the challengeR (v1.0) board.
Fri, Aug 7, 12:00 PM · challengeR (v1.0)
wiesenfa moved T27656: make sure data set is data.frame from Backlog to In Progress on the challengeR (v1.0) board.
Fri, Aug 7, 12:00 PM · challengeR (v1.0)
wiesenfa created T27656: make sure data set is data.frame.
Fri, Aug 7, 11:48 AM · challengeR (v1.0)

Thu, Aug 6

wiesenfa added a comment to T27453: Create complete network plot in its function.

can be closed?

Thu, Aug 6, 12:29 PM · challengeR (v1.0)
wiesenfa added a comment to T27453: Create complete network plot in its function.

the complication arises to handle the automatic sizing of the plot, which is why in the first chunk it reads out the width without plotting and in the second chunk the figure width is adapted

Thu, Aug 6, 12:28 PM · challengeR (v1.0)
wiesenfa added a comment to T27453: Create complete network plot in its function.

the function is network() and is already in the report

Thu, Aug 6, 10:09 AM · challengeR (v1.0)

May 14 2020

wiesenfa added a comment to T27396: Represent single-task challenge as multi-task challenge with one task.

Something important I think is also, that all plot functions work outside of the report as intended (it is desirable that users can also create their own reports). This includes choosing the correct function and giving an error if a function does not work with single tasks, e.g.

May 14 2020, 2:25 PM · challengeR (v1.0)
wiesenfa added a comment to T27396: Represent single-task challenge as multi-task challenge with one task.

Thanks.
In a single task situation, in practice a task will not have a name, so there should be no title and there should not be the need to set a task name I think....
I'll have a look at it, but please give me some time

May 14 2020, 2:20 PM · challengeR (v1.0)
wiesenfa added a comment to T27396: Represent single-task challenge as multi-task challenge with one task.

I think this should be well thought through before putting into action

May 14 2020, 11:42 AM · challengeR (v1.0)
wiesenfa created T27420: report text.
May 14 2020, 10:58 AM · challengeR (v1.0)
wiesenfa added a comment to T27407: Warnings are shown in multi-task challenge report for violin plot.

it's not because of missing test cases. It is because in certain situation no Kendall can be computed. Don't use treat.na for this.

May 14 2020, 10:53 AM · challengeR (v1.0)

May 11 2020

wiesenfa added a comment to T27338: Report contains misleading information on missing values.

I agree, it would be nice if the actual number of NAs would be reported (together with the na.treat method) and not the number after na.treat which is then obviously 0.

May 11 2020, 2:05 PM · challengeR (v1.0)
wiesenfa added a comment to T27326: autolayout networks in multi task report ugly.

layouting (circle sizes, distances, font sizes, size of plot) needs to be automatically optimized which I failed so far

May 11 2020, 2:04 PM · challengeR (v1.0)
wiesenfa added a comment to T27385: Variables holding the aggregated value are named differently for single- and multi-task challenges.

Did you take care that FUN="mean" and FUN=mean is handled differently (in the former case it is a name, in the latter case it is a function)?

May 11 2020, 2:02 PM · challengeR (v1.0)
wiesenfa added a comment to T27396: Represent single-task challenge as multi-task challenge with one task.

might indeed reduce complexity, however,

  • many functions need to be adapted requiring some care
  • behavior is sometimes by purpose different, e.g. there are plot titles with the task name in multi-task challenges while there is none in single task challenges
  • many visualizations apply only to multi-task challenges and trying to use them in single task challenges throws an error, this would be needed to be handled
  • also reports for multi task challenges contain more visualizations which would be uninformative for single task challenges (could however be handled by checking the number of tasks internally)
  • a workaround would be necessary adding a task column to single class challenges (with the same label in every row)
May 11 2020, 1:59 PM · challengeR (v1.0)

Apr 29 2020

wiesenfa moved T27252: Multiple cases per algorithm are not detected when missing data was added before from In Progress to Backlog on the challengeR (v1.0) board.
Apr 29 2020, 4:03 PM · challengeR (v1.0)
wiesenfa added a comment to T27252: Multiple cases per algorithm are not detected when missing data was added before.

ok

Apr 29 2020, 4:03 PM · challengeR (v1.0)

Apr 27 2020

wiesenfa created T27360: compatibility with R4.0.0.
Apr 27 2020, 5:27 PM · challengeR (v1.0)
wiesenfa placed T27287: is warning given if na.treat unspecified in rank-first and obligatory otherwise up for grabs.
Apr 27 2020, 4:25 PM · challengeR (v1.0)
wiesenfa added a comment to T27287: is warning given if na.treat unspecified in rank-first and obligatory otherwise.

@eisenman : could you please check whether there is something to be done?

Apr 27 2020, 4:24 PM · challengeR (v1.0)
wiesenfa added a comment to T27323: Found bug for report with rankThenAggregate.

can this be closed?

Apr 27 2020, 4:23 PM · challengeR (v1.0)
wiesenfa added a comment to T27252: Multiple cases per algorithm are not detected when missing data was added before.

@eisenman: did you take over solving this task? Or should I still do something here?

Apr 27 2020, 4:21 PM · challengeR (v1.0)

Apr 20 2020

wiesenfa added a comment to T27323: Found bug for report with rankThenAggregate.

This is strange. This should normally not happen only if there is a strange package interfering . It is helpful to run sessionInfo() or slightly more detailed devtools::session_info() after a bug happened and report that in the task

Apr 20 2020, 8:55 AM · challengeR (v1.0)

Apr 17 2020

wiesenfa created T27327: warning in docx report.
Apr 17 2020, 2:19 PM · challengeR (v1.0)
wiesenfa created T27326: autolayout networks in multi task report ugly.
Apr 17 2020, 2:14 PM · challengeR (v1.0)
wiesenfa created T27325: Plot titles in rankingHeatmap missing in multi task report.
Apr 17 2020, 2:12 PM · challengeR (v1.0)

Apr 3 2020

wiesenfa created T27294: add multiple figure output formats in report with option clean=TRUE.
Apr 3 2020, 5:06 PM · challengeR (v1.0)
wiesenfa created T27291: update license file.
Apr 3 2020, 4:11 PM · challengeR (v1.0)

Apr 2 2020

wiesenfa claimed T27253: Notify user when multi-task data set is interpreted as single-task data set.
Apr 2 2020, 11:32 AM · challengeR (v1.0)
wiesenfa created T27288: separate readme.md and readme.Rmd.
Apr 2 2020, 11:32 AM · challengeR (v1.0)
wiesenfa created T27287: is warning given if na.treat unspecified in rank-first and obligatory otherwise.
Apr 2 2020, 11:31 AM · challengeR (v1.0)
wiesenfa updated subscribers of T27286: interactive plots.
Apr 2 2020, 11:29 AM · challengeR (v1.0)
wiesenfa created T27286: interactive plots.
Apr 2 2020, 11:29 AM · challengeR (v1.0)

Mar 27 2020

wiesenfa added a comment to T27241: Readme improvements.

There should be a team section where all of you are acknowledged

Mar 27 2020, 10:48 AM · challengeR (v1.0)
wiesenfa added a comment to T27256: Changes during sanity check can constradict NA handling option.

in my opinion this is a desirable feature

Mar 27 2020, 10:43 AM · challengeR