Entering edit mode
6.2 years ago
ionox0
▴
390
I'm using toil 3.15.0 with a cwl workflow, and I was wondering if there was a way to have the toil stats
command list the names of the jobs in the workflow, when my jobs are defined in CWL.
Right now the output shows job names as one of "ResolveIndirect", "CWLGather" ,"CWLWorkflow", "CWLScatter", "CWLJob"
Worker
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
963 | 0.00 0.66 4.57 497.40 4402.72 | 0.00 0.48 3.84 299.96 3701.92 | -78.15 0.16 0.73 197.45 700.81 | 48K 151K 232K 7161K 223620K
Job
Worker Jobs | min med ave max
| 616 616 616 616
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
616 | 0.04 0.55 6.14 480.00 3780.53 | 0.01 0.26 5.41 298.77 3332.68 | -79.96 0.26 0.73 181.23 447.85 | 136K 190K 379K 7161K 233935K
ResolveIndirect
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
113 | 0.04 0.06 0.07 0.43 7.86 | 0.01 0.02 0.02 0.10 2.11 | 0.03 0.04 0.05 0.34 5.75 | 187K 195K 195K 203K 22048K
CWLGather
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
28 | 0.05 0.06 0.10 0.72 2.78 | 0.01 0.02 0.02 0.04 0.55 | 0.03 0.05 0.08 0.70 2.23 | 188K 197K 196K 202K 5499K
CWLWorkflow
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
113 | 0.10 0.42 0.46 2.31 52.18 | 0.04 0.14 0.16 1.04 18.07 | 0.05 0.28 0.30 1.27 34.12 | 190K 198K 197K 230K 22334K
CWLScatter
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
28 | 0.15 0.66 0.60 1.01 16.90 | 0.05 0.26 0.25 0.54 7.01 | 0.08 0.34 0.35 0.73 9.89 | 189K 197K 196K 201K 5490K
CWLJob
Count | Time* | Clock | Wait | Memory
n | min med* ave max total | min med ave max total | min med ave max total | min med ave max total
334 | 0.12 1.85 11.08 480.00 3700.81 | 0.03 0.89 9.90 298.77 3304.95 | -79.96 0.39 1.19 181.23 395.86 | 136K 141K 534K 7161K 178562K
I believe that this is a limitation specific to using CWL with toil
I have a PR here to address this:
https://github.com/DataBiosphere/toil/pull/2397