possible to show job names in toil stats command using cwl workflow
1
0
Entering edit mode
6.1 years ago
ionox0 ▴ 390

I'm using toil 3.15.0 with a cwl workflow, and I was wondering if there was a way to have the toil stats command list the names of the jobs in the workflow, when my jobs are defined in CWL.

Right now the output shows job names as one of "ResolveIndirect", "CWLGather" ,"CWLWorkflow", "CWLScatter", "CWLJob"

Worker
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      963 |     0.00    0.66    4.57  497.40 4402.72 |     0.00    0.48    3.84  299.96 3701.92 |   -78.15    0.16    0.73  197.45  700.81 |      48K    151K    232K   7161K 223620K
Job
 Worker Jobs  |     min    med    ave    max
              |     616    616    616    616
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      616 |     0.04    0.55    6.14  480.00 3780.53 |     0.01    0.26    5.41  298.77 3332.68 |   -79.96    0.26    0.73  181.23  447.85 |     136K    190K    379K   7161K 233935K
 ResolveIndirect
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      113 |     0.04    0.06    0.07    0.43    7.86 |     0.01    0.02    0.02    0.10    2.11 |     0.03    0.04    0.05    0.34    5.75 |     187K    195K    195K    203K  22048K
 CWLGather
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
       28 |     0.05    0.06    0.10    0.72    2.78 |     0.01    0.02    0.02    0.04    0.55 |     0.03    0.05    0.08    0.70    2.23 |     188K    197K    196K    202K   5499K
 CWLWorkflow
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      113 |     0.10    0.42    0.46    2.31   52.18 |     0.04    0.14    0.16    1.04   18.07 |     0.05    0.28    0.30    1.27   34.12 |     190K    198K    197K    230K  22334K
 CWLScatter
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
       28 |     0.15    0.66    0.60    1.01   16.90 |     0.05    0.26    0.25    0.54    7.01 |     0.08    0.34    0.35    0.73    9.89 |     189K    197K    196K    201K   5490K
 CWLJob
    Count |                                    Time* |                                    Clock |                                     Wait |                                   Memory
        n |      min    med*     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total |      min     med     ave     max   total
      334 |     0.12    1.85   11.08  480.00 3700.81 |     0.03    0.89    9.90  298.77 3304.95 |   -79.96    0.39    1.19  181.23  395.86 |     136K    141K    534K   7161K 178562K
toil cwl • 1.2k views
ADD COMMENT
1
Entering edit mode

I believe that this is a limitation specific to using CWL with toil

I have a PR here to address this:

https://github.com/DataBiosphere/toil/pull/2397

ADD REPLY
2
Entering edit mode
6.1 years ago

Thank you ionox0, your PR to Toil to fix this has been merged: https://github.com/DataBiosphere/toil/pull/2397

ADD COMMENT

Login before adding your answer.

Traffic: 1768 users visited in the last hour
Help About
FAQ
Access RSS
API
Stats

Use of this site constitutes acceptance of our User Agreement and Privacy Policy.

Powered by the version 2.3.6