How quickly can an SRA submission proceed directly from S3

1

Entering edit mode

11 months ago

Jeremy Leipzig 22k

How long would 10TB of RNA-Seq data take to submit to NCBI SRA if it's already in AWS S3?

SRA • 727 views

ADD COMMENT • link 11 months ago by Jeremy Leipzig 22k

0

Entering edit mode

Have you already got in touch with SRA help desk, if you are truly planning to upload that much data? They can probably suggest efficient/non-standard way.

ADD REPLY • link 11 months ago by GenoMax 148k

0

Entering edit mode

They should post here then. Isn't the point of biostars to disseminate this type of siloed knowledge?

ADD REPLY • link 11 months ago by Jeremy Leipzig 22k

0

Entering edit mode

Need to upload several TB of data is uncommon so while someone who has done this in the past may post you would save time by proactively contacting SRA help desk. While I see some NCBI folks answer questions on biostars I don't think I have ever seen anyone from SRA team here.

If you do get generally usable info please post that. My guess is solutions at this scale may be tailored for specific situations.

ADD REPLY • link 11 months ago by GenoMax 148k

0

Entering edit mode

My primary concern here is how to upload the metadata and processed files matched the actual fastq files. SRA can use Aspera so for the fastq files it's probably just go and wait. This terrible metadata spreadsheet from GEO is already a pita for a few dozen samples. Leave alone hundreds or thousands.