identifier: RX.X

version: v1.0

15 minutes

Hands-on

Yes

#### Intended Audience

Principal Investigators

Data Managers

Data Scientists

graph LR;

## Capability & Maturity Table

Capability Initial Maturity Level Final Maturity Level
Interoperability minimal repeatable

## Get Accounts Permissions:

• Apply for access
• Pay attention to the conditions
• Typically Aspera sites are locked down and need a username and password.
• For some sites, only one username is allowed per organisation, so it is worth making sure that that person is technically capable of uploading or downloading data, and also understands the data a little.

## Decide on Software needed and get it installed:

• You may need to have firewall exceptions raised to unblock ports 3301 and 22, with your organisation IT's network perimeter team.
• Try connecting first in case they are already not blocked

## Work out the appropriate command line options:

• Considerations:
• Use the -k {1,2,3} option to allow restarts without re-downloading all the data.
• Run it using something like screen, so that it can be running in the background on a server
• On the command line you can choose a preferred transfer rate. Please be careful to not hog the network bandwidth (we found up to about 100Mbps is okay).

• These are the download command options we used. (and both ports 3301 and 22 were unblocked) #set the password variable corresponding to your Aspera account. export ASPERA_SCP_FILEPASS="mypassword"

# example to download the files recursively from a specific directory on the Aspera server to

$/hpc/apps/current/aspera/v3.9.6.app/bin/ascp -k 1 -P 33001 -o FileCrypt=decrypt aspera.myacc@aspera-immport.niaid.nih.gov:dir_to_download ./  * Ascp Version we used: $ ascp --version
IBM Aspera Desktop Client version 3.9.6.176292
ascp version 3.9.6.176292
...

## Other suggestions:

• Have some automated monitoring on the download process to notify you if it stops/finishes. Even an hourly du -sh from a cron job
• Also typically you are pulling down many directories and files. On completion, it may be worth doing a recursive file listing to a file e.g. ls -ltR > file_listing.txt to give you and your "customers" a simple file catalogue.

• For uploading much of the above will apply. the main differences:
• know which area to upload to
• (Needed - no real example yet)

## TO DO:

• Aspera is commercial software
• Is this still okay as part of FAIR principles? As long as the instution with the server has paid for the licence
• Action : ask EBI e.g. Tony or Fuqi (in the presentation)
• Action Philippe: will ask Mark Wilkinson if Aspera is compliant? and how it would work with his evaluator?
• Look at the dockerised version of the client?