Skip to content

Download files

Downloading Files Manually

  1. create a new folder (referred to as the data folder) and download all .gz files from a specific DARPA dataset (follow the link provided for DARPA E3 here and DARPA E5 here). If using CLI, use gdown, by taking the ID of the document directly from the URL. In some cases, the downloading of a file may stop, in this case, simply ctrl+C and re-run the same gdown command with --continue until the file is fully downloaded. NOTE: Old files should be deleted before downloading a new dataset.

  2. in the data folder, download the java binary (ta3-java-consumer.tar.gz) to build the avro files for DARPA E3 and E5.

  3. in the data folder, download the schema files (i.e. files with filename extension '.avdl' and '.avsc') for DARPA E3 and E5.