PDS Data Upload Manager

The Planetary Data System (PDS) Data Upload Manager (DUM) Service provides a means for PDS Node end-users to request upload of files (PDS collections, labels, etc.) to the PDS Nucleus Cloud Computing environment. Use of the DUM is typically the first step in ingesting large data volumes to the PDS cloud for indexing, validation and eventual dissemination.

Currently, the DUM service is deployed as a Python package, and consists of two major facets:

• A client-side application (pds-ingress-client) to be used with on-prem environments to select the files to be uploaded to Nucleus.

• A server-side framework of AWS services to handle tasks such as user-authentication, mapping of requested files to S3 bucket(s), and log management. This framework can be deployed automatically via Terraform scripts bundled with the DUM repo.

Sitemap

Contents:

• 📦 Installation
  • Requirements
  • Installation Instructions
    • Installation
    • Client Configuration
    • Running the Client script
  • Upgrading the Service
  • Configuring the Server side Bucket Map
  • Adding users to the AWS Cognito User Pool
• 👩‍💻 Development
  • Quick start
  • Testing
  • Making Releases
  • Contribute
• 🏃‍ ️Usage
  • pds-ingress-client Description
• Deployment Scripts
• Creating the deployment .tfvars file
• Deploying the Terraform
• Utilizing Terraform Outputs
• Destroying a Deployment
• ️Command Line API
  • pds-ingress-client
• Contact Us
• Contribute
• Report a Bug or New Feature Request
• Help