Build 11.1 Plan
The Planetary Data System (PDS) is a long-term archive of digital data products returned from NASA’s planetary missions, and from other kinds of flight and ground-based data acquisitions, including laboratory experiments. But it is more than just a facility - the archive is actively managed by planetary scientists to help ensure its usefulness and usability by the world wide planetary science community.
The following page outlines the planned PDS software enhancements, bug fixes, and impacted requirements for the upcoming Build .
A more detailed breakdown of these tasks by date and priority can be found in our Zenhub Roadmap (login required).
Key Dates
Date |
Name |
Description |
|---|---|---|
03/19/2021 |
Delivery to I&T |
The PDS4 IM and all software updated during this build cycle are delivered to EN I&T. |
04/05/2021 |
Test Readiness Review (TRR) |
PDS EN internal review to verify readiness to enter I&T phase. |
05/27/2021 |
Delivery and Deployment Review (DRR) |
PDS internal review with PDS Software Working Group to verify readiness to deploy build system. |
06/11/2021 |
Operational Deployment |
PDS4 system is operationally deployed and website is updated accordingly. |
For a more detailed schedule, see https://pds-engineering.jpl.nasa.gov/content/schedules.
Planned PDS4 Information Model Changes
This section details the planned changes to the PDS4 Information Model for this build. These changes are deliverables by the PDS Data Design Working Group (DDWG) to the Engineering Node for implementation.
pds4-information-model#258 CCB-301: The attribute <name> in the <DD_Attribute> and <DD_Class> classes is not properly constrained
pds4-information-model#256 CCB-312: <ldd_version_id> does not appear to be constrained the way LDDTool expects
pds4-information-model#254 CCB-305: Missing validation constraint on <specified_unit_id>
pds4-information-model#253 CCB-313: Definition of <external_source_product_identifier> refers to non-existent documentation
pds4-information-model#249 CCB-288: Change Internal_Reference reference type to ‘guided’ text
pds4-information-model#257 CCB-302: No <reference_type> values defined in DD_Attribute or DD_Class contexts
pds4-information-model#255 CCB-300: Apparently deprecated units of measure are not actually deprecated
pds4-information-model#251 CCB-303: The definition for <skos_relation_name> is not sufficient.
pds4-information-model#250 CCB-315: “PDS3” is an allowed parsing standard for Bundle documentation file
Planned Software Changes
This section details the planned software changes for this build.
Planned tasks for the next release cycle are grouped by software component, and sub-tasks are included where known at the time of this plan generation. Each section also includes additional information, such as:
Software description
Link to 🔍 User Guide
Link to 💻 Github Repo
Link to 🚑 Issue Tracking
Link to 📒 Backlog - future work not planned for this release cycle
Don’t see the tool you are looking for? This means there is no active development planned for this build cycle. Head to the PDS Tool Registry to see all possible tools available for PDS data.
Have a new feature or tool you think we should be working on? Create a ticket in the applicable Github repo or in our PDS EN Operations repo and we will see how that can fit into our plans moving forward.
validate
Validates PDS4 product labels, data and PDS3 Volumes
- validate#250 Improvements to meet updated Standards Reference since initial requirements implementation
validate#5 Improve file base name check according to Standards Reference
validate#6 Improve pds4.bundle unlabeled files check to handle files without a file suffix
validate#11 Update allowable field_format values per Standards Reference definition regarding [+|-] characters
validate#81 Validate and throw error when duplicate LIDs are found in Bundle
validate#153 Update validate to throw error when a file has a space in the filename
validate#230 Update validate per SR requirements for collection inventories
validate#240 Unexpected error for data collection in a sub-directory
validate#242 Update LID validation to meet latest PDS4 SR Requirements
- validate#249 Improvements for validating accumulating bundles / collections
validate#51 Provide the capability to specify multiple locations for pds4.bundle validation
validate#231 For accumulating bundles, validate latest version of collections only
validate#238 validate does not perform full bundle validation when using a specific bundle.xml
validate#246 Add output directory flag to validate-bundle tool
validate#256 validate should only do integrity checking on latest version of a collection when referenced by LID
pds4-jparser
Java Library providing APIs for parsing and exporting information on PDS4 products, including table and image objects to various formats including CSV, PNG, VICAR, FITs, etc.
- pds4-jparser#21 Update table reads for large files and improve memory footprints
validate#189 Validate error reading tables > 2GiB
pds4-information-model
The software tools and data necessary for generating the Information Model including PDS4 ontology, data, and information model.
- pds4-information-model#242 DocBook HTML/WebHelp generation and conversion processes
pds4-information-model#170 LDDTool: DocBook generation does not work from any file system location
pds4-information-model#243 Document how to generate the DocBook XML and how to generate HTML/WebHelp
- pds4-information-model#241 Improvements from Build 11.0 testing
pds4-information-model#104 LDDTool: Enable to ability to set custom namespace base URI in IngestLDD
pds4-information-model#175 LDDTool: Displaying invalid Imaging Discipline Classes
pds4-information-model#186 PDS4_PDS_1E00.sch inconsistent rules for type of Investigation vs Investigation_Area
pds4-information-model#235 Incorrect error messages for DD_Associate_External_Class
- pds4-information-model#238 Continuing refactoring of IMTool / LDDTool
pds4-information-model#239 Refactor Class information from config to Data Dictionary Protege ontology
pds4-information-model#240 Improve argument handling using argument parsing library
pds-deep-archive
PDS Open Archival Information System (OAIS) utilities, including Submission Information Package (SIP) and Archive Information Package (AIP) generators
pds-deep-archive#80 NSSDCA Delivery Onboarding
pds-doi-service
Service and tools for generating DOIs for PDS bundles, collections, and data sets
- pds-doi-service#68 Develop Web UI for DOI service
pds-doi-service#67 Mock web UI for DOI management
pds-doi-service#108 Reserve DOI UI forms
pds-doi-service#109 Release existing DOI (previously reserved, drafted or released) UI forms
pds-doi-service#110 Release new DOI forms
- pds-doi-service#52 API Implementation for DOI Service
pds-doi-service#38 Add Status / Query component to API
pds-doi-service#77 Add POST PDS4 or OSTI DOI label to API
pds-doi-service#78 Add POST Reserve xslx/csv DOI function to API
pds-doi-service#79 Add Release DOI function to API
pds-doi-service#80 Develop API specification in SwaggerHub
pds-doi-service#100 Add GET DOI to the API
pds-doi-service#101 Add PUT DOI to the API (for updates)
pds-doi-service#105 Complete get DOIS criterias with the arguments proposed in command line
pds-doi-service#106 Add exception name in the error messages
pds-doi-service#107 allow to post PDS4 labels in the payload (for draft)
pds-doi-service#91 Develop User Access / Management Strategy
- pds-doi-service#86 Deploy DOI API and UI
pds-doi-service#87 Dev beta testing with API
pds-doi-service#88 Operations team test interface with DOI Service
pds-doi-service#89 Update procedures to use DOI web interface submission
pds-doi-service#90 Deploy point build of DOI service and UI
pds-doi-service#23 Document how to Deactivate a DOI (with curl command)
pds-registry-app
Registry application enabling a PDS node to register all its data products for long term preservation and sharing with the rest of the PDS system.
- pds-registry-app#13 Beta test operational deployment
pds-registry-app#82 Develop test plan
pds-registry-app#83 Deploy and install multi-node ES
pds-registry-app#84 Download large data set for testing
pds-registry-app#85 Document performance benchmarks in registry app docs
pds-registry-app#42 Integrate Registry API into pds-registry-app
- pds-registry-app#27 Manage PDS4 product relationships
pds-registry-app#76 Manage relationships between bundles / collections / products
pds-registry-app#77 Manage relationships described by reference types
pds-registry-app#97 Research RDF technologies to handle pds4 label cross-references in the registry
pds-registry-app#92 Update Registry API per PDS API v0-beta
- pds-registry-app#91 Deploy Registries in AWS
pds-registry-app#86 Deploy EN Registry in AWS
pds-registry-app#87 Deploy GEO Registry in AWS
pds-registry-app#88 Deploy IMG Registry in AWS
pds-registry-app#89 Document AWS deployment for Registry
pds-registry-app#90 Develop cost model and reporting for Registry deployments
pds-registry-app#81 Registry Integration component
pds-registry-app#12 Ingest PDS supplemental metadata
- pds-registry-app#53 Improve Attribute Search Component
pds-registry-app#45 Validate Elastic Search index configuration for attribute search
pds-registry-app#61 Update the index schema in ES dynamically when new record are ingested
pds-registry-app#64 Fix the Json data dictionary format
pds-registry-mgr-elastic#5 Create a field-data type lookup table
pds-registry-mgr-elastic#6 Update the field-data type lookup table
pds-registry-app#93 Research tech stack modifications due to large number of search fields in registry
PDS.nasa.gov-Search
Front-end interface for PDS.nasa.gov data search capability
- PDS.nasa.gov-Search#20 Search Details Page / DOI Landing Page
PDS.nasa.gov-Search#26 Review search details / DOI page updates
- PDS.nasa.gov-Search#21 DOI Landing Page Requirements and Design
PDS.nasa.gov-Search#22 Develop DOI Landing Page Scope
PDS.nasa.gov-Search#23 Revise requirements to meet scope
PDS.nasa.gov-Search#24 Review scope and requirements with DOI WG
PDS.nasa.gov-Search#25 Develop more formalized design documentation
pds-api
PDS API Application with client and server integrated into one package
pds-api#31 Streamline testing of API server implementation
- pds-api#17 Response format conventions and parameter definition
pds-api#18 Refine format conventions defined by the API WG
pds-api#19 Define default response fields
pds-api#20 Define required response fields
pds-api#21 Define response formatting for default vs “additional” metadata fields
pds-api#22 Update API Spec with refined response format conventions and field definitions
pds-api#23 Implement response format definition in API Service
pds-api#35 Initial Federated API implementation
- pds-api#34 Deploy PDS API v0 (beta) for beta testing
pds-api#32 Deploy PDS API v0 (beta) on pds-gamma test server
pds-api#33 Update public PDS API Spec in Github
- pds-api#30 SwaggerHub CodeGen Server adaptation and integration how-tos
pds-api-pythonlib#1 Test and write a procedure to develop a python implementation from swaggerHub
pds-api#26 Document basic adaptation capabilities from pds-api-service
- pds-api#28 DN Pilot API Project(s)
pds-api#16 Implement EN query of DN API service
pds-api#26 Document basic adaptation capabilities from pds-api-service
pds-api#27 Identify nodes and define scope for piloting pds-api-service adaptation
pds-api#29 Implement EN query passing to DN search UI
pds-api#24 Define PDS handling of enriched / supplemental metadata
pds-api#25 PDS API extension convention for discipline-specific search engines
pds-api#15 Query passing and search integration design
pds-api#14 Define intra-discipline (product-level) search scope
pds-api#12 Initial Query Syntax Lexer Implementation
pds-api#7 Initial discipline/node-specific search parameter definition
pdsen-corral
*umbrella project to manage the build cycle (continuous integration and stable release) for the PDS EN tools. *
- pdsen-corral#16 Github Action and Documentation Generation Best Practices
nasa-pds.github.io#3 Update nasa-pds.github.io with software documentation best practices
nasa-pds.github.io#4 Update nasa-pds.github.io with github action best practices
pds-template-repo-python#2 Define a PDS standard to manage version in python project
pds-deep-archive#81 Update Github Actions for dev and ops releases
pds-doi-service#94 Update to use pds round-up github action
roundup-action#1 Add Java / Maven support
pdsen-corral#24 Re-evaluate generating requirements for -dev versions
pds-template-repo-python#3 Add the roundup action in the template
validate#255 Retrofit validate CI to use roundup-action
pds4-jparser#30 Retrofit pds4-jparser CI to use roundup-action
pds-registry-app#94 Retrofit pds-registry-app CI to use roundup-action
pdsen-corral#23 AWS Continuous Deployment Implementation
pdsen-corral#22 Integration with Test Rail
pdsen-corral#20 AWS Continuous Deployment Strategy
PDS.nasa.gov-UX
PDS.nasa.gov User Experience Task Issue and Prototype repository
- PDS.nasa.gov-UX#3 Formulate user stories for prototype
PDS.nasa.gov-UX#14 Develop user personas based upon outputs from user interview synthesis
PDS.nasa.gov-UX#58 Propose users stories for selected subset of the user personnas
PDS.nasa.gov-UX#6 Model workflows and initial design directions
- PDS.nasa.gov-UX#8 Design mockups and develop Figma prototype
PDS.nasa.gov-UX#10 Develop generic design and mockups for cross-node Material templates
PDS.nasa.gov-UX#11 Define component (footer/header) styles
- PDS.nasa.gov-UX#41 Review Feedback Widget Design
PDS.nasa.gov-UX#38 Re-evaluate the design of the Feedback widget
PDS.nasa.gov-UX#40 Re-visit Feedback Widget Content
feedback-widget#10 Apply WDS to Widget
pds-wds#11 Implement Feedback Widget in React
- PDS.nasa.gov-UX#47 Design System Documentation
pds-wds#1 Show Text Field component that displays units
pds-wds#2 Add other organizational logos
pds-wds#4 Propagate PDS brand colors across all components in Figma
pds-wds#6 Define types of banner notifications
pds-wds#8 Document UI guidelines and rules
pds-wds#9 Restructure component organization in Figma
PDS.nasa.gov-UX#54 Relay for Figma (continuous delivery)
- PDS.nasa.gov-UX#53 PDS Sitemap Generator
PDS.nasa.gov-UX#49 Evaluate sitemap generator tools
PDS.nasa.gov-UX#50 Generate sitemap for pds.nasa.gov
PDS.nasa.gov-UX#51 Submit sitemap to Google Webmaster
PDS.nasa.gov-UX#52 Integrate Google Webmaster and sitemap generator with DNs
PDS.nasa.gov-UX#45 WDS Mobile Considerations
- PDS.nasa.gov-UX#35 Content Management System
PDS.nasa.gov-UX#36 Abstract out the structure of PDS pages from CMS
PDS.nasa.gov-UX#37 Converge on a CMS solution
- PDS.nasa.gov-UX#31 Formulate PDS Information Architecture
PDS.nasa.gov-UX#32 Evaluate the current structure of PDS structure using mapping tools
PDS.nasa.gov-UX#33 Re-organize PDS web content based on business/user needs
PDS.nasa.gov-UX#34 Consolidate pages and ensure there is a logical structure to how we are organizing our sites
- PDS.nasa.gov-UX#30 User Documentation Consolidation
PDS.nasa.gov-UX#28 Document the information that is redundant across nodes
PDS.nasa.gov-UX#29 Consolidate PDS wide information in to a user guide
pds-api#36 Propose PDS style for API documentation
pdsen-operations
Tickets for the PDSEN Operations Team
- pdsen-operations#14 LDD CCB and Management processes
pdsen-operations#15 Work with LDD Stewards to develop process and CCB
pdsen-operations#16 Update LDD CI/CD accordingly to match the expectations from the CCB review process
pdsen-operations#22 Document how to tag an LDD Release
pds-tracking-service
Provides functionality for tracking status and other aspects pertaining to PDS products that are not captured in the Registry Service.
pds-tracking-service#1 Open Source Tracking Service
- pds-tracking-service#6 Refactor Tracking Service
pds-tracking-service#5 De-couple individual components
pds-tracking-service#7 Deploy beta of individual components
pds-tracking-service#8 Integrate DOI Tracking with DOI Service
- pds-tracking-service#2 Review Tracking Service Requirements and Design
pds-tracking-service#4 Identify implemented requirements
Other Information
Reference Documents
This section details the controlling and applicable documents referenced for this release. The controlling documents are as follows:
PDS Level 1, 2 and 3 Requirements, April 20, 2017.
PDS4 Project Plan, July 17, 2013.
PDS4 System Architecture Specification, Version 1.3, September 1, 2013.
PDS4 Operations Concept, Version 1.0, September 1, 2013.
PDS General System Software Requirements Document (SRD), Version 1.1, September 1, 2013.
PDS Harvest Tool Software Requirements and Design Document (SRD/SDD), Version 1.2, September 1, 2013.
PDS Preparation Tools Software Requirements and Design Document (SRD/SDD), Version 0.3, September 1, 2013.
PDS Registry Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Report Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
- PDS Search Service Software Requirements and Design Document (SRD/SDD), Version 1.0, September 1, 2013.
PDS Search Scenarios, Version 1.0, September 1, 2013.
PDS Search Protocol, Version 1.2, March 21, 2014.
PDAP Search Protocol, Version 1.0, March 21, 2014.
PDS Security Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS NSSDC Delivery Software Requirements and Design Document (SRD/SDD), Version 0.1, October 29, 2019.
System Requirements, Dependencies, and Assumptions
See individual applications for specific dependencies and system requirements.