Release Description Document (Build B16)
This release of the PDS4 System is intended as an operational release of the system components to date. The original plan for this release can be found here: plan B16
The following sections can be found in this document:
PDS4 Standards and Information Model Changes
This section details the changes to the PDS4 Standards and Information Model approved by the PDS4 Change Control Board and implemented by the PDS within the latest build period.
Ref |
Title |
---|---|
CCB-60: New permissible value for File_Area_Observational.Header.parsing_standard_id: “CDF 3.9 ISTP/IACG” |
|
CCB-59: funding_year only allows the value “9999” |
|
CCB-62: Transfer_Manifest class should enforce data types for its two mandatory columns |
Software Changes
For each software repository, the changes are listed in 2 categories:
Planned Updates
Other Updates
The ‘Planned Updates’ are organized by ‘Themes’ (or ‘Release Themes’), which are defined in advance and approved by the PDS Software Working Group (see Plan B16).
The ‘Other Updates’ occurs during the build cycle without being planned or attached to a theme. They are organized by types (bug, enhancements, requirements, tasks). Any updates that require a de-scope of planned tasks are reviewed by the PDS Software Working Group.
The deliveries are validated by the development team and go through an additional Integration & Test process, as
applicable, as indicated by the `Testing Status`
column in the tables below. There are 3 possible statuses for
testing:
🔵 Skip Testing - Testing is not needed for this ticket. These are determined at the discretion of the team based upon the technical or operational nature of the closed task.
🟡 Testing Needed
🟢 Testing Complete - Initial testing complete, and test cases/results documented.
Data-upload-manager
Data Upload Manager (DUM) component for managing the interface for data uploads to the Planetary Data Cloud from Data Providers and PDS Nodes.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
data-upload-manager#241 When DUM crashes, the report it generates falsely indicates success |
🟡 |
s.medium |
data-upload-manager#271 DUM output has typo |
🟡 |
s.low |
data-upload-manager#282 During DUM load, undocumented message about “Backing off” |
🟡 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
data-upload-manager#232 As a user, I want to load web logs to the web analytics bucket |
🟡 |
p.should-have |
data-upload-manager#221 As a user, I want to support upload of files >5GB |
🟡 |
p.must-have |
Deep-archive
PDS Open Archival Information System (OAIS) utilities, including Submission Information Package (SIP) and Archive Information Package (AIP) generators
Planned Updates
deep-archive#204 Add Support for Labels with LBLX file suffix
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
deep-archive#210 B16 Deep Archive Maintenance Tasks
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
deep-archive#208 Output manifest .tab files do not use forward slashes on Windows |
🟡 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
deep-archive#136 As a user, I want to know that the software is still executing on long running jobs. |
🔵 |
p.could-have |
deep-archive#157 As a user, I want deep archive to support LBLX label extensions |
🟡 |
p.should-have |
Devops
Parent repo for PDS DevOps activities
Planned Updates
devops#81 Enable Continuous Deployment for Portal
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Doi-service
Service and tools for generating DOIs for PDS bundles, collections, and data sets
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
doi-service#466 DOI service does not properly process UTF-16 in a JSON label |
🟡 |
s.medium |
doi-service#476 Tests do not run successfully on windows |
🟡 |
s.medium |
doi-service#456 Large majority of units tests failing |
🟡 |
s.high |
doi-service#455 SBN DOIs contain unexpected metadata that is breaking our database load script |
🟡 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
doi-service#432 As a user, I want to submit a label utilizing the updated author/contributor metadata (List_Author, List_Contributor, List_Editor) |
🟡 |
p.must-have |
doi-service#478 As a user, I want to support labels with lblx suffix |
🔵 |
p.must-have |
Ds-view
Data Set View application (pds.nasa.gov/ds-view)
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
ds-view#56 Fix potential XSS security vulnerability on ds-view |
🟡 |
s.high |
ds-view#53 DOIs are not properly resolving on some landing pages |
🔵 |
s.medium |
Edwg
PDS Editorial Working Group Working Area
Planned Updates
EdWG#85 Gather Investigation Imagery
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
EdWG#86 Context Updates Phase 1: Facilities and Telescopes
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Harvest
Version<=4 of the standalone Harvest client application providing the functionality for capturing and indexing product metadata into the PDS Registry system. Version 5+ are now managed through https://github.com/NASA-PDS/registry-loader/
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
harvest#239 Harvest failing due to AOSS OCU limits without retrying |
🟡 |
s.high |
harvest#247 Error FIPS mode: only SunJSSE TrustManagers may be used |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
harvest#261 As a user, I want harvest to raise an error if an attribute is not found in a local data dictionary (LDD) |
🟡 |
p.must-have |
harvest#262 As a user, I want to ingest all XML attribute values as string, by default |
🟡 |
p.must-have |
Lasso-releasers
Automatic “release” of software to artifact repositories, publishing packages for general availability
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
lasso-releasers#5 Stable releases of ds-view are not publishing releases or their assets |
🟡 |
s.high |
Nucleus
Nucleus is a software platform used to create workflows for the Planetary Data (PDS).
Planned Updates
nucleus#131 Update Architecture and Implement Separate EFS Per Node Baseline DAG
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
nucleus#142 Support Data Backlog Use Case
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
nucleus#147 Design and Prototype New Tracking Service
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
nucleus#149 Upgrade Nucleus to the latest 2.x version in MWAA
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
nucleus#156 Develop a DAG Task Library
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
nucleus#159 Invalid creation of archive buckets with terraform |
🔵 |
s.medium |
Pds4-information-model
The software tools and data necessary for generating the Information Model including PDS4 ontology, data, and information model.
Planned Updates
pds4-information-model#652 B14.0 LDDTool/IMTool Code Refactoring
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
pds4-information-model#951 PDS4 Instrument class (Product_Context) lists attributes that cannot be used |
🟡 |
s.medium |
pds4-information-model#938 Current WebHelp documentation (1O00/1.24.0.0) does not reflect latest Rings LDD |
🟡 |
s.medium |
pds4-information-model#947 LDD generator is not generating valid LDDs |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
pds4-information-model#939 As a user, I want to easily identify which IM and LDD version the WebHelp documentation is for |
🟡 |
p.should-have |
pds4-information-model#949 CCB-62: Transfer_Manifest class should enforce data types for its two mandatory columns |
🟡 |
p.must-have |
pds4-information-model#945 CCB-60: New permissible value for File_Area_Observational.Header.parsing_standard_id: “CDF 3.9 ISTP/IACG” |
🟡 |
p.must-have |
pds4-information-model#946 CCB-59: funding_year only allows the value “9999” |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
pds4-information-model#953 [namespace-registry] add new namespace “galileo” |
🟡 |
p.must-have |
pds4-information-model#958 [namespace-registry] add new namespace “prov” |
🟡 |
p.must-have |
Pdsen-maven-parent
PDS Engineering Node Maven Parent POM
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
pdsen-maven-parent#70 Manually push 1.20.0 to maven central to enable update of registry tools |
🔵 |
unknown |
Peppi
Planetary Data Explorer: Python (PEPPi) client library (pds.peppi) to access Planetary Data from the NASA Planetary Data System
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
peppi#102 as_dataframe method fails |
🟡 |
s.high |
Planetary-data-cloud
PDS Cloud Migration documentation, issue, tracking and simple tools for assisting in the PDS hybrid cloud study and migration efforts.
Planned Updates
planetary-data-cloud#87 Develop PDC User Engagement Strategy
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
planetary-data-cloud#139 Define Tagging Strategy for Planetary Data Cloud
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
planetary-data-cloud#165 Define PDC Assumed User Roles
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
planetary-data-cloud#188 Document Archive Management Guidelines and Constraints
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
planetary-data-cloud#171 Cloudfront caching of API requests causing confusion with user expectations |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
planetary-data-cloud#153 As a user, I need a lambda function to tag S3 objects based upon file suffix |
🔵 |
p.must-have |
Portal-tasks
PDS Portal tasks repo used to track update requests for the website. Actual code and website are managed in separate private repo
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
portal-tasks#123 Data release item details (data_product_information.cfm?) does not display on testing machine |
🔵 |
s.medium |
Registry
PDS Registry provides service and software application necessary for tracking, searching, auditing, locating, and maintaining artifacts within the system. These artifacts can range from data files and label files, schemas, dictionary definitions for objects and elements, services, etc.
Planned Updates
registry#370 Resurrect Legacy Registry Dashboards
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry#375 product has date for sweeper index but is listed as not indexed |
🟡 |
s.medium |
registry#403 members of GEO bundle/collection collection not found |
🟡 |
s.high |
registry#380 CSV response not returning the values associated with fields argument |
🟡 |
s.medium |
registry#422 Some of product urn:nasa:pds:lro_diviner_derived2::1.0’s fields are not indexed |
🟡 |
s.high |
registry#404 Registry is not accepting date time with leap second, e.g. 2015-06-30T23:59:60.862Z |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry#424 As a user, I want to receive an alert when my registry credentials are readable by someone else than myself |
🟡 |
p.should-have |
registry#113 As a node operator, I want the the registry schema to update autonomously / dynamically when new data is ingested. |
🟡 |
p.should-have |
registry#396 As a node user, I want to have multiple cognito groups and still have the main cognito node group to be effective |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry#360 Fix GEO node products which ops:Harvest_Info/ops:node_name: geo |
🔵 |
p.must-have |
Registry-api
Web API service for the PDS Registry, providing the implementation of the PDS Search API (https://github.com/nasa-pds/pds-api) for the PDS Registry.
Planned Updates
registry-api#623 Implement Registry API Performance Improvements
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
registry-api#633 Prototype Semantic Search Using AI / LLMs
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry-api#638 The API fails when no Accept header is provided |
🟡 |
s.high |
Registry-common
Version<=2 of the library utilized by tools that manage and load data into the PDS Registry, including Harvest, Registry Manager, and Supplementer. Version 3+ is now managed through https://github.com/NASA-PDS/registry-loader/.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry-common#149 Default to throwing an error when an attribute is missing from a LDD |
🟡 |
p.must-have |
Registry-legacy-solr
Legacy Registry Software components leveraging Apache Solr. Includes Legacy Harvest Tool, Registry Manager, PDS3 Catalog Tool, and Search Core library. These components provide the capabilities for loading PDS3 and PDS4 data into the Legacy Solr Registry, driving the PDS keyword search.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry-legacy-solr#217 Auto-restart the registry legacy docker container unless stopped |
🔵 |
unknown |
Registry-mgr
Version<=5 of the standalone Registry Manager application responsible for managing the PDS Registry (https://github.com/NASA-PDS/registry) schemas and indexes. Version 6+ is now managed through https://github.com/NASA-PDS/registry-loader/ .
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry-mgr#137 set-archive-status is changing the status of more products than are in the bundle |
🟡 |
s.high |
registry-mgr#134 registry-manager is incorrectly changing the archive_status of collection versions not in the bundle version |
🟡 |
s.high |
Registry-sweepers
*Scripts that run regularly on the registry database, to clean and consolidate information *
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
registry-sweepers#171 Ancestry not working properly for SBN |
🟡 |
s.critical |
registry-sweepers#164 ATM Registry-Sweeper ECS task is failing |
🔵 |
s.critical |
Roundup-action
Do a “roundup”, a/k/a PDS-style continuous integration and delivery
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
roundup-action#154 All stable builds are not tagging Releases in GitHub |
🟡 |
s.high |
Search-ui-legacy
Legacy Keyword Search UI querying the Legacy Registry through Apache Solr.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
search-ui-legacy#59 Bug with XSS vulnerability |
🟡 |
s.high |
Software-issues-repo
Issue tracking repository as a centralized entry point for general PDS software bugs and feature requests.
Planned Updates
software-issues-repo#118 2025 Annual A&A Assessment Prep and Review
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
software-issues-repo#124 Re-imagine Data Release and DOI Processes in GitHub
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
software-issues-repo#125 Complete ISA with NSSDCA
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
software-issues-repo#128 Upgrade Java Repos to use Maven Central Portal from OSSRH
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
software-issues-repo#135 Update LDD off-nominal release process to include regeneration of WebHelp |
🔵 |
unknown |
software-issues-repo#113 Create tool to generate SLOC reports for software deliveries |
🔵 |
unknown |
Validate
Validates PDS4 product labels, data and PDS3 Volumes
Planned Updates
validate#1184 Update Context Metadata Quality Checks to Support Aliases
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
validate#1332 Validate Incorrectly Reports Overlap Error If Initial Bits Are Not Specified in Packed_Data_Fields |
🟡 |
s.medium |
validate#1357 Encoded_External/encoding_standard_id does not allow NetCDF |
🟡 |
s.medium |
validate#1276 –strict-field-checks not working as expected |
🟡 |
s.medium |
validate#1234 validate does not raise a warning when a table has more records than label says it has |
🟡 |
s.medium |
validate#1359 Validate does not allow LIDVID for external products |
🟡 |
s.medium |
validate#1331 validate-bundle does not find same files as validate (uppercase label filenames) |
🟡 |
s.medium |
validate#1149 validate-bundle has no default value for –report-dir |
🟡 |
s.medium |
validate#967 validate configuration includes context product names that do not match the products |
🟡 |
s.medium |
validate#1358 Validate doesn’t correctly handle an integer value of valid_maximum associated with floating point data array |
🟡 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
validate#970 As a user, I want to includes titles and aliases in context product name validation |
🟡 |
p.could-have |
validate#1137 As a user, I want to know how much progress is being made during a validate run |
🟡 |
p.should-have |
validate#1201 As a user, I want validate to report empty (blank) PDS4 labels |
🟡 |
p.should-have |
Web-analytics
None
Planned Updates
web-analytics#57 Complete Logstash Wrapper Tools for Prod Deployment
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
web-analytics#51 en-web-analytics is locked up and unable to use |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
---|---|---|
web-analytics#53 As a user, I want to automatically deploy all web analytics components |
🔵 |
p.must-have |
Web-modernization
PDS.nasa.gov Web Modernization repo for managing the overall design process and user testing for modernizing the PDS web experience.
Planned Updates
web-modernization#257 Design Instrument Package Portal Pages
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
web-modernization#258 Design Learning Hub Page
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
web-modernization#259 Design-System Housekeeping
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Liens
Issue |
Title |
Rationale |
---|---|---|
Engineering Node Software Catalog
The Engineering Node Software resources are listed in the Software Release Summary (B16)
Installation and Operation
PDS Engineering Node Software have 3 different venues/purposes for execution: Standalone, Discipline Node Deployment or Engineering Node-only Deployment For the Installation and Operation manual see the users manuals in the software summary sections below:
Reference documents
This section details the controlling and applicable documents referenced for this release. The controlling documents are as follows:
PDS Level 1, 2 and 3 Requirements, April 20, 2017.
PDS4 Project Plan, July 17, 2013.
PDS4 System Architecture Specification, Version 1.3, September 1, 2013.
PDS4 Operations Concept, Version 1.0, September 1, 2013.
PDS Harvest Tool Software Requirements and Design Document (SRD/SDD), Version 1.2, September 1, 2013.
PDS Preparation Tools Software Requirements and Design Document (SRD/SDD), Version 0.3, September 1, 2013.
PDS Registry Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Report Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Search Service Software Requirements and Design Document (SRD/SDD), Version 1.0, September 1, 2013.
PDS Search Scenarios, Version 1.0, September 1, 2013.
PDS Search Protocol, Version 1.2, March 21, 2014.
PDAP Search Protocol, Version 1.0, March 21, 2014.
PDS Security Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Deep Archive Software Requirements and Design Document (SRD/SDD)