Release Description Document (Build B15.1)
This release of the PDS4 System is intended as an operational release of the system components to date. The original plan for this release can be found here: plan B15.1
The following sections can be found in this document:
PDS4 Standards and Information Model Changes
This section details the changes to the PDS4 Standards and Information Model approved by the PDS4 Change Control Board and implemented by the PDS within the latest build period.
No PDS4 Standards Updates
Software Changes
For each software repository, the changes are listed in 2 categories:
Planned Updates
Other Updates
The ‘Planned Updates’ are organized by ‘Themes’ (or ‘Release Themes’), which are defined in advance and approved by the PDS Software Working Group (see Plan B15.1).
The ‘Other Updates’ occurs during the build cycle without being planned or attached to a theme. They are organized by types (bug, enhancements, requirements, tasks). Any updates that require a de-scope of planned tasks are reviewed by the PDS Software Working Group.
The deliveries are validated by the development team and go through an additional Integration & Test process, as
applicable, as indicated by the `Testing Status` column in the tables below. There are 3 possible statuses for
testing:
🔵 Skip Testing - Testing is not needed for this ticket. These are determined at the discretion of the team based upon the technical or operational nature of the closed task.
🟡 Testing Needed
🟢 Testing Complete - Initial testing complete, and test cases/results documented.
Devops
Parent repo for PDS DevOps activities
Planned Updates
devops#69 Phase 2: Develop CI/CD for NPM/React projects
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
devops#78 Image vulnerability scanning updates have broken the Validate docker build |
🔵 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
devops#76 As a developer, I want to ensure image dependencies are secure |
🟡 |
p.should-have |
devops#77 As a developer and tester, I want my test case to be automatically defined from the github ticket without manual editing, copy/paste |
🟡 |
unknown |
Ds-view
Data Set View application (pds.nasa.gov/ds-view)
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
ds-view#40 Products with multiple resources are not appearing on landing pages |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
ds-view#39 As a user, I want a landing page for Telescope context objects |
🟡 |
p.must-have |
ds-view#37 As a user, I want a landing page for Airborne context objects |
🟡 |
p.must-have |
ds-view#38 As a user, I want a landing page for Facility context objects |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
ds-view#42 Update to improve ordering based upon indexed order |
🔵 |
unknown |
Edwg
PDS Editorial Working Group Working Area
Planned Updates
EdWG#38 Context Updates Phase 1: Investigations
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
EdWG#55 Context product missing from Working directory |
🟡 |
s.high |
EdWG#57 Modification_Detail out of order |
🟡 |
s.medium |
Harvest
Standalone Harvest client application providing the functionality for capturing and indexing product metadata into the PDS Registry system (https://github.com/nasa-pds/registry).
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#222 Issue with ALT LDD date format error |
🔵 |
s.medium |
harvest#206 Issues identified with uncaught throttling errors |
🟡 |
s.high |
harvest#204 OpenSearch mapping conflict issue when trying to change a type ([illegal_argument_exception]) |
🟡 |
s.critical |
harvest#213 harvest by default overwrites all products |
🟡 |
s.critical |
harvest#190 I want to update the OpenSearch schema whatever the number of fields to be updated |
🟡 |
s.critical |
harvest#208 Read time out errors occurring with big data uploads |
🔵 |
s.medium |
harvest#186 New records harvested in the registry don’t have the expected Node value |
🟡 |
s.high |
harvest#197 Unknown date format used that could not be parsed by Harvest |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#187 As a user, I want to include my organization name in the harvest metadata (ops:Harvest_Info.ops:node_name) |
🟡 |
p.must-have |
harvest#199 As a user, I want harvest to exit with non 0 code when the arguments are not parsable |
🟡 |
p.should-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#223 Quiet Harvest noisy logs for Invalid cookie header |
🔵 |
unknown |
harvest#205 Optimize LDD downloads also on errors |
🔵 |
p.must-have |
harvest#203 Add the date time in the log messages |
🔵 |
p.should-have |
harvest#207 Update harvest to support batches with data volumes larger than AOSS allowable limit |
🔵 |
p.must-have |
Mi-label
Metadata Injector for PDS Labels (MILabel) provides a command-line interface for generating PDS4 Labels using a user provided PDS4 XML template and input (source) data products.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
mi-label#84 As a user, I want to provide metadata in JSON files |
🟡 |
p.should-have |
Nucleus
Nucleus is a software platform used to create workflows for the Planetary Data (PDS).
Planned Updates
nucleus#130 Update Product-Level DAG with Upgraded Harvest
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
nucleus#121 Integrate the latest version 4.0.1 of harvest in Nucleus workflow |
🔵 |
unknown |
Operations
Tickets for the PDSEN Operations Team
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
operations#551 [ldd-request] Create new LDD “dragonfly” |
🟡 |
p.must-have |
Pds4-information-model
The software tools and data necessary for generating the Information Model including PDS4 ontology, data, and information model.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
pds4-information-model#822 Tests fail when there are multiple tests with multiple schemas/schematrons |
🟡 |
s.medium |
pds4-information-model#849 lddtool -h returns expected information twice and then error messages |
🔵 |
s.medium |
pds4-information-model#834 emrsp namespaces are configured to be produced as https: |
🔵 |
s.high |
pds4-information-model#846 Download links broken for lddtool for online documentation |
🔵 |
s.medium |
pds4-information-model#852 Issue trying to generate schemas 1E00 and 1D00 |
🟡 |
s.high |
pds4-information-model#848 lddtool -v creates/overwrites output directory and files |
🟡 |
s.medium |
pds4-information-model#857 Exit codes no longer working as expected |
🔵 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
pds4-information-model#860 As a user, I want to generate the core PDS4 IM for a specific version of PDS4 |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
pds4-information-model#825 Add Product_Native test case for #795 back to test suite |
🔵 |
unknown |
pds4-information-model#845 [namespace-registry] add new namespace LCROSS |
🔵 |
p.must-have |
pds4-information-model#861 Update command-line arguments to be in line with standard best practices |
🔵 |
unknown |
Peppi
Planetary Data Explorer: Python (PEPPi) client library (pds.peppi) to access Planetary Data from the NASA Planetary Data System
Planned Updates
peppi#53 Prep for AGU Training Workshop
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
peppi#61 As a user, I want to read all tables within a collection into a pandas DataFrame |
🟡 |
p.should-have |
peppi#31 As a user, I want to search for products based upon a instrument LID |
🟡 |
p.must-have |
peppi#47 As a user, I want to see an online reference documentation of the library |
🟡 |
p.should-have |
peppi#57 As a user, I want my query response as a Pandas DataFrame |
🟡 |
p.could-have |
peppi#64 As a user, I want to limit the number of fields returned |
🟡 |
p.should-have |
peppi#33 As a user, I want to search for collection products only |
🟡 |
p.must-have |
peppi#34 As a user, I want to search for bundle products only |
🟡 |
p.must-have |
peppi#35 As a user, I want to filter on a specific processing level |
🟡 |
p.must-have |
peppi#32 As a user, I want to search for observational products only |
🟡 |
p.must-have |
peppi#60 As a user, I want to transform binary tables (.dat) in CSVs for all members of a collection |
🟡 |
p.should-have |
peppi#30 As a user, I want to search for products based upon a investigation LID |
🟡 |
p.must-have |
Planetary-data-cloud
PDS Cloud Migration documentation, issue, tracking and simple tools for assisting in the PDS hybrid cloud study and migration efforts.
Planned Updates
planetary-data-cloud#74 [SBN CATCH Migration] Support Development of Initial Migration Plan and Architecture
Issue |
I&T Status |
Level |
Priority / Bug Severity |
|---|---|---|---|
planetary-data-cloud#121 Phase 1: PDS-EN to provide codeql scan for SBN to incorporate. Review any questions at next SBN cloud migration tagup (11/22/24) |
🟡 |
enhancement |
p.must-have |
planetary-data-cloud#122 Phase 1: PDS-EN to provide terraform templates for SBN to capture the current status of CATCH. |
🟡 |
enhancement |
p.must-have |
planetary-data-cloud#123 Phase 1: PDS-EN to provide cloud endpoint for SBN to integrate the endpoint into SBN Survey Image Service. |
🔵 |
enhancement |
p.must-have |
planetary-data-cloud#80 Develop PDC Tenant Roles
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
planetary-data-cloud#112 Refine Data Backup, Disaster Recovery and Configuration Management Plans
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#125 CSS ODR bucket no longer accessible to the public |
🟡 |
s.critical |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#75 As a user, I want a warm backup of my archive data to be available in the event of corruption of of primary archive data |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#128 Setup Budgets and Reporting for all accounts |
🔵 |
unknown |
Portal-tasks
PDS Portal tasks repo used to track update requests for the website. Actual code and website are managed in separate private repo
Planned Updates
portal-tasks#108 Create 2025 Data Release Calendar
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-tasks#104 Tool Registry search does not work past initial query |
🟡 |
s.high |
portal-tasks#107 Missing PDS4_IMG_1100.xsd |
🟡 |
s.high |
portal-tasks#103 Browse and search link broken on https://pds.nasa.gov/datastandards/dictionaries/index-missions.shtml |
🟡 |
s.medium |
portal-tasks#109 Tool Registry doesn’t work for text searches |
🔵 |
s.high |
portal-tasks#106 Missing PDS4_MSN_SURFACE_1A10.xsd |
🟡 |
s.medium |
portal-tasks#102 tool registry search result count is incorrect |
🟡 |
s.medium |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-tasks#115 Remove phonebook from portal |
🔵 |
unknown |
Portal-wp
New PDS Website driven by the PDS Web Modernization Working Group
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#72 Search results are linking to an empty page (investigations/identifier/data) |
🟡 |
s.critical |
portal-wp#139 Page Type value in search results does not match actual page_type field value |
🔵 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#87 As a user, I want collection descriptions to default to pds:Citation_Information.pds:description |
🟡 |
p.must-have |
portal-wp#119 As a user, I want to select 1 or more filters to facet search results |
🔵 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#97 Add State to Homepage for what has been selected |
🔵 |
p.must-have |
portal-wp#129 Update facets and search results to enable sorting by title |
🔵 |
unknown |
portal-wp#107 Test instructions for running WST Drupal Site |
🔵 |
unknown |
Registry
PDS Registry provides service and software application necessary for tracking, searching, auditing, locating, and maintaining artifacts within the system. These artifacts can range from data files and label files, schemas, dictionary definitions for objects and elements, services, etc.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry#331 GEO index does not work, appears to be corrupted |
🟡 |
s.critical |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry#352 Recreate PDS EN Registry from scratch and load only necessary data |
🔵 |
p.must-have |
Registry-common
Library utilized by tools that manage and load data into the PDS Registry, including Harvest, Registry Manager, and Supplementer
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-common#83 As a Nucleus system, I want to be able to invoke harvest and registry-mgr from within the AWS VPC |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-common#118 Cleanup potential resource leaks |
🔵 |
unknown |
Registry-legacy-solr
Legacy Registry Software components leveraging Apache Solr. Includes Legacy Harvest Tool, Registry Manager, PDS3 Catalog Tool, and Search Core library. These components provide the capabilities for loading PDS3 and PDS4 data into the Legacy Solr Registry, driving the PDS keyword search.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#156 viewDataset.jsp shows no links for Search/Access Data |
🟡 |
s.high |
registry-legacy-solr#163 Cassini ISS Users Guide returns “No Document Information found in the registry” msg |
🟡 |
s.high |
registry-legacy-solr#174 Harvest ignoring secondary members of collections managed by EN |
🟡 |
unknown |
registry-legacy-solr#172 Possible memory leak related to use of Solr library per Direct buffer memory errors |
🔵 |
s.medium |
registry-legacy-solr#176 SIP_Deep_Archive products showing up in search results |
🟡 |
s.medium |
registry-legacy-solr#154 viewDocument.jsp has no links for SEARCH/ACCESS DATA |
🟡 |
s.high |
registry-legacy-solr#147 page_type not working for context products |
🔵 |
s.critical |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#179 As a user, I want to provide a data input path via command-line |
🟡 |
p.should-have |
registry-legacy-solr#93 As a user, I want to provide search/access links using the hsk.cat files within the data set |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#158 Add single-value title and context name field to enable sorting |
🔵 |
p.must-have |
Registry-mgr
Standalone Registry Manager application responsible for managing the PDS Registry (https://github.com/NASA-PDS/registry) schemas and indexes.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-mgr#109 archive status does not change for all bundle members |
🟡 |
s.high |
registry-mgr#122 [ERROR] Need to fill this out when have a return value when trying to execute list-dd command |
🟡 |
s.medium |
registry-mgr#107 Unable to update archive status of a lidvid in the registry |
🟡 |
s.critical |
registry-mgr#121 Missing required property ‘FieldValue.<variant value>’ error when running with list-dd command |
🟡 |
s.high |
registry-mgr#124 Getting null message in log with option packageId |
🟡 |
s.low |
registry-mgr#104 Update inline help to match latest features |
🟡 |
s.high |
registry-mgr#111 registry-mgr return ERROR null |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-mgr#113 As a user, I want to change the archive status for a collection and it’s associated products given a collection lidvid |
🟡 |
p.should-have |
registry-mgr#112 As a user, I want to update a bundle and associated collections’ and products’ archive status given a bundle lidvid |
🟡 |
p.should-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-mgr#117 Quiet SLF4J log message from end user |
🔵 |
unknown |
S3-browser-cloudfront
Web view for files in S3 buckets
Planned Updates
s3-browser-cloudfront#29 Deploy S3 Browser to Test and Prod
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
s3-browser-cloudfront#131 Resolve broken icon links in file pages |
🟡 |
s.medium |
Search-ui-legacy
Legacy Keyword Search UI querying the Legacy Registry through Apache Solr.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
search-ui-legacy#40 Too many open files error for servlet |
🔵 |
unknown |
System-i-n-t
Repo for PDS EN System I&T scripts and issue tracking
Planned Updates
system-i-n-t#54 B15.0 System Integration & Test
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
system-i-n-t#55 B15.0 Test Readiness Review (TRR)
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Validate
Validates PDS4 product labels, data and PDS3 Volumes
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
validate#1066 Telescopes missing from registry context products config |
🟡 |
s.high |
validate#1008 The PDF verification / VeraPDF component of Validate seems to error on Windows paths |
🟡 |
s.medium |
validate#1058 validate cucumber testing is not exercising all tests as it should be |
🟡 |
s.medium |
validate#1100 validate’s PDS4 Bundle Level Validation Results are wrong if filenames end in XML |
🟡 |
s.medium |
validate#979 OutOfMemoryError when NASA validate v3.5.2 is executed through a library for a batch of products |
🔵 |
s.medium |
validate#1028 validate incorrectly disallows Encoded_Native/encoding_standard_id = ‘SEED 2.4’ |
🟡 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
validate#992 As a user, I want to validate that there is exactly one digit to the left of the decimal point for the specifier e or E |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
validate#1085 Improve error handling for Registry connection issues |
🔵 |
unknown |
Web-modernization
PDS.nasa.gov Web Modernization repo for managing the overall design process and user testing for modernizing the PDS web experience.
Planned Updates
web-modernization#239 Final Prep for MVP
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
web-modernization#246 Refine Designs and Implement Improved Faceting
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Liens
Issue |
Title |
Rationale |
|---|---|---|
Engineering Node Software Catalog
The Engineering Node Software resources are listed in the Software Release Summary (B15.1)
Installation and Operation
PDS Engineering Node Software have 3 different venues/purposes for execution: Standalone, Discipline Node Deployment or Engineering Node-only Deployment For the Installation and Operation manual see the users manuals in the software summary sections below:
Reference documents
This section details the controlling and applicable documents referenced for this release. The controlling documents are as follows:
PDS Level 1, 2 and 3 Requirements, April 20, 2017.
PDS4 Project Plan, July 17, 2013.
PDS4 System Architecture Specification, Version 1.3, September 1, 2013.
PDS4 Operations Concept, Version 1.0, September 1, 2013.
PDS Harvest Tool Software Requirements and Design Document (SRD/SDD), Version 1.2, September 1, 2013.
PDS Preparation Tools Software Requirements and Design Document (SRD/SDD), Version 0.3, September 1, 2013.
PDS Registry Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Report Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Search Service Software Requirements and Design Document (SRD/SDD), Version 1.0, September 1, 2013.
PDS Search Scenarios, Version 1.0, September 1, 2013.
PDS Search Protocol, Version 1.2, March 21, 2014.
PDAP Search Protocol, Version 1.0, March 21, 2014.
PDS Security Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Deep Archive Software Requirements and Design Document (SRD/SDD)