Release Description Document (Build B15.1)
This release of the PDS4 System is intended as an operational release of the system components to date. The original plan for this release can be found here: plan B15.1
The following sections can be found in this document:
PDS4 Standards and Information Model Changes
This section details the changes to the PDS4 Standards and Information Model approved by the PDS4 Change Control Board and implemented by the PDS within the latest build period.
No PDS4 Standards Updates
Software Changes
For each software repository, the changes are listed in 2 categories:
Planned Updates
Other Updates
The ‘Planned Updates’ are organized by ‘Themes’ (or ‘Release Themes’), which are defined in advance and approved by the PDS Software Working Group (see Plan B15.1).
The ‘Other Updates’ occurs during the build cycle without being planned or attached to a theme. They are organized by types (bug, enhancements, requirements, tasks). Any updates that require a de-scope of planned tasks are reviewed by the PDS Software Working Group.
The deliveries are validated by the development team and go through an additional Integration & Test process, as
applicable, as indicated by the `Testing Status` column in the tables below. There are 3 possible statuses for
testing:
🔵 Skip Testing - Testing is not needed for this ticket. These are determined at the discretion of the team based upon the technical or operational nature of the closed task.
🟡 Testing Needed
🟢 Testing Complete - Initial testing complete, and test cases/results documented.
Devops
Parent repo for PDS DevOps activities
Planned Updates
devops#69 Phase 2: Develop CI/CD for NPM/React projects
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
devops#78 Image vulnerability scanning updates have broken the Validate docker build |
🔵 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
devops#77 As a developer and tester, I want my test case to be automatically defined from the github ticket without manual editing, copy/paste |
🟡 |
unknown |
devops#76 As a developer, I want to ensure image dependencies are secure |
🟡 |
p.should-have |
Ds-view
Data Set View application (pds.nasa.gov/ds-view)
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
ds-view#14 Memory leak in Solr connections leading to Tomcat crash |
🔵 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
ds-view#38 As a user, I want a landing page for Facility context objects |
🟡 |
p.must-have |
ds-view#39 As a user, I want a landing page for Telescope context objects |
🟡 |
p.must-have |
ds-view#37 As a user, I want a landing page for Airborne context objects |
🟡 |
p.must-have |
Edwg
PDS Editorial Working Group Working Area
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
EdWG#55 Context product missing from Working directory |
🟡 |
s.high |
Harvest
Standalone Harvest client application providing the functionality for capturing and indexing product metadata into the PDS Registry system (https://github.com/nasa-pds/registry).
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#197 Unknown date format used that could not be parsed by Harvest |
🟡 |
s.high |
harvest#190 I want to update the OpenSearch schema whatever the number of fields to be updated |
🟡 |
s.critical |
harvest#213 harvest by default overwrites all products |
🟡 |
s.critical |
harvest#206 Issues identified with uncaught throttling errors |
🟡 |
s.high |
harvest#208 Read time out errors occurring with big data uploads |
🔵 |
s.medium |
harvest#222 Issue with ALT LDD date format error |
🔵 |
s.medium |
harvest#186 New records harvested in the registry don’t have the expected Node value |
🟡 |
s.high |
harvest#204 OpenSearch mapping conflict issue when trying to change a type ([illegal_argument_exception]) |
🟡 |
s.critical |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#187 As a user, I want to include my organization name in the harvest metadata (ops:Harvest_Info.ops:node_name) |
🟡 |
p.must-have |
harvest#199 As a user, I want harvest to exit with non 0 code when the arguments are not parsable |
🟡 |
p.should-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
harvest#223 Quiet Harvest noisy logs for Invalid cookie header |
🔵 |
unknown |
harvest#205 Optimize LDD downloads also on errors |
🔵 |
p.must-have |
harvest#207 Update harvest to support batches with data volumes larger than AOSS allowable limit |
🔵 |
p.must-have |
harvest#203 Add the date time in the log messages |
🔵 |
p.should-have |
Nucleus
Nucleus is a software platform used to create workflows for the Planetary Data (PDS).
Planned Updates
nucleus#130 Update Product-Level DAG with Upgraded Harvest
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
nucleus#121 Integrate the latest version 4.0.1 of harvest in Nucleus workflow |
🔵 |
unknown |
Operations
Tickets for the PDSEN Operations Team
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
operations#551 [ldd-request] Create new LDD “dragonfly” |
🟡 |
p.must-have |
Pds4-information-model
The software tools and data necessary for generating the Information Model including PDS4 ontology, data, and information model.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
pds4-information-model#822 Tests fail when there are multiple tests with multiple schemas/schematrons |
🟡 |
s.medium |
pds4-information-model#834 emrsp namespaces are configured to be produced as https: |
🔵 |
s.high |
pds4-information-model#846 Download links broken for lddtool for online documentation |
🔵 |
s.medium |
pds4-information-model#849 lddtool -h returns expected information twice and then error messages |
🔵 |
s.medium |
pds4-information-model#848 lddtool -v creates/overwrites output directory and files |
🟡 |
s.medium |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
pds4-information-model#825 Add Product_Native test case for #795 back to test suite |
🔵 |
unknown |
pds4-information-model#845 [namespace-registry] add new namespace LCROSS |
🔵 |
p.must-have |
Peppi
Planetary Data Explorere: Python (PEPPi) library (pds.peppi) to access Planetary Data from the Planetary Data System (formerly known as updart)
Planned Updates
peppi#53 Prep for AGU Training Workshop
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
peppi#47 As a user, I want to see an online reference documentation of the library |
🟡 |
p.should-have |
peppi#61 As a user, I want to read all tables within a collection into a pandas DataFrame |
🟡 |
p.should-have |
peppi#31 As a user, I want to search for products based upon a instrument LID |
🟡 |
p.must-have |
peppi#34 As a user, I want to search for bundle products only |
🟡 |
p.must-have |
peppi#30 As a user, I want to search for products based upon a investigation LID |
🟡 |
p.must-have |
peppi#64 As a user, I want to limit the number of fields returned |
🟡 |
p.should-have |
peppi#33 As a user, I want to search for collection products only |
🟡 |
p.must-have |
peppi#60 As a user, I want to transform binary tables (.dat) in CSVs for all members of a collection |
🟡 |
p.should-have |
peppi#35 As a user, I want to filter on a specific processing level |
🟡 |
p.must-have |
peppi#57 As a user, I want my query response as a Pandas DataFrame |
🟡 |
p.could-have |
peppi#32 As a user, I want to search for observational products only |
🟡 |
p.must-have |
Planetary-data-cloud
PDS Cloud Migration documentation, issue, tracking and simple tools for assisting in the PDS hybrid cloud study and migration efforts.
Planned Updates
planetary-data-cloud#80 Develop PDC Tenant Roles
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
planetary-data-cloud#112 Refine Data Backup, Disaster Recovery and Configuration Management Plans
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#125 CSS ODR bucket no longer accessible to the public |
🟡 |
s.critical |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#75 As a user, I want a warm backup of my archive data to be available in the event of corruption of of primary archive data |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
planetary-data-cloud#121 Phase 1: PDS-EN to provide codeql scan for SBN to incorporate. Review any questions at next SBN cloud migration tagup (11/22/24) |
🟡 |
p.must-have |
planetary-data-cloud#123 Phase 1: PDS-EN to provide cloud endpoint for SBN to integrate the endpoint into SBN Survey Image Service. |
🔵 |
p.must-have |
planetary-data-cloud#122 Phase 1: PDS-EN to provide terraform templates for SBN to capture the current status of CATCH. |
🟡 |
p.must-have |
planetary-data-cloud#128 Setup Budgets and Reporting for all accounts |
🔵 |
unknown |
Portal-tasks
PDS Portal tasks repo used to track update requests for the website. Actual code and website are managed in separate private repo
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-tasks#103 Browse and search link broken on https://pds.nasa.gov/datastandards/dictionaries/index-missions.shtml |
🟡 |
s.medium |
portal-tasks#102 tool registry search result count is incorrect |
🟡 |
s.medium |
portal-tasks#109 Tool Registry doesn’t work for text searches |
🔵 |
s.high |
portal-tasks#106 Missing PDS4_MSN_SURFACE_1A10.xsd |
🟡 |
s.medium |
portal-tasks#107 Missing PDS4_IMG_1100.xsd |
🟡 |
s.high |
portal-tasks#104 Tool Registry search does not work past initial query |
🟡 |
s.high |
Portal-wp
New PDS Website driven by the PDS Web Modernization Working Group
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#72 Search results are linking to an empty page (investigations/identifier/data) |
🟡 |
s.critical |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#87 As a user, I want collection descriptions to default to pds:Citation_Information.pds:description |
🟡 |
p.must-have |
portal-wp#119 As a user, I want to select 1 or more filters to facet search results |
🔵 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
portal-wp#129 Update facets and search results to enable sorting by title |
🔵 |
unknown |
portal-wp#107 Test instructions for running WST Drupal Site |
🔵 |
unknown |
portal-wp#97 Add State to Homepage for what has been selected |
🔵 |
p.must-have |
Registry
PDS Registry provides service and software application necessary for tracking, searching, auditing, locating, and maintaining artifacts within the system. These artifacts can range from data files and label files, schemas, dictionary definitions for objects and elements, services, etc.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry#331 GEO index does not work, appears to be corrupted |
🟡 |
s.critical |
Registry-common
Library utilized by tools that manage and load data into the PDS Registry, including Harvest, Registry Manager, and Supplementer
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-common#83 As a Nucleus system, I want to be able to invoke harvest and registry-mgr from within the AWS VPC |
🟡 |
p.must-have |
Registry-legacy-solr
Legacy Registry Software components leveraging Apache Solr. Includes Legacy Harvest Tool, Registry Manager, PDS3 Catalog Tool, and Search Core library. These components provide the capabilities for loading PDS3 and PDS4 data into the Legacy Solr Registry, driving the PDS keyword search.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#172 Possible memory leak related to use of Solr library per Direct buffer memory errors |
🔵 |
s.medium |
registry-legacy-solr#176 SIP_Deep_Archive products showing up in search results |
🟡 |
s.medium |
registry-legacy-solr#147 page_type not working for context products |
🔵 |
s.critical |
registry-legacy-solr#174 Harvest ignoring secondary members of collections managed by EN |
🟡 |
unknown |
registry-legacy-solr#156 viewDataset.jsp shows no links for Search/Access Data |
🟡 |
s.high |
registry-legacy-solr#154 viewDocument.jsp has no links for SEARCH/ACCESS DATA |
🟡 |
s.high |
registry-legacy-solr#163 Cassini ISS Users Guide returns “No Document Information found in the registry” msg |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#93 As a user, I want to provide search/access links using the hsk.cat files within the data set |
🟡 |
p.must-have |
Enhancements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-legacy-solr#158 Add single-value title and context name field to enable sorting |
🔵 |
p.must-have |
Registry-mgr
Standalone Registry Manager application responsible for managing the PDS Registry (https://github.com/NASA-PDS/registry) schemas and indexes.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-mgr#107 Unable to update archive status of a lidvid in the registry |
🟡 |
s.critical |
registry-mgr#111 registry-mgr return ERROR null |
🟡 |
s.high |
registry-mgr#109 archive status does not change for all bundle members |
🟡 |
s.high |
registry-mgr#121 Missing required property ‘FieldValue.<variant value>’ error when running with list-dd command |
🟡 |
s.high |
registry-mgr#122 [ERROR] Need to fill this out when have a return value when trying to execute list-dd command |
🟡 |
s.medium |
registry-mgr#104 Update inline help to match latest features |
🟡 |
s.high |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
registry-mgr#113 As a user, I want to change the archive status for a collection and it’s associated products given a collection lidvid |
🟡 |
p.should-have |
registry-mgr#112 As a user, I want to update a bundle and associated collections’ and products’ archive status given a bundle lidvid |
🟡 |
p.should-have |
S3-browser-cloudfront
Web view for files in S3 buckets
Planned Updates
s3-browser-cloudfront#29 Deploy S3 Browser to Test and Prod
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Search-ui-legacy
Legacy Keyword Search UI querying the Legacy Registry through Apache Solr.
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
search-ui-legacy#40 Too many open files error for servlet |
🔵 |
unknown |
System-i-n-t
Repo for PDS EN System I&T scripts and issue tracking
Planned Updates
system-i-n-t#54 B15.0 System Integration & Test
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
system-i-n-t#55 B15.0 Test Readiness Review (TRR)
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Validate
Validates PDS4 product labels, data and PDS3 Volumes
Planned Updates
No planned updates realized for this build in this repository.
Other Updates
Bugs
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
validate#1066 Telescopes missing from registry context products config |
🟡 |
s.high |
validate#1028 validate incorrectly disallows Encoded_Native/encoding_standard_id = ‘SEED 2.4’ |
🟡 |
s.medium |
validate#1008 The PDF verification / VeraPDF component of Validate seems to error on Windows paths |
🟡 |
s.medium |
validate#979 OutOfMemoryError when NASA validate v3.5.2 is executed through a library for a batch of products |
🔵 |
s.medium |
Requirements
Issue |
I&T Status |
Priority / Bug Severity |
|---|---|---|
validate#992 As a user, I want to validate that there is exactly one digit to the left of the decimal point for the specifier e or E |
🟡 |
p.must-have |
Web-modernization
PDS.nasa.gov Web Modernization repo for managing the overall design process and user testing for modernizing the PDS web experience.
Planned Updates
web-modernization#239 Final Prep for MVP
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
web-modernization#246 Refine Designs and Implement Improved Faceting
No requirements, enhancements, or bug fixes tickets identified for this theme in the current build. Click on the link in this section title for details.
Liens
Issue |
Title |
Rationale |
|---|---|---|
Engineering Node Software Catalog
The Engineering Node Software resources are listed in the Software Release Summary (B15.1)
Installation and Operation
PDS Engineering Node Software have 3 different venues/purposes for execution: Standalone, Discipline Node Deployment or Engineering Node-only Deployment For the Installation and Operation manual see the users manuals in the software summary sections below:
Reference documents
This section details the controlling and applicable documents referenced for this release. The controlling documents are as follows:
PDS Level 1, 2 and 3 Requirements, April 20, 2017.
PDS4 Project Plan, July 17, 2013.
PDS4 System Architecture Specification, Version 1.3, September 1, 2013.
PDS4 Operations Concept, Version 1.0, September 1, 2013.
PDS Harvest Tool Software Requirements and Design Document (SRD/SDD), Version 1.2, September 1, 2013.
PDS Preparation Tools Software Requirements and Design Document (SRD/SDD), Version 0.3, September 1, 2013.
PDS Registry Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Report Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Search Service Software Requirements and Design Document (SRD/SDD), Version 1.0, September 1, 2013.
PDS Search Scenarios, Version 1.0, September 1, 2013.
PDS Search Protocol, Version 1.2, March 21, 2014.
PDAP Search Protocol, Version 1.0, March 21, 2014.
PDS Security Service Software Requirements and Design Document (SRD/SDD), Version 1.1, September 1, 2013.
PDS Deep Archive Software Requirements and Design Document (SRD/SDD)