Index

A B C D E F G H I J L M N O P R S T V W X
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form

A

aBundle(String) - Static method in class gov.nasa.pds.harvest.util.xml.XmlIs

aCollection(String) - Static method in class gov.nasa.pds.harvest.util.xml.XmlIs

add(String, String, XPathExpression) - Method in class gov.nasa.pds.harvest.util.xml.XPathCache

Get an item to the cache.

addLid(String) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Add a lid to the cache

addLids(Collection<String>) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Add multiple lids to the cache

addLidVid(String) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Add a lidvid to the cache

addLidVids(Collection<String>) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Add multiple lidvids to the cache

aLabel(String) - Static method in class gov.nasa.pds.harvest.util.xml.XmlIs

archive_status - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

auth - Variable in class gov.nasa.pds.harvest.cfg.RegistryType

autogenExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

autogenFields - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

AutogenFieldsType - Class in gov.nasa.pds.harvest.cfg

Determines how items found in the products should be indexed in the registry.

AutogenFieldsType() - Constructor for class gov.nasa.pds.harvest.cfg.AutogenFieldsType

B

baseDir - Variable in class gov.nasa.pds.harvest.cfg.XpathMapsType

BaseProcessor - Class in gov.nasa.pds.harvest.crawler

Base class to process PDS4 XML label files

BaseProcessor(HarvestConfigurationType, String) - Constructor for class gov.nasa.pds.harvest.crawler.BaseProcessor

Constructor.

basicExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

bundle - Variable in class gov.nasa.pds.harvest.cfg.BundlesType

BundleProcessor - Class in gov.nasa.pds.harvest.crawler

Process "Product_Bundle" products (PDS4 XML label files).

BundleProcessor(HarvestConfigurationType, String) - Constructor for class gov.nasa.pds.harvest.crawler.BundleProcessor

Constructor

bundles - Variable in class gov.nasa.pds.harvest.cfg.LoadType

BundlesType - Class in gov.nasa.pds.harvest.cfg

Unnecessary object to keep legacy format.

BundlesType() - Constructor for class gov.nasa.pds.harvest.cfg.BundlesType

BundleType - Class in gov.nasa.pds.harvest.cfg

Describe the bundle to be processed.

BundleType() - Constructor for class gov.nasa.pds.harvest.cfg.BundleType

C

cacheNonRegisteredInventory(File) - Method in class gov.nasa.pds.harvest.crawler.CollectionInventoryProcessor

Query Registry (Elasticsearch) to find existing (registered) products.

classFilter - Variable in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

clear() - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Clear the cache.

clear() - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

CliCommand - Interface in gov.nasa.pds.harvest.cmd

All Registry Manager command-line interface (CLI) commands such as "create-registry", "delete-registry", "load-data", etc.

close() - Method in class gov.nasa.pds.harvest.dao.MetadataWriter

close() - Method in class gov.nasa.pds.harvest.util.out.SupplementalWriter

collection - Variable in class gov.nasa.pds.harvest.cfg.BundleType

CollectionInventoryProcessor - Class in gov.nasa.pds.harvest.crawler

Process inventory files of "Product_Collection" products (PDS4 label files)

CollectionInventoryProcessor(boolean) - Constructor for class gov.nasa.pds.harvest.crawler.CollectionInventoryProcessor

Constructor

CollectionProcessor - Class in gov.nasa.pds.harvest.crawler

Process "Product_Collection" products (PDS4 XML label files).

CollectionProcessor(HarvestConfigurationType, String) - Constructor for class gov.nasa.pds.harvest.crawler.CollectionProcessor

Constructor.

CollectionType - Class in gov.nasa.pds.harvest.cfg

The collection's LID or LIDVID.

CollectionType() - Constructor for class gov.nasa.pds.harvest.cfg.CollectionType

config - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

ConfigManager - Class in gov.nasa.pds.harvest.cfg

Harvest configuration file reader.

ConfigManager() - Constructor for class gov.nasa.pds.harvest.cfg.ConfigManager

configure(String, String) - Static method in class gov.nasa.pds.harvest.util.log.Log4jConfigurator

Configure Log4j v2 logging library.

containsLid(String) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Check if the cache contains a lid

containsLidVid(String) - Method in class gov.nasa.pds.harvest.crawler.LidVidCache

Check if the cache contains a lidvid

count - Variable in class gov.nasa.pds.harvest.util.CounterMap.Item

Counter - Class in gov.nasa.pds.harvest.crawler

Counter of processed products.

Counter() - Constructor for class gov.nasa.pds.harvest.crawler.Counter

CounterMap - Class in gov.nasa.pds.harvest.util

Product counters (by product type).

CounterMap() - Constructor for class gov.nasa.pds.harvest.util.CounterMap

Constructor

CounterMap.Item - Class in gov.nasa.pds.harvest.util

Inner class to store counters by key.

createAutogenFieldsType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of AutogenFieldsType

createBundlesType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of BundlesType

createBundleType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of BundleType

createCollectionType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of CollectionType

createDirsType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of DirsType

createFileInfoType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of FileInfoType

createFileRefType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of FileRefType

createFilesType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of FilesType

createFilterType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of FilterType

createHarvest() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of Harvest

createHarvestConfigurationType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of HarvestConfigurationType

createLoadType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of LoadType

createMetadataNormalizer() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Create new metadata normalizer

createMissingFieldsProcessor() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Create new missing field processor

createProductType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of ProductType

createReferencesType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of ReferencesType

createRegistryType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of RegistryType

createXpathMapsType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of XpathMapsType

createXpathMapType() - Method in class gov.nasa.pds.harvest.cfg.ObjectFactory

Create an instance of XpathMapType

D

dataJson - Variable in class gov.nasa.pds.harvest.dao.RegistryDocBatch.NJsonItem

dataType - Variable in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

dbf - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

destroy() - Static method in class gov.nasa.pds.harvest.dao.RegistryManager

Clean up resources (close Elasticsearch client / connection).

destroy() - Static method in class gov.nasa.pds.harvest.util.out.WriterManager

Clean up resources / close files.

dir - Variable in class gov.nasa.pds.harvest.cfg.BundleType

dir - Variable in class gov.nasa.pds.harvest.cfg.ProductType

directories - Variable in class gov.nasa.pds.harvest.cfg.LoadType

DirsType - Class in gov.nasa.pds.harvest.cfg

Java class for dirs_type complex type.

DirsType() - Constructor for class gov.nasa.pds.harvest.cfg.DirsType

E

exchangeFileRef(List<FileRefType>) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

exchangeIndexForNode(String) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

exchangeLids(List<CollectionType>) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

exchangeLidvids(List<CollectionType>) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

exchangeRegistry(RegistryType) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

exclude - Variable in class gov.nasa.pds.harvest.cfg.FilterType

extract(Document, FieldMap) - Method in class gov.nasa.pds.harvest.meta.XPathExtractor

Extract metadata from a PDS label by XPath

F

failedFileCount - Variable in class gov.nasa.pds.harvest.crawler.Counter

fieldName - Variable in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

fileDataExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

fileInfo - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

FileInfoType - Class in gov.nasa.pds.harvest.cfg

Used to rename file locations from a local space to the install space.

FileInfoType() - Constructor for class gov.nasa.pds.harvest.cfg.FileInfoType

filePath - Variable in class gov.nasa.pds.harvest.cfg.XpathMapType

fileRef - Variable in class gov.nasa.pds.harvest.cfg.FileInfoType

FileRefType - Class in gov.nasa.pds.harvest.cfg

Describe the prefix of the filename to replace with new content.

FileRefType() - Constructor for class gov.nasa.pds.harvest.cfg.FileRefType

files - Variable in class gov.nasa.pds.harvest.cfg.LoadType

FilesProcessor - Class in gov.nasa.pds.harvest.crawler

Process PDS label files in a directory.

FilesProcessor(HarvestConfigurationType, String) - Constructor for class gov.nasa.pds.harvest.crawler.FilesProcessor

Constructor

FilesType - Class in gov.nasa.pds.harvest.cfg

Java class for files_type complex type.

FilesType() - Constructor for class gov.nasa.pds.harvest.cfg.FilesType

FilterType - Class in gov.nasa.pds.harvest.cfg

A simple container to hold two lists of strings, One for inclusion and the other for exclusion,

FilterType() - Constructor for class gov.nasa.pds.harvest.cfg.FilterType

flush() - Method in class gov.nasa.pds.harvest.dao.MetadataWriter

G

generate - Variable in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

getAuth() - Method in class gov.nasa.pds.harvest.cfg.RegistryType

Gets the value of the auth property.

getAutogenFields() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the autogenFields property.

getBaseDir() - Method in class gov.nasa.pds.harvest.cfg.XpathMapsType

Gets the value of the baseDir property.

getBundle() - Method in class gov.nasa.pds.harvest.cfg.BundlesType

Gets the value of the bundle property.

getBundles() - Method in class gov.nasa.pds.harvest.cfg.LoadType

Gets the value of the bundles property.

getCacheByObjectType(String) - Method in class gov.nasa.pds.harvest.meta.XPathCacheManager

Get a cache by object type, e.g., "Product_Collection"

getClassFilter() - Method in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

Gets the value of the classFilter property.

getCollection() - Method in class gov.nasa.pds.harvest.cfg.BundleType

Gets the value of the collection property.

getCollectionInventoryWriter() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get collection inventory writer

getCollectionRefsCache() - Method in class gov.nasa.pds.harvest.crawler.RefsCache

Get collection reference cache.

getCommonCache() - Method in class gov.nasa.pds.harvest.meta.XPathCacheManager

Get common cache.

getCounter() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get counter of processed products

getCounts() - Method in class gov.nasa.pds.harvest.util.CounterMap

Get all counters grouped by key.

getDataDictionaryDao() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get Data Dictionary DAO object.

getDir() - Method in class gov.nasa.pds.harvest.cfg.BundleType

Gets the value of the dir property.

getDir() - Method in class gov.nasa.pds.harvest.cfg.ProductType

Gets the value of the dir property.

getDirectories() - Method in class gov.nasa.pds.harvest.cfg.LoadType

Gets the value of the directories property.

getExclude() - Method in class gov.nasa.pds.harvest.cfg.FilterType

Gets the value of the exclude property.

getFieldNameCache() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get Field name cache

getFileInfo() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the fileInfo property.

getFilePath() - Method in class gov.nasa.pds.harvest.cfg.XpathMapType

Gets the value of the filePath property.

getFileRef() - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Gets the value of the fileRef property.

getFiles() - Method in class gov.nasa.pds.harvest.cfg.LoadType

Gets the value of the files property.

getInclude() - Method in class gov.nasa.pds.harvest.cfg.FilterType

Gets the value of the include property.

getIndexName() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

getInstance() - Static method in class gov.nasa.pds.harvest.crawler.RefsCache

Get singleton instance.

getInstance() - Static method in class gov.nasa.pds.harvest.dao.RegistryManager

Get the singleton instance.

getInstance() - Static method in class gov.nasa.pds.harvest.meta.XPathCacheManager

Get singleton instance.

getInstance() - Static method in class gov.nasa.pds.harvest.util.out.WriterManager

Get singleton instance.

getInstance() - Static method in class gov.nasa.pds.harvest.util.PackageIdGenerator

Get the singleton instance.

getItems() - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

getItems() - Method in class gov.nasa.pds.harvest.util.xml.XPathCache

Get all cached items.

getLid() - Method in class gov.nasa.pds.harvest.cfg.CollectionType

Gets the value of the lid property.

getLidvid() - Method in class gov.nasa.pds.harvest.cfg.CollectionType

Gets the value of the lidvid property.

getLidVids() - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

getLoad() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the load property.

getManifest() - Method in class gov.nasa.pds.harvest.cfg.FilesType

Gets the value of the manifest property.

getNonExistingIds(Collection<String>) - Method in class gov.nasa.pds.harvest.dao.RegistryDao

Check if given product IDs (lidvids) exist in Elasticsearch "registry" collection.

getPackageId() - Method in class gov.nasa.pds.harvest.util.PackageIdGenerator

Get package / Harvest run ID.

getPath() - Method in class gov.nasa.pds.harvest.cfg.DirsType

Gets the value of the path property.

getProdRefsCache() - Method in class gov.nasa.pds.harvest.crawler.RefsCache

Get product reference cache.

getProduct() - Method in class gov.nasa.pds.harvest.cfg.BundleType

Gets the value of the product property.

getProductFilter() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the productFilter property.

getReferences() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the references property.

getRegistry() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the registry property.

getRegistryDao() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get registry DAO object.

getRegistryWriter() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get registry writer

getReplacePrefix() - Method in class gov.nasa.pds.harvest.cfg.FileRefType

Gets the value of the replacePrefix property.

getRootElement() - Method in class gov.nasa.pds.harvest.cfg.XpathMapType

Gets the value of the rootElement property.

getSchemaDao() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get schema DAO object.

getSupplementalWriter() - Method in class gov.nasa.pds.harvest.util.out.WriterManager

Get a writer for supplemental products

getTotal() - Method in class gov.nasa.pds.harvest.util.CounterMap

Get total count.

getValue() - Method in class gov.nasa.pds.harvest.cfg.RegistryType

Gets the value of the value property.

getVersions() - Method in class gov.nasa.pds.harvest.cfg.BundleType

Gets the value of the versions property.

getWith() - Method in class gov.nasa.pds.harvest.cfg.FileRefType

Gets the value of the with property.

getXpathMap() - Method in class gov.nasa.pds.harvest.cfg.XpathMapsType

Gets the value of the xpathMap property.

getXpathMaps() - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Gets the value of the xpathMaps property.

gov.nasa.pds.harvest - package gov.nasa.pds.harvest

gov.nasa.pds.harvest.cfg - package gov.nasa.pds.harvest.cfg

gov.nasa.pds.harvest.cmd - package gov.nasa.pds.harvest.cmd

gov.nasa.pds.harvest.crawler - package gov.nasa.pds.harvest.crawler

gov.nasa.pds.harvest.dao - package gov.nasa.pds.harvest.dao

gov.nasa.pds.harvest.exception - package gov.nasa.pds.harvest.exception

gov.nasa.pds.harvest.meta - package gov.nasa.pds.harvest.meta

gov.nasa.pds.harvest.util - package gov.nasa.pds.harvest.util

gov.nasa.pds.harvest.util.log - package gov.nasa.pds.harvest.util.log

gov.nasa.pds.harvest.util.out - package gov.nasa.pds.harvest.util.out

gov.nasa.pds.harvest.util.xml - package gov.nasa.pds.harvest.util.xml

H

Harvest - Class in gov.nasa.pds.harvest.cfg

This terrible construct is so that xjc can autodetect this as the root node for processing.

Harvest() - Constructor for class gov.nasa.pds.harvest.cfg.Harvest

HarvestCli - Class in gov.nasa.pds.harvest

Harvest Command-Line Interface (CLI) manager / command runner.

HarvestCli() - Constructor for class gov.nasa.pds.harvest.HarvestCli

Constructor

HarvestCmd - Class in gov.nasa.pds.harvest.cmd

A CLI command to crawl files and process PDS4 labels.

HarvestCmd() - Constructor for class gov.nasa.pds.harvest.cmd.HarvestCmd

Constructor

HarvestConfigurationType - Class in gov.nasa.pds.harvest.cfg

These are the basic options for the harvest configuration file.

HarvestConfigurationType() - Constructor for class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

HarvestMain - Class in gov.nasa.pds.harvest

Main function / entry point.

HarvestMain() - Constructor for class gov.nasa.pds.harvest.HarvestMain

I

idExists(String) - Method in class gov.nasa.pds.harvest.dao.RegistryDao

Check if product id (lidvid) exists in "registry" index in Elasticsearch.

inc() - Method in class gov.nasa.pds.harvest.util.CounterMap.Item

inc(String) - Method in class gov.nasa.pds.harvest.util.CounterMap

Increment counter for the given key (product type).

include - Variable in class gov.nasa.pds.harvest.cfg.FilterType

init(ConnectionFactory, boolean) - Static method in class gov.nasa.pds.harvest.dao.RegistryManager

Initialize the singleton.

init(File) - Static method in class gov.nasa.pds.harvest.util.out.WriterManager

Create writers to write JSON data files with metadata extracted from PDS4 labels.

InvalidPDS4ProductException - Exception in gov.nasa.pds.harvest.exception

InvalidPDS4ProductException is a custom exception to throw when there is an error reading bundle/collection references.

InvalidPDS4ProductException(String) - Constructor for exception gov.nasa.pds.harvest.exception.InvalidPDS4ProductException

isEmpty() - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

isEmpty() - Method in class gov.nasa.pds.harvest.util.xml.XPathCache

Check if cache is empty.

isGenerate() - Method in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

Gets the value of the generate property.

isOverwrite() - Method in class gov.nasa.pds.harvest.dao.RegistryManager

Get overwrite flag

isPrimaryOnly() - Method in class gov.nasa.pds.harvest.cfg.ReferencesType

Gets the value of the primaryOnly property.

isProcessDataFiles() - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Gets the value of the processDataFiles property.

isStoreJsonLabels() - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Gets the value of the storeJsonLabels property.

isStoreLabels() - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Gets the value of the storeLabels property.

Item(String) - Constructor for class gov.nasa.pds.harvest.util.CounterMap.Item

Item(String, XPathExpression) - Constructor for class gov.nasa.pds.harvest.util.xml.XPathCache.Item

Constructor

J

jobId - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

L

LEVEL_SUMMARY - Static variable in class gov.nasa.pds.harvest.util.log.LogUtils

lid - Variable in class gov.nasa.pds.harvest.cfg.CollectionType

lidvid - Variable in class gov.nasa.pds.harvest.cfg.CollectionType

lidvid - Variable in class gov.nasa.pds.harvest.dao.RegistryDocBatch.NJsonItem

LidVidCache - Class in gov.nasa.pds.harvest.crawler

A cache of product ids (lids and lidvids)

LidVidCache() - Constructor for class gov.nasa.pds.harvest.crawler.LidVidCache

Constructor

load - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

load(XpathMapsType) - Method in class gov.nasa.pds.harvest.meta.XPathCacheLoader

Load XPaths from a configuration file

LoadType - Class in gov.nasa.pds.harvest.cfg

DEV notes: Had to bury this one deeper because cannot have a choice in an all.

LoadType() - Constructor for class gov.nasa.pds.harvest.cfg.LoadType

log - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

log - Variable in class gov.nasa.pds.harvest.crawler.CollectionInventoryProcessor

Log4jConfigurator - Class in gov.nasa.pds.harvest.util.log

Configure Log4j v2 logging library.

Log4jConfigurator() - Constructor for class gov.nasa.pds.harvest.util.log.Log4jConfigurator

LogUtils - Class in gov.nasa.pds.harvest.util.log

Helper methods and constants used by logger.

LogUtils() - Constructor for class gov.nasa.pds.harvest.util.log.LogUtils

M

main(String[]) - Static method in class gov.nasa.pds.harvest.HarvestMain

manifest - Variable in class gov.nasa.pds.harvest.cfg.FilesType

MAX_XML_FILE_LENGTH - Static variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

MetadataWriter - Class in gov.nasa.pds.harvest.dao

MetadataWriter(ConnectionFactory, RegistryDao, Counter) - Constructor for class gov.nasa.pds.harvest.dao.MetadataWriter

Constructor

N

name - Variable in class gov.nasa.pds.harvest.util.CounterMap.Item

NJsonItem() - Constructor for class gov.nasa.pds.harvest.dao.RegistryDocBatch.NJsonItem

O

ObjectFactory - Class in gov.nasa.pds.harvest.cfg

This object contains factory methods for each Java content interface and Java element interface generated in the gov.nasa.pds.harvest.cfg package.

ObjectFactory() - Constructor for class gov.nasa.pds.harvest.cfg.ObjectFactory

Create a new ObjectFactory that can be used to create new instances of schema derived classes for package: gov.nasa.pds.harvest.cfg

onFile(File) - Method in class gov.nasa.pds.harvest.crawler.ProductProcessor

Process one file

P

PackageIdGenerator - Class in gov.nasa.pds.harvest.util

Singleton to generate package / Harvest run IDs.

path - Variable in class gov.nasa.pds.harvest.cfg.DirsType

pkJson - Variable in class gov.nasa.pds.harvest.dao.RegistryDocBatch.NJsonItem

primaryOnly - Variable in class gov.nasa.pds.harvest.cfg.ReferencesType

printHelp() - Static method in class gov.nasa.pds.harvest.HarvestCli

Print help screen.

printVersion() - Static method in class gov.nasa.pds.harvest.HarvestCli

Print Harvest version

process(BundleType) - Method in class gov.nasa.pds.harvest.crawler.BundleProcessor

Process one bundle configuration from Harvest configuration file.

process(BundleType) - Method in class gov.nasa.pds.harvest.crawler.CollectionProcessor

Process collections of a bundle.

process(BundleType) - Method in class gov.nasa.pds.harvest.crawler.ProductProcessor

Process products of a bundle

processDataFiles - Variable in class gov.nasa.pds.harvest.cfg.FileInfoType

processDirectory(File) - Method in class gov.nasa.pds.harvest.crawler.FilesProcessor

Process a directory

processManifest(File) - Method in class gov.nasa.pds.harvest.crawler.FilesProcessor

Process a manifest (file list) file

prodClass - Variable in class gov.nasa.pds.harvest.dao.RegistryDocBatch.NJsonItem

prodCounters - Variable in class gov.nasa.pds.harvest.crawler.Counter

product - Variable in class gov.nasa.pds.harvest.cfg.BundleType

productFilter - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

ProductProcessor - Class in gov.nasa.pds.harvest.crawler

Process products (PDS4 XML label files) excluding collections and bundles.

ProductProcessor(HarvestConfigurationType, String) - Constructor for class gov.nasa.pds.harvest.crawler.ProductProcessor

Constructor

ProductType - Class in gov.nasa.pds.harvest.cfg

Java class for product_type complex type.

ProductType() - Constructor for class gov.nasa.pds.harvest.cfg.ProductType

R

read(File) - Static method in class gov.nasa.pds.harvest.cfg.ConfigManager

references - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

ReferencesType - Class in gov.nasa.pds.harvest.cfg

Seems like a forgotten idea

ReferencesType() - Constructor for class gov.nasa.pds.harvest.cfg.ReferencesType

refExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

RefsCache - Class in gov.nasa.pds.harvest.crawler

Product and collection reference cache.

registry - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

RegistryDao - Class in gov.nasa.pds.harvest.dao

Elasticsearch "registry" index Data Access Object (DAO).

RegistryDao(RestClient, String) - Constructor for class gov.nasa.pds.harvest.dao.RegistryDao

Constructor

RegistryDao(RestClient, String, boolean) - Constructor for class gov.nasa.pds.harvest.dao.RegistryDao

Constructor.

RegistryDocBatch - Class in gov.nasa.pds.harvest.dao

A batch of NJSON documents to be loaded into Elasticsearch

RegistryDocBatch() - Constructor for class gov.nasa.pds.harvest.dao.RegistryDocBatch

Constructor

RegistryDocBatch.NJsonItem - Class in gov.nasa.pds.harvest.dao

RegistryManager - Class in gov.nasa.pds.harvest.dao

A singleton object to query Elasticsearch.

RegistryType - Class in gov.nasa.pds.harvest.cfg

Define the connection to the registry, security for the connection, and the index within the registry.

RegistryType() - Constructor for class gov.nasa.pds.harvest.cfg.RegistryType

replacePrefix - Variable in class gov.nasa.pds.harvest.cfg.FileRefType

reset() - Method in class gov.nasa.pds.harvest.util.PackageIdGenerator

Reset / create new ID.

rootElement - Variable in class gov.nasa.pds.harvest.cfg.XpathMapType

run(String[]) - Method in class gov.nasa.pds.harvest.HarvestCli

Parse command line arguments and run commands.

run(CommandLine) - Method in interface gov.nasa.pds.harvest.cmd.CliCommand

Run CLI command.

run(CommandLine) - Method in class gov.nasa.pds.harvest.cmd.HarvestCmd

Run this command.

S

save(Metadata, XmlNamespaces) - Method in class gov.nasa.pds.harvest.crawler.BaseProcessor

searchExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

setAuth(String) - Method in class gov.nasa.pds.harvest.cfg.RegistryType

Sets the value of the auth property.

setAutogenFields(AutogenFieldsType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the autogenFields property.

setBaseDir(String) - Method in class gov.nasa.pds.harvest.cfg.XpathMapsType

Sets the value of the baseDir property.

setBundles(BundlesType) - Method in class gov.nasa.pds.harvest.cfg.LoadType

Sets the value of the bundles property.

setClassFilter(FilterType) - Method in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

Sets the value of the classFilter property.

setDataType(String) - Method in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

Set item data type.

setDir(String) - Method in class gov.nasa.pds.harvest.cfg.BundleType

Sets the value of the dir property.

setDir(String) - Method in class gov.nasa.pds.harvest.cfg.ProductType

Sets the value of the dir property.

setDirectories(DirsType) - Method in class gov.nasa.pds.harvest.cfg.LoadType

Sets the value of the directories property.

setFileInfo(FileInfoType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the fileInfo property.

setFilePath(String) - Method in class gov.nasa.pds.harvest.cfg.XpathMapType

Sets the value of the filePath property.

setFiles(FilesType) - Method in class gov.nasa.pds.harvest.cfg.LoadType

Sets the value of the files property.

setGenerate(Boolean) - Method in class gov.nasa.pds.harvest.cfg.AutogenFieldsType

Sets the value of the generate property.

setLid(String) - Method in class gov.nasa.pds.harvest.cfg.CollectionType

Sets the value of the lid property.

setLidvid(String) - Method in class gov.nasa.pds.harvest.cfg.CollectionType

Sets the value of the lidvid property.

setLoad(LoadType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the load property.

setOverwriteExisting(boolean) - Method in class gov.nasa.pds.harvest.dao.MetadataWriter

setPrimaryOnly(Boolean) - Method in class gov.nasa.pds.harvest.cfg.ReferencesType

Sets the value of the primaryOnly property.

setProcessDataFiles(Boolean) - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Sets the value of the processDataFiles property.

setProductFilter(FilterType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the productFilter property.

setReferences(ReferencesType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the references property.

setRegistry(RegistryType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the registry property.

setReplacePrefix(String) - Method in class gov.nasa.pds.harvest.cfg.FileRefType

Sets the value of the replacePrefix property.

setRootElement(String) - Method in class gov.nasa.pds.harvest.cfg.XpathMapType

Sets the value of the rootElement property.

setStoreJsonLabels(Boolean) - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Sets the value of the storeJsonLabels property.

setStoreLabels(Boolean) - Method in class gov.nasa.pds.harvest.cfg.FileInfoType

Sets the value of the storeLabels property.

setValue(String) - Method in class gov.nasa.pds.harvest.cfg.RegistryType

Sets the value of the value property.

setVersions(String) - Method in class gov.nasa.pds.harvest.cfg.BundleType

Sets the value of the versions property.

setWith(String) - Method in class gov.nasa.pds.harvest.cfg.FileRefType

Sets the value of the with property.

setXpathMaps(XpathMapsType) - Method in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

Sets the value of the xpathMaps property.

size() - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

skippedFileCount - Variable in class gov.nasa.pds.harvest.crawler.Counter

storeJsonLabels - Variable in class gov.nasa.pds.harvest.cfg.FileInfoType

storeLabels - Variable in class gov.nasa.pds.harvest.cfg.FileInfoType

SupplementalWriter - Class in gov.nasa.pds.harvest.util.out

Write a list of file paths of supplemental product labels.

SupplementalWriter(File) - Constructor for class gov.nasa.pds.harvest.util.out.SupplementalWriter

Constructor

T

TYPE_DATE - Static variable in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

TYPE_STRING - Static variable in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

V

value - Variable in class gov.nasa.pds.harvest.cfg.RegistryType

versions - Variable in class gov.nasa.pds.harvest.cfg.BundleType

W

with - Variable in class gov.nasa.pds.harvest.cfg.FileRefType

write(ConnectionFactory, Metadata, String) - Method in class gov.nasa.pds.harvest.dao.RegistryDocBatch

write(Metadata) - Method in class gov.nasa.pds.harvest.dao.MetadataWriter

write(File) - Method in class gov.nasa.pds.harvest.util.out.SupplementalWriter

Write supplemental product label file path

WriterManager - Class in gov.nasa.pds.harvest.util.out

Singleton to hold references to registry metadata, collection inventory (product references) and other data writers.

X

XmlIs - Class in gov.nasa.pds.harvest.util.xml

XmlIs() - Constructor for class gov.nasa.pds.harvest.util.xml.XmlIs

XPathCache - Class in gov.nasa.pds.harvest.util.xml

XPath cache is used to map a field in a PDS4 label (by its XPath) to a registry field name.

XPathCache() - Constructor for class gov.nasa.pds.harvest.util.xml.XPathCache

Constructor.

XPathCache.Item - Class in gov.nasa.pds.harvest.util.xml

Inner class representing one cache record / item.

XPathCacheLoader - Class in gov.nasa.pds.harvest.meta

Loads XPaths from a configuration file into XPath cache.

XPathCacheLoader() - Constructor for class gov.nasa.pds.harvest.meta.XPathCacheLoader

Constructor

XPathCacheManager - Class in gov.nasa.pds.harvest.meta

A singleton.

xpathExtractor - Variable in class gov.nasa.pds.harvest.crawler.BaseProcessor

XPathExtractor - Class in gov.nasa.pds.harvest.meta

Extract data from PDS4 label by XPath

XPathExtractor() - Constructor for class gov.nasa.pds.harvest.meta.XPathExtractor

Constructor

xpathMap - Variable in class gov.nasa.pds.harvest.cfg.XpathMapsType

xpathMaps - Variable in class gov.nasa.pds.harvest.cfg.HarvestConfigurationType

XpathMapsType - Class in gov.nasa.pds.harvest.cfg

The xpaths to apply to PDS4 labels for determining harvesting.

XpathMapsType() - Constructor for class gov.nasa.pds.harvest.cfg.XpathMapsType

XpathMapType - Class in gov.nasa.pds.harvest.cfg

Point at an xpath file to apply against PDS4 labels.

XpathMapType() - Constructor for class gov.nasa.pds.harvest.cfg.XpathMapType

xpe - Variable in class gov.nasa.pds.harvest.util.xml.XPathCache.Item

A B C D E F G H I J L M N O P R S T V W X
All Classes and Interfaces|All Packages|Constant Field Values|Serialized Form