org.apache.oodt.cas.crawl

Class ProductCrawler

java.lang.Object

org.apache.oodt.cas.crawl.config.ProductCrawlerBean

org.apache.oodt.cas.crawl.ProductCrawler

All Implemented Interfaces:

CoreMetKeys, SpringSetIdInjectionType

Direct Known Subclasses:

AutoDetectProductCrawler, MetExtractorProductCrawler, StdProductCrawler

public abstract class ProductCrawler
extends ProductCrawlerBean

An abstract base class for Product Crawling. This class provides methods to communicate with the file manager and parse met files that show how to ingest a particular Product into the File Manager.

Author:

mattmann (Chris Mattmann), bfoster (Brian Foster)

Field Summary

Fields

Modifier and Type	Field and Description
protected CrawlerActionRepo	actionRepo
protected static FileFilter	DIR_FILTER
protected static FileFilter	FILE_FILTER
protected Ingester	ingester
protected List<IngestStatus>	ingestStatus
protected static Logger	LOG

Fields inherited from interface org.apache.oodt.cas.filemgr.metadata.CoreMetKeys

FILE_LOCATION, FILE_SIZE, FILENAME, MIME_TYPE, PRODUCT_ID, PRODUCT_NAME, PRODUCT_RECEVIED_TIME, PRODUCT_STRUCTURE, PRODUCT_TYPE

Constructor Summary

Constructors

Constructor and Description
ProductCrawler()

Method Summary

Modifier and Type	Method and Description
void	crawl()
void	crawl(File dirRoot)
List<IngestStatus>	getIngestStatus()
protected abstract Metadata	getMetadataForProduct(File product)
IngestStatus	handleFile(File product)
protected abstract boolean	passesPreconditions(File product)
protected abstract File	renameProduct(File product, Metadata productMetadata)

Methods inherited from class org.apache.oodt.cas.crawl.config.ProductCrawlerBean

getActionIds, getApplicationContext, getClientTransferer, getDaemonPort, getDaemonWait, getFilemgrUrl, getGlobalMetadata, getId, getProductPath, getRequiredMetadata, isCrawlForDirs, isNoRecur, isSkipIngest, setActionIds, setApplicationContext, setClientTransferer, setCrawlForDirs, setDaemonPort, setDaemonWait, setFilemgrUrl, setGlobalMetadata, setId, setNoRecur, setProductPath, setRequiredMetadata, setSkipIngest

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

LOG

protected static Logger LOG

DIR_FILTER

protected static FileFilter DIR_FILTER

FILE_FILTER

protected static FileFilter FILE_FILTER

ingestStatus

protected List<IngestStatus> ingestStatus

actionRepo

protected CrawlerActionRepo actionRepo

ingester

protected Ingester ingester

Constructor Detail

ProductCrawler

public ProductCrawler()

Method Detail

crawl

public void crawl()

crawl

public void crawl(File dirRoot)

handleFile

public IngestStatus handleFile(File product)

getIngestStatus

public List<IngestStatus> getIngestStatus()

passesPreconditions

protected abstract boolean passesPreconditions(File product)

getMetadataForProduct

protected abstract Metadata getMetadataForProduct(File product)
                                           throws Exception

Throws:

Exception

renameProduct

protected abstract File renameProduct(File product,
                                      Metadata productMetadata)
                               throws Exception

Throws:

Exception