Package | Description |
---|---|
org.apache.manifoldcf.agents.incrementalingest | |
org.apache.manifoldcf.agents.interfaces | |
org.apache.manifoldcf.crawler.system |
Modifier and Type | Field and Description |
---|---|
IPipelineSpecification |
IncrementalIngester.PipelineObject.pipelineConnections |
Modifier and Type | Method and Description |
---|---|
boolean |
IncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
Date date,
IOutputCheckActivity activity)
Check if a date is indexable.
|
boolean |
IncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
protected static String |
IncrementalIngester.computePackedTransformationVersion(IPipelineSpecification pipelineSpecification,
int stage)
Compute a transformation version given a pipeline specification and starting output stage.
|
protected IncrementalIngester.PipelineObject |
IncrementalIngester.pipelineGrab(IPipelineSpecification pipelineConnections)
Grab the entire pipeline.
|
Constructor and Description |
---|
IncrementalIngester.PipelineObject(IPipelineSpecification pipelineConnections,
ITransformationConnector[] transformationConnectors,
IOutputConnector[] outputConnectors) |
Modifier and Type | Interface and Description |
---|---|
interface |
IPipelineSpecificationWithVersions
This interface describes a multi-output pipeline, with existing document version information from
each output..
|
Modifier and Type | Method and Description |
---|---|
boolean |
IIncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
Date date,
IOutputCheckActivity activity)
Check if a document date is indexable.
|
boolean |
IIncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IIncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IIncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IIncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
Modifier and Type | Class and Description |
---|---|
class |
PipelineSpecification
Class which handles pipeline specifications that include current (new) description strings.
|
class |
PipelineSpecificationWithVersions
Class which handles pipeline specifications, including both new versions and old versions.
|
Modifier and Type | Field and Description |
---|---|
protected IPipelineSpecification |
PipelineSpecificationWithVersions.pipelineSpecification |
protected IPipelineSpecification |
WorkerThread.ProcessActivity.pipelineSpecification |
Constructor and Description |
---|
PipelineSpecificationWithVersions(IPipelineSpecification pipelineSpecification,
QueuedDocument queuedDocument,
String componentIDHash) |
WorkerThread.ProcessActivity(Long jobID,
String processID,
IReprioritizationTracker rt,
IJobManager jobManager,
IIncrementalIngester ingester,
String connectionName,
IPipelineSpecification pipelineSpecification,
Map<String,QueuedDocument> previousDocuments,
long currentTime,
Long expireInterval,
Map<String,Set<String>> forcedMetadata,
Long recrawlInterval,
Long maxInterval,
int hopcountMode,
IRepositoryConnection connection,
IRepositoryConnector connector,
IRepositoryConnectionManager connMgr,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
String parameterVersion)
Constructor.
|