Package | Description |
---|---|
org.apache.manifoldcf.crawler.system |
Modifier and Type | Field and Description |
---|---|
protected QueuedDocument |
WorkerThread.DocumentToProcess.document |
protected QueuedDocument[] |
QueuedDocumentSet.documents
This is the array of QueuedDocument objects.
|
protected QueuedDocument |
PipelineSpecificationWithVersions.queuedDocument |
Modifier and Type | Field and Description |
---|---|
protected Map<String,QueuedDocument> |
WorkerThread.ExistingVersions.map |
protected Map<String,QueuedDocument> |
WorkerThread.ProcessActivity.previousDocuments |
Modifier and Type | Method and Description |
---|---|
QueuedDocument |
WorkerThread.DocumentToProcess.getDocument()
Get the document.
|
QueuedDocument |
QueuedDocumentSet.getDocument(int index)
Get the nth document.
|
Modifier and Type | Method and Description |
---|---|
protected static List<QueuedDocument> |
WorkerThread.removeFromIndex(IPipelineConnections pipelineConnections,
String connectionName,
IJobManager jobManager,
List<QueuedDocument> deleteList,
IIncrementalIngester ingester,
WorkerThread.OutputActivity ingestLogger)
Remove a specified set of documents from the index.
|
Modifier and Type | Method and Description |
---|---|
protected static String |
WorkerThread.makeListString(List<QueuedDocument> sourceList) |
protected static void |
WorkerThread.moveList(List<QueuedDocument> sourceList,
List<QueuedDocument> targetList) |
protected static void |
WorkerThread.moveList(List<QueuedDocument> sourceList,
List<QueuedDocument> targetList) |
protected static void |
WorkerThread.processDeleteLists(IPipelineConnections pipelineConnections,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
List<QueuedDocument> deleteList,
IIncrementalIngester ingester,
Long jobID,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Clear specified documents out of the job queue and from the appliance.
|
protected static void |
WorkerThread.processHopcountRemovalLists(IPipelineConnections pipelineConnections,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
List<QueuedDocument> hopcountremoveList,
IIncrementalIngester ingester,
Long jobID,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Mark specified documents as 'hopcount removed', and remove them from the
index.
|
protected static void |
WorkerThread.processJobQueueDeletions(List<QueuedDocument> jobmanagerDeleteList,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
Long jobID,
String[] legalLinkTypes,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Process job queue deletions.
|
protected static void |
WorkerThread.processJobQueueHopcountRemovals(List<QueuedDocument> jobmanagerRemovalList,
IRepositoryConnector connector,
IRepositoryConnection connection,
IJobManager jobManager,
Long jobID,
String[] legalLinkTypes,
int hopcountMethod,
IReprioritizationTracker rt,
long currentTime)
Process job queue hopcount removals.
|
protected static List<QueuedDocument> |
WorkerThread.removeFromIndex(IPipelineConnections pipelineConnections,
String connectionName,
IJobManager jobManager,
List<QueuedDocument> deleteList,
IIncrementalIngester ingester,
WorkerThread.OutputActivity ingestLogger)
Remove a specified set of documents from the index.
|
protected static void |
WorkerThread.requeueDocuments(IJobManager jobManager,
List<QueuedDocument> requeueList,
long retryTime,
long failTime,
int failCount)
Requeue documents after a service interruption was detected.
|
Constructor and Description |
---|
PipelineSpecificationWithVersions(IPipelineSpecification pipelineSpecification,
QueuedDocument queuedDocument,
String componentIDHash) |
WorkerThread.DocumentToProcess(QueuedDocument document,
boolean scanOnly)
Construct.
|
Constructor and Description |
---|
QueuedDocumentSet(List<QueuedDocument> documents,
IJobDescription jobDescription,
IRepositoryConnection connection)
Constructor.
|
WorkerThread.ExistingVersions(String lastOutputConnectionName,
List<QueuedDocument> list) |
WorkerThread.ProcessActivity(Long jobID,
String processID,
IReprioritizationTracker rt,
IJobManager jobManager,
IIncrementalIngester ingester,
String connectionName,
IPipelineSpecification pipelineSpecification,
Map<String,QueuedDocument> previousDocuments,
long currentTime,
Long expireInterval,
Map<String,Set<String>> forcedMetadata,
Long recrawlInterval,
Long maxInterval,
int hopcountMode,
IRepositoryConnection connection,
IRepositoryConnector connector,
IRepositoryConnectionManager connMgr,
String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger,
String parameterVersion)
Constructor.
|