Modifier and Type | Method and Description |
---|---|
protected XMLContext |
XMLContext.beginTag(String namespaceURI,
String localName,
String qName,
Attributes atts)
This method is meant to be extended by classes that extend this class.
|
protected XMLContext |
XMLWriterContext.beginTag(String namespaceURI,
String localName,
String qName,
Attributes atts)
Start a child tag.
|
protected void |
XMLContext.endTag()
This method is meant to be extended by classes that extend this class
|
protected void |
XMLWriterContext.endTag()
End a child tag.
|
void |
XMLStream.parse(InputStream xmlInputStream) |
protected void |
XMLContext.tagContents(char[] ch,
int start,
int length)
This method is meant to be extended by classes that extend this class
|
Modifier and Type | Method and Description |
---|---|
int |
IncrementalIngester.PipelineAddEntryPoint.addOrReplaceDocumentWithException(String documentURI,
RepositoryDocument document) |
int |
IncrementalIngester.OutputAddEntryPoint.addOrReplaceDocumentWithException(String documentURI,
RepositoryDocument document) |
int |
IncrementalIngester.PipelineObjectWithVersions.addOrReplaceDocumentWithException(String docKey,
String componentHash,
String documentURI,
RepositoryDocument document,
String newDocumentVersion,
String newParameterVersion,
String authorityNameString,
IOutputActivity finalActivity,
long ingestTime) |
boolean |
IncrementalIngester.OutputAddActivitiesWrapper.checkDateIndexable(Date date)
Detect if a date is acceptable downstream or not.
|
boolean |
IncrementalIngester.PipelineCheckFanout.checkDateIndexable(Date date) |
boolean |
IncrementalIngester.PipelineCheckEntryPoint.checkDateIndexable(Date date) |
boolean |
IncrementalIngester.PipelineAddFanout.checkDateIndexable(Date date) |
boolean |
IncrementalIngester.PipelineAddEntryPoint.checkDateIndexable(Date date) |
boolean |
IncrementalIngester.MonitoredAddActivityWrapper.checkDateIndexable(Date date)
Detect if a date is acceptable downstream or not.
|
boolean |
IncrementalIngester.PipelineObject.checkDateIndexable(Date date,
IOutputCheckActivity finalActivity) |
boolean |
IncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
Date date,
IOutputCheckActivity activity)
Check if a date is indexable.
|
boolean |
IncrementalIngester.OutputAddActivitiesWrapper.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineCheckFanout.checkDocumentIndexable(File localFile) |
boolean |
IncrementalIngester.PipelineCheckEntryPoint.checkDocumentIndexable(File localFile) |
boolean |
IncrementalIngester.PipelineAddFanout.checkDocumentIndexable(File localFile) |
boolean |
IncrementalIngester.PipelineAddEntryPoint.checkDocumentIndexable(File localFile) |
boolean |
IncrementalIngester.MonitoredAddActivityWrapper.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineObject.checkDocumentIndexable(File localFile,
IOutputCheckActivity finalActivity) |
boolean |
IncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IncrementalIngester.OutputAddActivitiesWrapper.checkLengthIndexable(long length)
Pre-determine whether a document's length is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineCheckFanout.checkLengthIndexable(long length) |
boolean |
IncrementalIngester.PipelineCheckEntryPoint.checkLengthIndexable(long length) |
boolean |
IncrementalIngester.PipelineAddFanout.checkLengthIndexable(long length) |
boolean |
IncrementalIngester.PipelineAddEntryPoint.checkLengthIndexable(long length) |
boolean |
IncrementalIngester.MonitoredAddActivityWrapper.checkLengthIndexable(long length)
Pre-determine whether a document's length is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineObject.checkLengthIndexable(long length,
IOutputCheckActivity finalActivity) |
boolean |
IncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IncrementalIngester.OutputAddActivitiesWrapper.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is acceptable downstream or not.
|
boolean |
IncrementalIngester.PipelineCheckFanout.checkMimeTypeIndexable(String mimeType) |
boolean |
IncrementalIngester.PipelineCheckEntryPoint.checkMimeTypeIndexable(String mimeType) |
boolean |
IncrementalIngester.PipelineAddFanout.checkMimeTypeIndexable(String mimeType) |
boolean |
IncrementalIngester.PipelineAddEntryPoint.checkMimeTypeIndexable(String mimeType) |
boolean |
IncrementalIngester.MonitoredAddActivityWrapper.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is acceptable downstream or not.
|
boolean |
IncrementalIngester.PipelineObject.checkMimeTypeIndexable(String mimeType,
IOutputCheckActivity finalActivity) |
boolean |
IncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
boolean |
IncrementalIngester.OutputAddActivitiesWrapper.checkURLIndexable(String url)
Pre-determine whether a document's URL is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineCheckFanout.checkURLIndexable(String uri) |
boolean |
IncrementalIngester.PipelineCheckEntryPoint.checkURLIndexable(String uri) |
boolean |
IncrementalIngester.PipelineAddFanout.checkURLIndexable(String uri) |
boolean |
IncrementalIngester.PipelineAddEntryPoint.checkURLIndexable(String uri) |
boolean |
IncrementalIngester.MonitoredAddActivityWrapper.checkURLIndexable(String url)
Pre-determine whether a document's URL is acceptable downstream.
|
boolean |
IncrementalIngester.PipelineObject.checkURLIndexable(String uri,
IOutputCheckActivity finalActivity) |
void |
IncrementalIngester.documentDelete(IPipelineConnections pipelineConnections,
String identifierClass,
String identifierHash,
IOutputRemoveActivity activities)
Delete a document from the search engine index.
|
void |
IncrementalIngester.documentDeleteMultiple(IPipelineConnections[] pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
IOutputRemoveActivity activities)
Delete multiple documents from the search engine index.
|
void |
IncrementalIngester.documentDeleteMultiple(IPipelineConnections pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
IOutputRemoveActivity activities)
Delete multiple documents from the search engine index.
|
boolean |
IncrementalIngester.documentIngest(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
String identifierClass,
String identifierHash,
String componentHash,
String documentVersion,
String parameterVersion,
String authorityName,
RepositoryDocument data,
long ingestTime,
String documentURI,
IOutputActivity activities)
Ingest a document.
|
void |
IncrementalIngester.documentNoData(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
String identifierClass,
String identifierHash,
String componentHash,
String documentVersion,
String parameterVersion,
String authorityName,
long recordTime,
IOutputActivity activities)
Remove a document from specified indexes, just as if an empty document
was indexed, and record the necessary version information.
|
void |
IncrementalIngester.documentRemove(IPipelineConnections pipelineConnections,
String identifierClass,
String identifierHash,
String componentHash,
IOutputRemoveActivity activities)
Remove a document component from the search engine index.
|
void |
IncrementalIngester.documentRemoveMultiple(IPipelineConnections pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
String componentHash,
IOutputRemoveActivity activities)
Remove multiple document components from the search engine index.
|
VersionContext |
IncrementalIngester.getOutputDescription(IOutputConnection outputConnection,
Specification spec)
Get an output version string for a document.
|
VersionContext |
IncrementalIngester.getTransformationDescription(ITransformationConnection transformationConnection,
Specification spec)
Get transformation version string for a document.
|
void |
IncrementalIngester.OutputAddActivitiesWrapper.noDocument()
Send NO document via the pipeline to the next output connection.
|
void |
IncrementalIngester.PipelineAddFanout.noDocument()
Send NO document via the pipeline to the next output connection.
|
void |
IncrementalIngester.PipelineAddEntryPoint.noDocument() |
void |
IncrementalIngester.OutputAddEntryPoint.noDocument() |
void |
IncrementalIngester.MonitoredAddActivityWrapper.noDocument()
Send NO document via the pipeline to the next output connection.
|
void |
IncrementalIngester.PipelineObjectWithVersions.noDocument(String docKey,
String componentHash,
String newDocumentVersion,
String newParameterVersion,
String authorityNameString,
IOutputActivity finalActivity,
long ingestTime) |
protected void |
IncrementalIngester.removeDocument(IOutputConnection connection,
String documentURI,
String outputDescription,
IOutputRemoveActivity activities)
Remove document, using the specified output connection, via the standard pool.
|
int |
IncrementalIngester.OutputAddActivitiesWrapper.sendDocument(String documentURI,
RepositoryDocument document)
Send a document via the pipeline to the next output connection.
|
int |
IncrementalIngester.PipelineAddFanout.sendDocument(String documentURI,
RepositoryDocument document)
Send a document via the pipeline to the next output connection.
|
int |
IncrementalIngester.MonitoredAddActivityWrapper.sendDocument(String documentURI,
RepositoryDocument document)
Send a document via the pipeline to the next output connection.
|
Modifier and Type | Method and Description |
---|---|
int |
IPipelineConnector.addOrReplaceDocumentWithException(String documentURI,
VersionContext pipelineDescription,
RepositoryDocument document,
String authorityNameString,
IOutputAddActivity activities)
Add (or replace) a document in the output data store using the connector.
|
boolean |
IOutputCheckActivity.checkDateIndexable(Date date)
Detect if a document date is acceptable downstream or not.
|
boolean |
IIncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
Date date,
IOutputCheckActivity activity)
Check if a document date is indexable.
|
boolean |
IPipelineConnector.checkDateIndexable(VersionContext pipelineDescription,
Date date,
IOutputCheckActivity checkActivity)
Detect if a document date is acceptable or not.
|
boolean |
IOutputCheckActivity.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is acceptable downstream.
|
boolean |
ITransformationCheckActivity.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is acceptable downstream.
|
boolean |
IIncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IPipelineConnector.checkDocumentIndexable(VersionContext pipelineDescription,
File localFile,
IOutputCheckActivity checkActivity)
Pre-determine whether a document (passed here as a File object) is acceptable or not.
|
boolean |
IIncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IOutputCheckActivity.checkLengthIndexable(long length)
Pre-determine whether a document's length is acceptable downstream.
|
boolean |
ITransformationCheckActivity.checkLengthIndexable(long length)
Pre-determine whether a document's length is acceptable downstream.
|
boolean |
IPipelineConnector.checkLengthIndexable(VersionContext pipelineDescription,
long length,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's length is acceptable.
|
boolean |
IIncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IOutputCheckActivity.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is acceptable downstream or not.
|
boolean |
ITransformationCheckActivity.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is acceptable downstream or not.
|
boolean |
IPipelineConnector.checkMimeTypeIndexable(VersionContext pipelineDescription,
String mimeType,
IOutputCheckActivity checkActivity)
Detect if a mime type is acceptable or not.
|
boolean |
IIncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
boolean |
IOutputCheckActivity.checkURLIndexable(String url)
Pre-determine whether a document's URL is acceptable downstream.
|
boolean |
ITransformationCheckActivity.checkURLIndexable(String url)
Pre-determine whether a document's URL is acceptable downstream.
|
boolean |
IPipelineConnector.checkURLIndexable(VersionContext pipelineDescription,
String url,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's URL is acceptable.
|
void |
IIncrementalIngester.documentDelete(IPipelineConnections pipelineConnections,
String identifierClass,
String identifierHash,
IOutputRemoveActivity activities)
Delete a document, and all its components, from the search engine index.
|
void |
IIncrementalIngester.documentDeleteMultiple(IPipelineConnections[] pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
IOutputRemoveActivity activities)
Delete multiple documents, and their components, from the search engine index.
|
void |
IIncrementalIngester.documentDeleteMultiple(IPipelineConnections pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
IOutputRemoveActivity activities)
Delete multiple documents, and their components, from the search engine index.
|
boolean |
IIncrementalIngester.documentIngest(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
String identifierClass,
String identifierHash,
String componentHash,
String documentVersion,
String parameterVersion,
String authorityName,
RepositoryDocument data,
long ingestTime,
String documentURI,
IOutputActivity activities)
Ingest a document.
|
void |
IIncrementalIngester.documentNoData(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
String identifierClass,
String identifierHash,
String componentHash,
String documentVersion,
String parameterVersion,
String authorityName,
long recordTime,
IOutputActivity activities)
Remove a document from specified indexes, just as if an empty document
was indexed, and record the necessary version information.
|
void |
IIncrementalIngester.documentRemove(IPipelineConnections pipelineConnections,
String identifierClass,
String identifierHash,
String componentHash,
IOutputRemoveActivity activities)
Remove a document component from the search engine index.
|
void |
IIncrementalIngester.documentRemoveMultiple(IPipelineConnections pipelineConnections,
String[] identifierClasses,
String[] identifierHashes,
String componentHash,
IOutputRemoveActivity activities)
Remove multiple document components from the search engine index.
|
VersionContext |
IIncrementalIngester.getOutputDescription(IOutputConnection outputConnection,
Specification spec)
Get an output version string for a document.
|
VersionContext |
IPipelineConnector.getPipelineDescription(Specification spec)
Get a pipeline version object, given a pipeline specification object.
|
VersionContext |
IIncrementalIngester.getTransformationDescription(ITransformationConnection transformationConnection,
Specification spec)
Get transformation version string for a document.
|
void |
IOutputAddActivity.noDocument()
Send NO document via the pipeline to the next output connection.
|
void |
IOutputConnector.noteJobComplete(IOutputNotifyActivity activities)
Notify the connector of a completed job.
|
void |
IOutputConnector.removeDocument(String documentURI,
String outputDescription,
IOutputRemoveActivity activities)
Remove a document using the connector.
|
int |
IOutputAddActivity.sendDocument(String documentURI,
RepositoryDocument document)
Send a document via the pipeline to the next output connection.
|
Modifier and Type | Method and Description |
---|---|
int |
BaseOutputConnector.addOrReplaceDocument(String documentURI,
String outputDescription,
RepositoryDocument document,
String authorityNameString,
IOutputAddActivity activities)
Add (or replace) a document in the output data store using the connector.
|
int |
BaseOutputConnector.addOrReplaceDocumentWithException(String documentURI,
VersionContext pipelineDescription,
RepositoryDocument document,
String authorityNameString,
IOutputAddActivity activities)
Add (or replace) a document in the output data store using the connector.
|
boolean |
BaseOutputConnector.checkDateIndexable(VersionContext pipelineDescription,
Date date,
IOutputCheckActivity checkActivity)
Detect if a document date is acceptable or not.
|
boolean |
BaseOutputConnector.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is indexable by this connector.
|
boolean |
BaseOutputConnector.checkDocumentIndexable(String outputDescription,
File localFile)
Pre-determine whether a document (passed here as a File object) is indexable by this connector.
|
boolean |
BaseOutputConnector.checkDocumentIndexable(VersionContext pipelineDescription,
File localFile,
IOutputCheckActivity checkActivity)
Pre-determine whether a document (passed here as a File object) is acceptable or not.
|
boolean |
BaseOutputConnector.checkLengthIndexable(String outputDescription,
long length)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
BaseOutputConnector.checkLengthIndexable(VersionContext pipelineDescription,
long length,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's length is acceptable.
|
boolean |
BaseOutputConnector.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is indexable or not.
|
boolean |
BaseOutputConnector.checkMimeTypeIndexable(String outputDescription,
String mimeType)
Detect if a mime type is indexable or not.
|
boolean |
BaseOutputConnector.checkMimeTypeIndexable(VersionContext pipelineDescription,
String mimeType,
IOutputCheckActivity checkActivity)
Detect if a mime type is acceptable or not.
|
boolean |
BaseOutputConnector.checkURLIndexable(String outputDescription,
String url)
Pre-determine whether a document's URL is indexable by this connector.
|
boolean |
BaseOutputConnector.checkURLIndexable(VersionContext pipelineDescription,
String url,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's URL is acceptable.
|
String |
BaseOutputConnector.getOutputDescription(OutputSpecification spec)
Get an output version string, given an output specification.
|
VersionContext |
BaseOutputConnector.getPipelineDescription(Specification spec)
Get a pipeline version string, given a pipeline specification object.
|
void |
BaseOutputConnector.noteJobComplete(IOutputNotifyActivity activities)
Notify the connector of a completed job.
|
void |
BaseOutputConnector.removeDocument(String documentURI,
String outputDescription,
IOutputRemoveActivity activities)
Remove a document using the connector.
|
Modifier and Type | Method and Description |
---|---|
static void |
ManifoldCF.createServiceInterruptionNode(Configuration output,
ServiceInterruption e)
Handle a service interruption, by converting it to a serviceinterruption node.
|
Modifier and Type | Method and Description |
---|---|
int |
BaseTransformationConnector.addOrReplaceDocumentWithException(String documentURI,
VersionContext pipelineDescription,
RepositoryDocument document,
String authorityNameString,
IOutputAddActivity activities)
Add (or replace) a document in the output data store using the connector.
|
boolean |
BaseTransformationConnector.checkDateIndexable(VersionContext pipelineDescription,
Date date,
IOutputCheckActivity checkActivity)
Detect if a document date is acceptable or not.
|
boolean |
BaseTransformationConnector.checkDocumentIndexable(VersionContext pipelineDescription,
File localFile,
IOutputCheckActivity checkActivity)
Pre-determine whether a document (passed here as a File object) is acceptable or not.
|
boolean |
BaseTransformationConnector.checkLengthIndexable(VersionContext pipelineDescription,
long length,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's length is acceptable.
|
boolean |
BaseTransformationConnector.checkMimeTypeIndexable(VersionContext pipelineDescription,
String mimeType,
IOutputCheckActivity checkActivity)
Detect if a mime type is acceptable or not.
|
boolean |
BaseTransformationConnector.checkURLIndexable(VersionContext pipelineDescription,
String url,
IOutputCheckActivity checkActivity)
Pre-determine whether a document's URL is acceptable.
|
VersionContext |
BaseTransformationConnector.getPipelineDescription(Specification spec)
Get a pipeline version string, given a pipeline specification object.
|
Modifier and Type | Method and Description |
---|---|
void |
BaseRepositoryConnector.addSeedDocuments(ISeedingActivity activities,
DocumentSpecification spec,
long startTime,
long endTime)
Queue "seed" documents.
|
void |
BaseRepositoryConnector.addSeedDocuments(ISeedingActivity activities,
DocumentSpecification spec,
long startTime,
long endTime,
int jobMode) |
void |
BaseRepositoryConnector.addSeedDocuments(ISeedingActivity activities,
Specification spec,
long startTime,
long endTime,
int jobMode)
Queue "seed" documents.
|
String |
BaseRepositoryConnector.addSeedDocuments(ISeedingActivity activities,
Specification spec,
String lastSeedVersion,
long seedTime,
int jobMode)
Queue "seed" documents.
|
IDocumentIdentifierStream |
BaseRepositoryConnector.getDocumentIdentifiers(DocumentSpecification spec,
long startTime,
long endTime)
The short version of getDocumentIdentifiers.
|
IDocumentIdentifierStream |
BaseRepositoryConnector.getDocumentIdentifiers(ISeedingActivity activities,
DocumentSpecification spec,
long startTime,
long endTime)
The long version of getDocumentIdentifiers.
|
void |
BaseRepositoryConnector.getDocumentVersions(DocumentVersions documentVersions,
String[] documentIdentifiers,
String[] oldVersions,
IVersionActivity activities,
Specification spec,
int jobMode,
boolean usesDefaultAuthority)
Get document versions given an array of document identifiers.
|
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
DocumentSpecification spec)
The short version of getDocumentVersions.
|
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
IVersionActivity activities,
DocumentSpecification spec)
The long version of getDocumentIdentifiers.
|
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
String[] oldVersions,
IVersionActivity activities,
DocumentSpecification spec)
Get document versions given an array of document identifiers.
|
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
String[] oldVersions,
IVersionActivity activities,
DocumentSpecification spec,
int jobMode)
Get document versions given an array of document identifiers.
|
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
String[] oldVersions,
IVersionActivity activities,
DocumentSpecification spec,
int jobMode,
boolean usesDefaultAuthority) |
String[] |
BaseRepositoryConnector.getDocumentVersions(String[] documentIdentifiers,
String[] oldVersions,
IVersionActivity activities,
Specification spec,
int jobMode,
boolean usesDefaultAuthority)
Get document versions given an array of document identifiers.
|
IDocumentIdentifierStream |
BaseRepositoryConnector.getRemainingDocumentIdentifiers(ISeedingActivity activities,
DocumentSpecification spec,
long startTime,
long endTime)
This method returns the document identifiers that should be considered part of the seeds, but do not need to be
queued for processing at this time.
|
void |
BaseRepositoryConnector.processDocuments(String[] documentIdentifiers,
DocumentVersions versions,
IProcessActivity activities,
boolean[] scanOnly,
int jobMode)
Process a set of documents.
|
void |
BaseRepositoryConnector.processDocuments(String[] documentIdentifiers,
IExistingVersions statuses,
Specification spec,
IProcessActivity activities,
int jobMode,
boolean usesDefaultAuthority)
Process a set of documents.
|
void |
BaseRepositoryConnector.processDocuments(String[] documentIdentifiers,
String[] versions,
IProcessActivity activities,
DocumentSpecification spec,
boolean[] scanOnly)
Process a set of documents.
|
void |
BaseRepositoryConnector.processDocuments(String[] documentIdentifiers,
String[] versions,
IProcessActivity activities,
DocumentSpecification spec,
boolean[] scanOnly,
int jobMode) |
void |
BaseRepositoryConnector.processDocuments(String[] documentIdentifiers,
String[] versions,
IProcessActivity activities,
Specification spec,
boolean[] scanOnly,
int jobMode)
Process a set of documents.
|
Modifier and Type | Method and Description |
---|---|
String |
IRepositoryConnector.addSeedDocuments(ISeedingActivity activities,
Specification spec,
String lastSeedVersion,
long seedTime,
int jobMode)
Queue "seed" documents.
|
boolean |
IFingerprintActivity.checkDateIndexable(Date date)
Detect if a date is indexable or not.
|
boolean |
IFingerprintActivity.checkDocumentIndexable(File localFile)
Check whether a document is indexable by the currently specified output connector.
|
void |
IAbortActivity.checkJobStillActive()
Check whether current job is still active.
|
boolean |
IFingerprintActivity.checkLengthIndexable(long length)
Check whether a document of a specific length is indexable by the currently specified output connector.
|
boolean |
IFingerprintActivity.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is indexable or not.
|
boolean |
IFingerprintActivity.checkURLIndexable(String url)
Pre-determine whether a document's URL is indexable by this connector.
|
void |
IProcessActivity.deleteDocument(String documentIdentifier,
String version)
Deprecated.
|
String |
IDocumentIdentifierStream.getNextIdentifier()
Get the next local document identifier.
|
void |
IProcessActivity.ingestDocument(String documentIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Deprecated.
|
void |
IProcessActivity.ingestDocumentWithException(String documentIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Ingest the current document.
|
void |
IProcessActivity.ingestDocumentWithException(String documentIdentifier,
String componentIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Ingest the current document.
|
void |
IProcessActivity.noDocument(String documentIdentifier,
String version)
Remove the specified document from the search engine index, and update the
recorded version information for the document.
|
void |
IProcessActivity.noDocument(String documentIdentifier,
String componentIdentifier,
String version)
Remove the specified document from the search engine index, and update the
recorded version information for the document.
|
void |
INotificationConnector.notifyOfJobEnd(Specification spec)
Notify of job end
|
void |
INotificationConnector.notifyOfJobStopErrorAbort(Specification spec)
Notify of job stop due to error abort.
|
void |
INotificationConnector.notifyOfJobStopManualAbort(Specification spec)
Notify of job stop due to manual abort.
|
void |
INotificationConnector.notifyOfJobStopManualPause(Specification spec)
Notify of job stop due to manual pause.
|
void |
INotificationConnector.notifyOfJobStopRestart(Specification spec)
Notify of job stop due to restart.
|
void |
INotificationConnector.notifyOfJobStopSchedulePause(Specification spec)
Notify of job stop due to schedule pause.
|
void |
IRepositoryConnector.processDocuments(String[] documentIdentifiers,
IExistingVersions statuses,
Specification spec,
IProcessActivity activities,
int jobMode,
boolean usesDefaultAuthority)
Process a set of documents.
|
void |
IProcessActivity.removeDocument(String documentIdentifier)
Remove the specified document primary component permanently from the search engine index,
and from the status table.
|
Modifier and Type | Method and Description |
---|---|
void |
BaseNotificationConnector.notifyOfJobEnd(Specification spec)
Notify of job end.
|
void |
BaseNotificationConnector.notifyOfJobStop(Specification spec)
Notify of job stop.
|
void |
BaseNotificationConnector.notifyOfJobStopErrorAbort(Specification spec)
Notify of job stop due to error abort.
|
void |
BaseNotificationConnector.notifyOfJobStopManualAbort(Specification spec)
Notify of job stop due to manual abort.
|
void |
BaseNotificationConnector.notifyOfJobStopManualPause(Specification spec)
Notify of job stop due to manual pause.
|
void |
BaseNotificationConnector.notifyOfJobStopRestart(Specification spec)
Notify of job stop due to restart.
|
void |
BaseNotificationConnector.notifyOfJobStopSchedulePause(Specification spec)
Notify of job stop due to schedule pause.
|
Modifier and Type | Field and Description |
---|---|
protected ServiceInterruption |
JobNotificationThread.Disposition.serviceInterruption |
Modifier and Type | Method and Description |
---|---|
ServiceInterruption |
JobNotificationThread.Disposition.getServiceInterruption() |
Modifier and Type | Method and Description |
---|---|
boolean |
WorkerThread.ProcessActivity.checkDateIndexable(Date date)
Detect if a date is indexable or not.
|
boolean |
WorkerThread.CheckActivity.checkDateIndexable(Date date)
Detect if a date is acceptable downstream or not.
|
boolean |
WorkerThread.ProcessActivity.checkDocumentIndexable(File localFile)
Check whether a document is indexable by the currently specified output connector.
|
boolean |
WorkerThread.CheckActivity.checkDocumentIndexable(File localFile)
Pre-determine whether a document (passed here as a File object) is acceptable downstream.
|
void |
SeedingActivity.checkJobStillActive()
Check whether current job is still active.
|
void |
WorkerThread.ProcessActivity.checkJobStillActive()
Check whether current job is still active.
|
boolean |
WorkerThread.ProcessActivity.checkLengthIndexable(long length)
Check whether a document of a specified length is indexable by the currently specified output connector.
|
boolean |
WorkerThread.CheckActivity.checkLengthIndexable(long length)
Pre-determine whether a document's length is acceptable downstream.
|
boolean |
WorkerThread.ProcessActivity.checkMimeTypeIndexable(String mimeType)
Check whether a mime type is indexable by the currently specified output connector.
|
boolean |
WorkerThread.CheckActivity.checkMimeTypeIndexable(String mimeType)
Detect if a mime type is acceptable downstream or not.
|
boolean |
WorkerThread.ProcessActivity.checkURLIndexable(String url)
Pre-determine whether a document's URL is indexable by this connector.
|
boolean |
WorkerThread.CheckActivity.checkURLIndexable(String url)
Pre-determine whether a document's URL is acceptable downstream.
|
void |
WorkerThread.ProcessActivity.deleteDocument(String documentIdentifier,
String version)
Deprecated.
|
protected static void |
WorkerThread.handleIOException(IOException e,
String context) |
void |
WorkerThread.ProcessActivity.ingestDocument(String localIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Deprecated.
|
void |
WorkerThread.ProcessActivity.ingestDocumentWithException(String documentIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Ingest the current document.
|
void |
WorkerThread.ProcessActivity.ingestDocumentWithException(String documentIdentifier,
String componentIdentifier,
String version,
String documentURI,
RepositoryDocument data)
Ingest the current document.
|
void |
WorkerThread.OutputActivity.noDocument()
Send NO document via the pipeline to the next output connection.
|
void |
WorkerThread.ProcessActivity.noDocument(String documentIdentifier,
String version)
Remove the specified document from the search engine index, while keeping track of the version information
for it (to reduce churn).
|
void |
WorkerThread.ProcessActivity.noDocument(String documentIdentifier,
String componentIdentifier,
String version)
Remove the specified document from the search engine index, and update the
recorded version information for the document.
|
void |
WorkerThread.ProcessActivity.removeDocument(String documentIdentifier)
Remove the specified document primary component permanently from the search engine index,
and from the status table.
|
int |
WorkerThread.OutputActivity.sendDocument(String documentURI,
RepositoryDocument document)
Send a document via the pipeline to the next output connection.
|
Constructor and Description |
---|
JobNotificationThread.Disposition(ServiceInterruption serviceInterruption) |
Constructor and Description |
---|
PipelineSpecification(IPipelineConnections connections,
IJobDescription job,
IIncrementalIngester ingester) |