Package | Description |
---|---|
org.apache.manifoldcf.agents.incrementalingest | |
org.apache.manifoldcf.agents.interfaces | |
org.apache.manifoldcf.crawler.system |
Modifier and Type | Field and Description |
---|---|
protected IPipelineSpecificationWithVersions |
IncrementalIngester.PipelineObjectWithVersions.pipelineSpecificationWithVersions |
Modifier and Type | Method and Description |
---|---|
boolean |
IncrementalIngester.checkFetchDocument(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String newDocumentVersion,
java.lang.String newAuthorityNameString)
Determine whether we need to fetch or refetch a document.
|
boolean |
IncrementalIngester.documentIngest(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String identifierClass,
java.lang.String identifierHash,
java.lang.String componentHash,
java.lang.String documentVersion,
java.lang.String authorityName,
RepositoryDocument data,
long ingestTime,
java.lang.String documentURI,
IOutputActivity activities)
Ingest a document.
|
void |
IncrementalIngester.documentNoData(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String identifierClass,
java.lang.String identifierHash,
java.lang.String componentHash,
java.lang.String documentVersion,
java.lang.String authorityName,
long recordTime,
IOutputActivity activities)
Remove a document from specified indexes, just as if an empty document
was indexed, and record the necessary version information.
|
protected IncrementalIngester.PipelineObjectWithVersions |
IncrementalIngester.pipelineGrabWithVersions(IPipelineSpecificationWithVersions pipelineConnections)
Grab the entire pipeline.
|
Constructor and Description |
---|
PipelineObjectWithVersions(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
ITransformationConnector[] transformationConnectors,
IOutputConnector[] outputConnectors) |
Modifier and Type | Method and Description |
---|---|
boolean |
IIncrementalIngester.checkFetchDocument(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String newDocumentVersion,
java.lang.String newAuthorityNameString)
Determine whether we need to fetch or refetch a document.
|
boolean |
IIncrementalIngester.documentIngest(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String identifierClass,
java.lang.String identifierHash,
java.lang.String componentHash,
java.lang.String documentVersion,
java.lang.String authorityName,
RepositoryDocument data,
long ingestTime,
java.lang.String documentURI,
IOutputActivity activities)
Ingest a document.
|
void |
IIncrementalIngester.documentNoData(IPipelineSpecificationWithVersions pipelineSpecificationWithVersions,
java.lang.String identifierClass,
java.lang.String identifierHash,
java.lang.String componentHash,
java.lang.String documentVersion,
java.lang.String authorityName,
long recordTime,
IOutputActivity activities)
Remove a document from specified indexes, just as if an empty document
was indexed, and record the necessary version information.
|
Modifier and Type | Class and Description |
---|---|
class |
PipelineSpecificationWithVersions
Class which handles pipeline specifications, including both new versions and old versions.
|
Modifier and Type | Method and Description |
---|---|
protected IPipelineSpecificationWithVersions |
WorkerThread.ProcessActivity.computePipelineSpecificationWithVersions(java.lang.String documentIdentifierHash,
java.lang.String componentIdentifierHash,
java.lang.String documentIdentifier) |