Package | Description |
---|---|
org.apache.manifoldcf.agents.incrementalingest | |
org.apache.manifoldcf.agents.interfaces | |
org.apache.manifoldcf.crawler.system |
Modifier and Type | Field and Description |
---|---|
IPipelineSpecification |
IncrementalIngester.PipelineObject.pipelineConnections |
Modifier and Type | Method and Description |
---|---|
boolean |
IncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
java.util.Date date,
IOutputCheckActivity activity)
Check if a date is indexable.
|
boolean |
IncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
java.io.File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
java.lang.String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
java.lang.String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
protected static java.lang.String |
IncrementalIngester.computePackedTransformationVersion(IPipelineSpecification pipelineSpecification,
int stage)
Compute a transformation version given a pipeline specification and starting output stage.
|
protected IncrementalIngester.PipelineObject |
IncrementalIngester.pipelineGrab(IPipelineSpecification pipelineConnections)
Grab the entire pipeline.
|
Constructor and Description |
---|
PipelineObject(IPipelineSpecification pipelineConnections,
ITransformationConnector[] transformationConnectors,
IOutputConnector[] outputConnectors) |
Modifier and Type | Interface and Description |
---|---|
interface |
IPipelineSpecificationWithVersions
This interface describes a multi-output pipeline, with existing document version information from
each output..
|
Modifier and Type | Method and Description |
---|---|
boolean |
IIncrementalIngester.checkDateIndexable(IPipelineSpecification pipelineSpecification,
java.util.Date date,
IOutputCheckActivity activity)
Check if a document date is indexable.
|
boolean |
IIncrementalIngester.checkDocumentIndexable(IPipelineSpecification pipelineSpecification,
java.io.File localFile,
IOutputCheckActivity activity)
Check if a file is indexable.
|
boolean |
IIncrementalIngester.checkLengthIndexable(IPipelineSpecification pipelineSpecification,
long length,
IOutputCheckActivity activity)
Pre-determine whether a document's length is indexable by this connector.
|
boolean |
IIncrementalIngester.checkMimeTypeIndexable(IPipelineSpecification pipelineSpecification,
java.lang.String mimeType,
IOutputCheckActivity activity)
Check if a mime type is indexable.
|
boolean |
IIncrementalIngester.checkURLIndexable(IPipelineSpecification pipelineSpecification,
java.lang.String url,
IOutputCheckActivity activity)
Pre-determine whether a document's URL is indexable by this connector.
|
Modifier and Type | Class and Description |
---|---|
class |
PipelineSpecification
Class which handles pipeline specifications that include current (new) description strings.
|
class |
PipelineSpecificationWithVersions
Class which handles pipeline specifications, including both new versions and old versions.
|
Modifier and Type | Field and Description |
---|---|
protected IPipelineSpecification |
PipelineSpecificationWithVersions.pipelineSpecification |
protected IPipelineSpecification |
WorkerThread.ProcessActivity.pipelineSpecification |
Constructor and Description |
---|
PipelineSpecificationWithVersions(IPipelineSpecification pipelineSpecification,
QueuedDocument queuedDocument,
java.lang.String componentIDHash) |
ProcessActivity(java.lang.Long jobID,
java.lang.String processID,
IReprioritizationTracker rt,
IJobManager jobManager,
IIncrementalIngester ingester,
java.lang.String connectionName,
IPipelineSpecification pipelineSpecification,
java.util.Map<java.lang.String,QueuedDocument> previousDocuments,
long currentTime,
java.lang.Long expireInterval,
java.lang.Long recrawlInterval,
java.lang.Long maxInterval,
int hopcountMode,
IRepositoryConnection connection,
IRepositoryConnector connector,
IRepositoryConnectionManager connMgr,
java.lang.String[] legalLinkTypes,
WorkerThread.OutputActivity ingestLogger)
Constructor.
|