public class MetadataTransfer extends Object
Modifier and Type | Field and Description |
---|---|
static String |
depthKeyName
Metadata key name for tracking the depth
|
static String |
maxDepthKeyName
Metadata key name for tracking a non-default max depth
|
static String |
metadataPersistParamName
Parameter name indicating which metadata to persist for a given document
but not transfer to outlinks.
|
static String |
metadataTransferClassParamName
Class to use for transfering metadata to outlinks.
|
static String |
metadataTransferParamName
Parameter name indicating which metadata to transfer to the outlinks and
persist for a given document.
|
static String |
trackDepthParamName
Parameter name indicating whether to track the depth from seed.
|
static String |
trackPathParamName
Parameter name indicating whether to track the url path or not.
|
static String |
urlPathKeyName
Metadata key name for tracking the source URLs
|
Constructor and Description |
---|
MetadataTransfer() |
Modifier and Type | Method and Description |
---|---|
protected void |
configure(Map<String,Object> conf) |
Metadata |
filter(Metadata metadata)
Determine which metadata should be persisted for a given document
including those which are not necessarily transferred to the outlinks
|
static MetadataTransfer |
getInstance(Map<String,Object> conf) |
Metadata |
getMetaForOutlink(String targetURL,
String sourceURL,
Metadata parentMD)
Determine which metadata should be transfered to an outlink.
|
public static final String metadataTransferClassParamName
public static final String metadataTransferParamName
public static final String metadataPersistParamName
public static final String trackPathParamName
public static final String trackDepthParamName
public static final String urlPathKeyName
public static final String depthKeyName
public static final String maxDepthKeyName
public static MetadataTransfer getInstance(Map<String,Object> conf)
public Metadata getMetaForOutlink(String targetURL, String sourceURL, Metadata parentMD)
Copyright © 2018 DigitalPebble Ltd. All rights reserved.