com.digitalpebble.stormcrawler.spout

Class FileSpout

java.lang.Object

org.apache.storm.topology.base.BaseComponent

org.apache.storm.topology.base.BaseRichSpout

com.digitalpebble.stormcrawler.spout.FileSpout

All Implemented Interfaces:

Serializable, org.apache.storm.spout.ISpout, org.apache.storm.topology.IComponent, org.apache.storm.topology.IRichSpout

public class FileSpout
extends org.apache.storm.topology.base.BaseRichSpout

Reads the lines from a UTF-8 file and use them as a spout. Load the entire content into memory

See Also:

Serialized Form

Field Summary

Fields

Modifier and Type	Field and Description
static int	BATCH_SIZE
static org.slf4j.Logger	LOG

Constructor Summary

Constructors

Constructor and Description
FileSpout(org.apache.storm.spout.Scheme scheme, String... files)
FileSpout(String file, org.apache.storm.spout.Scheme scheme)
FileSpout(String dir, String filter, org.apache.storm.spout.Scheme scheme)

Method Summary

Modifier and Type	Method and Description
void	activate()
void	close()
void	deactivate()
void	declareOutputFields(org.apache.storm.topology.OutputFieldsDeclarer declarer)
void	nextTuple()
void	open(Map conf, org.apache.storm.task.TopologyContext context, org.apache.storm.spout.SpoutOutputCollector collector)

Methods inherited from class org.apache.storm.topology.base.BaseRichSpout

ack, fail

Methods inherited from class org.apache.storm.topology.base.BaseComponent

getComponentConfiguration

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface org.apache.storm.topology.IComponent

getComponentConfiguration

Field Detail

BATCH_SIZE

public static final int BATCH_SIZE

See Also:

Constant Field Values

LOG

public static final org.slf4j.Logger LOG

Constructor Detail

FileSpout

public FileSpout(String dir,
                 String filter,
                 org.apache.storm.spout.Scheme scheme)

FileSpout

public FileSpout(String file,
                 org.apache.storm.spout.Scheme scheme)

FileSpout

public FileSpout(org.apache.storm.spout.Scheme scheme,
                 String... files)

Method Detail

open

public void open(Map conf,
                 org.apache.storm.task.TopologyContext context,
                 org.apache.storm.spout.SpoutOutputCollector collector)

nextTuple

public void nextTuple()

declareOutputFields

public void declareOutputFields(org.apache.storm.topology.OutputFieldsDeclarer declarer)

close

public void close()

Specified by:

close in interface org.apache.storm.spout.ISpout

Overrides:

close in class org.apache.storm.topology.base.BaseRichSpout

activate

public void activate()

Specified by:

activate in interface org.apache.storm.spout.ISpout

Overrides:

activate in class org.apache.storm.topology.base.BaseRichSpout

deactivate

public void deactivate()

Specified by:

deactivate in interface org.apache.storm.spout.ISpout

Overrides:

deactivate in class org.apache.storm.topology.base.BaseRichSpout