com.twitter.maple.tap

Class MemorySourceTap

java.lang.Object

cascading.tap.Tap<Config,Input,java.lang.Void>

cascading.tap.SourceTap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>>

com.twitter.maple.tap.MemorySourceTap

All Implemented Interfaces:

cascading.flow.FlowElement, cascading.util.Traceable, java.io.Serializable

public class MemorySourceTap
extends cascading.tap.SourceTap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>>
implements java.io.Serializable

See Also:

Serialized Form

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
static class	MemorySourceTap.MemorySourceScheme

Constructor Summary

Constructors

Constructor and Description
MemorySourceTap(java.util.List<cascading.tuple.Tuple> tuples, cascading.tuple.Fields fields)

Method Summary

Modifier and Type	Method and Description
boolean	equals(java.lang.Object object)
java.lang.String	getIdentifier()
long	getModifiedTime(org.apache.hadoop.mapred.JobConf conf)
org.apache.hadoop.fs.Path	getPath()
cascading.tuple.TupleEntryIterator	openForRead(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> flowProcess, org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable> input)
boolean	resourceExists(org.apache.hadoop.mapred.JobConf conf)

Methods inherited from class cascading.tap.SourceTap

commitResource, createResource, deleteResource, getSinkFields, isSink, openForWrite, rollbackResource, sinkConfInit

Methods inherited from class cascading.tap.Tap

createResource, deleteResource, flowConfInit, getConfigDef, getFullIdentifier, getFullIdentifier, getModifiedTime, getScheme, getSinkMode, getSourceFields, getStepConfigDef, getTrace, hasConfigDef, hashCode, hasStepConfigDef, id, isEquivalentTo, isKeep, isReplace, isSource, isTemporary, isUpdate, openForRead, openForWrite, outgoingScopeFor, presentSinkFields, presentSourceFields, resolveIncomingOperationArgumentFields, resolveIncomingOperationPassThroughFields, resourceExists, retrieveSinkFields, retrieveSourceFields, setScheme, sourceConfInit, taps, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

MemorySourceTap

public MemorySourceTap(java.util.List<cascading.tuple.Tuple> tuples,
                       cascading.tuple.Fields fields)

Method Detail

getIdentifier

public java.lang.String getIdentifier()

Specified by:

getIdentifier in class cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>,java.lang.Void>

getPath

public org.apache.hadoop.fs.Path getPath()

resourceExists

public boolean resourceExists(org.apache.hadoop.mapred.JobConf conf)
                       throws java.io.IOException

Specified by:

resourceExists in class cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>,java.lang.Void>

Throws:

java.io.IOException

equals

public boolean equals(java.lang.Object object)

Overrides:

equals in class cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>,java.lang.Void>

openForRead

public cascading.tuple.TupleEntryIterator openForRead(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> flowProcess,
                                                      org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable> input)
                                               throws java.io.IOException

Specified by:

openForRead in class cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>,java.lang.Void>

Throws:

java.io.IOException

getModifiedTime

public long getModifiedTime(org.apache.hadoop.mapred.JobConf conf)
                     throws java.io.IOException

Specified by:

getModifiedTime in class cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader<TupleWrapper,org.apache.hadoop.io.NullWritable>,java.lang.Void>

Throws:

java.io.IOException