com.twitter.elephantbird.cascading2.scheme
Class LzoThriftScheme<M extends org.apache.thrift.TBase<?,?>>

java.lang.Object
  cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],T>
      com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme<M,ThriftWritable<M>>
          com.twitter.elephantbird.cascading2.scheme.LzoThriftScheme<M>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

LzoThriftB64LineScheme

public class LzoThriftScheme<M extends org.apache.thrift.TBase<?,?>>
extends LzoBinaryScheme<M,ThriftWritable<M>>

Scheme for Thrift lzo compressed files.

Author:

Argyris Zymnis

See Also:

Serialized Form

Constructor Summary

LzoThriftScheme(Class thriftClass)

Method Summary

protected ThriftWritable<M>	prepareBinaryWritable()
void	sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)
void	sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)

Methods inherited from class com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme

sink, sinkPrepare, source, sourceCleanup, sourcePrepare

Methods inherited from class cascading.scheme.Scheme

equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, sinkCleanup, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

LzoThriftScheme

public LzoThriftScheme(Class thriftClass)

Method Detail

sinkConfInit

public void sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp,
                         cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                         org.apache.hadoop.mapred.JobConf conf)

Specified by:

sinkConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],ThriftWritable<M extends org.apache.thrift.TBase<?,?>>>

prepareBinaryWritable

protected ThriftWritable<M> prepareBinaryWritable()

Specified by:

prepareBinaryWritable in class LzoBinaryScheme<M extends org.apache.thrift.TBase<?,?>,ThriftWritable<M extends org.apache.thrift.TBase<?,?>>>

sourceConfInit

public void sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp,
                           cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                           org.apache.hadoop.mapred.JobConf conf)

Specified by:

sourceConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],ThriftWritable<M extends org.apache.thrift.TBase<?,?>>>