com.twitter.elephantbird.cascading2.scheme
Class LzoProtobufScheme<M extends com.google.protobuf.Message>

java.lang.Object
  cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],T>
      com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme<M,ProtobufWritable<M>>
          com.twitter.elephantbird.cascading2.scheme.LzoProtobufScheme<M>

All Implemented Interfaces:

Serializable

Direct Known Subclasses:

LzoProtobufB64LineScheme, LzoProtobufBlockScheme

public class LzoProtobufScheme<M extends com.google.protobuf.Message>
extends LzoBinaryScheme<M,ProtobufWritable<M>>

Scheme for Protobuf lzo compressed files.

Author:

Avi Bryant, Ning Liang

See Also:

Serialized Form

Constructor Summary

LzoProtobufScheme(Class protoClass)

Method Summary

protected ProtobufWritable<M>	prepareBinaryWritable()
void	sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)
void	sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)

Methods inherited from class com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme

sink, sinkPrepare, source, sourceCleanup, sourcePrepare

Methods inherited from class cascading.scheme.Scheme

equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, sinkCleanup, toString

Methods inherited from class java.lang.Object

clone, finalize, getClass, notify, notifyAll, wait, wait, wait

Constructor Detail

LzoProtobufScheme

public LzoProtobufScheme(Class protoClass)

Method Detail

prepareBinaryWritable

protected ProtobufWritable<M> prepareBinaryWritable()

Specified by:

prepareBinaryWritable in class LzoBinaryScheme<M extends com.google.protobuf.Message,ProtobufWritable<M extends com.google.protobuf.Message>>

sinkConfInit

public void sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp,
                         cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                         org.apache.hadoop.mapred.JobConf conf)

Specified by:

sinkConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],ProtobufWritable<M extends com.google.protobuf.Message>>

sourceConfInit

public void sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> hfp,
                           cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                           org.apache.hadoop.mapred.JobConf conf)

Specified by:

sourceConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],ProtobufWritable<M extends com.google.protobuf.Message>>