com.twitter.elephantbird.cascading2.scheme
Class LzoByteArrayScheme

java.lang.Object
  extended by cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],T>
      extended by com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme<byte[],RawBytesWritable>
          extended by com.twitter.elephantbird.cascading2.scheme.LzoByteArrayScheme
All Implemented Interfaces:
Serializable

public class LzoByteArrayScheme
extends LzoBinaryScheme<byte[],RawBytesWritable>

Scheme for lzo compressed files with binary records.

Author:
Sam Ritchie
See Also:
Serialized Form

Constructor Summary
LzoByteArrayScheme()
           
 
Method Summary
protected  RawBytesWritable prepareBinaryWritable()
           
 void sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)
           
 void sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp, cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap, org.apache.hadoop.mapred.JobConf conf)
           
 
Methods inherited from class com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme
sink, sinkPrepare, source, sourceCleanup, sourcePrepare
 
Methods inherited from class cascading.scheme.Scheme
equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, sinkCleanup, toString
 
Methods inherited from class java.lang.Object
clone, finalize, getClass, notify, notifyAll, wait, wait, wait
 

Constructor Detail

LzoByteArrayScheme

public LzoByteArrayScheme()
Method Detail

prepareBinaryWritable

protected RawBytesWritable prepareBinaryWritable()
Specified by:
prepareBinaryWritable in class LzoBinaryScheme<byte[],RawBytesWritable>

sourceConfInit

public void sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
                           cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                           org.apache.hadoop.mapred.JobConf conf)
Specified by:
sourceConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],RawBytesWritable>

sinkConfInit

public void sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
                         cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
                         org.apache.hadoop.mapred.JobConf conf)
Specified by:
sinkConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],RawBytesWritable>


Copyright © 2015 Twitter. All Rights Reserved.