com.twitter.elephantbird.cascading2.scheme
Class LzoByteArrayScheme
java.lang.Object
cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],T>
com.twitter.elephantbird.cascading2.scheme.LzoBinaryScheme<byte[],RawBytesWritable>
com.twitter.elephantbird.cascading2.scheme.LzoByteArrayScheme
- All Implemented Interfaces:
- Serializable
public class LzoByteArrayScheme
- extends LzoBinaryScheme<byte[],RawBytesWritable>
Scheme for lzo compressed files with binary records.
- Author:
- Sam Ritchie
- See Also:
- Serialized Form
|
Method Summary |
protected RawBytesWritable |
prepareBinaryWritable()
|
void |
sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
org.apache.hadoop.mapred.JobConf conf)
|
void |
sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
org.apache.hadoop.mapred.JobConf conf)
|
| Methods inherited from class cascading.scheme.Scheme |
equals, getNumSinkParts, getSinkFields, getSourceFields, getTrace, hashCode, isSink, isSource, isSymmetrical, presentSinkFields, presentSinkFieldsInternal, presentSourceFields, presentSourceFieldsInternal, retrieveSinkFields, retrieveSourceFields, setNumSinkParts, setSinkFields, setSourceFields, sinkCleanup, toString |
LzoByteArrayScheme
public LzoByteArrayScheme()
prepareBinaryWritable
protected RawBytesWritable prepareBinaryWritable()
- Specified by:
prepareBinaryWritable in class LzoBinaryScheme<byte[],RawBytesWritable>
sourceConfInit
public void sourceConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
org.apache.hadoop.mapred.JobConf conf)
- Specified by:
sourceConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],RawBytesWritable>
sinkConfInit
public void sinkConfInit(cascading.flow.FlowProcess<org.apache.hadoop.mapred.JobConf> fp,
cascading.tap.Tap<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector> tap,
org.apache.hadoop.mapred.JobConf conf)
- Specified by:
sinkConfInit in class cascading.scheme.Scheme<org.apache.hadoop.mapred.JobConf,org.apache.hadoop.mapred.RecordReader,org.apache.hadoop.mapred.OutputCollector,Object[],RawBytesWritable>
Copyright © 2015 Twitter. All Rights Reserved.