com.twitter.chill.hadoop

Class KryoSerialization

java.lang.Object

org.apache.hadoop.conf.Configured

com.twitter.chill.hadoop.KryoSerialization

All Implemented Interfaces:

org.apache.hadoop.conf.Configurable, org.apache.hadoop.io.serializer.Serialization<java.lang.Object>

public class KryoSerialization
extends org.apache.hadoop.conf.Configured
implements org.apache.hadoop.io.serializer.Serialization<java.lang.Object>

Field Summary

Fields

Modifier and Type	Field and Description
protected static int	GUESS_THREADS_PER_CORE Since each thread only needs 1 Kryo, the pool doesn't need more space than the number of threads.
protected static int	MAX_CACHED_KRYO

Constructor Summary

Constructors

Constructor and Description
KryoSerialization() By default, this is the constructor used by Hadoop.
KryoSerialization(org.apache.hadoop.conf.Configuration conf) Constructor KryoSerialization creates a new KryoSerialization instance.

Method Summary

Modifier and Type	Method and Description
boolean	accept(java.lang.Class<?> aClass) Uses the initialized Kryo instance from the JobConf to test if Kryo will accept the class
org.apache.hadoop.io.serializer.Deserializer<java.lang.Object>	getDeserializer(java.lang.Class<java.lang.Object> aClass)
org.apache.hadoop.io.serializer.Serializer<java.lang.Object>	getSerializer(java.lang.Class<java.lang.Object> aClass)
void	setConf(org.apache.hadoop.conf.Configuration conf)

Methods inherited from class org.apache.hadoop.conf.Configured

getConf

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

GUESS_THREADS_PER_CORE

protected static int GUESS_THREADS_PER_CORE

Since each thread only needs 1 Kryo, the pool doesn't need more space than the number of threads. We guess that there are 4 hyperthreads / core and then multiple by the nember of cores.

MAX_CACHED_KRYO

protected static int MAX_CACHED_KRYO

Constructor Detail

KryoSerialization

public KryoSerialization()

By default, this is the constructor used by Hadoop. It will first call this, then setConf.

KryoSerialization

public KryoSerialization(org.apache.hadoop.conf.Configuration conf)

Constructor KryoSerialization creates a new KryoSerialization instance.

Parameters:

conf - of type Configuration

Method Detail

setConf

public void setConf(org.apache.hadoop.conf.Configuration conf)

Specified by:

setConf in interface org.apache.hadoop.conf.Configurable

Overrides:

setConf in class org.apache.hadoop.conf.Configured

accept

public boolean accept(java.lang.Class<?> aClass)

Uses the initialized Kryo instance from the JobConf to test if Kryo will accept the class

Specified by:

accept in interface org.apache.hadoop.io.serializer.Serialization<java.lang.Object>

Parameters:

aClass -

Returns:

getSerializer

public org.apache.hadoop.io.serializer.Serializer<java.lang.Object> getSerializer(java.lang.Class<java.lang.Object> aClass)

Specified by:

getSerializer in interface org.apache.hadoop.io.serializer.Serialization<java.lang.Object>

getDeserializer

public org.apache.hadoop.io.serializer.Deserializer<java.lang.Object> getDeserializer(java.lang.Class<java.lang.Object> aClass)

Specified by:

getDeserializer in interface org.apache.hadoop.io.serializer.Serialization<java.lang.Object>