Class RecordReaderGenericRdfBase<U,G,A,T>
- java.lang.Object
-
- org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,T>
-
- net.sansa_stack.hadoop.core.RecordReaderGenericBase<U,G,A,T>
-
- net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfBase<U,G,A,T>
-
- All Implemented Interfaces:
Closeable
,AutoCloseable
- Direct Known Subclasses:
RecordReaderGenericRdfAccumulatingBase
,RecordReaderGenericRdfNonAccumulatingBase
public abstract class RecordReaderGenericRdfBase<U,G,A,T> extends RecordReaderGenericBase<U,G,A,T>
-
-
Field Summary
Fields Modifier and Type Field Description protected String
baseIri
protected String
baseIriKey
protected String
headerBytesKey
protected org.apache.jena.riot.Lang
lang
protected String
prefixesMaxLengthKey
-
Fields inherited from class net.sansa_stack.hadoop.core.RecordReaderGenericBase
accumulating, codec, currentKey, currentValue, datasetFlow, decompressor, EMPTY_BYTE_ARRAY, isEncoded, isFirstSplit, maxRecordLength, maxRecordLengthKey, minRecordLength, minRecordLengthKey, postambleBytes, preambleBytes, probeRecordCount, probeRecordCountKey, raisedThrowable, rawStream, recordStartPattern, split, splitEnd, splitLength, splitStart, stream
-
-
Method Summary
All Methods Instance Methods Concrete Methods Modifier and Type Method Description void
initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
Read out config paramaters (prefixes, length thresholds, ...) and examine the codec in order to set an internal flag whether the stream will be encoded or not.-
Methods inherited from class net.sansa_stack.hadoop.core.RecordReaderGenericBase
aggregate, close, createRecordFlow, didHitSplitBound, effectiveInputStream, effectiveInputStreamSupp, findFirstPositionWithProbeSuccess, findNextRecord, getCurrentKey, getCurrentValue, getPos, getProgress, initRecordFlow, lines, logClose, logUnexpectedClose, nextKeyValue, parse, parseFromSeekable, prober, setStreamToInterval
-
-
-
-
Method Detail
-
initialize
public void initialize(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context) throws IOException
Description copied from class:RecordReaderGenericBase
Read out config paramaters (prefixes, length thresholds, ...) and examine the codec in order to set an internal flag whether the stream will be encoded or not.- Overrides:
initialize
in classRecordReaderGenericBase<U,G,A,T>
- Throws:
IOException
-
-