Package net.sansa_stack.hadoop.format.jena.base

Class RecordReaderGenericRdfTripleBase

java.lang.Object

org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,T>

net.sansa_stack.hadoop.core.RecordReaderGenericBase<U,G,A,T>

net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfBase<T,T,T,T>

net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfNonAccumulatingBase<org.apache.jena.graph.Triple>

net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfTripleBase

All Implemented Interfaces:

Closeable, AutoCloseable

Direct Known Subclasses:

RecordReaderRdfNTriples, RecordReaderRdfTurtleTriple

public class RecordReaderGenericRdfTripleBase
extends RecordReaderGenericRdfNonAccumulatingBase<org.apache.jena.graph.Triple>

Nested Class Summary

Nested classes/interfaces inherited from class net.sansa_stack.hadoop.core.RecordReaderGenericBase

RecordReaderGenericBase.ReadTooFarException

Field Summary

Fields inherited from class net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfBase

baseIri, baseIriKey, headerBytesKey, lang, prefixesMaxLengthKey, prefixMap

Fields inherited from class net.sansa_stack.hadoop.core.RecordReaderGenericBase

accumulating, codec, currentKey, currentValue, datasetFlow, decompressor, EMPTY_BYTE_ARRAY, enableStats, isEncoded, isFirstSplit, maxExtraByteCount, maxRecordLength, maxRecordLengthKey, minRecordLength, minRecordLengthKey, postambleBytes, preambleBytes, probeElementCount, probeElementCountKey, probeRecordCount, probeRecordCountKey, rawStream, recordFlowCloseable, recordStartPattern, regionStartSearchReadOverRegionEnd, regionStartSearchReadOverSplitEnd, skipRecordCount, split, splitEnd, splitId, splitLength, splitName, splitStart, stream, tailByteBuffer, tailBytes, tailEltBuffer, tailElts, tailEltsTime, tailRecordOffset, totalEltCount, totalRecordCount

Constructor Summary

Constructors

Constructor	Description
RecordReaderGenericRdfTripleBase(RecordReaderRdfConf conf)

Method Summary

Modifier and Type	Method	Description
protected Stream<org.apache.jena.graph.Triple>	parse(InputStream inputStream, boolean isProbe)	Create a flowable from the input stream.

Methods inherited from class net.sansa_stack.hadoop.format.jena.base.RecordReaderGenericRdfBase

initialize, setupParser

Methods inherited from class net.sansa_stack.hadoop.core.RecordReaderGenericBase

abbreviate, abbreviate, abbreviateAsUTF8, aggregate, aggregate, close, convert, createMatcherFactory, createRecordFlow, detectTail, didHitSplitBound, effectiveInputStream, effectiveInputStreamSupp, findFirstPositionWithProbeSuccess, findNextRegion, getCurrentKey, getCurrentValue, getPos, getPosition, getProgress, getStats, initRecordFlow, lines, logClose, logUnexpectedClose, nextKeyValue, parseFromSeekable, prober, setStreamToInterval, unbufferedStream

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Details

RecordReaderGenericRdfTripleBase

public RecordReaderGenericRdfTripleBase(RecordReaderRdfConf conf)

Method Details

parse

protected Stream<org.apache.jena.graph.Triple> parse(InputStream inputStream,
 boolean isProbe)

Description copied from class: RecordReaderGenericBase

Create a flowable from the input stream. The input stream may be incorrectly positioned in which case the Flowable is expected to indicate this by raising an error event.

Specified by:

parse in class RecordReaderGenericBase<org.apache.jena.graph.Triple,org.apache.jena.graph.Triple,org.apache.jena.graph.Triple,org.apache.jena.graph.Triple>

Parameters:

inputStream - A supplier of input streams. May supply the same underlying stream on each call hence only at most a single stream should be taken from the supplier. Supplied streams are safe to use in try-with-resources blocks (possibly using CloseShieldInputStream). Taken streams should be closed by the client code.

isProbe - Whether the parser should be configured for probing. For example, it is desireable to suppress porse errors during probing. Also, for probing the parser may optimize itself for minimizing latency of yielding items rather than overall throughput.

Returns: