Package net.sansa_stack.hadoop.format.univocity.csv.csv

Class FileInputFormatCsvUnivocity

java.lang.Object
org.apache.hadoop.mapreduce.InputFormat<K,V>
org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,String[]>
net.sansa_stack.hadoop.format.univocity.csv.csv.FileInputFormatCsvUnivocity
public class FileInputFormatCsvUnivocity extends org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,String[]>

  • Nested Class Summary

    Nested classes/interfaces inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

    org.apache.hadoop.mapreduce.lib.input.FileInputFormat.Counter

  • Field Summary

    Fields
    Modifier and Type
    Field
    Description
    static final String
    NS_CSV_FORMAT
     

    Fields inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

    DEFAULT_LIST_STATUS_NUM_THREADS, INPUT_DIR, INPUT_DIR_NONRECURSIVE_IGNORE_SUBDIRS, INPUT_DIR_RECURSIVE, LIST_STATUS_NUM_THREADS, NUM_INPUT_FILES, PATHFILTER_CLASS, SPLIT_MAXSIZE, SPLIT_MINSIZE

  • Constructor Summary

    Constructors
    Constructor
    Description
    FileInputFormatCsvUnivocity()
     

  • Method Summary

    Modifier and Type
    Method
    Description
    org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,String[]>
    createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
     
    static org.aksw.commons.model.csvw.univocity.UnivocityCsvwConf
    getUnivocityConfig(org.apache.hadoop.conf.Configuration conf)
     
    boolean
    isSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path file)
     
    static void
    setUnivocityConfig(org.apache.hadoop.conf.Configuration conf, org.aksw.commons.model.csvw.univocity.UnivocityCsvwConf csv)
     

    Methods inherited from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat

    addInputPath, addInputPathRecursively, addInputPaths, computeSplitSize, getBlockIndex, getFormatMinSplitSize, getInputDirRecursive, getInputPathFilter, getInputPaths, getMaxSplitSize, getMinSplitSize, getSplits, listStatus, makeSplit, makeSplit, setInputDirRecursive, setInputPathFilter, setInputPaths, setInputPaths, setMaxInputSplitSize, setMinInputSplitSize, shrinkStatus

    Methods inherited from class java.lang.Object

    clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

  • Field Details

  • Constructor Details

    • FileInputFormatCsvUnivocity

      public FileInputFormatCsvUnivocity()

  • Method Details

    • setUnivocityConfig

      public static void setUnivocityConfig(org.apache.hadoop.conf.Configuration conf, org.aksw.commons.model.csvw.univocity.UnivocityCsvwConf csv)

    • getUnivocityConfig

      public static org.aksw.commons.model.csvw.univocity.UnivocityCsvwConf getUnivocityConfig(org.apache.hadoop.conf.Configuration conf)

    • isSplitable

      public boolean isSplitable(org.apache.hadoop.mapreduce.JobContext context, org.apache.hadoop.fs.Path file)
      Overrides:
      isSplitable in class org.apache.hadoop.mapreduce.lib.input.FileInputFormat<org.apache.hadoop.io.LongWritable,String[]>

    • createRecordReader

      public org.apache.hadoop.mapreduce.RecordReader<org.apache.hadoop.io.LongWritable,String[]> createRecordReader(org.apache.hadoop.mapreduce.InputSplit inputSplit, org.apache.hadoop.mapreduce.TaskAttemptContext context)
      Specified by:
      createRecordReader in class org.apache.hadoop.mapreduce.InputFormat<org.apache.hadoop.io.LongWritable,String[]>