public class FileSplitUtils extends Object
Constructor and Description |
---|
FileSplitUtils() |
Modifier and Type | Method and Description |
---|---|
static List<org.apache.hadoop.mapreduce.InputSplit> |
generateFileSplits(org.apache.hadoop.fs.Path testHadoopPath,
long fileLengthTotal,
int numSplits)
Utility method to create a specific number of splits for a file.
|
static InputStream |
getDecodedStreamFromSplit(org.apache.hadoop.mapreduce.lib.input.FileSplit split,
org.apache.hadoop.conf.Configuration job)
Util method to open a decoded stream from a split.
|
public static InputStream getDecodedStreamFromSplit(org.apache.hadoop.mapreduce.lib.input.FileSplit split, org.apache.hadoop.conf.Configuration job) throws IOException
split
- job
- IOException
public static List<org.apache.hadoop.mapreduce.InputSplit> generateFileSplits(org.apache.hadoop.fs.Path testHadoopPath, long fileLengthTotal, int numSplits) throws IOException
testHadoopPath
- fileLengthTotal
- numSplits
- IOException
Copyright © 2016–2021 Smart Data Analytics (SDA) Research Group. All rights reserved.