当前位置: 首页>>代码示例>>Java>>正文


Java LoadPushDown类代码示例

本文整理汇总了Java中org.apache.pig.LoadPushDown的典型用法代码示例。如果您正苦于以下问题:Java LoadPushDown类的具体用法?Java LoadPushDown怎么用?Java LoadPushDown使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


LoadPushDown类属于org.apache.pig包,在下文中一共展示了LoadPushDown类的9个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:xushjie1987,项目名称:es-hadoop-v2.2.0,代码行数:5,代码来源:EsStorage.java

示例2: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return Lists.newArrayList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:AvroStorage.java

示例3: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    List<OperatorSet> features = new ArrayList<OperatorSet>(1);
    features.add( LoadPushDown.OperatorSet.PROJECTION );
    return features;
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:7,代码来源:TableLoader.java

示例4: prepareToRead

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public void prepareToRead(
        @SuppressWarnings("rawtypes") RecordReader reader, PigSplit split)
        throws IOException {

    AllReader allReader = (AllReader) reader;

    if (currentPath == null || !(currentPath.equals(allReader.path))) {
        currentPathPartitionKeyMap = (partitionColumns == null) ? null
                : pathPartitionerHelper
                        .getPathPartitionKeyValues(allReader.path
                                .toString());
        currentPath = allReader.path;
    }

    childLoadFunc = allReader.prepareLoadFuncForReading(split);

    String projectProperty = getUDFContext().getProperty(PROJECTION_ID);

    if (projectProperty != null) {

        // load the required field list from the current UDF context
        ByteArrayInputStream input = new ByteArrayInputStream(
                Base64.decodeBase64(projectProperty.getBytes("UTF-8")));

        ObjectInputStream objInput = new ObjectInputStream(input);

        try {
            requiredFieldList = (RequiredFieldList) objInput.readObject();
        } catch (ClassNotFoundException e) {
            throw new FrontendException(e.toString(), e);
        } finally {
            IOUtils.closeStream(objInput);
        }

        if (childLoadFunc.getClass().isAssignableFrom(LoadPushDown.class)) {
            supportPushDownProjection = true;
            ((LoadPushDown) childLoadFunc)
                    .pushProjection(requiredFieldList);
        } else {
            if (requiredFieldList != null) {
                requiredFieldHashSet = new TreeSet<Integer>();
                for (RequiredField requiredField : requiredFieldList
                        .getFields()) {
                    requiredFieldHashSet.add(requiredField.getIndex());
                }
            }
        }

    }

}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:53,代码来源:AllLoader.java

示例5: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
   public List<OperatorSet> getFeatures() {
return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
   }
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:5,代码来源:HiveColumnarLoader.java

示例6: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
  return asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:apache,项目名称:parquet-mr,代码行数:5,代码来源:ParquetLoader.java

示例7: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
    return ((LoadPushDown)super.loadFunc()).getFeatures();
}
 
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:5,代码来源:ParquetLoader.java

示例8: pushProjection

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public RequiredFieldResponse pushProjection(RequiredFieldList requiredFieldList)
        throws FrontendException {
    return ((LoadPushDown)super.loadFunc()).pushProjection(requiredFieldList);
}
 
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:6,代码来源:ParquetLoader.java

示例9: getFeatures

import org.apache.pig.LoadPushDown; //导入依赖的package包/类
@Override
public List<OperatorSet> getFeatures() {
	return Arrays.asList(LoadPushDown.OperatorSet.PROJECTION);
}
 
开发者ID:data-tsunami,项目名称:cobol-dump-parser,代码行数:5,代码来源:FixedWidthLoader.java


注:本文中的org.apache.pig.LoadPushDown类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。