当前位置: 首页>>代码示例>>Java>>正文


Java SparkContext.accumulator方法代码示例

本文整理汇总了Java中org.apache.spark.SparkContext.accumulator方法的典型用法代码示例。如果您正苦于以下问题:Java SparkContext.accumulator方法的具体用法?Java SparkContext.accumulator怎么用?Java SparkContext.accumulator使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.spark.SparkContext的用法示例。


在下文中一共展示了SparkContext.accumulator方法的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: initializeVariables

import org.apache.spark.SparkContext; //导入方法依赖的package包/类
public void initializeVariables(SparkContext sc) {
    for (int i = 0; i < this.numberOfCluster; i++) {
        longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());
        clusterCounterMaliciousList.add(longAccumulator);

        longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());
        clusterCounterBenignList.add(longAccumulator);
    }


    longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());

    totalBenign = sc.accumulator(0L, new LongAccumulatorParam());
    totalMalicious = sc.accumulator(0L, new LongAccumulatorParam());

    totalNanoSeconds = sc.accumulator(0L, "totalNanoSeconds", new LongAccumulatorParam());
    flowCounterMalicious = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
    flowCounterBenign = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
}
 
开发者ID:shlee89,项目名称:athena,代码行数:20,代码来源:ClusterValidationSummary.java

示例2: initializeVariables

import org.apache.spark.SparkContext; //导入方法依赖的package包/类
public void initializeVariables(SparkContext sc) {
    for (int i = 0; i < this.numberOfLabels; i++) {
        longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());
        classificationCounterValidatedList.add(longAccumulator);

        longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());
        classificationCounterOriginList.add(longAccumulator);

        //unique entries
        flowCounter = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
        uniqueOriginEntires.add(flowCounter);

        flowCounter = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
        uniqueValidatedEntires.add(flowCounter);
    }


    longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());

    totalBenign = sc.accumulator(0L, new LongAccumulatorParam());
    totalMalicious = sc.accumulator(0L, new LongAccumulatorParam());

    truePositive = sc.accumulator(0L, new LongAccumulatorParam());
    falseNegative = sc.accumulator(0L, new LongAccumulatorParam());
    falsePositive = sc.accumulator(0L, new LongAccumulatorParam());
    trueNegative = sc.accumulator(0L, new LongAccumulatorParam());

    totalNanoSeconds = sc.accumulator(0L, "totalNanoSeconds", new LongAccumulatorParam());
    flowCounterMalicious = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
    flowCounterBenign = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
}
 
开发者ID:shlee89,项目名称:athena,代码行数:32,代码来源:ClassificationValidationSummary.java

示例3: initializeVariables

import org.apache.spark.SparkContext; //导入方法依赖的package包/类
public void initializeVariables(SparkContext sc) {


        longAccumulator = sc.accumulator(0L, new LongAccumulatorParam());

        totalBenign = sc.accumulator(0L, new LongAccumulatorParam());
        totalMalicious = sc.accumulator(0L, new LongAccumulatorParam());

        flowCounterMalicious = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
        flowCounterBenign = sc.accumulator(new HashMap<BigInteger, Boolean>(), new UniqueFlowAccumulatorParam());
    }
 
开发者ID:shlee89,项目名称:athena,代码行数:12,代码来源:ClusterModelSummary.java


注:本文中的org.apache.spark.SparkContext.accumulator方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。