当前位置: 首页>>代码示例>>Java>>正文


Java OutputStats.getPOStore方法代码示例

本文整理汇总了Java中org.apache.pig.tools.pigstats.OutputStats.getPOStore方法的典型用法代码示例。如果您正苦于以下问题:Java OutputStats.getPOStore方法的具体用法?Java OutputStats.getPOStore怎么用?Java OutputStats.getPOStore使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.pig.tools.pigstats.OutputStats的用法示例。


在下文中一共展示了OutputStats.getPOStore方法的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: getJobs

import org.apache.pig.tools.pigstats.OutputStats; //导入方法依赖的package包/类
/**
 * Retrieves a list of Job objects from the PigStats object
 * @param stats
 * @return A list of ExecJob objects
 */
protected List<ExecJob> getJobs(PigStats stats) {
    LinkedList<ExecJob> jobs = new LinkedList<ExecJob>();
    JobGraph jGraph = stats.getJobGraph();
    Iterator<JobStats> iter = jGraph.iterator();
    while (iter.hasNext()) {
        JobStats js = iter.next();
        for (OutputStats output : js.getOutputs()) {
            if (js.isSuccessful()) {
                jobs.add(new HJob(HJob.JOB_STATUS.COMPLETED, pigContext, output
                        .getPOStore(), output.getAlias(), stats));
            } else {
                HJob hjob = new HJob(HJob.JOB_STATUS.FAILED, pigContext, output
                        .getPOStore(), output.getAlias(), stats);
                hjob.setException(js.getException());
                jobs.add(hjob);
            }
        }
    }
    return jobs;
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:26,代码来源:PigServer.java

示例2: getJobs

import org.apache.pig.tools.pigstats.OutputStats; //导入方法依赖的package包/类
/**
 * Retrieves a list of Job objects from the PigStats object
 * @param stats
 * @return A list of ExecJob objects
 */
protected List<ExecJob> getJobs(PigStats stats) {
    LinkedList<ExecJob> jobs = new LinkedList<ExecJob>();
    if (stats instanceof EmptyPigStats) {
        HJob job = new HJob(HJob.JOB_STATUS.COMPLETED, pigContext, stats.result(null)
                .getPOStore(), null);
        jobs.add(job);
        return jobs;
    }
    JobGraph jGraph = stats.getJobGraph();
    Iterator<JobStats> iter = jGraph.iterator();
    while (iter.hasNext()) {
        JobStats js = iter.next();
        for (OutputStats output : js.getOutputs()) {
            if (js.isSuccessful()) {
                jobs.add(new HJob(HJob.JOB_STATUS.COMPLETED, pigContext, output
                        .getPOStore(), output.getAlias(), stats));
            } else {
                HJob hjob = new HJob(HJob.JOB_STATUS.FAILED, pigContext, output
                        .getPOStore(), output.getAlias(), stats);
                hjob.setException(js.getException());
                jobs.add(hjob);
            }
        }
    }
    return jobs;
}
 
开发者ID:sigmoidanalytics,项目名称:spork,代码行数:32,代码来源:PigServer.java

示例3: store

import org.apache.pig.tools.pigstats.OutputStats; //导入方法依赖的package包/类
/**
 * Executes a Pig Latin script up to and including indicated alias and stores the resulting
 * records into a file.  That is, if a user does:
 * <pre>
 * PigServer server = new PigServer();
 * server.registerQuery("A = load 'foo';");
 * server.registerQuery("B = filter A by $0 &gt; 0;");
 * server.registerQuery("C = order B by $1;");
 * </pre>
 * Then
 * <pre>
 * server.store("B", "bar", "mystorefunc");
 * </pre>
 * filtered but unsorted data will be stored to the file <tt>bar</tt> using
 * <tt>mystorefunc</tt>.  If instead a user does
 * <pre>
 * server.store("C", "bar", "mystorefunc");
 * </pre>
 * filtered and sorted data will be stored to the file <tt>bar</tt> using
 * <tt>mystorefunc</tt>.
 * <p>
 * @param id The alias to store
 * @param filename The file to which to store to
 * @param func store function to use
 * @return {@link ExecJob} containing information about this job
 * @throws IOException
 */
public ExecJob store(String id, String filename, String func)
        throws IOException {
    PigStats stats = storeEx(id, filename, func);
    if (stats.getOutputStats().size() < 1) {
        throw new IOException("Couldn't retrieve job.");
    }
    OutputStats output = stats.getOutputStats().get(0);

    if(stats.isSuccessful()){
        return  new HJob(JOB_STATUS.COMPLETED, pigContext, output
                .getPOStore(), output.getAlias(), stats);
    }else{
        HJob job = new HJob(JOB_STATUS.FAILED, pigContext,
                output.getPOStore(), output.getAlias(), stats);

        //check for exception
        Exception ex = null;
        for(JobStats js : stats.getJobGraph()){
            if(js.getException() != null) {
                ex = js.getException();
            }
        }
        job.setException(ex);
        return job;
    }
}
 
开发者ID:sigmoidanalytics,项目名称:spork-streaming,代码行数:54,代码来源:PigServer.java


注:本文中的org.apache.pig.tools.pigstats.OutputStats.getPOStore方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。