当前位置: 首页>>代码示例>>Java>>正文


Java FileDeletionTask类代码示例

本文整理汇总了Java中org.apache.hadoop.yarn.server.nodemanager.DeletionService.FileDeletionTask的典型用法代码示例。如果您正苦于以下问题:Java FileDeletionTask类的具体用法?Java FileDeletionTask怎么用?Java FileDeletionTask使用的例子?那么恭喜您, 这里精选的类代码示例或许可以为您提供帮助。


FileDeletionTask类属于org.apache.hadoop.yarn.server.nodemanager.DeletionService包,在下文中一共展示了FileDeletionTask类的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: cleanUpFilesPerUserDir

import org.apache.hadoop.yarn.server.nodemanager.DeletionService.FileDeletionTask; //导入依赖的package包/类
private void cleanUpFilesPerUserDir(FileContext lfs, DeletionService del,
    Path userDirPath) throws IOException {
  RemoteIterator<FileStatus> userDirStatus = lfs.listStatus(userDirPath);
  FileDeletionTask dependentDeletionTask =
      del.createFileDeletionTask(null, userDirPath, new Path[] {});
  if (userDirStatus != null && userDirStatus.hasNext()) {
    List<FileDeletionTask> deletionTasks = new ArrayList<FileDeletionTask>();
    while (userDirStatus.hasNext()) {
      FileStatus status = userDirStatus.next();
      String owner = status.getOwner();
      FileDeletionTask deletionTask =
          del.createFileDeletionTask(owner, null,
            new Path[] { status.getPath() });
      deletionTask.addFileDeletionTaskDependency(dependentDeletionTask);
      deletionTasks.add(deletionTask);
    }
    for (FileDeletionTask task : deletionTasks) {
      del.scheduleFileDeletionTask(task);
    }
  } else {
    del.scheduleFileDeletionTask(dependentDeletionTask);
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:24,代码来源:ResourceLocalizationService.java

示例2: cleanUpFilesPerUserDir

import org.apache.hadoop.yarn.server.nodemanager.DeletionService.FileDeletionTask; //导入依赖的package包/类
private void cleanUpFilesPerUserDir(FileContext lfs, DeletionService del,
    Path userDirPath) throws IOException {
  RemoteIterator<FileStatus> userDirStatus = lfs.listStatus(userDirPath);
  FileDeletionTask dependentDeletionTask =
      del.createFileDeletionTask(null, userDirPath, new Path[] {});
  if (userDirStatus != null) {
    List<FileDeletionTask> deletionTasks = new ArrayList<FileDeletionTask>();
    while (userDirStatus.hasNext()) {
      FileStatus status = userDirStatus.next();
      String owner = status.getOwner();
      FileDeletionTask deletionTask =
          del.createFileDeletionTask(owner, null,
            new Path[] { status.getPath() });
      deletionTask.addFileDeletionTaskDependency(dependentDeletionTask);
      deletionTasks.add(deletionTask);
    }
    for (FileDeletionTask task : deletionTasks) {
      del.scheduleFileDeletionTask(task);
    }
  } else {
    del.scheduleFileDeletionTask(dependentDeletionTask);
  }
}
 
开发者ID:ict-carch,项目名称:hadoop-plus,代码行数:24,代码来源:ResourceLocalizationService.java

示例3: matches

import org.apache.hadoop.yarn.server.nodemanager.DeletionService.FileDeletionTask; //导入依赖的package包/类
@Override
public boolean matches(Object o) {
  FileDeletionTask fd = (FileDeletionTask)o;
  if (fd.getUser() == null && user != null) {
    return false;
  } else if (fd.getUser() != null && user == null) {
    return false;
  } else if (fd.getUser() != null && user != null) {
    return fd.getUser().equals(user);
  }
  if (!comparePaths(fd.getSubDir(), subDirIncludes)) {
    return false;
  }
  if (baseDirIncludes == null && fd.getBaseDirs() != null) {
    return false;
  } else if (baseDirIncludes != null && fd.getBaseDirs() == null ) {
    return false;
  } else if (baseDirIncludes != null && fd.getBaseDirs() != null) {
    if (baseDirIncludes.length != fd.getBaseDirs().size()) {
      return false;
    }
    for (int i =0 ; i < baseDirIncludes.length; i++) {
      if (!comparePaths(fd.getBaseDirs().get(i), baseDirIncludes[i])) {
        return false;
      }
    }
  }
  return true;
}
 
开发者ID:naver,项目名称:hadoop,代码行数:30,代码来源:TestNodeManagerReboot.java


注:本文中的org.apache.hadoop.yarn.server.nodemanager.DeletionService.FileDeletionTask类示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。