本文整理汇总了Java中org.apache.hadoop.yarn.util.ConverterUtils.getPathFromYarnURL方法的典型用法代码示例。如果您正苦于以下问题:Java ConverterUtils.getPathFromYarnURL方法的具体用法?Java ConverterUtils.getPathFromYarnURL怎么用?Java ConverterUtils.getPathFromYarnURL使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类org.apache.hadoop.yarn.util.ConverterUtils
的用法示例。
在下文中一共展示了ConverterUtils.getPathFromYarnURL方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。
示例1: LocalResourceRequest
import org.apache.hadoop.yarn.util.ConverterUtils; //导入方法依赖的package包/类
/**
* Wrap API resource to match against cache of localized resources.
* @param resource Resource requested by container
* @throws URISyntaxException If the path is malformed
*/
public LocalResourceRequest(LocalResource resource)
throws URISyntaxException {
this(ConverterUtils.getPathFromYarnURL(resource.getResource()),
resource.getTimestamp(),
resource.getType(),
resource.getVisibility(),
resource.getPattern());
}
示例2: verifyAccess
import org.apache.hadoop.yarn.util.ConverterUtils; //导入方法依赖的package包/类
/**
* Checks that the (original) remote file is either owned by the user who
* started the app or public.
*/
@VisibleForTesting
boolean verifyAccess() throws IOException {
// if it is in the public cache, it's trivially OK
if (resource.getVisibility() == LocalResourceVisibility.PUBLIC) {
return true;
}
final Path remotePath;
try {
remotePath = ConverterUtils.getPathFromYarnURL(resource.getResource());
} catch (URISyntaxException e) {
throw new IOException("Invalid resource", e);
}
// get the file status of the HDFS file
FileSystem remoteFs = remotePath.getFileSystem(conf);
FileStatus status = remoteFs.getFileStatus(remotePath);
// check to see if the file has been modified in any way
if (status.getModificationTime() != resource.getTimestamp()) {
LOG.warn("The remote file " + remotePath +
" has changed since it's localized; will not consider it for upload");
return false;
}
// check for the user ownership
if (status.getOwner().equals(user)) {
return true; // the user owns the file
}
// check if the file is publicly readable otherwise
return fileIsPublic(remotePath, remoteFs, status);
}