当前位置: 首页>>代码示例>>Java>>正文


Java DFSUtil.setGenericConf方法代码示例

本文整理汇总了Java中org.apache.hadoop.hdfs.DFSUtil.setGenericConf方法的典型用法代码示例。如果您正苦于以下问题:Java DFSUtil.setGenericConf方法的具体用法?Java DFSUtil.setGenericConf怎么用?Java DFSUtil.setGenericConf使用的例子?那么, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hdfs.DFSUtil的用法示例。


在下文中一共展示了DFSUtil.setGenericConf方法的2个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: initializeGenericKeys

import org.apache.hadoop.hdfs.DFSUtil; //导入方法依赖的package包/类
/**
 * In federation configuration is set for a set of
 * namenode and secondary namenode/backup/checkpointer, which are
 * grouped under a logical nameservice ID. The configuration keys specific 
 * to them have suffix set to configured nameserviceId.
 * 
 * This method copies the value from specific key of format key.nameserviceId
 * to key, to set up the generic configuration. Once this is done, only
 * generic version of the configuration is read in rest of the code, for
 * backward compatibility and simpler code changes.
 * 
 * @param conf
 *          Configuration object to lookup specific key and to set the value
 *          to the key passed. Note the conf object is modified
 * @param nameserviceId name service Id (to distinguish federated NNs)
 * @param namenodeId the namenode ID (to distinguish HA NNs)
 * @see DFSUtil#setGenericConf(Configuration, String, String, String...)
 */
public static void initializeGenericKeys(Configuration conf,
    String nameserviceId, String namenodeId) {
  if ((nameserviceId != null && !nameserviceId.isEmpty()) || 
      (namenodeId != null && !namenodeId.isEmpty())) {
    if (nameserviceId != null) {
      conf.set(DFS_NAMESERVICE_ID, nameserviceId);
    }
    if (namenodeId != null) {
      conf.set(DFS_HA_NAMENODE_ID_KEY, namenodeId);
    }
    
    DFSUtil.setGenericConf(conf, nameserviceId, namenodeId,
        NAMENODE_SPECIFIC_KEYS);
    DFSUtil.setGenericConf(conf, nameserviceId, null,
        NAMESERVICE_SPECIFIC_KEYS);
  }
  
  // If the RPC address is set use it to (re-)configure the default FS
  if (conf.get(DFS_NAMENODE_RPC_ADDRESS_KEY) != null) {
    URI defaultUri = URI.create(HdfsConstants.HDFS_URI_SCHEME + "://"
        + conf.get(DFS_NAMENODE_RPC_ADDRESS_KEY));
    conf.set(FS_DEFAULT_NAME_KEY, defaultUri.toString());
    LOG.debug("Setting " + FS_DEFAULT_NAME_KEY + " to " + defaultUri.toString());
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:44,代码来源:NameNode.java

示例2: create

import org.apache.hadoop.hdfs.DFSUtil; //导入方法依赖的package包/类
public static DFSZKFailoverController create(Configuration conf) {
  Configuration localNNConf = DFSHAAdmin.addSecurityConfiguration(conf);
  String nsId = DFSUtil.getNamenodeNameServiceId(conf);

  if (!HAUtil.isHAEnabled(localNNConf, nsId)) {
    throw new HadoopIllegalArgumentException(
        "HA is not enabled for this namenode.");
  }
  String nnId = HAUtil.getNameNodeId(localNNConf, nsId);
  if (nnId == null) {
    String msg = "Could not get the namenode ID of this node. " +
        "You may run zkfc on the node other than namenode.";
    throw new HadoopIllegalArgumentException(msg);
  }
  NameNode.initializeGenericKeys(localNNConf, nsId, nnId);
  DFSUtil.setGenericConf(localNNConf, nsId, nnId, ZKFC_CONF_KEYS);
  
  NNHAServiceTarget localTarget = new NNHAServiceTarget(
      localNNConf, nsId, nnId);
  return new DFSZKFailoverController(localNNConf, localTarget);
}
 
开发者ID:naver,项目名称:hadoop,代码行数:22,代码来源:DFSZKFailoverController.java


注:本文中的org.apache.hadoop.hdfs.DFSUtil.setGenericConf方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。