当前位置: 首页>>代码示例>>Java>>正文


Java MiniJournalCluster.getCurrentDir方法代码示例

本文整理汇总了Java中org.apache.hadoop.hdfs.qjournal.MiniJournalCluster.getCurrentDir方法的典型用法代码示例。如果您正苦于以下问题:Java MiniJournalCluster.getCurrentDir方法的具体用法?Java MiniJournalCluster.getCurrentDir怎么用?Java MiniJournalCluster.getCurrentDir使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.apache.hadoop.hdfs.qjournal.MiniJournalCluster的用法示例。


在下文中一共展示了MiniJournalCluster.getCurrentDir方法的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: checkRecovery

import org.apache.hadoop.hdfs.qjournal.MiniJournalCluster; //导入方法依赖的package包/类
private void checkRecovery(MiniJournalCluster cluster,
    long segmentTxId, long expectedEndTxId)
    throws IOException {
  int numFinalized = 0;
  for (int i = 0; i < cluster.getNumNodes(); i++) {
    File logDir = cluster.getCurrentDir(i, JID);
    EditLogFile elf = FileJournalManager.getLogFile(logDir, segmentTxId);
    if (elf == null) {
      continue;
    }
    if (!elf.isInProgress()) {
      numFinalized++;
      if (elf.getLastTxId() != expectedEndTxId) {
        fail("File " + elf + " finalized to wrong txid, expected " +
            expectedEndTxId);
      }
    }      
  }
  
  if (numFinalized < cluster.getQuorumSize()) {
    fail("Did not find a quorum of finalized logs starting at " +
        segmentTxId);
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:25,代码来源:TestQuorumJournalManager.java

示例2: testRollbackWithQJM

import org.apache.hadoop.hdfs.qjournal.MiniJournalCluster; //导入方法依赖的package包/类
@Test
public void testRollbackWithQJM() throws Exception {
  final Configuration conf = new HdfsConfiguration();
  MiniJournalCluster mjc = null;
  MiniDFSCluster cluster = null;
  final Path foo = new Path("/foo");
  final Path bar = new Path("/bar");

  try {
    mjc = new MiniJournalCluster.Builder(conf).numJournalNodes(
        NUM_JOURNAL_NODES).build();
    conf.set(DFSConfigKeys.DFS_NAMENODE_EDITS_DIR_KEY, mjc
        .getQuorumJournalURI(JOURNAL_ID).toString());
    cluster = new MiniDFSCluster.Builder(conf).numDataNodes(0).build();
    cluster.waitActive();

    DistributedFileSystem dfs = cluster.getFileSystem();
    final DFSAdmin dfsadmin = new DFSAdmin(conf);
    dfs.mkdirs(foo);

    // start rolling upgrade
    dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    Assert.assertEquals(0,
        dfsadmin.run(new String[] { "-rollingUpgrade", "prepare" }));
    dfs.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);
    // create new directory
    dfs.mkdirs(bar);
    dfs.close();

    // rollback
    cluster.restartNameNode("-rollingUpgrade", "rollback");
    // make sure /foo is still there, but /bar is not
    dfs = cluster.getFileSystem();
    Assert.assertTrue(dfs.exists(foo));
    Assert.assertFalse(dfs.exists(bar));

    // check storage in JNs
    for (int i = 0; i < NUM_JOURNAL_NODES; i++) {
      File dir = mjc.getCurrentDir(0, JOURNAL_ID);
      // segments:(startSegment, mkdir, endSegment), (startSegment, upgrade
      // marker, mkdir, endSegment)
      checkJNStorage(dir, 4, 7);
    }
  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
    if (mjc != null) {
      mjc.shutdown();
    }
  }
}
 
开发者ID:naver,项目名称:hadoop,代码行数:53,代码来源:TestRollingUpgradeRollback.java

示例3: testRollbackWithQJM

import org.apache.hadoop.hdfs.qjournal.MiniJournalCluster; //导入方法依赖的package包/类
@Test
public void testRollbackWithQJM() throws Exception {
  final Configuration conf = new HdfsConfiguration();
  MiniJournalCluster mjc = null;
  MiniDFSCluster cluster = null;
  final Path foo = new Path("/foo");
  final Path bar = new Path("/bar");

  try {
    mjc = new MiniJournalCluster.Builder(conf).numJournalNodes(
        NUM_JOURNAL_NODES).build();
    mjc.waitActive();
    conf.set(DFSConfigKeys.DFS_NAMENODE_EDITS_DIR_KEY, mjc
        .getQuorumJournalURI(JOURNAL_ID).toString());
    cluster = new MiniDFSCluster.Builder(conf).numDataNodes(0).build();
    cluster.waitActive();

    DistributedFileSystem dfs = cluster.getFileSystem();
    final DFSAdmin dfsadmin = new DFSAdmin(conf);
    dfs.mkdirs(foo);

    // start rolling upgrade
    dfs.setSafeMode(SafeModeAction.SAFEMODE_ENTER);
    Assert.assertEquals(0,
        dfsadmin.run(new String[] { "-rollingUpgrade", "prepare" }));
    dfs.setSafeMode(SafeModeAction.SAFEMODE_LEAVE);
    // create new directory
    dfs.mkdirs(bar);
    dfs.close();

    // rollback
    cluster.restartNameNode("-rollingUpgrade", "rollback");
    // make sure /foo is still there, but /bar is not
    dfs = cluster.getFileSystem();
    Assert.assertTrue(dfs.exists(foo));
    Assert.assertFalse(dfs.exists(bar));

    // check storage in JNs
    for (int i = 0; i < NUM_JOURNAL_NODES; i++) {
      File dir = mjc.getCurrentDir(0, JOURNAL_ID);
      // segments:(startSegment, mkdir, endSegment), (startSegment, upgrade
      // marker, mkdir, endSegment)
      checkJNStorage(dir, 4, 7);
    }
  } finally {
    if (cluster != null) {
      cluster.shutdown();
    }
    if (mjc != null) {
      mjc.shutdown();
    }
  }
}
 
开发者ID:aliyun-beta,项目名称:aliyun-oss-hadoop-fs,代码行数:54,代码来源:TestRollingUpgradeRollback.java


注:本文中的org.apache.hadoop.hdfs.qjournal.MiniJournalCluster.getCurrentDir方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。