当前位置: 首页>>代码示例>>Java>>正文


Java Notifications.notifyCommitTransaction方法代码示例

本文整理汇总了Java中org.kitesdk.morphline.base.Notifications.notifyCommitTransaction方法的典型用法代码示例。如果您正苦于以下问题:Java Notifications.notifyCommitTransaction方法的具体用法?Java Notifications.notifyCommitTransaction怎么用?Java Notifications.notifyCommitTransaction使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.kitesdk.morphline.base.Notifications的用法示例。


在下文中一共展示了Notifications.notifyCommitTransaction方法的7个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: testLoadSolrBasic

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testLoadSolrBasic() throws Exception {
  //System.setProperty("ENV_SOLR_HOME", testSolrHome + "/collection1");
  morphline = createMorphline("test-morphlines/loadSolrBasic");    
  //System.clearProperty("ENV_SOLR_HOME");
  Record record = new Record();
  record.put(Fields.ID, "id0");
  record.put("first_name", "Nadja"); // will be sanitized
  startSession();
  Notifications.notifyBeginTransaction(morphline);
  assertTrue(morphline.process(record));
  assertEquals(1, collector.getNumStartEvents());
  Notifications.notifyCommitTransaction(morphline);
  Record expected = new Record();
  expected.put(Fields.ID, "id0");
  assertEquals(Arrays.asList(expected), collector.getRecords());
  assertEquals(1, queryResultSetSize("*:*"));
  Notifications.notifyRollbackTransaction(morphline);
  Notifications.notifyShutdown(morphline);
}
 
开发者ID:europeana,项目名称:search,代码行数:21,代码来源:SolrMorphlineTest.java

示例2: testTokenizeText

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testTokenizeText() throws Exception {
  morphline = createMorphline("test-morphlines" + File.separator + "tokenizeText");
  for (int i = 0; i < 3; i++) {
    Record record = new Record();
    record.put(Fields.MESSAGE, "Hello World!");
    record.put(Fields.MESSAGE, "\[email protected] #%()123");
    Record expected = record.copy();
    expected.getFields().putAll("tokens", Arrays.asList("hello", "world", "foo", "bar.com", "123"));
    collector.reset();
    startSession();
    Notifications.notifyBeginTransaction(morphline);
    assertTrue(morphline.process(record));
    assertEquals(1, collector.getNumStartEvents());
    Notifications.notifyCommitTransaction(morphline);
    assertEquals(expected, collector.getFirstRecord());
  }
}
 
开发者ID:europeana,项目名称:search,代码行数:19,代码来源:SolrMorphlineTest.java

示例3: executePipeline

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
public static List<Record> executePipeline(Pipeline pipeline, Record inputRecord) {
  Command morphline = pipeline.getMorphline();

  try {
    LOG.trace("Input Record: {}", inputRecord);

    // Process the Record
    Notifications.notifyStartSession(morphline);
    boolean success = morphline.process(inputRecord);
    Notifications.notifyCommitTransaction(morphline);

    if (!success) {
      throw new MorphlineRuntimeException("Morphline failed to process incoming Record: " + inputRecord);
    }

    // Collect the output
    List<Record> outputRecords = pipeline.getCollector().getRecords();
    if (!outputRecords.iterator().hasNext()) {
      throw new MorphlineRuntimeException("Morphline did not produce output Record(s)");
    }
    LOG.trace("Output Record(s): {}", outputRecords);

    return outputRecords;

  } catch (RuntimeException e) {
    Notifications.notifyRollbackTransaction(morphline);
    // TODO : Review exception handling
    LOG.warn("Morphline failed to execute properly on incoming Record: " + inputRecord, e);
    throw e;
  }
}
 
开发者ID:cloudera-labs,项目名称:envelope,代码行数:32,代码来源:MorphlineUtils.java

示例4: testSimpleCSV

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testSimpleCSV() throws Exception {
  morphline = createMorphline("test-morphlines/simpleCSV");

  Notifications.notifyBeginTransaction(morphline);

  InputStream in = new FileInputStream(new File(RESOURCES_DIR + "/test-documents/simpleCSV.txt"));
  Record record = new Record();
  record.put(Fields.ATTACHMENT_BODY, in);
  record.put(Fields.ATTACHMENT_MIME_TYPE, "text/plain");

  // Actually process the input file.
  assertTrue(morphline.process(record));

  assertEquals(collector.getRecords().size(), 2);
  Record rec = collector.getRecords().get(0);

  // Since id and timestamp vary with run, just see if they have anything in them
  assertTrue(rec.get("id").toString().length() > 5);
  assertTrue(rec.get("timestamp").toString().length() > 5);
  assertEquals(rec.get("text").toString(), "[text for body]");

  // Now look at second record
  rec = collector.getRecords().get(1);

  assertTrue(rec.get("id").toString().length() > 5);
  assertTrue(rec.get("timestamp").toString().length() > 5);
  assertEquals(rec.get("text").toString(), "[second record]");

  in.close();
  Notifications.notifyCommitTransaction(morphline);
}
 
开发者ID:kite-sdk,项目名称:kite-examples,代码行数:33,代码来源:ExampleMorphlineTest.java

示例5: commitTransaction

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Override
public void commitTransaction() {
  Notifications.notifyCommitTransaction(morphline);      
}
 
开发者ID:moueimei,项目名称:flume-release-1.7.0,代码行数:5,代码来源:MorphlineHandlerImpl.java

示例6: commit

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Override
protected void commit() throws Exception {
  Notifications.notifyCommitTransaction(morphline);    
  super.commit();
}
 
开发者ID:europeana,项目名称:search,代码行数:6,代码来源:AbstractSolrMorphlineZkTestBase.java

示例7: cleanup

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
public void cleanup() {
  Notifications.notifyCommitTransaction(morphline);
  Notifications.notifyShutdown(morphline);
}
 
开发者ID:europeana,项目名称:search,代码行数:5,代码来源:MorphlineMapRunner.java


注:本文中的org.kitesdk.morphline.base.Notifications.notifyCommitTransaction方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。