当前位置: 首页>>代码示例>>Java>>正文


Java Notifications.notifyBeginTransaction方法代码示例

本文整理汇总了Java中org.kitesdk.morphline.base.Notifications.notifyBeginTransaction方法的典型用法代码示例。如果您正苦于以下问题:Java Notifications.notifyBeginTransaction方法的具体用法?Java Notifications.notifyBeginTransaction怎么用?Java Notifications.notifyBeginTransaction使用的例子?那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在org.kitesdk.morphline.base.Notifications的用法示例。


在下文中一共展示了Notifications.notifyBeginTransaction方法的5个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: testLoadSolrBasic

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testLoadSolrBasic() throws Exception {
  //System.setProperty("ENV_SOLR_HOME", testSolrHome + "/collection1");
  morphline = createMorphline("test-morphlines/loadSolrBasic");    
  //System.clearProperty("ENV_SOLR_HOME");
  Record record = new Record();
  record.put(Fields.ID, "id0");
  record.put("first_name", "Nadja"); // will be sanitized
  startSession();
  Notifications.notifyBeginTransaction(morphline);
  assertTrue(morphline.process(record));
  assertEquals(1, collector.getNumStartEvents());
  Notifications.notifyCommitTransaction(morphline);
  Record expected = new Record();
  expected.put(Fields.ID, "id0");
  assertEquals(Arrays.asList(expected), collector.getRecords());
  assertEquals(1, queryResultSetSize("*:*"));
  Notifications.notifyRollbackTransaction(morphline);
  Notifications.notifyShutdown(morphline);
}
 
开发者ID:europeana,项目名称:search,代码行数:21,代码来源:SolrMorphlineTest.java

示例2: testTokenizeText

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testTokenizeText() throws Exception {
  morphline = createMorphline("test-morphlines" + File.separator + "tokenizeText");
  for (int i = 0; i < 3; i++) {
    Record record = new Record();
    record.put(Fields.MESSAGE, "Hello World!");
    record.put(Fields.MESSAGE, "\[email protected] #%()123");
    Record expected = record.copy();
    expected.getFields().putAll("tokens", Arrays.asList("hello", "world", "foo", "bar.com", "123"));
    collector.reset();
    startSession();
    Notifications.notifyBeginTransaction(morphline);
    assertTrue(morphline.process(record));
    assertEquals(1, collector.getNumStartEvents());
    Notifications.notifyCommitTransaction(morphline);
    assertEquals(expected, collector.getFirstRecord());
  }
}
 
开发者ID:europeana,项目名称:search,代码行数:19,代码来源:SolrMorphlineTest.java

示例3: setPipeline

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
/**
 *
 * @param morphlineFile
 * @param morphlineId
 * @param collector
 * @param isProduction
 * @return
 */
public static Pipeline setPipeline(String morphlineFile, String morphlineId, Collector collector, boolean isProduction) {
  LOG.debug("Constructing Pipeline[{}#{}]", morphlineFile, morphlineId);

  // Set up the Morphline context and handler
  MorphlineContext context = new MorphlineContext.Builder()
      .setExceptionHandler(new FaultTolerance(isProduction, false))
      .build();

  // Compile the Morphline process
  Command morphline;
  try {
    morphline = new Compiler().compile(
        new File(morphlineFile),
        morphlineId,
        context,
        collector);
  } catch (Exception e) {
    throw new MorphlineCompilationException("Morphline compilation error", null, e);
  }

  // Create the pipeline wrapper
  Pipeline pipeline = new Pipeline(morphline, collector);

  // Ensure shutdown notification to Morphline commands esp in streaming environments
  JVMUtils.closeAtShutdown(pipeline);

  // Prep the pipeline
  Notifications.notifyBeginTransaction(pipeline.getMorphline());

  // Register the pipeline into the cache
  if (null == pipelineCache.get()) {
    pipelineCache.set(new HashMap<String, Pipeline>());
  }
  pipelineCache.get().put(morphlineFile + SEPARATOR + morphlineId, pipeline);

  LOG.trace("Pipeline[{}#{}] prepared", morphlineFile, morphlineId);
  return pipeline;
}
 
开发者ID:cloudera-labs,项目名称:envelope,代码行数:47,代码来源:MorphlineUtils.java

示例4: testSimpleCSV

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Test
public void testSimpleCSV() throws Exception {
  morphline = createMorphline("test-morphlines/simpleCSV");

  Notifications.notifyBeginTransaction(morphline);

  InputStream in = new FileInputStream(new File(RESOURCES_DIR + "/test-documents/simpleCSV.txt"));
  Record record = new Record();
  record.put(Fields.ATTACHMENT_BODY, in);
  record.put(Fields.ATTACHMENT_MIME_TYPE, "text/plain");

  // Actually process the input file.
  assertTrue(morphline.process(record));

  assertEquals(collector.getRecords().size(), 2);
  Record rec = collector.getRecords().get(0);

  // Since id and timestamp vary with run, just see if they have anything in them
  assertTrue(rec.get("id").toString().length() > 5);
  assertTrue(rec.get("timestamp").toString().length() > 5);
  assertEquals(rec.get("text").toString(), "[text for body]");

  // Now look at second record
  rec = collector.getRecords().get(1);

  assertTrue(rec.get("id").toString().length() > 5);
  assertTrue(rec.get("timestamp").toString().length() > 5);
  assertEquals(rec.get("text").toString(), "[second record]");

  in.close();
  Notifications.notifyCommitTransaction(morphline);
}
 
开发者ID:kite-sdk,项目名称:kite-examples,代码行数:33,代码来源:ExampleMorphlineTest.java

示例5: beginTransaction

import org.kitesdk.morphline.base.Notifications; //导入方法依赖的package包/类
@Override
public void beginTransaction() {
  Notifications.notifyBeginTransaction(morphline);      
}
 
开发者ID:moueimei,项目名称:flume-release-1.7.0,代码行数:5,代码来源:MorphlineHandlerImpl.java


注:本文中的org.kitesdk.morphline.base.Notifications.notifyBeginTransaction方法示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。