当前位置: 首页>>代码示例>>Java>>正文


Java OriginalType.MAP属性代码示例

本文整理汇总了Java中org.apache.parquet.schema.OriginalType.MAP属性的典型用法代码示例。如果您正苦于以下问题:Java OriginalType.MAP属性的具体用法?Java OriginalType.MAP怎么用?Java OriginalType.MAP使用的例子?那么恭喜您, 这里精选的属性代码示例或许可以为您提供帮助。您也可以进一步了解该属性所在org.apache.parquet.schema.OriginalType的用法示例。


在下文中一共展示了OriginalType.MAP属性的3个代码示例,这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞,您的评价将有助于系统推荐出更棒的Java代码示例。

示例1: BagConverter

BagConverter(GroupType parquetSchema, FieldSchema pigSchema, ParentValueContainer parent, boolean numbersDefaultToZero, boolean columnIndexAccess) throws FrontendException {
  this.parent = parent;
  if (parquetSchema.getFieldCount() != 1) {
    throw new IllegalArgumentException("bags have only one field. " + parquetSchema + " size = " + parquetSchema.getFieldCount());
  }
  Type nestedType = parquetSchema.getType(0);

  ParentValueContainer childsParent;
  FieldSchema pigField;
  if (nestedType.isPrimitive() || nestedType.getOriginalType() == OriginalType.MAP || nestedType.getOriginalType() == OriginalType.LIST) {
    // Pig bags always contain tuples
    // In that case we need to wrap the value in an extra tuple
    childsParent = new ParentValueContainer() {
      @Override
      void add(Object value) {
        buffer.add(TF.newTuple(value));
      }};
    pigField = pigSchema.schema.getField(0).schema.getField(0);
  } else {
    childsParent = new ParentValueContainer() {
      @Override
      void add(Object value) {
        buffer.add((Tuple)value);
      }};
    pigField = pigSchema.schema.getField(0);
  }
  child = newConverter(pigField, nestedType, childsParent, numbersDefaultToZero, columnIndexAccess);
}
 
开发者ID:apache,项目名称:parquet-mr,代码行数:28,代码来源:TupleConverter.java

示例2: filterBag

private Type filterBag(GroupType bagType, FieldSchema bagFieldSchema) throws FrontendException {
  if (LOG.isDebugEnabled()) LOG.debug("filtering BAG schema:\n" + bagType + "\nwith:\n " + bagFieldSchema);
  if (bagType.getFieldCount() != 1) {
    throw new RuntimeException("not unwrapping the right type, this should be a Bag: " + bagType);
  }
  Type nested = bagType.getType(0);
  FieldSchema innerField = bagFieldSchema.schema.getField(0);
  if (nested.isPrimitive() || nested.getOriginalType() == OriginalType.MAP || nested.getOriginalType() == OriginalType.LIST) {
    // Bags always contain tuples => we skip the extra tuple that was inserted in that case.
    innerField = innerField.schema.getField(0);
  }
  return bagType.withNewFields(filter(nested, innerField));
}
 
开发者ID:apache,项目名称:parquet-mr,代码行数:13,代码来源:PigSchemaConverter.java

示例3: getOriginalType

OriginalType getOriginalType(ConvertedType type) {
  switch (type) {
    case UTF8:
      return OriginalType.UTF8;
    case MAP:
      return OriginalType.MAP;
    case MAP_KEY_VALUE:
      return OriginalType.MAP_KEY_VALUE;
    case LIST:
      return OriginalType.LIST;
    case ENUM:
      return OriginalType.ENUM;
    case DECIMAL:
      return OriginalType.DECIMAL;
    case DATE:
      return OriginalType.DATE;
    case TIME_MILLIS:
      return OriginalType.TIME_MILLIS;
    case TIME_MICROS:
      return OriginalType.TIME_MICROS;
    case TIMESTAMP_MILLIS:
      return OriginalType.TIMESTAMP_MILLIS;
    case TIMESTAMP_MICROS:
      return OriginalType.TIMESTAMP_MICROS;
    case INTERVAL:
      return OriginalType.INTERVAL;
    case INT_8:
      return OriginalType.INT_8;
    case INT_16:
      return OriginalType.INT_16;
    case INT_32:
      return OriginalType.INT_32;
    case INT_64:
      return OriginalType.INT_64;
    case UINT_8:
      return OriginalType.UINT_8;
    case UINT_16:
      return OriginalType.UINT_16;
    case UINT_32:
      return OriginalType.UINT_32;
    case UINT_64:
      return OriginalType.UINT_64;
    case JSON:
      return OriginalType.JSON;
    case BSON:
      return OriginalType.BSON;
    default:
      throw new RuntimeException("Unknown converted type " + type);
  }
}
 
开发者ID:apache,项目名称:parquet-mr,代码行数:50,代码来源:ParquetMetadataConverter.java


注:本文中的org.apache.parquet.schema.OriginalType.MAP属性示例由纯净天空整理自Github/MSDocs等开源代码及文档管理平台,相关代码片段筛选自各路编程大神贡献的开源项目,源码版权归原作者所有,传播和使用请参考对应项目的License;未经允许,请勿转载。