本文整理汇总了Python中pyspark.rdd.RDD.mapValues方法的典型用法代码示例。如果您正苦于以下问题：Python RDD.mapValues方法的具体用法？Python RDD.mapValues怎么用？Python RDD.mapValues使用的例子？那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类pyspark.rdd.RDD的用法示例。
在下文中一共展示了RDD.mapValues方法的1个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Python代码示例。
示例1: asDataFrames
# 需要导入模块: from pyspark.rdd import RDD [as 别名]
# 或者: from pyspark.rdd.RDD import mapValues [as 别名]
def asDataFrames(self, *index_by):
'''
Reads the spanned rows as DataFrames if pandas is available, or as
a dict of numpy arrays if only numpy is available or as a dict with
primitives and objects otherwise.
@param index_by If pandas is available, the dataframes will be
indexed by the given columns.
'''
for c in index_by:
if c in self.columns:
raise ValueError('column %s cannot be used as index in the data'
'frames as it is a column by which the rows are spanned.')
columns = as_java_array(self.ctx._gateway, "String", (str(c) for c in self.columns))
jrdd = self._helper.spanBy(self._cjrdd, columns)
rdd = RDD(jrdd, self.ctx)
global pd
if index_by and pd:
return rdd.mapValues(lambda _: _.set_index(*[str(c) for c in index_by]))
else:
return rdd