本文整理汇总了Python中pyspark.SparkContext.fitsFiles方法的典型用法代码示例。如果您正苦于以下问题：Python SparkContext.fitsFiles方法的具体用法？Python SparkContext.fitsFiles怎么用？Python SparkContext.fitsFiles使用的例子？那么恭喜您, 这里精选的方法代码示例或许可以为您提供帮助。您也可以进一步了解该方法所在类pyspark.SparkContext的用法示例。
在下文中一共展示了SparkContext.fitsFiles方法的1个代码示例，这些例子默认根据受欢迎程度排序。您可以为喜欢或者感觉有用的代码点赞，您的评价将有助于系统推荐出更棒的Python代码示例。
示例1: SparkContext
# 需要导入模块: from pyspark import SparkContext [as 别名]
# 或者: from pyspark.SparkContext import fitsFiles [as 别名]
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
#
import numpy as np
import sep
import sys
from astropy.io import fits
from astropy.wcs import WCS
import reproject
from reproject import reproject_interp
from pyspark import SparkContext
if __name__ == "__main__":
sc = SparkContext(appName="Reproject")
rdd = sc.fitsFiles("/Users/zhaozhang/projects/SDSS/data")
header = rdd.take(1).pop().pop().header
rprordd = rdd.map(lambda x: reproject_interp(x.pop(), header))
nrdd = rprordd.zipWithIndex()
nrdd.foreach(lambda ((array, footprint), index): fits.writeto(str(index)+".fits", array, header))
sc.stop()