本文整理匯總了Python中WMComponent.DBS3Buffer.DBSBufferUtil.DBSBufferUtil.findUploadableFilesByDAS方法的典型用法代碼示例。如果您正苦於以下問題：Python DBSBufferUtil.findUploadableFilesByDAS方法的具體用法？Python DBSBufferUtil.findUploadableFilesByDAS怎麽用？Python DBSBufferUtil.findUploadableFilesByDAS使用的例子？那麽, 這裏精選的方法代碼示例或許可以為您提供幫助。您也可以進一步了解該方法所在類WMComponent.DBS3Buffer.DBSBufferUtil.DBSBufferUtil的用法示例。
在下文中一共展示了DBSBufferUtil.findUploadableFilesByDAS方法的1個代碼示例，這些例子默認根據受歡迎程度排序。您可以為喜歡或者感覺有用的代碼點讚，您的評價將有助於係統推薦出更棒的Python代碼示例。
示例1: DBSUploadPoller
# 需要導入模塊: from WMComponent.DBS3Buffer.DBSBufferUtil import DBSBufferUtil [as 別名]
# 或者: from WMComponent.DBS3Buffer.DBSBufferUtil.DBSBufferUtil import findUploadableFilesByDAS [as 別名]
#.........這裏部分代碼省略.........
raise
except Exception as ex:
msg = "Unhandled exception while loading files for existing blocks.\n"
msg += str(ex)
logging.error(msg)
logging.debug("Blocks being loaded: %s\n", blockname)
raise DBSUploadException(msg)
# Add the loaded files to the block
for f in files:
block.addFile(f, self.datasetType, self.primaryDatasetType)
# Add to the cache
self.blockCache[blockInfo['block_name']] = block
return
def loadFiles(self):
"""
_loadFiles_
Load all files that need to be loaded. I will do this by DatasetPath
to break the monstrous calls down into smaller chunks.
"""
dspList = self.dbsUtil.findUploadableDAS()
readyBlocks = []
for dspInfo in dspList:
datasetpath = dspInfo['DatasetPath']
# Get the files
try:
loadedFiles = self.dbsUtil.findUploadableFilesByDAS(datasetpath=datasetpath)
except WMException:
raise
except Exception as ex:
msg = "Unhandled exception while loading uploadable files for DatasetPath.\n"
msg += str(ex)
logging.error(msg)
logging.debug("DatasetPath being loaded: %s\n", datasetpath)
raise DBSUploadException(msg)
# Sort the files and blocks by location
fileDict = sortListByKey(loadedFiles, 'locations')
# Now add each file
for location in fileDict.keys():
files = fileDict.get(location)
if len(files) > 0:
currentBlock = self.getBlock(files[0], location, True)
currentBlock.setAcquisitionEra(era=dspInfo['AcquisitionEra'])
currentBlock.setProcessingVer(procVer=dspInfo['ProcessingVer'])
for newFile in files:
if not newFile.get('block', 1) is None:
# Then this file already has a block
# It should be accounted for somewhere
# Or loaded with the block
continue
# Check if we can put files in this block