You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
data-maker/pipeline.py

396 lines
14 KiB
Python

#!/usr/bin/env python3
5 years ago
@staticmethod
print (['drone mode enabled ....'])
os.environ['CUDA_VISIBLE_DEVICES'] = str(args['gpu'])
data_comp = _args['data'][args['columns']].join(_dc[args['columns']],rsuffix='_io') #-- will be used for comparison (store this in big query)
else:
#
# This handles failures/recoveries for whatever reason