You cannot select more than 25 topics Topics must start with a letter or number, can include dashes ('-') and can be up to 35 characters long.
data-maker/pipeline.py

535 lines
17 KiB
Python

#!/usr/bin/env python3
5 years ago
@staticmethod
df = pd.read_gbq(SQL,credentials=credentials,dialect='standard')
else :
4 years ago
4 years ago
4 years ago
_columns = set(df.columns) - set(_df.columns)
4 years ago
#
# @TODO:
# Log what was initiated so we have context of this processing ...
#
# jobs = [job for job in jobs if job.is_alive()]
# time.sleep(2)