Feature: Sharefile to Snowflake DAG Class - #65

Open

mberrien-fitzsimons wants to merge 39 commits into

mainfrom

feature/sharefile_to_snowflake_dag_builder

Commits on Mar 6, 2025

test first class method
mberrien-fitzsimons
committed
6fe9c36

Commits on Mar 7, 2025

updated variable inputs to init and individual methods
mberrien-fitzsimons
committed
8ce7eb9
added dock strings to all methods
mberrien-fitzsimons
committed
40cac6f

Commits on Mar 10, 2025

updated local path organization
mberrien-fitzsimons
committed
d550d0c
updated way that dag is initialized
mberrien-fitzsimons
committed
36d9651
added global to dag
mberrien-fitzsimons
committed
7c4734f
updated dag call structure
mberrien-fitzsimons
committed
5d590b9
updated way params is called within Dag instantion
mberrien-fitzsimons
committed
efb510d
small update
mberrien-fitzsimons
committed
db969c8
updated file_sources to include .keys
mberrien-fitzsimons
committed
b335d66
updated dag to using eacustomdag
mberrien-fitzsimons
committed
2fa3399
updated param type to array
mberrien-fitzsimons
committed
58a0332

Commits on Mar 11, 2025

Commits on Mar 12, 2025

Commits on Mar 13, 2025

updated sharefile sources
mberrien-fitzsimons
committed
9a90112

Commits on Mar 14, 2025

re-ordered init arguments
mberrien-fitzsimons
committed
bd8408e

Commits on Mar 20, 2025

update to readme documentation
mberrien-fitzsimons
committed
bd50225
updated readme with yaml file showing file_sources
mberrien-fitzsimons
committed
6eff93a
added additional information to yaml section of readme
mberrien-fitzsimons
committed
df7cc14

Commits on Mar 21, 2025

updated s3 to snowflake task
mberrien-fitzsimons
committed
32b37ff
updated sharefile to snowflake dag builder
mberrien-fitzsimons
committed
e791ca2

Commits on Mar 24, 2025

added print statement for folder ID to see what is happening
mberrien-fitzsimons
committed
0f4ef7c
updated transfer_to_s3
mberrien-fitzsimons
committed
6f57bf6
removed partial method
mberrien-fitzsimons
committed
344ada0

Commits on Mar 25, 2025

added controle flow for choosing tansfer from s3 to snowflake step
mberrien-fitzsimons
committed
950ca35

Commits on Mar 27, 2025