Feature/lightbeam delete dag

[sleblanc23]

No description provided.

[sleblanc23]

Test implementation: https://github.com/edanalytics/stadium_gsn/blob/feature/lightbeam_delete_dag/airflow/dags/lightbeam_delete_dag.py

[jayckaiser]

The code is beautiful. It brings a tear to my eye. I look forward to giving this a shot in South Carolina!

[sleblanc23]

I realized that the accident-prevention step of requiring at least one query parameter isn't very strong. If you have a typo in the key, such as "aaaaassessmentIdentifier": "NWEA-Map", it will fetch and subsequently delete all records from the resource. I think we should put some limits on this before it's released, perhaps requiring at least an assessmentIdentifier parameter.

[sleblanc23]

Added a fail-safe task that checks whether all of the records will be deleted from any resource. This guards against the possibility of no valid query parameters being passed (due to a typo in the query key, for example) and all records being returned for deletion. However this also means that if there is only one assessment in an ODS, for example, the DAG cannot delete it. I think this is a reasonable safety measure but am definitely open to other ideas.