Skip to content

fix(push): deleted data points (NA) logging - #18

Merged
EstebanMontandon merged 3 commits into
mainfrom
fix_deleted_counts_log
Sep 30, 2026
Merged

EstebanMontandon merged 3 commits into
mainfrom
fix_deleted_counts_log

Conversation

@EstebanMontandon

Copy link
Copy Markdown
Collaborator

Small fix to separate the import summary counts between regular imports (data points) and data points to delete (value = NA).
The current code is logging a confusing message including the total number in the summary, example below:

2026-09-11 19:24:37,608 - INFO - Pushing 6 data points with NA values.
2026-09-11 19:24:37,782 - WARNING - 6 data points will be set to NA. Please check the last execution report for details.
2026-09-11 19:24:37,915 - WARNING - 1. ...
...
2026-09-11 19:24:37,915 - WARNING - 6. ...
2026-09-11 19:25:09,631 - INFO - 6 / 6 data points processed. Final summary: {'imported': 22515, 'updated': 397, 'ignored': 2930223, 'deleted': 0}
2026-09-11 19:25:09,789 - INFO - Data points delete summary: {'imported': 22515, 'updated': 397, 'ignored': 2930223, 'deleted': 0}

After the fix the messages should be separated between imported (normal points) and deleted points for clarity.
No further functional changes.

@lgarridobsq lgarridobsq left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Very nice, I only left 1 stupid comment -- don't forget to up the version

Comment thread d2d_development/d2d_development/push.py Outdated
f" Final summary: {self.summary['import_counts']}"
)
self._log_message(f"{processed_points} / {total_data_points} data points processed.")
self._log_message(f"Final summary: {self.summary[summary_key]}")

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You say final summary in both the cases of pushing-pushing and pushing-deleting -- ¿maybe that is a bit confusing?

@EstebanMontandon
EstebanMontandon merged commit 46d7635 into main Sep 30, 2026
2 of 3 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants