Skip to content

Yaml schema config - #91

Open
azimov wants to merge 8 commits into
developfrom
yaml-schema-config
Open

Yaml schema config#91
azimov wants to merge 8 commits into
developfrom
yaml-schema-config

Conversation

@azimov

@azimov azimov commented Jul 15, 2026

Copy link
Copy Markdown
Collaborator

Move to use YAML files for schema definitions in packages instead of CSV files

Comment thread R/SchemaGenerator.R
CREATE TABLE @database_schema.@table_prefix@table_name (
@table_columns
);
)@partition_by;

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One limitation with the approach in this is that the upload for partitions in postgres is probably to insert with load tables that don't have indexes and then attach the partitions after large data inserts.

For small studies, this will not matter but where we actually see performance improvements from partitioning (e.g. a single covariate table for each cdm is > 2Gb) this matters a lot.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant