Oracle QSA Core: CLAIM, EMPLOYER, POLICY, PAYMENTS Change column: LAST_UPDATED

SAP or ERP extracts Files via SFTP or Blob

3rd party APIs REST JSON

Azure Data Factory (ADF) Parameterised pipelines Self-Hosted IR for Oracle Retries and alerts

Fivetran Oracle connector CDC where feasible 15-60 min sync

ADF connectors for SFTP and REST Schema-drift tolerant copy

ADLS Gen2 Raw (Bronze) Parquet or Delta Partitioned by load date and business key Audit logs

Snowflake RAW (optional) 1:1 source replica for CDC merge

Databricks (PySpark, Delta) Cleansing and standardisation Referential checks Schema evolution

dbt Staging models Source freshness and contracts Tests: not_null, unique, relationships, accepted_values

Microsoft Purview Glossary and data domains End-to-end lineage Sensitivity labels

Security and IAM Azure AD SSO and RBAC Key Vault credentials Access recertification and break-glass

dbt Core models SCD Type 2 dimensions Surrogate keys Late-arriving facts Snapshots for status history

Snowflake Data Warehouse Star schemas (facts and dims) RBAC and row access policies Dynamic masking Virtual warehouses

Power BI Datasets (Certified) Star-schema only Standard DAX measures Aggregations for DirectQuery or Composite

Power BI Security RLS and OLS with AAD groups Division or Region filters Sensitive columns hidden

Power BI Apps and Reports Live connection to shared datasets Workspace separation Dev Test Prod

Monitoring and Ops Power BI Admin APIs usage and refresh health ADF pipeline runs and alerts dbt test results Snowflake query profile

Schedule and IR connectivity

JDBC Oracle, CDC and snapshots

Files copy

REST copy

Auto load Parquet or Delta

Schedule and retries

Raw drop zone

Optional direct load

Delta reads

Conformed outputs

dbt run staging

dbt run dims and facts

Snowflake connector

Endorsement and usage

SSO and RBAC to DW

Runs and alerts

Tests and docs

Access history and masking

AAD groups for RLS