Skip to content

Add storage integration to CSVConfig#257

Merged
davidwzhao merged 4 commits into
mainfrom
dz-csv-export-storage-integration
Jun 12, 2026
Merged

Add storage integration to CSVConfig#257
davidwzhao merged 4 commits into
mainfrom
dz-csv-export-storage-integration

Conversation

@davidwzhao

Copy link
Copy Markdown
Contributor

This PR adds storage integration options for CSVConfig. These allow reading/writing to and from private s3/azure buckets with SAS tokens or private keys etc.

davidwzhao and others added 3 commits June 10, 2026 14:35
Make CSVConfig.storage_integration optional and parse/print it as a nested
(storage_integration {...}) config_dict. Secret credentials are masked as "***".

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Rename the grammar nonterm to storage_integration so it no longer collides
with the auto-generated CSVStorageIntegration message printer, and regenerate
the SDK parsers/printers.

Add a csv_storage_integration fixture (S3/Azure import + S3 export) plus unit
tests covering secret masking.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
Comment thread proto/relationalai/lqp/v1/logic.proto Outdated

@comnik comnik left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

One naming suggestion, otherwise looks good

Rename the grammar nonterm to _storage_integration to avoid colliding with
the renamed message's printer, and regenerate the SDKs.

Co-Authored-By: Claude Opus 4.8 (1M context) <noreply@anthropic.com>
@davidwzhao davidwzhao merged commit 00da0f1 into main Jun 12, 2026
5 checks passed
@davidwzhao davidwzhao deleted the dz-csv-export-storage-integration branch June 12, 2026 05:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants