Skip to content

feat(gooddata-sdk): add CSV upload support for GDSTORAGE data sources#1408

Merged
hkad98 merged 3 commits intogooddata:masterfrom
hkad98:jkd/csv-upload
Mar 13, 2026
Merged

feat(gooddata-sdk): add CSV upload support for GDSTORAGE data sources#1408
hkad98 merged 3 commits intogooddata:masterfrom
hkad98:jkd/csv-upload

Conversation

@hkad98
Copy link
Contributor

@hkad98 hkad98 commented Mar 13, 2026

Summary

  • Add result OpenAPI spec to api-client generation, bringing typed endpoints and models for CSV staging upload, analysis, import, file listing, and deletion
  • Add CatalogDataSourceGdStorage entity model with _NoCredentials support (GDSTORAGE sources require no authentication)
  • Add five new methods to CatalogDataSourceService: staging_upload, analyze_csv, import_csv, delete_csv_files, and upload_csv (end-to-end convenience wrapper)
  • Add documentation pages for all new methods

Structure

  • Commit 1 (build): regenerated gooddata-api-client/ with the result spec — purely mechanical, safe to skim
  • Commit 2 (feat): SDK code, entity model, exports, Makefile change, and docs — the reviewable part

@hkad98 hkad98 force-pushed the jkd/csv-upload branch 2 times, most recently from 28a6177 to b0919d9 Compare March 13, 2026 09:46
hkad98 added 2 commits March 13, 2026 10:48
Add the `result` spec (`/api/v1/schemas/result`) to the Makefile
download target and merge it into the combined api-client schema.
Regenerate gooddata-api-client, which brings typed endpoints and models
for CSV staging upload, CSV analysis, CSV import, file listing, file
deletion, and CSV file manifest reading.

jira: TRIVIAL
risk: low
Add five new methods to CatalogDataSourceService:

- staging_upload — upload a CSV to the staging area
- analyze_csv — detect columns, types, and parse config
- import_csv — import a staged CSV into a GDSTORAGE data source
- delete_csv_files — remove files from a data source
- upload_csv — end-to-end convenience wrapper

Also add CatalogDataSourceGdStorage entity model with _NoCredentials
support (GDSTORAGE sources require no authentication), export the new
symbol, and add documentation pages for all new methods.

jira: TRIVIAL
risk: low
…OpenAPI Generator

OpenAPI Generator v6.6.0 silently drops the \x00 literal from regex
patterns in the generated Python code.  The DeclarativeColumn model's
`name` field has a spec pattern of `^[^\x00]*$` (reject null bytes,
important for Postgres TEXT columns), but the generator produced the
invalid Python regex `^[^]*$`, causing `re.PatternError: unterminated
character set` at runtime.

Fix the generated file and add a post-generation sed fixup to the
Makefile `api-client` target so future regenerations are patched
automatically.

jira: TRIVIAL
risk: low
@codecov
Copy link

codecov bot commented Mar 13, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.
✅ Project coverage is 77.45%. Comparing base (46c0f4b) to head (34d53d0).

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #1408      +/-   ##
==========================================
- Coverage   77.53%   77.45%   -0.09%     
==========================================
  Files         225      225              
  Lines       14614    14661      +47     
==========================================
+ Hits        11331    11355      +24     
- Misses       3283     3306      +23     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.

@hkad98 hkad98 merged commit 2748e14 into gooddata:master Mar 13, 2026
12 of 13 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants