Zak | MotherDuck Community

Commented on Support for Azure Blob Storage in Motherduck Duckl...·Posted inGeneral

There is also this PR https://github.com/duckdb/duckdb-azure/pull/131 so hopefully duckdb can write to blob storage soon

Commented on Improving Security: ETL Pipelines and MotherDuck A...·Posted inGeneral

Zak

That's great, thanks both! One more question on this. Would loading into DuckDB databases in Azure Blob Storage be good for the prod to Azure Blob Storage pipeline or would it be better to load into a different file type like parquet?

Posted in General·

Zak

Improving Security: ETL Pipelines and MotherDuck Access Solutions

Hi all, I've got a question regarding security and using MotherDuck. The platform team where I work are currently improving our security and one thing they want is to prevent anything that touches our production databases to have internet access. Because of this, I believe my data ingestion and ETL pipelines that extract from our production databases and load directly into MotherDuck is an issue for them. The only thing I can think of to solve this is to have my data pipelines load to Azure Blob Storage instead (since Azure is our cloud provider) so that they wouldn't need internet access and then have a separate step where MotherDuck loads the data from there. Is this a sensible approach?

4Comments

About

Start Date
Title