Tool for Live Data Visualization with DuckDB/MotherDuck CSV URLs via GitHub

·Oct 18, 2024 12:23 AM

Just a little tool I made (read: gpt made) to help use our duckdb/motherduck data in dataviz tools that accept a CSV URL for live updates https://github.com/sahilng/csv-proxy-duckdb

🙌6

8 comments

· Sorted by Oldest

Show And Tell

Tool for Live Data Visualization with DuckDB/MotherDuck CSV URLs via GitHub

Sahil G.

·Oct 18, 2024 12:23 AM

Just a little tool I made (read: gpt made) to help use our duckdb/motherduck data in dataviz tools that accept a CSV URL for live updates https://github.com/sahilng/csv-proxy-duckdb

🙌6

8 comments

· Sorted by Oldest

Jacob M.
·
this is awesome Sahil!
Sahil G.
·
Thank you 😅
Jacob M.
·
what are you using this to serve, if you can share?
Sahil G.
·
We use Datawrapper to create i-frameable maps that we can put on our site (I work at dosomething.org) which basically have two dimensions, US State vs. Count of Users Who Participated in the Volunteer Opportunity. They support live updates via a CSV URL that they ping regularly. Using this tool, the link will basically query a view in MotherDuck that has the relevant data!
Sahil G.
·
(and/or a table that has been refreshed that morning w/ dbt)
Jacob M.
·
ah thats really cool!
Sahil G.
·
Thank you! Was excited by what I saw with quackpipe and now the httpserver extension, but didn’t want to wait for them to implement csv file responses 🙃
Jacob M.
·
yeah that makes sense, hopefully we can get more analytics frameworks (like datawrapper) integrated to WASM with MotherDuck too so you can skip that step in the future
👏1
✅1

Jacob M.
·
this is awesome Sahil!
Sahil G.
·
Thank you 😅
Jacob M.
·
what are you using this to serve, if you can share?
Sahil G.
·
We use Datawrapper to create i-frameable maps that we can put on our site (I work at dosomething.org) which basically have two dimensions, US State vs. Count of Users Who Participated in the Volunteer Opportunity. They support live updates via a CSV URL that they ping regularly. Using this tool, the link will basically query a view in MotherDuck that has the relevant data!
Sahil G.
·
(and/or a table that has been refreshed that morning w/ dbt)
Jacob M.
·
ah thats really cool!
Sahil G.
·
Thank you! Was excited by what I saw with quackpipe and now the httpserver extension, but didn’t want to wait for them to implement csv file responses 🙃
Jacob M.
·
yeah that makes sense, hopefully we can get more analytics frameworks (like datawrapper) integrated to WASM with MotherDuck too so you can skip that step in the future
👏1
✅1