Questions About Parallel Execution, Response Chunking, and Permissions in MotherduckWASM for Geospatial Data Projects
Hi Guys. I have 4 questions/issues that I'd appreciate a solution or feedback if I'm doing correctly. As we move from test projects to real client projects, we noticed somethings that impact the user experience with big or geospatial datasets. Just for context, it's galileo.world, a wasm app, so there's no backend except for auth. Here they go: MotherduckWASM 1. No parallel execution - for more than one chart execution locks in - results show only when all queries are executed - It has similar behavior in the MD panel, since a query only starts after another is finished. How can I deliver query results as they return in wasm? (I'm currently using enquedQuery requests to allow cancelling dynamically) 2. Chunks in response - the chunk + wait + chunk + wait slows down bigger results such as geometries - ex: a 10mb response takes too long because the chunks are about 1mb each. Geospatial datasets when dealing with polygons, even after simplification and within restricted boundaries may have big responses. Permissions and tokens 3. Is it possible to privately share a database to a specific user/email from another organization? 4. Is it technically possible to create scaling tokens that have access only to specific databases? -> Workaround: service account + read scaling token and granting permission to it to only specific databases BUT services accounts are considered from the same org therefore have access to all org shares. Even if the share is hidden, that creates a security issue for backendless projects when I need to make publicly accessible databases to people that do not have a motherduck account. In that case our org would have to be very careful about not making org shares, only restricted permission ones. If necessary I can show it live in the prod app so you could maybe see alternatives.
.png)