Next we are combining this work with an AR collection app for on-site capture and testing out workflows for "shared global anchors" (aka Spatial anchors or Cloud anchors) a recurring topic in the w3c immersive web working group:
https://github.com/immersive-web/proposals/issues/82#issueco...
Really nice! I did a quick test some weeks ago and apparently using google street view images to generate Gaussian splats works quite well: https://www.instagram.com/p/C2xozxVAdpG/
(I just took screenshots of the Street View, not the API, so the ground is falling apart a bit because of the street names.)
Agreed tons of potential here, however we may need to get our own geo data for this: Google was very clear during the API quota approval process that 3d tiles cannot be used for ML training or generation of derivative assets like Gaussian splats, at least with this specific product offering.
It's not immediately obvious, but you can move the viewpoint via panning by holding down shift while clicking and dragging (on desktop, at least). My natural instinct was to double-click like in Google Streetview.
Not sure if there's a limit on the map area but I was able to navigate all the way to Ocean Beach!
Congratulations on the amazing work/demo! An interesting extension of this would be integrating the "Level of Gaussians" approach presented at: https://zju3dv.github.io/LoG_webpage/
Also interesting would be to generate gaussian splats from Google Street View footage, and integrate it directly into the Google Maps 3D data as you have done.
Check out tippecanoe for preprocessing. Alternatively GDAL also has a gdal2tiles script if your input is already a raster. An open source option for frontend viewing is maplibre.
Here's a much better explainer from some people who seem to actually understand the subject matter and not just the buzzwords (and yes, the end result is basically a highly-detailed point cloud):
Thanks I just shrunk it a bunch more. It's a tech demo so apologies for the basic UI. It's also open source so anyone can remix it and play with the UI too
(I just took screenshots of the Street View, not the API, so the ground is falling apart a bit because of the street names.)
Not sure if there's a limit on the map area but I was able to navigate all the way to Ocean Beach!
Also interesting would be to generate gaussian splats from Google Street View footage, and integrate it directly into the Google Maps 3D data as you have done.
Now to fork and enable the FPV camera controls.
Great work!
For anyone interested this is what I ended up with to fly around:
Demo: https://delicious-enthusiastic-accelerator.glitch.meUnrelated - does anyone know a great library for building tile maps for 2D scatter plots?
I don't know what the hell a "gaussian splat" is and I have to say this video did not help at all.
https://www.youtube.com/watch?v=VkIJbpdTujE