I love protomaps, I have added it to my own hobby project to have a self-hosted fallback for regions (or times) where there are no SwissTopo maps available.<p>The app will periodically download the configured map regions and store the pmap files [1]. The Go backend then directly serves them to the frontend [2].<p>[1]: <a href="https://github.com/jo-m/cartomancer/tree/a02f042173b5ba1a7d9730344b300f1202d02099/internal/pkg/maps" rel="nofollow">https://github.com/jo-m/cartomancer/tree/a02f042173b5ba1a7d9...</a>
[2]: <a href="https://github.com/jo-m/cartomancer/blob/a02f042173b5ba1a7d9730344b300f1202d02099/internal/pkg/api/api.go#L117" rel="nofollow">https://github.com/jo-m/cartomancer/blob/a02f042173b5ba1a7d9...</a>
Word of warning. I had a client that was behind some corporate anti malware proxy. Turned out it stripped the range header from the request and simply did a request for the entire file. Had to implement a proxy endpoint just for them so they could do classic WMTS style requests insetad.
OpenFreeMap is a similar project:<p><a href="https://openfreemap.org/" rel="nofollow">https://openfreemap.org/</a><p>> <i>What is OpenFreeMap?</i><p>> OpenFreeMap lets you display custom maps on your website and apps for free.<p>> Using our public instance is completely free: there are no limits on the number of map views or requests. There’s no registration, no user database, no API keys, and no cookies. We aim to cover the running costs of our public instance through donations.<p>> <i>What is the tech stack?</i><p>> There is no tile server running; only nginx serving a Btrfs image with 300 million hard-linked files. This was my idea; I haven’t read about anyone else doing this in production, but it works really well.
Just be aware unlike Protomaps, OpenFreeMap uses OpenMapTiles which has stricter attribution requirements.<p>You'll also see upselling from MapTiler on the pages you're required to attribute along with upselling in the docs <a href="https://openmaptiles.org/docs/host/maptiler-cloud/" rel="nofollow">https://openmaptiles.org/docs/host/maptiler-cloud/</a>
Seconding the praise for OpenFreeMap. I've been using it for Streeter [0] for the last month or so and it's worked out great.<p>Self-hosting ended up being relatively cheap and easy too. They publish the whole planet as a single PMTiles file every week, and I just copy that to R2 and serve it through a small Worker, basically the Cloudflare route the article mentions.<p>[0] <a href="https://streeter.city/" rel="nofollow">https://streeter.city/</a>
OpenFreeMap is amazing. Coincidentally I released a new open source tool that uses that today - demo here: <a href="https://lite.datasette.io/?install=datasette-maplibre&url=https://gist.githubusercontent.com/simonw/39fa5d399465766039549912e2b3d291/raw/f6dfba99a75cbb8b5d9386223220eb52272767ee/demo.db&metadata=https://gist.githubusercontent.com/simonw/39fa5d399465766039549912e2b3d291/raw/f6dfba99a75cbb8b5d9386223220eb52272767ee/metadata.yml#/demo/capitals_and_countries%23map=0/4.2/180&color=continent" rel="nofollow">https://lite.datasette.io/?install=datasette-maplibre&url=ht...</a>
The mature best practice in the geospatial industry is a postgis server with R-tree based indexing of every item in space. Its pretty trivial to serve this as dynamic vector tiles (e.g. 'martin') including at different scales/zooms.<p>Few people store data on a server as tiles though it might be served as tiles. Aside from the added storage size, you dont want to have to update 20 levels tiles every time one piece of data is added or removed.
I didn't know they just served it straight from disk, that's pretty cool!
We're doing something like this behind Cloudflare R2, same concept of owning the map infra (for privacy and access-control) and reducing load on public infrastructure.<p>If you are into this stuff, you can view PMTiles from the CLI with "gloss", or try to drag-and-drop on its web interface [1]. It seems large tiles (>128M) and some raster formats are failing; plus it would be nice to load from URL there. Will fix that...<p>(AI warning). ntmaps [2] is a Golang library that lets you use different tile providers, deployable in terminal or browser. ntplaygrounds [3] uses that and nt3d and ntactor to make a city simulation. Data is pulled from OpenStreetMap in those.<p>[1] <a href="https://nimbleterminal.com/gloss/app.html" rel="nofollow">https://nimbleterminal.com/gloss/app.html</a>
[2] <a href="https://nimbleterminal.com/ntmaps" rel="nofollow">https://nimbleterminal.com/ntmaps</a>
[3] <a href="https://nimbleterminal.com/ntplaygrounds" rel="nofollow">https://nimbleterminal.com/ntplaygrounds</a>
> If you are into this stuff, you can view PMTiles from the CLI with "gloss", or try to drag-and-drop on its web interface<p>The official PMTiles viewer [1, 2, 3] is also pretty good.<p>[1]: <a href="https://pmtiles.io/" rel="nofollow">https://pmtiles.io/</a><p>[2]: <a href="https://github.com/protomaps/PMTiles/tree/main/app" rel="nofollow">https://github.com/protomaps/PMTiles/tree/main/app</a><p>[3]: <a href="https://protomaps.com/blog/new-pmtiles-io/" rel="nofollow">https://protomaps.com/blog/new-pmtiles-io/</a>
R2 is amazing for this.<p>Cloudflare, generally, is amazing for this, actually. It serves my personal hiking map for about $2/mo, using R2, D1 and Workers.<p>Building the map itself is free via GitHub Actions.<p>It's bonkers how the map world has changed over the last 20 years.
R2 is kind of too good, it makes me nervous about how long such a good thing can last.
Nice ! Yeah I just built bowmaps.com with this approach of cloudflare for tiles and workers for on the fly vector tiling
That's mostly for the storage not the bandwidth right?
how are you using D1 and Workers with this?
Two small uses:<p>1. The app is a remix app, workers do server-side rendering, so that a vanilla `curl` shows the actual payload, not just a script tag that loads the app.<p>2. I'm a great big nerd, so I recently added the ability to post reviews/photos/GPX traces to your AT protocol PDS. The app has a Worker cron job that subscribes to Bluesky's Jetstream for events in its namespace, and indexes these into D1 in order to answer certain API calls like "get traces in this area" or "get reviews for this hike". So the app itself isn't the primary source of truth, a person's PDS (which they control) is. The app just maintains a cache/index that can be rebuilt.
same, we use pmtiles on R2 for landstats.com parcel map. it's very easy to set up and cheap to serve<p>and we have a CF worker than turns them into rasters on the fly if that's how people want to get them
For Cartes.app we used to pay Maptiler. While great, recommanded to start, without client revenue it was impossible to scale, we've hit 150 €/month bills way too fast.<p>Hence Protomaps. Hosting costs almost nothing.<p>The main problem though is that once you host your tiles, why not put what you want inside ?<p>Tune Tilemaker's processing.lua to your envy. Spend hours designing maps and building a Typescrpt dynamic Maplibre style.
yeah, basemaps are small enough to store and host cost effectively, but high res satellite imagery gets big and expensive fast as you go up in zoom level. I built my own satellite mosaic of North America for my app so I can offer users offline access to the tiles and had to stop at z17 because of projected storage requirements. high res global coverage can get you into the hundreds of TB range which is no longer in the "stick it on r2 and serve it with a worker" or "download and upload the entire dataset sequentially over your residential internet" territory<p>the fun/hard parts of the project weren't really scale dependent, although downloading source imagery and building the tile pyramids did take literally weeks to run. actually, the hardest part was getting demosaicing right, e.g. making the quilt seamless. filtering out cloudy and smokey/hazy tiles while picking alternatives from the same time of year so groundcover & crops are in a consistent growth stage so you don't end up with checkerboard patterns or cloud silhouettes randomly across your map. and there were other problems that came up more or less just because of how & when the satellite took the images that require exposure correction and more filtering<p>I also have a pelias index with 170M records for search and self-host valhalla for routing. the open source mapping ecosystem has really impressed me the more I learn with each project
Would be nice if cloudflare/someone would host a multi tb r2 satellite mosaic. Once it's cached it's pretty cheap to serve and everyone could use it.
Have you check Mapterhorn's next project ? Funded by Nlnet.
I was playing with their elevation data last week. Maptiler provides elevation data as well but it gets expensive quickly with them. We managed to blow through our 50$ limit in two days with them just testing this out. So, we tried out Mapterhorn.<p>I really like their data set. For self hosting, vector map tiles are small enough that storing it in a bucket won't break the bank. I think you need somewhere around 100-150GB or so for protomaps. A few dollars per month goes a long way. However Mapterhorn's elevation data set is something like 11 TB or so. That's going to cost some money to store somewhere. Satellite imagery is similarly expensive to host. And you typically want both.<p>There is of course an asymmetric relation with what you store and what you serve. Ideally, you store data for the whole planet. But you probably are only going to serve a tiny portion of it. This favors hosted setups where you pay for what you use via a CDN and share the storage with others. A shared service also relieves you from the burden of having to keep that data up to date. The main issue with that is commercial map services tend to overcharge for more intensive usage to the point where self hosting actually becomes attractive despite this.<p>The main issue is that the number of requests really goes through the roof if you start getting tiles beyond certain zoom levels, which pushes you into the expensive price tiers. With most providers you pay per request and you can easily generate hundreds of thousands of requests just panning around at low altitude over a map, which means you download lots of small tiles. That's how we hit the Maptiler limits. They have high resolution elevation data and exploring the Alps is a lot of fun. We hit 800K requests per day without any real users using our system even. This was just us playing with the data. We switched to Mapterhorn and cap the zoom level at zl-12 for now. Since it's a free service I want to be a bit mindful of not hammering their service.<p>I'd be interested in reasonable commercial solutions that won't cost me 300+$ per month that would allow me to remove zoom level limitations. At those price levels, self hosting becomes a possibility of course. Which suggests to me that somebody should be able to undercut that price and still make a decent profit.
yeah, I heard about them for the first time a few weeks ago. they have a fantastic data set just judging with my bare eyes. I built my topo map from terrain tiles on aws + gebco et al for the bathymetry data which is just personal preference (I love me an old globe with the tactile mountains and seafloor)
if you are looking into self hosting, i highly recommend checking out
<a href="https://versatiles.org/" rel="nofollow">https://versatiles.org/</a>
the maintainer seems pretty passionate<p>> VersaTiles is a completely FLOSS stack for generating, distributing, and using map tiles based on OpenStreetMap data, free of any commercial interests.
VersaTiles is a free and open alternative to commercial map services like Google Maps or Mapbox. It is designed for newsrooms, NGOs, developers, and public institutions who need reliable maps without vendor lock-in. VersaTiles is fully self-hostable, requires no API keys, charges no usage fees, and does not track your users.
The svg tiles are decent for reverse geocoding too. I've had great success splitting gps routes into segments by pulling location data out of relevant tiles. A lot of the reverse geocoding APIs have pretty restrictive per-second limits and response times in the order of 1-2 seconds. Hosting this in an s3 bucket costs an order of magnitude less than any of the APIs I tried at my scale, with millisecond latency, no request limits and near-flat volume scaling.
I'm making a Wikipedia walking game where each card comes in a sealed pack printed with the real streets around where you found it, rendered live.<p>With Mapbox or Google Maps I wouldn't even have considered building this game. Protomaps made it a no-brainer<p>Thanks to Brandon and the OSM contributors. This is what made the idea affordable for a side project.
I was very grateful to find protomaps recently for a project where I want to allow people to download custom regional subsections of the global map for offline usage.<p>After evaluating maplibre vs the somewhat-abandonned protomaps-leaflet library, I decided to go with the latter as I don't really need the fancy 3d gpu and custom layers functionality of maplibre. Plus leaflet is releasing a long-awaited v2 right now.
map.pathfinderwiki.com runs a fictional setting's world map on PMTiles, with both the mapping data and the website stack open-source:<p><a href="https://github.com/pf-wikis/mapping" rel="nofollow">https://github.com/pf-wikis/mapping</a> (using maplibre-gl-js and some custom Java code to manage layers, tile generation, and PoI collation from the associated MediaWiki)<p><a href="https://github.com/pf-wikis/mapping-data" rel="nofollow">https://github.com/pf-wikis/mapping-data</a> (using kart)
I’m using (and donating to) OpenFreeMap and using Cloudflare to host custom tiles for my travel time map for Canada, à portée [0] - it’s been so effortless and the tiles are quick to load. No clunky tile server required!<p>[0] aportee.ca
I use Protomaps and absolutely love it. After getting hit with a Google Maps bill that was larger than I ever would have expected, I swapped it out for Protomaps instead and I’ve loved it ever since.<p>Dirt cheap to run, theme-able, easy to use.
Deploying this as I am typing this. The problem I have with Mapbox is that there is no way to limit spending. When the public key gets abused, it's a potentially enormous bill.
A PMTiles file on a bucket is the only map provider whose worst case is a rounding error.
I self-host protomaps on CloudFlare for my side project: <a href="https://github.com/BlueBlazin/lowpolyearth" rel="nofollow">https://github.com/BlueBlazin/lowpolyearth</a><p>It costs me something like $2/month iirc, and it made tile querying faster over protomaps' free hosted endpoint.
Cloudflare recently improved their support for Range requests: <a href="https://blog.cloudflare.com/origin-range-requests/" rel="nofollow">https://blog.cloudflare.com/origin-range-requests/</a>
Checkout the new PRs submitted to Tilemaker. It appears building the planet could soon take less than 5 minutes.
My product safemap.io is hosted on Protomaps. Highly recommend.
I deployed self-hosted protomaps on geocode.xyz and it works like a charm. I wish it had more customization options though ( <a href="https://geocode.xyz/415%20C'WEALTH%20AVE%20WEST%20Singapore" rel="nofollow">https://geocode.xyz/415%20C'WEALTH%20AVE%20WEST%20Singapore</a> )
agree with this totally, use it on a project I am working on and it now takes like 3-4 hour to have a self hosted map of the world on your computer.
I use this on my blog with MapLibreGL. I wrote up how I do it: <a href="https://blog.gpkb.org/posts/hugo-static-site-maps/" rel="nofollow">https://blog.gpkb.org/posts/hugo-static-site-maps/</a><p>One thing I really like is that the data is static. This isn't useful for some applications, but for my use, namely blogging about my travels, it's perfect. I wouldn't come back and edit the text or pictures to reflect subsequent events, so why would I edit the map? Being able to take ad hoc snapshots of the map at a point in time is perfect.
Super nice!
okay, but what clients work with this approach?
You can use the pmtiles:// protocol in Maplibre GL, requires protomaps.js and a few lines of setup [1]<p>My experience with it is ... ok. It works. But going directly to cloud storage (s3 in my case) is unpredictable latency and neither the browser nor most servers really cache HTTP range requests granularly, so every tile is another high-latency round trip. Not worth it - I ended up putting Martin tile server in front of it.<p>I assume someone could write a protomaps adapter in WASM with some smart caching? Until then, Standard GET requests are just easier to cache and perform much better in practice. The downside being you have to run a server or statically generate files.<p>[1]- <a href="https://docs.protomaps.com/pmtiles/maplibre" rel="nofollow">https://docs.protomaps.com/pmtiles/maplibre</a>
I've had success with using a cache in front of my buckets for great performance. In my case I have raster tiles so they get turned into z/x/y tile filenames and a cloudflare worker pulls that from the full file and caches the result in the region.
For what it's worth I think latency/reliability varies a lot with provider. Bunny Storage has quite good latency in my experience (100-300ms) and their CDN supports Range caching (from my understanding Cloudflare does too they just limit the size of the file regardless of the Range)
we use pmtiles on s3 behind cloudfront, and it seems to work pretty well. maybe not a 100% solution compared to what you'd get from google maps, but good enough that i've got no reason to be looking for another solution.
Protomaps, pmtiles, are actually pretty ubiquitous. Even has a GDAL driver <a href="https://gdal.org/en/stable/drivers/vector/pmtiles.html" rel="nofollow">https://gdal.org/en/stable/drivers/vector/pmtiles.html</a>
There is an npm library that integrates the format into MapLibre (fork of Mapbox) and Leaflet.
A quick search showed that this should work with HTTP range requests: <a href="https://maplibre.org/" rel="nofollow">https://maplibre.org/</a>
Another open-for-everyone tile server is Tuiles en Libertés : <a href="https://tuiles.enliberte.fr/" rel="nofollow">https://tuiles.enliberte.fr/</a>
Really cool, did not know about it!
I visited the link and Malwarebytes warned of a potentially malicious site:<p>p - proxy - tp8ez dot bunny dot run<p>so I closed that window.<p>What else you got?
I really loved this post keep going
[flagged]
[flagged]
CoMaps said hi and uses OpenStreet maps.<p>It works amazingly on GrapheneOS, Android Auto, and Desktop app via Flatpak.