![](/static/253f0d9b/assets/icons/icon-96x96.png)
![](https://fry.gs/pictrs/image/c6832070-8625-4688-b9e5-5d519541e092.png)
Or, you say “i am the google web crawler”, which they let past the paywall so it can be added to google.
If I’m not wrong, Google has a set range of IP addresses for their crawlers, so not all sites will let you through just because your UA claims to be Googlebot
No ones asking you to stick some shiny thing up your ass and walk around to see how it fits. If you don’t like these services don’t use them, for most of us the convinience of an Internet connected device that let’s you stream content published to the Internet is a value.