From 0f52d80ca67a49258b235f5831163dd72fbd54cf Mon Sep 17 00:00:00 2001
From: Frankie B <git@diskfloppy.me>
Date: Tue, 11 Jun 2024 18:02:01 +0100
Subject: Merge MVC rewrite into master (#21)

* Just commit it all

* Require auth

* crap

* Update homepage

* Block AI scrapers

* Update cache update script

* Add dummy file

* Remove unnecessary lastfm config var

* Use withQueryParameters for LastFM API

* Fix embeds

* Update example env

* Smard
---
 public/robots.txt | 16 ++++++++++++++++
 1 file changed, 16 insertions(+)

(limited to 'public/robots.txt')

diff --git a/public/robots.txt b/public/robots.txt
index e65f07c..582552d 100644
--- a/public/robots.txt
+++ b/public/robots.txt
@@ -3,3 +3,19 @@ Disallow: /admin
 Disallow: /login
 Disallow: /js
 Disallow: /css
+
+User-Agent: GPTBot
+Disallow: /
+
+User-Agent: ChatGPT-User
+Disallow: /
+
+User-Agent: Google-Extended
+Disallow: /
+
+User-Agent: CCBot
+Disallow: /
+
+User-Agent: PerplexityBot
+Disallow: /
+
-- 
cgit v1.2.3-54-g00ecf