All in all, your first RESTful API in Python is about piecing together clear endpoints, matching them with the right HTTP ...
Google's John Mueller said that since the robots.txt file is cached by Google for about 24-hours, it does not make much sense to dynamically update your robots.txt file throughout the day to control ...