The Definitive Guide to dana
the worth with the identify attribute (robots) specifies the rule applies to all crawlers. both of those the title as well as content characteristics are scenario-insensitive. to deal with a selected crawler, switch the robots price of the name attribute Together with the user agent token of the crawler that you'll be addressing. Google supports tw