robots.txt | XenForo community

Hi All, Though I had never checked it earlier, the concern was raised after I changed my hosting. Recently, Google Console has not been indexing my site, ...

XF 2.2 - Recommended robots.txt | XenForo community

I've wanted ask, what nowadays is recommended to setup robots.txt for XF2.2 installation. Any recommendations are very appreciated, thanks!

TV Series on DVD

Old Hard to Find TV Series on DVD

Robots.txt | Page 3 | XenForo community

No. robots.txt goes in your root, not the directory that Xenforo is installed in. public_html presumably is your root.

XF 2.2 - Robots.txt is not accessible or doesn't exist - XenForo

I am getting robots blocked and redirection error messages too. When I checked for robots.txt file (ex: https://yourdomain.com/robots.txt ) then ...

My robots.txt file | XenForo community

I have this since I don't want members pages, search, help, misc, login, register pages indexed from Google, and only threads and forums.

Why disallow "posts" in robots.txt ? | Page 3 | XenForo community

Just want to clarify something: What does a screenshot of the finished result look like?

Adding Lines to Robots.txt to Block Specific URLs - XenForo

Go to page. Go. Next Last · A · Alfuzzy. Active ... What lines would I need to add to block each of the 5 URLs above in the sites robots.txt?

XF 2.2 - Robots.txt unreadable | XenForo community

this is my following robots.txt. User-agent: PetalBot. User-agent: AspiegelBot. User-agent: AhrefsBot. User-agent: SemrushBot

robots.txt - XenForo

... community/ User-agent: Amazonbot Disallow: /community/threads/*/reply User-agent: * Disallow: /community/whats-new/ Disallow: /community/account/ Disallow ...

Whats your robots.txt file look like? - Xenforo

Just trying to get some ideas of what anyone is currently using for their robots.txt on their Xenforo site ... community/find-new/ Disallow: / ...