To fix several issues on my site, I need to use a robots.txt file, but when I save it in my home page, it actually saves to http://www.wikiwealth.com/local--files/start/robots.txt. I need to save it at http://www.wikiwealth.com/robots.txt, because search engine robots near the file in my root directory.
This is what google says: "The robots.txt file must reside in the root of the domain and must be named "robots.txt". A robots.txt file located in a subdirectory isn't valid, as bots only check for this file in the root of the domain. For instance, http://www.example.com/robots.txt is a valid location. But, http://www.example.com/mysite/robots.txt is not. If you don't have access to the root of a domain, you can restrict access using the Robots META tag."
Thank you, Dave
Why can't you use Robots META tag then?
Piotr Gabryjeluk
visit my blog
The main reason to for this wish was to solve another problem of mine. The URLs /research:ko and /research:KO were going to the same page, so if you put a META tag on /research:ko, you would lose both pages out of search engines. This problem was recently solved.
I figured the robots.txt had other benefits that Wikidot members might want. If it doesn't receive votes, I wouldn't waste time on this project.
WikiWealth.com - Stock, Fund, Commodity & Currency Research | SWOT Analysis, WACC
Given the way that Wikidot stores and link to files I suspect this is not possible.
Rob Elliott - Strathpeffer, Scotland - Wikidot first line support & community admin team.