I submitted the sitemaps to Google webmaster tools, made a robots.txt file much ago, but Google is not indexing my website till now. So, I am trying to troubleshoot the problem.
I think there may be some issue in the robots.txt file. Although I checked it using Google webmaster robots.txt checker - which doesn't show any error, but I am creating robots.txt for this first time - so there is always a chance that I made a mistake which is banning Google from crawling the site.
Here is the robots.txt file content of my website (http://learni.online/ ) -
User-agent: *
Disallow: /index.php?
Disallow: /index.php/Help
Disallow: /index.php/MediaWiki
Disallow: /index.php/Template
Disallow: /skins/
Disallow: /all/Special:
Disallow: /all/Spezial:
Disallow: /all/Spesial:
Disallow: /all/Special%3A
Disallow: /all/Spezial%3A
Disallow: /all/Spesial%3A
Can someone please tell me if I am missing something of if there is a problem in the robots.txt file that may be causing this error. That would be a great help.
Information -
- I installed the MediaWiki in the web-root directory (i.e. public_html). In other words, my localsettings.php file is in the public_html directory.
- I have already set a short-URL which makes the link - "http://learni.online/all/......."
- You can find the robots.txt file here - http://learni.online/robots.txt