Contents
A Glimpse into httpstatus.io – URL Status Code Checker
URL HTTP status code check tool is an insightful example for those unfamiliar with digital tools.
It is an online platform designed for checking the HTTP status codes of a series of URLs. Users can swiftly decipher the response codes they return by entering these URLs into the tool. Whether it’s a successful connection (200 OK) or a missing page (404 Not Found), this tool simplifies the process, especially for those new to the SEO arena. Understanding such tools becomes essential as it not only enhances our comprehension of canonical domain check and crawler bots accessibility tests but also equips us with the resources to navigate the digital landscape effectively.
Testing Your Canonical Domain with URL Status Code Check
Testing for canonical domain means that you will enter your naked domain:
yourdomain.com
And get all the responses for all the iterations of your canonical domain:
http://yourdomain.com
https://yourdomain.com
http://www.yourdomain.com
https://www.yourdomain.com
Meaning it will be tested against “HTTP” and “HTTPS,” including the “www” prefix and “non-www.” After all your settings with DNS records and others, this test is helpful to know how your canonical domain works and your default setup.
For example, if you set your default configuration to “https://www.yourdomain.com” when you test for “yourdomain.com,” the httpstatus.io should show you the result:
http://yourdomain.com Status codes: 301, 301, 200 Redirects: 2 https://yourdomain.com Status codes: 301, 200 Redirects: 1 http://www.yourdomain.com Status codes: 301, 200 Redirects: 1 https://www.yourdomain.com Status codes: 200 Redirects: 0
The result “http://yourdomain.com” redirects twice, the first time to “https://yourdomain.com” since we use Cloudflare, and it rewrites and redirects all the HTTP requests to HTTPS. If you don’t follow our guide from the beginning or don’t want to use Cloudflare, you still need TLS Encryption on your site to redirect to HTTPS.
Then, the redirection goes to “https://www.yourdomain.com” because we set WordPress to the default URL with the “WWW” prefix. The same applies here if you follow our complete SEOGuide from the beginning. The “WWW” case is just an example. If you don’t use “WWW,” you will not see this entry.
The same happens with all the other versions since they redirect similarly.
Finally, “https://www.yourdomain.com” has no redirects and shows status code 200 directly. This URL is your default configuration of your canonical domain.
How to test Canonical Domain with httpstatus.io
Navigate to the HTTP Status check tool website.
In the main text box, input “yourdomain.com,” which is the naked domain of your website.
Under the text box, you will see an empty checkbox. Enable it:
[V] Canonical domain check
Click [Check status].
Testing Your Site If Crawlers Bots Can Reach It
There are several instances when you want to check if crawlers’ bots User Agent like Google bot, Bing bot, or any other search engine crawling bot can reach your site or a specific URL.
1. You enabled the robots.txt file on your site for a specific directory or the whole site, and you want to check if particular bots can still reach or the ones you specified cannot.
2. You see that a page has no index in a specific search engine, and you want to check if this page is at all crawlable.
How to check:
Navigate to the HTTP Status check tool website.
In the main text box, input the URL to a post on your website or homepage if you blocked the whole site from a bot, like “https://www.yourdomain.com.”
Make sure that you uncheck the Canonical checkbox under the textbox:
[ ] Canonical domain check
Under the textbox on the right, you will see the option “User-Agent.”
You can select any Search engine bot from there, like [Googlebot].
Click [Check status].
If it returns “200”, your provided URL is reachable for this user agent/bot.
If you find any mistakes or have ideas for improvement, please follow the email on the Contact page.