Sitemaps are files that list the URLs that belong to your website. Their primary usage is to notify search engines about all of the web pages that you wish to have crawled and indexed on your website. Sitemap files are submitted to search engines so that they can crawl and discover your website pages faster.
There are a few different formats for sitemap files, but the two most common formats are Text and XML:
<?xml version="1.0" encoding="UTF-8"?> <urlset xmlns="http://www.sitemaps.org/schemas/sitemap/0.9"> <url> <loc>https://www.dayaweb.com</loc> <lastmod>2018-11-06</lastmod> <changefreq>monthly</changefreq> <priority>1</priority> </url> <url> <loc>https://www.dayaweb.com/about/</loc> <lastmod>2018-02-08</lastmod> <changefreq>monthly</changefreq> <priority>1</priority> </url> <url> <loc>https://www.dayaweb.com/testimonials/</loc> <lastmod>2018-02-02</lastmod> <changefreq>monthly</changefreq> <priority>1</priority> </url> </urlset>
One big advantage to XML Sitemap files is that you can provide additional information about your website pages, including:
There are many different ways that you can create a sitemap file. The way in which you decide to create one will probably depend on a few different factors:
Among the many options available to you are:
However you decide to create a sitemap, remember to visually inspect the generated sitemap file to make sure that it includes all of the URLs that you want included. Additionally, you may want to exclude certain URLs that you don’t want to be indexed by search engines.
Finally, make sure that you follow the general sitemap guidelines.
Note: sitemaps can only have up to 50,000 URLs or be 50MB in size (uncompressed). If you have a very large website, then you will need to break up your sitemap into two or more files and use a sitemap index.
If you have a small website (less than 500 pages), then you can use an online tool like XML-Sitemaps.com. Simply enter in your main website URL and the tool will crawl your website and create an XML-formatted sitemap file that you can download.
Screaming Frog SEO Spider is a desktop application that can be used to crawl your website and create a sitemap file. It is free for websites under 500 pages.
The Yoast SEO plugin will automatically create an XML sitemap for a WordPress website.
If you have a small website, you might be able to manually create a sitemap file on your computer. Sitemap files must be UTF-8 encoded, so you will need to use a plain text editor:
Depending on the format that you choose, you would either save the sitemap file with a .txt or .xml extension.
Completed sitemap files are usually uploaded to your website’s document root. Once the sitemap file has been uploaded, you should also add the sitemap URL to your robots.txt file:
Even if you are planning on submitting your sitemap to Google Search Console and Bing WebMaster Tools, adding the sitemap URL to your robots.txt file will help other search engines find it.
Once you’ve created your sitemap file, you should validate it using a validation service such as the W3C Markup Validation Service.
Once your sitemap is complete and uploaded to your website, you can then submit it to search engines like Google and Bing:
Once you understand the format of sitemap files and all of the tools available to you, it shouldn’t be too much of a challenge to create a proper sitemap file for your website. However, it’s important to make sure that you keep your sitemap file updated as your website changes.