If the admin would like to have more control of which kinds of URLs are included in the XML sitemap, we have some advanced controls available. In order to understand how to best use these, it is first necessary to understand a bit about how the Sitemap Generator works.
How the Sitemap Generator works:
The Sitemap Generator will create a record of every page of the website in a formatted XML sitemap file that can be submitted to search engines.
The Sitemap Generator does this by creating separate XML files based on each of the SEO Templates (note: there are a few SEO Templates that no sitemap file is created for, such as the payment pages for example), and a separate file for all of the Static Pages on the website, this last one will also include any member category or post category page that has been converted into a static page.
However, search engines will generally only accept a single XML sitemap file to be submitted for a website. Since a separate XML file is created for each SEO Template and a separate one for static pages, a total of 40+ separate sitemap files will be created. In order to submit all of these individual XMLS sitemap files, the Sitemap Generator also creates what is called a "Sitemap Index File", which is the actual file that is submitted to search engines.
Exclusions to the Sitemap:
Any Web Page with the "NoIndex, NoFollow" setting checked is not included in sitemap:
If "Add "NOFOLLOW" to Member Web Links?" and "Hide Listing from Search Engines?" are set to "YES" within the Membership Plans:
Lastly, if the site has the Hidden Member Profiles add-on (click here for add-on information), it will hide all Non-Searchable members:
Sitemap Index File
As of the writing of this article, search engines generally allow up to 50,000 URLs to be in a single sitemap file. However, since many sites on the platform can have many more than 50,000 URLs, the Sitemap Generator will create several smaller XML sitemap files and one master file called a "sitemap index file".
The sitemap index file is a single XML file that contains links to all of the smaller sitemap files which contain the URLs of the website. When submitting the sitemap to search engines, the admin will submit the sitemap index file. For more information, please see this article from Google on the topic.
Advanced Controls
To display all of the individual sitemap files that can be generated and added to the Sitemap Index File, click on the "Advanced Controls" button:
Clicking this button will display a list of all of the SEO Templates that sitemap files can be generated from, along with some additional information and actions:
Generate or Update a Sitemap File for a Single SEO Template
To generate or update the sitemap file for a single SEO Template, locate the SEO Template the admin would like to generate for, and click on the "Add / Update Sitemap" button next to it:
After doing this, the system will generate a sitemap file for just that SEO Template and add the updated sitemap file to the Sitemap Index File. A link to the sitemap file for that SEO Template will then appear:
Generate or Update Sitemap Files for Multiple Selected SEO Templates
To generate or update the sitemap files for more that one SEO Template at a time, simply check the box next to all of the chosen SEO Templates:
After checking these boxes, scroll down and click on the "Bulk Add / Update" button:
After the system finishes processing the request, the admin will then see a link for each file here:
Doing this will update the sitemaps for those SEO templates and update the Sitemap Index File with the latest URLs as well.
Once the admin has generated or updated the sitemap files of their choice, they can submit the sitemap file shown at the top of the page to search engines:
SEO Templates That Will Generate More Than 50,000 URLs
As mentioned above, search engines will generally accept a sitemap file that has a maximum of 50,000 URLs per file. For larger sites, there can be more than 50,000 URLs generated for a single SEO Template. If this is the case, the system will generate a file for the first 50,000 URLs, and then continue generating another file for the next 50,000 URLs, and so on.
If this happens for an SEO Template, the admin will see multiple sitemap file links for the SEO Template (Sitemap File 1, Sitemap File 2, etc), instead of seeing a single sitemap file link as shown below:
All of these additional sitemap files are automatically added to the Sitemap Index File as soon as they are generated.
For additional assistance:
Email support@brilliantdirectories.com or create a ticket Inside Your Account Dashboard.
Was this article helpful and accurate? Yes No
Can't find what you're looking for?