Vfrdtyky

My django app sitemap.py looks like so:

class DetailViewSitemap(Sitemap):

    priority = 0.8

    changefreq = 'hourly'



    def items(self):

        objs = MyApp.objects.all().distinct('slug')

        return objs

..and my models.py convininetlky defines the a method like so:

@models.permalink

def get_absolute_url(self):

    try:

        return ('detail', [self.slug])

    except:

        return None

Everything works fine, but I have now realized that google does not allow more than 50k links in a single sitemaps - and unfortunately I have more than 50k links.

So, my question is how can I split my sitemap so that it generated say successive sitemaps on this app? So, I would like something along the lines of:

http://mywebapp.com/sitemap0.xml

http://mywebapp.com/sitemap1.xml

...

.. if this is possible at all!

One way to solve this problem is to break the large sitemap into a group of smaller sitemaps. For instance I have built a separate sitemap for Articles by the first letter of the title. So there will be a sitemap file for every letter in the alpahabet. If you want to use alpahnumeric characters that will also work but in our case alphabet letters works fine. The Python built-in method ascii_lowercase will return an array of alphabet characters that we can loop to build each sitemaps.

from datetime import date

from string import ascii_lowercase

from django.contrib.sitemaps import Sitemap

from .models import Article



def build_sitemaps():

    sitemap = {}

    for char in ascii_lowercase:

        article_sitemap = ArticleSitemap(letter=char)

        sitemap[char] = article_sitemap

    return sitemap





class ArticleSitemap(Sitemap):

    changefreq = "never"

    priority = 0.5



    def __init__(self, letter='a'):

        self.letter = letter.lower()

        super(ArticleSitemap, self).__init__()



    def items(self):

        today = date.today()

        return Article.objects.filter(

            status=Article.PUBLISHED,

            title__istartswith=self.letter,

            ).exclude(

                publish_date__gt=today,

            ).order_by('-publish_date')

Below I have also added caching of the sitemaps which is really nice. Then add the sitemaps in the urls.py like so:

from django.contrib.sitemaps import views as sitemaps_views                                                                                                          

from django.views.decorators.cache import cache_page 



from articles.sitemaps import build_sitemaps



urlpatterns = [

    url(r'^sitemap.xml$', cache_page(86400)(sitemaps_views.index), {'sitemaps': build_sitemaps()}),                                                                 

    url(r'^sitemap-(?P<section>.+).xml$', cache_page(86400)(sitemaps_views.sitemap), {'sitemaps': build_sitemaps()},                                                

        name='django.contrib.sitemaps.views.sitemap'),

]

If you need more code snippets on how to implement it with Sitemap Index, check this post in my website https://www.ronbeltran.com/2018/11/generating-large-xml-sitemaps-django/

Create an index sitemap and Django will automatically paginate the details sitemap like this:

http://mywebapp.com/sitemap-details.xml

http://mywebapp.com/sitemap-details.xml?page=1

...