Michael,
I was wondering why the most recent posts don't seem to be indexed. If you pick examples from the January list , you'll probably notice that the most recent posts are from Jan. 25: [1] indexed, [2] not indexed.
Maybe this is because the bot (if it ever returned after initial indexing) looked at [3] and didn't notice any change, so it didn't descend further. If this is the case and the bot returns daily or so, we should see some change soon because February is new on [3].
But I doubt that the bot ever came back after Jan 26.
You could try to submit a changed sitemap.xml each month, pointing to that month's message overview page and specifying a changefreq of 'daily' [4] for that page. Don't know whether Googlebot will take this into account though. But other ways such as the infamous revisit-after meta tag won't work at all, I was told.
-Gerrit
[1] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001072.htm... [2] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001073.htm... [3] https://mailman.uni-konstanz.de/pipermail/basex-talk/ [4] http://www.google.com/support/webmasters/bin/answer.py?answer=183668
Good Morning Gerrit,
thanks for reporting and your observations: Am 02.02.2011 um 22:21 schrieb Imsieke, Gerrit, le-tex:
Michael,
I was wondering why the most recent posts don't seem to be indexed. If you pick examples from the January list , you'll probably notice that the most recent posts are from Jan. 25: [1] indexed, [2] not indexed.
I was observing this behavior too, not particularly with the mailing list but generally:
Maybe this is because the bot (if it ever returned after initial indexing) looked at [3] and didn't notice any change, so it didn't descend further. If this is the case and the bot returns daily or so, we should see some change soon because February is new on [3].
But I doubt that the bot ever came back after Jan 26.
You could try to submit a changed sitemap.xml each month, pointing to that month's message overview page and specifying a changefreq of 'daily' [4] for that page. Don't know whether Googlebot will take this into account though. But other ways such as the infamous revisit-after meta tag won't work at all, I was told.
The main problem is, that we don't have direct access to any page under [3]. We could however try to add sth. like a daily digest via RSS (from our page that points to [1/2/…] ) and submit that feed to google; maybe this would ease some of the pain. I'll see if I can find something that does this automagically :-).
As a sidenote: Google still seems a little confused by the change of our domain name. Though we redirected all relevant pages via [5] and created sitemaps [4] for our new content, Google still has not indexed about 20% of our pages.
Maybe it takes some time for the Bot to fully adjust to our new domain.
Michael
-Gerrit
[1] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001072.htm... [2] https://mailman.uni-konstanz.de/pipermail/basex-talk/2011-January/001073.htm... [3] https://mailman.uni-konstanz.de/pipermail/basex-talk/ [4] http://www.google.com/support/webmasters/bin/answer.py?answer=183668
[5] https://www.google.com/support/webmasters/bin/answer.py?answer=93633&hl=...
BaseX-Talk mailing list BaseX-Talk@mailman.uni-konstanz.de https://mailman.uni-konstanz.de/mailman/listinfo/basex-talk
basex-talk@mailman.uni-konstanz.de
-
Imsieke, Gerrit, le-tex -
Michael Seiferle