Microsoft to Support Cross-Domain Sitemaps

LOS ANGELES — Microsoft, in collaboration with search competitors Google and Yahoo!, has announced an update to the Sitemaps Protocol, designed to increase usage through enhanced flexibility over where the sitemaps are hosted.

The update allows webmasters to host sitemap files on any domain, using a robots.txt file to indicate the location of the sitemap file and the domain it represents.

For example, MSN.com offers content across subdomains such as health.msn.com, travel.msn.com and moneycentral.msn.com, but is unable to host all of its sitemaps in one location, such as sitemaps.msn.com.

Until now the protocol did not support this scenario, each sitemap would have needed to be hosted directly under the domain it described," Fabrice Canel, program manager for Microsoft's Live Search Crawler, said. "This update now introduces support for this scenario, with the requirement that you simply include a reference to the sitemap in your robots.txt file."

Canel offered moneycentral.msn.com/robots.txt as an example, which could now include the following line; Sitemap: https://sitemaps.msn.com/index_moneycentral.msn.com.xml, adding that all URLs in the sitemap file must be within the same domain as the robots.txt file (e.g. moneycentral.msn.com/ in this example).

Multiple "Sitemap:" references are supported, although Microsoft recommends keeping robots.txt files under 1 MB in size and limiting individual sitemap files to under 10 MB, whether they are in XML, RSS or Text formats.

One feature that comes as a direct result of webmaster feedback is the ability to ping Live Search to notify it of updates to sitemaps.

In support of the changes to the Sitemap Protocol, Microsoft offers a Sitemap Forum for webmasters.

Related:  

Copyright © 2024 Adnet Media. All Rights Reserved. XBIZ is a trademark of Adnet Media.
Reproduction in whole or in part in any form or medium without express written permission is prohibited.

More News

Open Mind AI Seeks Inclusion in EU's AI Debate

New European industry initiative Open Mind AI has penned a letter asking EU authorities to include adult companies and creators in ongoing discussions on setting up a legal framework for AI content.

Canadian Law Professor: Proposed Age Verification Bill 'Will Make Things Worse'

Leading Canadian newspaper The Globe and Mail this week published an op-ed written by a legal scholar outlining fundamental issues with the Conservative-backed age verification bill currently making its way through Parliament.

UK Labour Government Confirms it Will Continue Baroness-Led 'Porn Review'

The U.K. Labour government of Prime Minister Keir Starmer has confirmed it will continue the controversial full review of British pornography laws ordered by former Tory Prime Minister Rishi Sunak in July 2023.

AEBN Publishes Popular Searches for July and August

AEBN has released the top search terms for the months of July and August from its straight and gay theaters in all 50 states and the District of Columbia.

SWR Data Survey Probes Concerns About Political Attacks on Industry

SWR Data, an adult-sector market research firm led by industry veterans Mike Stabile and MelRose Michaels, has released data from its upcoming 2024 State of the Creator report, illustrating creators’ concerns about political attacks on the industry.

FSC Urges SCOTUS to Strike Down 'Unconstitutional' Texas Age Verification Law

The Free Speech Coalition (FSC) urged the U.S. Supreme Court through a brief filed Monday to strike down Texas’ age verification law as unconstitutional.

Japanese Manga Industry Hit by Credit Card Companies' Anti-Porn Restrictions

Japanese manga retailers are reporting pressure from multinational credit card companies — many based in the U.S. and targeted by anti-porn religious conservatives — to censor their content if they wish to maintain their current payment processing arrangements.

Netherlands Government Continues Porn Probe Following Abuse Allegations

The Dutch government plans to continue investigating the local porn industry in the Netherlands, following a series of abuse allegations involving photographer and self-styled “model scout” Daniël van der W.

Clips4Sale Releases '20 Years of Fetish' Data Survey

Clips4Sale (C4S) has released a report based on 20 years of data and analysis to show how kink and fetish tastes have changed since the site began.

Grooby, Yanks Ink Website Management Deal

Grooby will begin managing Yanks.com under a new company, Blue.xxx.

Show More