# The Kansas City Star content is made available for your personal, non-commercial # use subject to our Terms of Service here: # https://www.mcclatchy.com/terms-of-service # Use of any device, tool, or process designed to data mine or scrape the content # using automated means is prohibited without prior written permission from # The Kansas City Star. Prohibited uses include but are not limited to: # (1) text and data mining activities # (2) the development of any software, machine learning, artificial intelligence (AI), # and/or large language models (LLMs); # (3) creating or providing archived or cached data sets containing our content to others; and/or # (4) any commercial purposes. # Global allow for Mediapartners - this is used by Google to place ads in content, # not indexing purposes. User-agent: Mediapartners-Google Disallow: # Global allow for the Klangoo bot User-agent: Magnetbot Disallow: # Throttles to decrease load User-agent: Yandex Crawl-delay: 3 User-agent: Baiduspider Crawl-delay: 3 User-agent: bingbot Crawl-delay: 1 User-agent: Slurp Crawl-delay: 2 User-agent: FacebookBot Crawl-delay: 3 # Story blocks for selected bots User-agent: anthropic-ai Disallow: /*.html User-agent: ChatGPT-User Disallow: /*.html User-agent: Claude-SearchBot Disallow: /*.html User-agent: Claude-Web Disallow: /*.html User-agent: ClaudeBot Disallow: /*.html User-agent: Google-Extended Disallow: /*.html User-agent: GPTBot Disallow: /*.html User-agent: OAI-SearchBot Disallow: /*.html User-agent: Perplexity-ai Disallow: /*.html User-agent: Perplexity-User Disallow: /*.html User-agent: PerplexityBot Disallow: /*.html User-agent: archive.org_bot Disallow: /*.html User-agent: ia_archiver Disallow: /*.html User-agent: ia_archiver-web.archive.org Disallow: /*.html # Complete blocks of uninteresting bots User-agent: A6-Indexer Disallow: / User-agent: AddSearchBot Disallow: / User-agent: aiHitBot Disallow: / User-agent: Andibot Disallow: / User-agent: ankiro.com Disallow: / User-agent: Applebot-Extended Disallow: / User-agent: AspiegelBot Disallow: / User-agent: Barkrowler Disallow: / User-agent: bigsur.ai Disallow: / User-agent: BLP_bbot Disallow: / User-agent: Brightbot 1.0 Disallow: / User-agent: Buck Disallow: / User-agent: Bytespider Disallow: / User-agent: CCBot Disallow: / User-agent: ChatGLM-Spider Disallow: / User-agent: CheckMarkNetwork Disallow: / User-agent: coccocbot-web Disallow: / User-agent: cohere-ai Disallow: / User-agent: cohere-training-data-crawler Disallow: / User-agent: Cotoyogi Disallow: / User-agent: crawler4j Disallow: / User-agent: Crawlspace Disallow: / User-agent: dataprovider Disallow: / User-agent: Datenbank Crawler Disallow: / User-agent: Diffbot Disallow: / User-agent: EasouSpider Disallow: / User-agent: Echobot Bot Disallow: / User-agent: EchoboxBot Disallow: / User-agent: ecoResearch Disallow: / User-agent: FirecrawlAgent Disallow: / User-agent: Grok Disallow: / User-agent: GrokBot Disallow: / User-agent: GrokBot/1.0 Disallow: / User-agent: Grok-DeepSearch/1.0 Disallow: / User-agent: Genieo Disallow: / User-agent: https://hada.news Disallow: / User-agent: iaskspider/2.0 Disallow: / User-agent: ICC-Crawler Disallow: / User-agent: img2dataset Disallow: / User-agent: JenkersBot Disallow: / User-agent: Jetslide Disallow: / User-agent: Kangaroo Bot Disallow: / User-agent: KunatoCrawler Disallow: / User-agent: legistorm.com Disallow: / User-agent: LivelapBot Disallow: / User-agent: magpie-crawler Disallow: / User-agent: Magus Bot Disallow: / User-agent: MauiBot Disallow: / User-agent: MAZBot Disallow: / User-agent: Meta-ExternalAgent Disallow: / User-agent: Meta-ExternalFetcher Disallow: / User-agent: MistralAI-User Disallow: / User-agent: MistralAI-User/1.0 Disallow: / User-agent: Mojeek Disallow: / User-agent: MojeekBot Disallow: / User-agent: MyCentralAIScraperBot Disallow: / User-agent: news-please Disallow: / User-agent: NewsNow Disallow: / User-agent: Netvibes Disallow: / User-agent: nlcrawler Disallow: / User-agent: NovaAct Disallow: / User-agent: Omgilibot Disallow: / User-agent: omgili Disallow: / User-agent: Oracle Secure Enterprise Search Disallow: / User-agent: panscient.com Disallow: / User-agent: PetalBot Disallow: / User-agent: PanguBot Disallow: / User-agent: Poseidon Research Crawler Disallow: / User-agent: Primalbot Disallow: / User-agent: Riddler Disallow: / User-agent: QuillBot Disallow: / User-agent: quillbot.com Disallow: / User-agent: R6_CommentReader Disallow: / User-agent: SBIntuitionsBot Disallow: / User-agent: Scrapy Disallow: / User-agent: SeekportBot Disallow: / User-agent: Seekr Disallow: / User-agent: SeekrBot Disallow: / User-agent: SeznamBot Disallow: / User-agent: SeznamHomepageCrawler Disallow: / User-agent: Sidetrade indexer bot Disallow: / User-agent: Spinn3r Disallow: / User-agent: TaraGroup Intelligent Bot Disallow: / User-agent: Thinkbot Disallow: / User-agent: Timpibot Disallow: / User-agent: VelenPublicWebCrawler Disallow: / User-agent: Verity Disallow: / User-agent: Verity/1.1 Disallow: / User-agent: ViennaTinyBot Disallow: / User-agent: voxgov.com Disallow: / User-agent: webintegration.at Disallow: / User-agent: WebVac Disallow: / User-agent: Webzio-Extended Disallow: / User-agent: WebZip Disallow: / User-agent: WRTNBot Disallow: / User-agent: xAI Disallow: / User-agent: xAI-Grok/1.0 Disallow: / User-agent: yacy Disallow: / User-agent: yacybot Disallow: / User-agent: YouBot Disallow: / # Prevent bots from wasting crawl budget on template/non-content pages User-Agent: * Disallow: /search Disallow: /web Disallow: /mrcontent Disallow: /webapi-public Disallow: /adperfect Disallow: /*amp.html?* Disallow: *.ece* Allow: *.ece*.pdf # Block indexing of specific sections/content at the market's request User-Agent: * Disallow: /entertainment/ent-columns-blogs Disallow: /entertainment/ent-columns-blogs/back-to-rockville Disallow: /entertainment/ent-columns-blogs/stargazing Disallow: /entertainment/holidays Disallow: /entertainment/ink Disallow: /entertainment/ink/30-under-30 Disallow: /entertainment/ink/best-of-ink Disallow: /entertainment/ink/go-out Disallow: /entertainment/ink/ink-food-drink Disallow: /entertainment/ink/life-in-kc Disallow: /entertainment/ink/middle-of-map-festival Disallow: /entertainment/performing-arts/fringe-festival Disallow: /entertainment/restaurants Disallow: /entertainment/visual-arts Disallow: /entertainment/wizard-of-oz Disallow: /living/advice-columns Disallow: /living/food-drink/cooking-101 Disallow: /living/food-drink/eating-for-life Disallow: /living/food-drink/food-issue Disallow: /living/health-fitness Disallow: /living/home-garden/catalog-scout Disallow: /living/home-garden/handyman Disallow: /living/home-garden/home-q-a Disallow: /living/liv-columns-blogs/billy-graham Disallow: /living/liv-columns-blogs/cindy-hoedel Disallow: /living/liv-columns-blogs/jenee-osterheldt Disallow: /living/religion Disallow: /living/spirit Disallow: /living/star-magazine Disallow: /living/star-magazine/love-story Disallow: /living/star-magazine/money-manners Disallow: /living/star-magazine/now-trending Disallow: /living/star-magazine/tillman Disallow: /living/summer-guide Disallow: /news/business/biz-columns-blogs/diversity-diva Disallow: /news/business/biz-columns-blogs/kids-money Disallow: /news/business/biz-columns-blogs/talking-business Disallow: /news/business/public-records Disallow: /news/business/star-40 Disallow: /news/business/workplace Disallow: /news/local/community/816 Disallow: /news/local/community/816-north/816-north Disallow: /news/local/community/816-north/816-north-business Disallow: /news/local/community/816-north/816-north-diversions Disallow: /news/local/community/816-north/816-north-opinion Disallow: /news/local/community/816-north/816-north-sports Disallow: /news/local/community/816/816-business Disallow: /news/local/community/816/816-diversions Disallow: /news/local/community/816/816-opinion Disallow: /news/local/community/816/816-sports Disallow: /news/local/community/cass-county-demo/cc-news Disallow: /news/local/community/cass-county-demo/cc-opinion Disallow: /news/local/community/cass-county-demo/cc-sports Disallow: /news/local/community/lsjournal/lsj-news Disallow: /news/local/community/lsjournal/lsj-opinion Disallow: /news/local/community/lsjournal/lsj-sports Disallow: /news/local/community/wyandotte-leavenworth Disallow: /news/local/news-columns-blogs Disallow: /news/local/news-columns-blogs/c-w-gusewelle Disallow: /news/local/news-columns-blogs/crime-scene-kc Disallow: /news/local/news-columns-blogs/eyewitness Disallow: /news/local/news-columns-blogs/local-columnists Disallow: /news/local/news-columns-blogs/reporting-live Disallow: /news/local/news-columns-blogs/watchdog-blog Disallow: /news/lottery Disallow: /news/nation-world/immigration-refugees Disallow: /news/special-reports/_news_special-reports_doctors-inc_ Disallow: /news/special-reports/becoming-yordano Disallow: /news/special-reports/civil-rights-act-turns-50 Disallow: /news/special-reports/decision Disallow: /news/special-reports/domestic-terrorism Disallow: /news/special-reports/doomsday_kc Disallow: /news/special-reports/hoa Disallow: /news/special-reports/joplin Disallow: /news/special-reports/KC-sportswriters-memories Disallow: /news/special-reports/kc-true-crime Disallow: /news/special-reports/lake-drowning Disallow: /news/special-reports/many-probations Disallow: /news/special-reports/maryville Disallow: /news/special-reports/penguins Disallow: /news/special-reports/remembering-bob-dole Disallow: /news/special-reports/saving-govi Disallow: /news/special-reports/sprint-future Disallow: /news/state Disallow: /news/state/illinois Disallow: /opinion/editorial-cartoons/lee-judge Disallow: /opinion/opinion-influencers Disallow: /opinion/opn-columns-blogs/barbara-shelly Disallow: /opinion/opn-columns-blogs/lewis-diuguid Disallow: /opinion/opn-columns-blogs/mary-sanchez Disallow: /opinion/opn-columns-blogs/midwest-voices Disallow: /opinion/opn-columns-blogs/miriam-pepper Disallow: /opinion/opn-columns-blogs/public-editor Disallow: /opinion/opn-columns-blogs/star-views Disallow: /opinion/opn-columns-blogs/steve-paul Disallow: /opinion/opn-columns-blogs/steve-rose Disallow: /opinion/opn-columns-blogs/yael-t-abouhalkah Disallow: /spaces/advice Disallow: /spaces/arts-culture Disallow: /spaces/beauty Disallow: /spaces/design Disallow: /spaces/events Disallow: /spaces/fashion Disallow: /spaces/featured-homes Disallow: /spaces/food-entertaining Disallow: /spaces/food-news Disallow: /spaces/health-fitness Disallow: /spaces/partner Disallow: /spaces/recipes Disallow: /spaces/restaurants Disallow: /spaces/style Disallow: /sports/college/big-12/university-of-kansas/jayhawk-analysis Disallow: /sports/college/big-12/university-of-kansas/ku-basketball-news Disallow: /sports/college/big-12/university-of-kansas/ku-basketball-photos-videos Disallow: /sports/college/big-12/university-of-kansas/recruiting-central Disallow: /sports/college/big-12/university-of-kansas/the-jayhawk-legacy Disallow: /sports/college/naia-tournament Disallow: /sports/college/sec/university-of-missouri/mizzou-analysis Disallow: /sports/college/sec/university-of-missouri/mizzou-basketball-news Disallow: /sports/college/sec/university-of-missouri/mizzou-football-news Disallow: /sports/high-school/other-kansas-prep-sports Disallow: /sports/high-school/other-missouri-prep-sports Disallow: /sports/high-school/prep-basketball Disallow: /sports/high-school/prep-basketball/kansas-prep-basketball Disallow: /sports/high-school/prep-basketball/missouri-prep-basketball Disallow: /sports/high-school/prep-football Disallow: /sports/high-school/prep-football/kansas-prep-football Disallow: /sports/high-school/prep-football/missouri-prep-football Disallow: /sports/mlb/baseball-preview Disallow: /sports/mlb/kansas-city-royals/george-brett Disallow: /sports/mlb/kansas-city-royals/royals-photos-videos Disallow: /sports/nfl/kansas-city-chiefs/chiefs-photos-videos Disallow: /sports/other-sports Disallow: /sports/scores-stats Disallow: /sports/sports-on-the-air Disallow: /sports/spt-columns-blogs/campus-corner Disallow: /sports/spt-columns-blogs/dont-kill-the-mellinger Disallow: /sports/spt-columns-blogs/gregorian-chants Disallow: /sports/spt-columns-blogs/judging-the-royals Disallow: /sports/spt-columns-blogs/red-zone Disallow: /sports/spt-columns-blogs/the-full-90 Disallow: /sports/world-soccer Disallow: /weddings Disallow: /weddings/accommodations Disallow: /weddings/bachelorette-parties Disallow: /weddings/beauty-health Disallow: /weddings/bridal-fashion-jewelry Disallow: /weddings/bridal-showers Disallow: /weddings/bridal-spectacular Disallow: /weddings/catering-cakes Disallow: /weddings/ceremony-reception-sites Disallow: /weddings/decor-rental Disallow: /weddings/dj-music-entertainment Disallow: /weddings/floral Disallow: /weddings/gift-registry Disallow: /weddings/honeymoon Disallow: /weddings/inspiration Disallow: /weddings/invitations Disallow: /weddings/lighting-design Disallow: /weddings/partner-events Disallow: /weddings/photography-video Disallow: /weddings/rehearsal-dinner Disallow: /weddings/transportation Disallow: /weddings/wedding-planners Disallow: /weddings/wedding-services Disallow: /advertise/circulars Disallow: /advertise/place-an-ad Disallow: /advertise/sponsored_content/sponsored-posts Disallow: /advertise/welcome Disallow: /advertise/welcome/welcome-page-lg Disallow: /advertise/welcome/welcome-page-md Disallow: /advertise/welcome/welcome-page-sm Disallow: /advertise/welcome/welcome-page-xs Disallow: /customer-service/404 Disallow: /customer-service/410 Disallow: /customer-service/faq/commenting-faq Disallow: /customer-service/project-warmth Disallow: /customer-service/subscription/special-offers/dbm Disallow: /customer-service/subscription/special-offers/offer-a Disallow: /customer-service/subscription/special-offers/offer-b Disallow: /customer-service/subscription/special-offers/offer-c Disallow: /customer-service/subscription/special-offers/others Disallow: /customer-service/subscription/special-offers/unlimited Disallow: /mobile/m-fan-guide Disallow: /mobile/m-pro-soccer-photos Disallow: /mobile/m-sports Disallow: /mobile/m-top-stories Disallow: /mobile/red-zone-fan-guide Disallow: /site-services/contests-promotions Disallow: /site-services/newsletters/entertainment-preview Disallow: /site-services/newsletters/newsletter-signup Disallow: /site-services/plus Disallow: /site-services/plus/trial-offer Disallow: /site-services/promos Disallow: /site-services/tablets Disallow: /site-services/testing Disallow: /site-services/testing/contest-test Disallow: /site-services/testing/newsgate-test Disallow: /site-services/testing/ntl-ad-ops-testing Disallow: /site-services/testing/Redirect_test1 Disallow: /site-services/testing/test-ink Disallow: /living/liv-columns-blogs Disallow: /sports/spt-columns-blogs Allow: /news/local/news-columns-blogs/the-buzz Allow: /news/state/kansas Allow: /news/state/missouri Allow: /living/liv-columns-blogs/chow-town Allow: /living/liv-columns-blogs/kc-gardens Allow: /sports/spt-columns-blogs/blair-kerkhoff Allow: /sports/spt-columns-blogs/for-petes-sake Allow: /sports/spt-columns-blogs/sam-mellinger Allow: /sports/spt-columns-blogs/vahe-gregorian Allow: /sports/spt-columns-blogs/sam-mcdowell # Sitemap files Sitemap: https://www.kansascity.com/sitemap/story/update.xml Sitemap: https://www.kansascity.com/sitemap/story/archive.xml Sitemap: https://www.kansascity.com/sitemap/story/googlenews.xml Sitemap: https://www.kansascity.com/sitemap/blogpost/update.xml Sitemap: https://www.kansascity.com/sitemap/blogpost/archive.xml Sitemap: https://www.kansascity.com/sitemap/section/archive.xml Sitemap: https://www.kansascity.com/sitemap/topic/archive.xml Sitemap: https://www.kansascity.com/careers-education/sitemap_index.xml Sitemap: https://www.kansascity.com/sitemap/video/archive.xml Sitemap: https://www.kansascity.com/sitemap/video/update.xml