Lexington Brief

About the Lexington Brief crawler

Lexington Brief (lexbrief.news) is a local news site for Lexington, Kentucky. We group coverage of the same event from many outlets and link every story back to the publisher, so readers finish the story on your site. If you saw requests from us in your server logs, this page explains what they are.

What our software requests

• Your RSS or Atom feed. We identify ourselves as LexingtonBrief/1.0 and ask for each feed about once every 5 minutes. We use conditional requests (ETag and Last-Modified) when the feed supports them, and we wait longer after errors or a Retry-After response.
• Article pages your feed links to. We identify ourselves as LexingtonBrief/1.0 and wait at least 250 milliseconds between requests to the same site. We read the page so we can write a short headline and summary.

Pages that block automated requests

Some sites answer plain automated requests with a bot-challenge page. For those pages we may load the article in a headless browser instead. Those requests come from a standard browser, so they do not carry the Lexington Brief name. We do not log in to sites, use credentials, or solve CAPTCHAs.

What we publish

• The headline, a short summary, your outlet's name, and a prominent link to your original article. We do not republish full articles.
• Summaries and some headlines are written with the help of AI language models, which may process article text on third-party services. They are meant to help readers decide what to read, not to replace the article.

Contact and removal requests

If you have a question, a correction, or want us to stop fetching your site or change how your content appears, email info@lexbrief.news. We honor requests to change or remove how a publisher's content appears.