Skip to main content

Our crawler — for publishers

সর্বশেষ হালনাগাদ: September 20, 2026

Who we are

কী মিস করলাম! (kimisskorlam.com) is a Bangladeshi reader that shows what happened, grouped by topic, and sends readers to the original reporting. Our automated fetcher identifies itself as:

kimisskorlam-ingestor/1.0 (+https://kimisskorlam.com/bot)

What it fetches

  • Your public RSS feed, or your Google-News sitemap where you publish one.
  • For a topic's picture: the og:image of a page that robots.txt lets us fetch.

From that we keep the headline, a short excerpt (at most 300 characters), your thumbnail's address and the link, and we show your outlet's name with every item. We do not store or display full articles.

How it behaves

  • It obeys robots.txt for every URL it fetches, and skips a site that disallows it.
  • A handful of requests per outlet every two hours; no crawling of article archives.
  • It only requests public addresses, and does not attempt to get around firewalls or bot protection.

Allow-list, opt out, or ask us anything

If your firewall blocks our fetcher and you'd like to be included, allow-list the user agent above or tell us the feed address you prefer. If you would rather not appear, say so and we will remove your outlet and its items promptly. Write to support@kimisskorlam.com or use the contact form.