CHYP.ai · ORBIT // Cloudy_Day Security Suite

CRAWL INVENTORY

How ORBIT is set up to be crawled

Internal inventory of public URLs ORBIT advertises to crawlers, plus when our own archiver last wrote a timestamp we can read. These are not Google Search Console numbers. They are not rankings, impressions, clicks, index coverage, or a claim about what any search engine has indexed.

Indexable URL estimate

The current XML sitemap lists 2116 public URLs. 434 of them carry a lastmod we actually know (daily briefs, KEV dates, historic dissector cases, recent incidents). The rest omit lastmod rather than invent a date. Generated .

“Indexable” here means: the URL is public, is listed in the sitemap, and is not noindexed by ORBIT. Search engines decide what they crawl and keep. This estimate will move as KEV rows, briefs and recent incidents change.

Sitemaps

A sitemap index lists each section, plus the all-in-one file that older crawlers already know:

SectionWhat's in itURLs
coreCore hubs (home, weather, news desk, citation, inventory)19
statusStatus radar, service pages, pulse and signals1010
incidentsOutage dossiers, dissector, war room, recent incident pages606
toolsPublic tools (Arena is listed separately)32
labsORBIT Labs stations and missions27
osCHYP OS2
communityCHYP Community boards (index pages only; threads and profiles are not auto-listed)11
arenaCloudy_Day Arena (public rooms and challenges; personal /arena/me/ is not listed)65
legalLegal, about and policy pages13
kevCISA KEV and CVE trackers302
newsNews, daily briefs, topics and the feeds index29
TotalUnique public URLs in the inventory2116

Last archiver write we can see

When the archiver stores a JSON blob in the meta table, this page shows the timestamp field if one is present (for example a KEV catalog fetchedAt). That is a record of our collector, not of Googlebot.

Archiver keyTimestamp found in the value
arena_live_syncno timestamp field in this row
awin_syncno timestamp field in this row
events_chatno timestamp field in this row
events_last
feed_lastno timestamp field in this row
kev_meta
kev_versionno timestamp field in this row
listen_last
markets_leaseno timestamp field in this row
news_last
ofh_cycleno timestamp field in this row
ofh_last
sig_leaseno timestamp field in this row
takes_archive_last
takes_postno timestamp field in this row
v5_sweepno timestamp field in this row
watch_last

What we deliberately do not hide

  • No Bot Fight Mode, no AI-bot blocking, no zone rate limits aimed at crawlers, and no robots.txt Disallows that hide public pages.
  • Language-model briefings live at /llms.txt, /llms-full.txt, /.well-known/llms.txt and /.well-known/ai.txt.
  • /humans.txt is a short, truthful credits file.
  • JSON and Markdown exports stay cacheable (they are not a crawl trap) and are not listed in the sitemap. Replay and as-of URLs are canonicalized; we do not list every time-sliced variant.
  • Search result pages (/search/?q=) stay crawlable so the site search box can be verified, and they are noindexed so they do not compete with the real pages.

Related

Where to next