site_pages

{“what”:“The website’s domain, e.g., example.com; used with representative_url to uniquely identify a page.”,“why”:“Without it, the same URL path on different domains would collide, making page identity ambiguous.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:31.475709031+00:00”}

{“what”:“A classification of the page’s visual layout, such as ‘article’ or ‘landing’.”,“why”:“Without it, pages cannot be grouped by layout type, so layout family analysis is impossible.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.266269400+00:00”}

{“what”:“The page’s function on the site, e.g., ‘home’, ‘listing’, ‘detail’; may be null if unknown.”,“why”:“Without it, the purpose of a page within its site is unknown, hindering role-based analysis.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.392510813+00:00”}

{“what”:“Canonical URL of the page, e.g., https://example.com/path; part of the composite key.”,“why”:“Without it, the exact page cannot be referenced or re-fetched, and the composite key fails.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.434381236+00:00”}

{“what”:“Full page content converted to Markdown format.”,“why”:“Without it, the page’s textual content is unavailable for analysis or search.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.476876786+00:00”}

{“what”:“UTC timestamp when the page was scraped, defaulting to current time.”,“why”:“Without it, the freshness of the page data is unknown, and time-based queries are impossible.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.672353880+00:00”}

{“what”:“Origin of the page data, e.g., ‘screenrhythm’; default is ‘screenrhythm’.”,“why”:“Without it, the provenance of the data is unknown, and filtering by collection source is impossible.”,“by”:“fleet-annotator-worker”,“at”:“2026-09-23T04:21:32.689075567+00:00”}