https://spyonweb.net/

{
  "url": "https://spyonweb.net/",
  "timestamp": 1771425349461,
  "fetch": {
    "mode": "simple",
    "timeMs": 51,
    "htmlSizeBytes": 47948,
    "supportsMarkdown": false,
    "markdownAgents": {
      "contentNegotiation": false,
      "mdUrl": {
        "found": false,
        "url": null
      },
      "linkTag": {
        "found": false,
        "url": null
      },
      "linkHeader": {
        "found": false,
        "url": null
      },
      "responseHeaders": {
        "contentSignal": null,
        "xMarkdownTokens": null,
        "vary": null
      },
      "frontmatter": {
        "present": false,
        "fields": [],
        "level": "none"
      },
      "level": "none"
    },
    "statusCode": 200
  },
  "extraction": {
    "title": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool",
    "excerpt": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
    "byline": null,
    "siteName": "SpyOnWeb",
    "lang": "en",
    "contentLength": 1265,
    "metadata": {
      "description": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
      "ogTitle": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool",
      "ogDescription": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
      "ogImage": "https://spyonweb.net/assets/images/og-default.png",
      "ogType": "website",
      "canonical": "https://spyonweb.net/",
      "lang": "en",
      "schemas": [
        {
          "@context": "https://schema.org",
          "@type": "WebSite",
          "name": "SpyOnWeb",
          "url": "https://spyonweb.net/",
          "description": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
          "inLanguage": "en",
          "potentialAction": {
            "@type": "SearchAction",
            "target": "https://spyonweb.net/?query={search_term_string}",
            "query-input": "required name=search_term_string"
          }
        },
        {
          "@context": "https://schema.org",
          "@type": "Organization",
          "name": "SpyOnWeb",
          "url": "https://spyonweb.net/",
          "description": "Domain intelligence platform for discovering relationships between websites through shared identifiers and infrastructure."
        }
      ],
      "robotsMeta": "index, follow",
      "author": null,
      "generator": null,
      "markdownAlternateHref": null
    }
  },
  "markdown": "## Map the digital footprint of any domain.\n\nSpyOnWeb correlates domains, Analytics snippets, AdSense publishers, nameservers and IP addresses so you can discover hidden relationships in seconds.\n\n132,745 Domains\n\n99,299 Analytics\n\n40,179 AdSense\n\n41,645 Nameservers\n\n129,054 IPs\n\n25 Technologies\n\n120,894 SSL Active\n\n### Fast reconnaissance\n\nFeed a single domain or identifier and receive correlated assets in real time. Perfect for security assessments, competitive research or due diligence.\n\n### Actionable context\n\nSee shared Analytics, AdSense, nameservers and historic IPs in one view to understand infrastructure reuse and uncover connected entities quickly.\n\n### Deployment friendly\n\nDesigned for shared hosting: pure PHP, MySQL and no external APIs required. Install through the web wizard and manage data with the built-in admin panel.\n",
  "fullPageMarkdown": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool\n\n[SpyOnWeb](https://spyonweb.net/)\n\nToggle color theme Language English Español\n\n# Map the digital footprint of any domain.\n\nSpyOnWeb correlates domains, Analytics snippets, AdSense publishers, nameservers and IP addresses so you can discover hidden relationships in seconds.\n\nLookup query  Search\n\nExamples: stackscale.com, UA-123456-1, pub-1234567890123456, ns1.example.net\n\n132,745 Domains\n\n99,299 Analytics\n\n40,179 AdSense\n\n41,645 Nameservers\n\n129,054 IPs\n\n25 Technologies\n\n120,894 SSL Active\n\n### Fast reconnaissance\n\nFeed a single domain or identifier and receive correlated assets in real time. Perfect for security assessments, competitive research or due diligence.\n\n### Actionable context\n\nSee shared Analytics, AdSense, nameservers and historic IPs in one view to understand infrastructure reuse and uncover connected entities quickly.\n\n### Deployment friendly\n\nDesigned for shared hosting: pure PHP, MySQL and no external APIs required. Install through the web wizard and manage data with the built-in admin panel.\n",
  "markdownStats": {
    "images": 0,
    "links": 0,
    "tables": 0,
    "codeBlocks": 0,
    "headings": 4
  },
  "tokens": {
    "htmlTokens": 11017,
    "markdownTokens": 166,
    "reduction": 10851,
    "reductionPercent": 98
  },
  "score": {
    "score": 81,
    "grade": "B",
    "dimensions": {
      "semanticHtml": {
        "score": 96,
        "weight": 20,
        "grade": "A",
        "checks": {
          "uses_article_or_main": {
            "score": 100,
            "weight": 20,
            "details": "Has both <article> and <main>"
          },
          "proper_heading_hierarchy": {
            "score": 85,
            "weight": 25,
            "details": "1 heading level skip(s)"
          },
          "semantic_elements": {
            "score": 100,
            "weight": 20,
            "details": "13 semantic elements, 17 divs (ratio: 43%)"
          },
          "meaningful_alt_texts": {
            "score": 100,
            "weight": 15,
            "details": "No images found"
          },
          "low_div_nesting": {
            "score": 100,
            "weight": 20,
            "details": "Avg div depth: 0.1, max: 1"
          }
        }
      },
      "contentEfficiency": {
        "score": 70,
        "weight": 25,
        "grade": "C",
        "checks": {
          "token_reduction_ratio": {
            "score": 100,
            "weight": 40,
            "details": "98% token reduction (HTML→Markdown)"
          },
          "content_to_noise_ratio": {
            "score": 0,
            "weight": 30,
            "details": "Content ratio: 2.6% (1265 content chars / 47948 HTML bytes)"
          },
          "minimal_inline_styles": {
            "score": 100,
            "weight": 15,
            "details": "0/127 elements with inline styles (0.0%)"
          },
          "reasonable_page_weight": {
            "score": 100,
            "weight": 15,
            "details": "HTML size: 47KB"
          }
        }
      },
      "aiDiscoverability": {
        "score": 57,
        "weight": 25,
        "grade": "D",
        "checks": {
          "has_llms_txt": {
            "score": 100,
            "weight": 20,
            "details": "llms.txt exists and is valid"
          },
          "has_robots_txt": {
            "score": 100,
            "weight": 10,
            "details": "robots.txt exists"
          },
          "robots_allows_ai_bots": {
            "score": 34,
            "weight": 15,
            "details": "2/3 AI bots blocked: ClaudeBot, GPTBot"
          },
          "has_sitemap": {
            "score": 100,
            "weight": 10,
            "details": "Sitemap found"
          },
          "supports_markdown_negotiation": {
            "score": 0,
            "weight": 25,
            "details": "No Markdown for Agents support detected"
          },
          "has_content_signals": {
            "score": 60,
            "weight": 20,
            "details": "robots.txt: search=yes, ai-train=no | Policy included"
          }
        }
      },
      "structuredData": {
        "score": 100,
        "weight": 15,
        "grade": "A",
        "checks": {
          "has_schema_org": {
            "score": 100,
            "weight": 30,
            "details": "JSON-LD found: WebSite, Organization"
          },
          "has_open_graph": {
            "score": 100,
            "weight": 25,
            "details": "All OG tags present"
          },
          "has_meta_description": {
            "score": 100,
            "weight": 20,
            "details": "Meta description: 134 chars"
          },
          "has_canonical_url": {
            "score": 100,
            "weight": 15,
            "details": "Canonical URL present"
          },
          "has_lang_attribute": {
            "score": 100,
            "weight": 10,
            "details": "lang=\"en\""
          }
        }
      },
      "accessibility": {
        "score": 100,
        "weight": 15,
        "grade": "A",
        "checks": {
          "content_without_js": {
            "score": 100,
            "weight": 40,
            "details": "Content available without JavaScript"
          },
          "reasonable_page_size": {
            "score": 100,
            "weight": 30,
            "details": "Page size: 47KB"
          },
          "fast_content_position": {
            "score": 100,
            "weight": 30,
            "details": "Main content starts at 9% of HTML"
          }
        }
      }
    }
  },
  "recommendations": [
    {
      "id": "improve_content_ratio",
      "priority": "critical",
      "category": "contentEfficiency",
      "titleKey": "rec.improve_content_ratio.title",
      "descriptionKey": "rec.improve_content_ratio.description",
      "howToKey": "rec.improve_content_ratio.howto",
      "effort": "moderate",
      "estimatedImpact": 6,
      "checkScore": 0,
      "checkDetails": "Content ratio: 2.6% (1265 content chars / 47948 HTML bytes)"
    },
    {
      "id": "add_markdown_negotiation",
      "priority": "critical",
      "category": "aiDiscoverability",
      "titleKey": "rec.add_markdown_negotiation.title",
      "descriptionKey": "rec.add_markdown_negotiation.description",
      "howToKey": "rec.add_markdown_negotiation.howto",
      "effort": "significant",
      "estimatedImpact": 6,
      "checkScore": 0,
      "checkDetails": "No Markdown for Agents support detected"
    },
    {
      "id": "allow_ai_bots",
      "priority": "high",
      "category": "aiDiscoverability",
      "titleKey": "rec.allow_ai_bots.title",
      "descriptionKey": "rec.allow_ai_bots.description",
      "howToKey": "rec.allow_ai_bots.howto",
      "effort": "quick-win",
      "estimatedImpact": 7,
      "checkScore": 34,
      "checkDetails": "2/3 AI bots blocked: ClaudeBot, GPTBot"
    }
  ],
  "llmsTxtPreview": "# SpyOnWeb\n\n> Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.\n\n## Documentation\n- [FAQ](https://spyonweb.net/faq)\n\n## Main\n- [SpyOnWeb — Domain Intelligence & Reverse Lookup Tool](https://spyonweb.net/): Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free rever…\n- [About Us](https://spyonweb.net/about)\n- [Top Lists](https://spyonweb.net/top)\n\n## Support\n- [FAQ](https://spyonweb.net/faq)\n\n",
  "llmsTxtExisting": "# SpyOnWeb — Domain Intelligence Platform\n\n> SpyOnWeb is a domain intelligence tool that reveals relationships between websites through shared Analytics codes, AdSense publishers, IP addresses, nameservers, SSL certificates and web technologies.\n\n## Main Pages\n\n- [Home](https://spyonweb.net/): Search any domain, IP, or identifier\n- [About](https://spyonweb.net/about): Platform overview and capabilities\n- [FAQ](https://spyonweb.net/faq): Common questions answered\n- [Top Rankings](https://spyonweb.net/top): Most prevalent technologies, SSL issuers, analytics codes\n\n## Lookup Types\n\n- Domain profile: `/domain/{name}` — Full domain report with IP, technologies, associations\n- IP lookup: `/ip/{address}` — All domains hosted on an IP address\n- Analytics: `/analytics/{code}` — Domains sharing a Google Analytics code\n- AdSense: `/adsense/{code}` — Domains from the same AdSense publisher\n- Nameserver: `/nameserver/{ns}` — Domains delegated to a DNS nameserver\n- Technology: `/technology/{name}` — Domains using a specific technology\n- SSL Issuer: `/ssl/{issuer}` — Domains with certificates from an issuer\n\n## API\n\nJSON API available at `/api/v1/` for programmatic access. API keys generated from user dashboard.",
  "snippets": [
    {
      "id": "allow_ai_bots",
      "title": "Allow AI bots in robots.txt",
      "description": "Some AI bots are blocked in your robots.txt. Remove or modify these Disallow rules to let AI agents index your content.",
      "language": "txt",
      "code": "# Add to your robots.txt — explicitly allow AI bots:\nUser-agent: GPTBot\nAllow: /\n\nUser-agent: ClaudeBot\nAllow: /\n\nUser-agent: PerplexityBot\nAllow: /",
      "filename": "/robots.txt"
    },
    {
      "id": "add_markdown_negotiation",
      "title": "Support Markdown for Agents",
      "description": "Implement one or more of the 4 Markdown for Agents mechanisms to let AI agents request content in markdown format.",
      "language": "html",
      "code": "<!-- 1. Content negotiation: respond to Accept: text/markdown -->\n<!-- In your server/framework, check the Accept header and return markdown -->\n<!-- with Content-Type: text/markdown -->\n\n<!-- 2. Serve .md URLs (e.g., /about.md alongside /about) -->\n<!-- Generate static .md files or handle .md routes in your app -->\n\n<!-- 3. Add <link> tag in your HTML <head>: -->\n<link rel=\"alternate\" type=\"text/markdown\" href=\"/page.md\">\n\n<!-- 4. Add Link HTTP header on HTML responses: -->\n<!-- Link: </page.md>; rel=\"alternate\"; type=\"text/markdown\" -->\n\n<!-- Best practice: include Vary: Accept and X-Markdown-Tokens headers -->\n<!-- on markdown responses -->",
      "filename": "<head> + server config"
    }
  ]
}

Use our API to get this programmatically (coming soon)