https://spyonweb.net/

{
  "url": "https://spyonweb.net/",
  "timestamp": 1771174273569,
  "fetch": {
    "mode": "simple",
    "timeMs": 73,
    "htmlSizeBytes": 47945,
    "supportsMarkdown": false,
    "statusCode": 200
  },
  "extraction": {
    "title": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool",
    "excerpt": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
    "byline": null,
    "siteName": "SpyOnWeb",
    "lang": "en",
    "contentLength": 1262,
    "metadata": {
      "description": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
      "ogTitle": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool",
      "ogDescription": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
      "ogImage": "https://spyonweb.net/assets/images/og-default.png",
      "ogType": "website",
      "canonical": "https://spyonweb.net/",
      "lang": "en",
      "schemas": [
        {
          "@context": "https://schema.org",
          "@type": "WebSite",
          "name": "SpyOnWeb",
          "url": "https://spyonweb.net/",
          "description": "Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.",
          "inLanguage": "en",
          "potentialAction": {
            "@type": "SearchAction",
            "target": "https://spyonweb.net/?query={search_term_string}",
            "query-input": "required name=search_term_string"
          }
        },
        {
          "@context": "https://schema.org",
          "@type": "Organization",
          "name": "SpyOnWeb",
          "url": "https://spyonweb.net/",
          "description": "Domain intelligence platform for discovering relationships between websites through shared identifiers and infrastructure."
        }
      ],
      "robotsMeta": "index, follow",
      "author": null,
      "generator": null
    }
  },
  "markdown": "## Map the digital footprint of any domain.\n\nSpyOnWeb correlates domains, Analytics snippets, AdSense publishers, nameservers and IP addresses so you can discover hidden relationships in seconds.\n\n65,678 Domains\n\n43,519 Analytics\n\n38,984 AdSense\n\n30,243 Nameservers\n\n81,700 IPs\n\n25 Technologies\n\n57,384 SSL Active\n\n### Fast reconnaissance\n\nFeed a single domain or identifier and receive correlated assets in real time. Perfect for security assessments, competitive research or due diligence.\n\n### Actionable context\n\nSee shared Analytics, AdSense, nameservers and historic IPs in one view to understand infrastructure reuse and uncover connected entities quickly.\n\n### Deployment friendly\n\nDesigned for shared hosting: pure PHP, MySQL and no external APIs required. Install through the web wizard and manage data with the built-in admin panel.\n",
  "fullPageMarkdown": "SpyOnWeb — Domain Intelligence & Reverse Lookup Tool\n\n[SpyOnWeb](https://spyonweb.net/)\n\nToggle color theme Language English Español\n\n# Map the digital footprint of any domain.\n\nSpyOnWeb correlates domains, Analytics snippets, AdSense publishers, nameservers and IP addresses so you can discover hidden relationships in seconds.\n\nLookup query  Search\n\nExamples: stackscale.com, UA-123456-1, pub-1234567890123456, ns1.example.net\n\n65,678 Domains\n\n43,519 Analytics\n\n38,984 AdSense\n\n30,243 Nameservers\n\n81,700 IPs\n\n25 Technologies\n\n57,384 SSL Active\n\n### Fast reconnaissance\n\nFeed a single domain or identifier and receive correlated assets in real time. Perfect for security assessments, competitive research or due diligence.\n\n### Actionable context\n\nSee shared Analytics, AdSense, nameservers and historic IPs in one view to understand infrastructure reuse and uncover connected entities quickly.\n\n### Deployment friendly\n\nDesigned for shared hosting: pure PHP, MySQL and no external APIs required. Install through the web wizard and manage data with the built-in admin panel.\n",
  "markdownStats": {
    "images": 0,
    "links": 0,
    "tables": 0,
    "codeBlocks": 0,
    "headings": 4
  },
  "tokens": {
    "htmlTokens": 11017,
    "markdownTokens": 166,
    "reduction": 10851,
    "reductionPercent": 98
  },
  "score": {
    "score": 82,
    "grade": "B",
    "dimensions": {
      "semanticHtml": {
        "score": 96,
        "weight": 20,
        "grade": "A",
        "checks": {
          "uses_article_or_main": {
            "score": 100,
            "weight": 20,
            "details": "Has both <article> and <main>"
          },
          "proper_heading_hierarchy": {
            "score": 85,
            "weight": 25,
            "details": "1 heading level skip(s)"
          },
          "semantic_elements": {
            "score": 100,
            "weight": 20,
            "details": "13 semantic elements, 17 divs (ratio: 43%)"
          },
          "meaningful_alt_texts": {
            "score": 100,
            "weight": 15,
            "details": "No images found"
          },
          "low_div_nesting": {
            "score": 100,
            "weight": 20,
            "details": "Avg div depth: 0.1, max: 1"
          }
        }
      },
      "contentEfficiency": {
        "score": 70,
        "weight": 25,
        "grade": "C",
        "checks": {
          "token_reduction_ratio": {
            "score": 100,
            "weight": 40,
            "details": "98% token reduction (HTML→Markdown)"
          },
          "content_to_noise_ratio": {
            "score": 0,
            "weight": 30,
            "details": "Content ratio: 2.6% (1262 content chars / 47945 HTML bytes)"
          },
          "minimal_inline_styles": {
            "score": 100,
            "weight": 15,
            "details": "0/127 elements with inline styles (0.0%)"
          },
          "reasonable_page_weight": {
            "score": 100,
            "weight": 15,
            "details": "HTML size: 47KB"
          }
        }
      },
      "aiDiscoverability": {
        "score": 62,
        "weight": 25,
        "grade": "C",
        "checks": {
          "has_llms_txt": {
            "score": 100,
            "weight": 25,
            "details": "llms.txt exists and is valid"
          },
          "has_robots_txt": {
            "score": 100,
            "weight": 15,
            "details": "robots.txt exists"
          },
          "robots_allows_ai_bots": {
            "score": 34,
            "weight": 20,
            "details": "2/3 AI bots blocked: ClaudeBot, GPTBot"
          },
          "has_sitemap": {
            "score": 100,
            "weight": 15,
            "details": "Sitemap found"
          },
          "supports_markdown_negotiation": {
            "score": 0,
            "weight": 15,
            "details": "No markdown content negotiation"
          },
          "has_content_signals": {
            "score": 0,
            "weight": 10,
            "details": "No Content-Signal header"
          }
        }
      },
      "structuredData": {
        "score": 100,
        "weight": 15,
        "grade": "A",
        "checks": {
          "has_schema_org": {
            "score": 100,
            "weight": 30,
            "details": "JSON-LD found: WebSite, Organization"
          },
          "has_open_graph": {
            "score": 100,
            "weight": 25,
            "details": "All OG tags present"
          },
          "has_meta_description": {
            "score": 100,
            "weight": 20,
            "details": "Meta description: 134 chars"
          },
          "has_canonical_url": {
            "score": 100,
            "weight": 15,
            "details": "Canonical URL present"
          },
          "has_lang_attribute": {
            "score": 100,
            "weight": 10,
            "details": "lang=\"en\""
          }
        }
      },
      "accessibility": {
        "score": 100,
        "weight": 15,
        "grade": "A",
        "checks": {
          "content_without_js": {
            "score": 100,
            "weight": 40,
            "details": "Content available without JavaScript"
          },
          "reasonable_page_size": {
            "score": 100,
            "weight": 30,
            "details": "Page size: 47KB"
          },
          "fast_content_position": {
            "score": 100,
            "weight": 30,
            "details": "Main content starts at 9% of HTML"
          }
        }
      }
    }
  },
  "recommendations": [
    {
      "id": "improve_content_ratio",
      "priority": "critical",
      "category": "contentEfficiency",
      "titleKey": "rec.improve_content_ratio.title",
      "descriptionKey": "rec.improve_content_ratio.description",
      "howToKey": "rec.improve_content_ratio.howto",
      "effort": "moderate",
      "estimatedImpact": 6,
      "checkScore": 0,
      "checkDetails": "Content ratio: 2.6% (1262 content chars / 47945 HTML bytes)"
    },
    {
      "id": "add_markdown_negotiation",
      "priority": "critical",
      "category": "aiDiscoverability",
      "titleKey": "rec.add_markdown_negotiation.title",
      "descriptionKey": "rec.add_markdown_negotiation.description",
      "howToKey": "rec.add_markdown_negotiation.howto",
      "effort": "significant",
      "estimatedImpact": 4,
      "checkScore": 0,
      "checkDetails": "No markdown content negotiation"
    },
    {
      "id": "add_content_signals",
      "priority": "critical",
      "category": "aiDiscoverability",
      "titleKey": "rec.add_content_signals.title",
      "descriptionKey": "rec.add_content_signals.description",
      "howToKey": "rec.add_content_signals.howto",
      "effort": "moderate",
      "estimatedImpact": 3,
      "checkScore": 0,
      "checkDetails": "No Content-Signal header"
    },
    {
      "id": "allow_ai_bots",
      "priority": "high",
      "category": "aiDiscoverability",
      "titleKey": "rec.allow_ai_bots.title",
      "descriptionKey": "rec.allow_ai_bots.description",
      "howToKey": "rec.allow_ai_bots.howto",
      "effort": "quick-win",
      "estimatedImpact": 7,
      "checkScore": 34,
      "checkDetails": "2/3 AI bots blocked: ClaudeBot, GPTBot"
    }
  ],
  "llmsTxtPreview": "# SpyOnWeb\n\n> Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free reverse lookup tool.\n\n## Documentation\n- [FAQ](https://spyonweb.net/faq)\n\n## Main\n- [SpyOnWeb — Domain Intelligence & Reverse Lookup Tool](https://spyonweb.net/): Find domain relationships, shared Analytics & AdSense codes, IP addresses, nameservers and web technologies. Free rever…\n- [About Us](https://spyonweb.net/about)\n- [Top Lists](https://spyonweb.net/top)\n\n## Support\n- [FAQ](https://spyonweb.net/faq)\n\n",
  "llmsTxtExisting": "# SpyOnWeb — Domain Intelligence Platform\n\n> SpyOnWeb is a domain intelligence tool that reveals relationships between websites through shared Analytics codes, AdSense publishers, IP addresses, nameservers, SSL certificates and web technologies.\n\n## Main Pages\n\n- [Home](https://spyonweb.net/): Search any domain, IP, or identifier\n- [About](https://spyonweb.net/about): Platform overview and capabilities\n- [FAQ](https://spyonweb.net/faq): Common questions answered\n- [Top Rankings](https://spyonweb.net/top): Most prevalent technologies, SSL issuers, analytics codes\n\n## Lookup Types\n\n- Domain profile: `/domain/{name}` — Full domain report with IP, technologies, associations\n- IP lookup: `/ip/{address}` — All domains hosted on an IP address\n- Analytics: `/analytics/{code}` — Domains sharing a Google Analytics code\n- AdSense: `/adsense/{code}` — Domains from the same AdSense publisher\n- Nameserver: `/nameserver/{ns}` — Domains delegated to a DNS nameserver\n- Technology: `/technology/{name}` — Domains using a specific technology\n- SSL Issuer: `/ssl/{issuer}` — Domains with certificates from an issuer\n\n## API\n\nJSON API available at `/api/v1/` for programmatic access. API keys generated from user dashboard.",
  "snippets": [
    {
      "id": "allow_ai_bots",
      "title": "Allow AI bots in robots.txt",
      "description": "Some AI bots are blocked in your robots.txt. Remove or modify these Disallow rules to let AI agents index your content.",
      "language": "txt",
      "code": "# Add to your robots.txt — explicitly allow AI bots:\nUser-agent: GPTBot\nAllow: /\n\nUser-agent: ClaudeBot\nAllow: /\n\nUser-agent: PerplexityBot\nAllow: /",
      "filename": "/robots.txt"
    },
    {
      "id": "add_content_signals",
      "title": "Add Content-Signal HTTP header",
      "description": "The Content-Signal header tells AI agents about the nature of your content. Add it via your web server or CDN.",
      "language": "nginx",
      "code": "# Nginx — add to your server block:\nadd_header Content-Signal \"type=website; lang=en\" always;\n\n# Apache — add to .htaccess:\n# Header set Content-Signal \"type=website; lang=en\"",
      "filename": "nginx.conf or .htaccess"
    },
    {
      "id": "add_markdown_negotiation",
      "title": "Support Accept: text/markdown",
      "description": "When a client sends Accept: text/markdown, respond with a Markdown version of the page. This is the gold standard for AI-readiness.",
      "language": "nginx",
      "code": "# Nginx — serve .md files when client requests Markdown:\n# Option 1: Serve pre-generated .md files\nmap $http_accept $markdown_suffix {\n  default \"\";\n  \"~text/markdown\" \".md\";\n}\n\n# Then in your location block:\ntry_files $uri$markdown_suffix $uri =404;\n\n# Option 2: Use your app framework to check the Accept header\n# and return Markdown content with Content-Type: text/markdown",
      "filename": "nginx.conf or application code"
    }
  ]
}

APIを使用してプログラムで取得できます（近日公開）