Free tool
Server Log Analyzer
Paste access log lines to see status codes, top paths, top user agents and search and AI bot share.
How it works
What is the Server Log Analyzer?
The Server Log Analyzer is a free tool that reads Apache or nginx access log lines in combined format, pasted into your browser. It reports requests by status class, the most requested paths, the most common user agents, and the share of traffic from Googlebot, Bingbot and known AI crawlers. Bots are identified by user-agent string only.
How to use the Server Log Analyzer
- Copy lines from your access log, for example the last few thousand.
- Paste them into the box.
- Read the status classes, then the table of who is requesting.
- Check the top paths and top user agents for anything unexpected.
What is a server access log?
An access log is the web server's own record of every request it answered: one line each, with the client IP, the time, the request line, the status code, the response size, the referrer and the user agent. Unlike analytics scripts, it records crawlers, because bots do not run JavaScript.
That makes it the only first-hand evidence of how search engines and AI crawlers actually use your site: what they fetch, how often, and what your server answers.
Which log format does the analyzer read?
The combined log format, the default for nginx and the usual choice on Apache. A line looks like an IP address, two dashes or names, a timestamp in square brackets, the quoted request such as GET /page HTTP/1.1, the status, the byte count, then the quoted referrer and user agent.
Lines in the shorter common format, without referrer and user agent, are parsed too, but cannot be attributed to a bot. Lines that match neither are skipped and counted. Custom formats, JSON logs and CDN logs are not supported.
What do the status classes tell me?
2xx responses succeeded. 3xx are redirects; a high share for a crawler means it keeps requesting old URLs, often from outdated internal links or sitemaps. 4xx are client errors, mostly 404s. 5xx are server errors, and they matter most: Google slows its crawling when a site returns many of them.
If 404s stand out, take the URLs to the 404 Pattern Analyzer to find the causes.
How does the tool identify bots?
By looking for known tokens in the user-agent string: Googlebot, bingbot, and AI crawler tokens such as GPTBot, ClaudeBot and PerplexityBot. Anything else whose user agent contains bot, crawl, spider or slurp is counted as other bots, and the rest as everything else.
A user-agent string can be spoofed, and scrapers often pretend to be Googlebot. This tool does not verify IP addresses. To confirm a real Googlebot hit, run a reverse DNS lookup on the IP or compare it with the IP ranges Google publishes.
How much log data should I paste?
Enough to be representative. An hour of a busy site or a day of a quiet one shows the pattern. The parsing happens in your browser, so tens of thousands of lines are fine on a normal laptop, and very large files are better trimmed first with tail or grep.
Shares are of the lines you pasted, not of all your traffic. For a view of only AI crawlers, including whether they request /robots.txt and /llms.txt, use the AI Crawler Log Analyzer. To see how your robots.txt treats them, use the Robots.txt Checker.
Questions
- Is my log data uploaded anywhere?
- No. The lines are parsed in your browser and never leave your device. Logs contain IP addresses, so that matters.
- Why are some lines skipped?
- They do not match the common or combined format. Error log lines, custom formats and wrapped lines are the usual cause.
- Are query strings counted as separate paths?
- No. The query string is removed, so
/page?a=1and/page?a=2count as/page. - Can it tell real Googlebot from a fake one?
- No. It reads the user-agent string only. Verifying a crawler needs a DNS or IP range check, which a browser tool cannot do.
- Is the Server Log Analyzer free?
- Yes, with a free spyc.ai account. It runs in your browser, so nothing you type or paste is sent to a server.
Technical SEO Tools
More in Technical SEO Tools
Opengraph Viewer
Paste a URL and see the card it produces when someone shares it — title, description, image.
View OpengraphOpen Graph Generator
Write the Open Graph tags, preview the card, copy the markup.
Generate Open Graph tagsRobots.txt Checker
Fetch any site's robots.txt and test one URL against it: allowed, or blocked by which rule.
View robots.txtReady when you are
Before your next buyer asks AI about you, ask AI about yourself
One check, four engines, about twenty seconds. We show you the answers before we ask for anything.