Accurate ranking data is the foundation of every SEO decision. This article explains how Nightwatch collects rankings, why they can differ from manual checks, and how you can verify your data at any time.
Why Rankings Can Differ From Manual Checks
One of the most common questions in SEO is: “Why do my rankings look different when I check them manually?” Search results aren’t static. Google shows different results depending on several factors, many of which are outside a user’s control.
Location
Google personalises results heavily based on location, and your IP address largely determines which results you see, even if you change your Google settings. Nightwatch tracks each keyword from the exact location you set (country, city or ZIP code), so the rankings reflect that location, not your own browsing environment.
Language and device
Results differ between languages and between desktop and mobile. A keyword tracked on mobile in German in Berlin won’t show the same results as a desktop search in German at national level. Nightwatch matches the language, device and location set for each keyword.
Personalisation
Even in incognito mode, Google can personalise results based on your IP address, history and other signals. Nightwatch runs neutral, unpersonalised searches, so rankings are consistent and reproducible.
Google data centers
Google runs many data centers, and they can temporarily show slightly different results for the same search. When Nightwatch detects irregularities, it cross-checks results before confirming a ranking change.
Natural fluctuations
Algorithm updates, testing and index changes cause short-term ranking movement, often called the “Google Dance.” Nightwatch updates rankings daily, so you can follow trends over time rather than one-off changes.
How Nightwatch Ensures Accurate Results
Validation before every ranking is recorded
Google has recently introduced stronger restrictions on automated access to search results. In some cases, instead of blocking a request, Google returns a results page that looks complete but is missing results. To handle this, every ranking in Nightwatch goes through additional validation and a reference check before it’s recorded, and incomplete results are re-checked instead of being accepted. You can read more about these changes here: https://nightwatch.io/blog/poisoned-serps/
Dedicated processing for restricted searches
Some searches, especially location-based and highly competitive ones, are more heavily restricted by Google. These keywords get additional processing and re-checks, so they’re captured as accurately as possible.
Advanced location simulation
Nightwatch uses its own methods to simulate searches at a precise geographic level, including cities and ZIP codes, which is especially important for local SEO.
Controlled search environment
All searches are made in a neutral environment, without user history, logged-in accounts, or device personalization, so every request is standardized.
Dropout protection
Sudden drops can be caused by temporary instability on Google’s side. Nightwatch includes safeguards that prevent false ranking losses from being reported when they’re likely caused by temporary issues rather than real ranking changes.
Continuous monitoring
Our data collection and infrastructure are monitored around the clock, so issues are detected and handled quickly.
What Nightwatch Tracks
Ranking depth
Nightwatch tracks rankings up to position 50. Keywords ranking beyond position 50 are shown as not ranking.
Organic rank and main rank
Organic rank counts organic results only. Main rank can also include SERP features, such as the local pack, depending on your “include in main rank” settings. Image results aren’t counted as an organic ranking.
National and city-level tracking
“Global” in the SERP Preview means the keyword is tracked at national level, across the whole country. If your customers search from specific cities, you can also track keywords with a precise location, or add the same keyword with several locations to compare.
Mobile and desktop
Mobile and desktop rankings can differ significantly, so make sure you compare with the device the keyword is tracked on.
Latest data in the keyword table
The keyword table always shows the latest rankings, whatever date range you select. Reports use the selected date range, so the two can differ if newer checks have already been processed.
How to Verify Your Data
You can check your ranking data directly in Nightwatch:
SERP Preview shows the full results page captured for each keyword, so you can see exactly what was recorded.
Last update in the keyword list shows when each keyword was last checked.
Report a keyword: if a ranking looks off, click the three dots on the keyword’s row to report it. It goes straight to our technical team for testing.
How to Check Rankings Manually
Manual checks are always affected by your own location and settings, so some difference is normal. For the closest comparison:
Search signed out, in a private browser window.
Use the gl (country) and hl (language) URL parameters, for example gl=uk&hl=en for the United Kingdom.
For city-level keywords, use a uule parameter or a VPN located in the tracked city.
Use the same device type as the tracked keyword (desktop or mobile).
Count organic positions only, without images or other SERP features.
Avoid Google’s ad preview tool, which is built for testing ads and can show results that differ from a regular search.
Our free Search Simulator Chrome extension runs unbiased searches for any country directly from your browser:
https://chrome.google.com/webstore/detail/search-simulator-by-night/edfjfgjklednkencfhnokmkajbgfhpon
Still Seeing Differences?
Small differences between manual checks and tracked rankings are normal. If you notice consistent or significant differences, report the keyword in the app via the three dots on its row, or contact our team at [email protected]. To help us investigate quickly, please include:
The keyword (and keyword ID, if possible)
The tracked location and device
How you checked the ranking (location, device, signed in or out)
A screenshot of the results page, including Google’s location shown at the bottom
We take accuracy seriously and will look into every case.