Project

Know what competitors charge and what they rank for

A market overview from public information: services, prices and search terms of the providers in a region, every figure with its source. You set your price on data, not gut feeling.

The problem

People price themselves against the competitors they know. Many owners know a handful by name and guess at the rest of the market. If you want a closer look, you click through websites in the evening and keep a spreadsheet that is never finished. In the end the price comes from gut feeling, and the new website targets search terms where someone else has long been at the top.

Why I built this

I had to find out the market prices for websites and AI automation. The price column in my pricing sheet was empty, and I did not want to make a number up. By hand, that means opening every provider's website, hunting for prices subpage by subpage, and still not knowing who gets found on Google. So I built a system that collects public market data: every price, every package, every search term, linked to its source.

What runs on its own now

You see in black and white who offers what in your region, what it costs, who runs ads and which search terms bring your competitors customers. The system evaluates publicly available information. Fixed rules first check everything that is clear-cut in the source code. Only the rest goes to an AI that notes for every field whether it is stated word for word on the page. So even a large market stays manageable.

How it works

Drag or use the arrow keys to move the steps

From a Google search to a market overview in Excel. First the Google results, then every website. Fixed rules check what is clear-cut first, the AI handles only the rest. In wider markets, every competitor's search terms are added.
  1. Step 1: Find the competitors leads to Read the website
  2. Step 2: Read the website leads to Quick check without AI
  3. Step 3: Quick check without AI leads to AI profile with sources
  4. Step 4: AI profile with sources leads to Your market overview
  5. Step 5: Find the competitors leads to Measure rankings (wider market)
  6. Step 6: Measure rankings leads to Read the website
  7. Step 7: AI profile with sources leads to Quick check only (AI answer invalid)
  8. Step 8: Quick check only leads to Your market overview
Steps as text
  1. Step 1: Find the competitors

    For every service and every location, the system pulls the real Google results through the DataForSEO SERP API: the top results, the map pack with stars and review count per business and the pages that Google's AI Overview cites. Directories, job boards, portals and social networks are dropped. What remains are real providers.

  2. Step 2: Measure rankings

    For each domain, DataForSEO Labs (Ranked Keywords) returns every term it ranks for on Google: position, searches per month, cost per click in Google Ads and the page that ranks. Demand comes from the Google Ads Search Volume API, many terms in one request. You see which terms are taken and which are still open.

  3. Step 3: Read the website

    A tool reads the publicly available pages, most valuable first: prices and packages, services, references and clients, team and about us, contact and legal notice. If a website returns no readable content, that is recorded instead of guessed.

  4. Step 4: Quick check without AI

    Fixed rules read the source code: CMS, analytics tools, ad pixels from Google Ads, Meta, LinkedIn and TikTok including the account ID, chat, newsletter, review widgets, videos, legal notice, privacy policy, jobs page, blog, profiles on Instagram, LinkedIn, YouTube and TikTok, email, phone and booking links. No AI, no guessing.

  5. Step 5: AI profile with sources

    GPT-4.1 nano fills a fixed schema: about us, founding year, legal form, target industries, team with roles, service area, a fixed list of services as yes or no, packages with prices, pricing model, minimum project size, monthly retainers, booking route and free first consultation. Every field notes whether it is stated word for word on the page. Anything missing stays empty.

  6. Step 6: Your market overview

    You get one record per company and an Excel workbook: overview, services matrix, prices and packages, team, tech and advertising, buying process, location and contact. On top come the search terms with volume and cost per click and, if you like, your own price against the market range, every figure linked to its source.

Tools

  • OpenAI
  • Python

A system like this for your business?

In the intro call we'll work out where you lose enquiries and what can be built against it.