Portrait of Lika Kandel

Lika Kandel

Websites & AI

Book a call

Project

Know what competitors charge and what they rank for

You get an Excel workbook with every competitor in your region: services, prices, team, advertising and the Google search terms that bring them customers.

The starting point

Many owners know a handful of competitors by name. The rest of the market is a guess. If you want a closer look, you click through websites in the evening and keep a spreadsheet that is never finished. In the end the price is set by gut feeling, and the new website targets search terms where someone else has long been at the top.

Why I built this

I was given the task of finding out the market prices for websites and AI automation. The price column in my pricing sheet was empty, and I did not want to make a number up. By hand, that would have meant opening every provider's website, hunting for prices subpage by subpage, and still not knowing who actually gets found on Google. So I built a system that reads the competition for me: every price, every package, every search term, linked to its source.

The solution

You see in black and white who offers what in your region, what it costs, who runs ads and which search terms bring your competitors their customers. The system queries Google through DataForSEO and reads the most important pages of every website it finds. The key decision: fixed rules first check everything that is clear-cut in the source code. Only the rest goes to a small AI that notes for every field whether it is stated word for word on the page. So the AI reads only what no rule can settle, and even a large market stays manageable.

How it works

Drag or use the arrow keys to move the steps

From a Google search to a market overview in Excel. First the Google results, then every website. Fixed rules check what is clear-cut first, the AI handles only the rest. In wider markets, every competitor's search terms are added.
  1. Step 1: Find the competitors leads to Read the website
  2. Step 2: Read the website leads to Quick check without AI
  3. Step 3: Quick check without AI leads to AI profile with sources
  4. Step 4: AI profile with sources leads to Your market overview
  5. Step 5: Find the competitors leads to Measure rankings (wider market)
  6. Step 6: Measure rankings leads to Read the website
  7. Step 7: AI profile with sources leads to Quick check only (AI answer invalid)
  8. Step 8: Quick check only leads to Your market overview
Steps as text

  1. Step 1: Find the competitors

    For every service and every location, the system pulls the real Google results through the DataForSEO SERP API: the top results, the map pack with stars and review count per business and the pages that Google's AI Overview cites. Directories, job boards, portals and social networks are dropped. What remains are real providers.

  2. Step 2: Measure rankings

    For each domain, DataForSEO Labs (Ranked Keywords) returns every term it ranks for on Google: position, searches per month, cost per click in Google Ads and the page that ranks. Demand comes from the Google Ads Search Volume API, many terms in one request. You see which terms are taken and which are still open.

  3. Step 3: Read the website

    Crawl4AI opens the home page and the subpages from the menu and sitemap, most valuable first: prices and packages, services, references and clients, team and about us, contact and legal notice. If a website returns no readable content, that is recorded instead of guessed.

  4. Step 4: Quick check without AI

    Fixed rules read the source code: CMS, analytics tools, ad pixels from Google Ads, Meta, LinkedIn and TikTok including the account ID, chat, newsletter, review widgets, videos, legal notice, privacy policy, jobs page, blog, profiles on Instagram, LinkedIn, YouTube and TikTok, email, phone and booking links. No AI is needed for this, and it leaves no room for guessing.

  5. Step 5: AI profile with sources

    GPT-4.1 nano fills a fixed schema: about us, founding year, legal form, target industries, team with roles, service area, a fixed list of services as yes or no, packages with prices, pricing model, minimum project size, monthly retainers, booking route and free first consultation. Every field notes whether it is stated word for word on the page. Anything missing stays empty.

  6. Step 6: Your market overview

    You get one record per company and an Excel workbook: overview, services matrix, prices and packages, team, tech and advertising, buying process, location and contact. On top come the search terms with volume and cost per click and, if you like, your own price against the market range, every figure linked to its source.

Tools

  • OpenAI
  • Python

A similar workflow for your business?

In a short call, we'll work out which of your steps can be automated.

Book a call