# Lidl \[Just 💰$2] — European Grocery Prices (`blackfalcondata/lidl-scraper`) Actor

💰 $2 per 1,000 listings. Scrape Lidl grocery products across 28 European markets — each row tagged by country · current price · strikethrough normal price · per-unit comparison pricing. Incremental mode tracks new and changed products across scheduled runs.

- **URL**: https://apify.com/blackfalcondata/lidl-scraper.md
- **Developed by:** [Black Falcon Data](https://apify.com/blackfalcondata) (community)
- **Categories:** E-commerce, Lead generation, Automation
- **Stats:** 17 total users, 8 monthly users, 100.0% runs succeeded, 1 bookmarks
- **User rating**: No ratings yet

## Pricing

from $2.00 / 1,000 results

This Actor is paid per event and usage. You are charged both the fixed price for specific events and for Apify platform usage.

Learn more: https://docs.apify.com/platform/actors/running/actors-in-store#pay-per-event

## What's an Apify Actor?

Actors are web data automations that power AI and operations. They run on the Apify platform to scrape websites, process data, connect APIs, and automate workflows.
In Batch mode, an Actor accepts a well-defined JSON input, performs an action which can take anything from a few seconds to a few hours,
and optionally produces a well-defined JSON output, datasets with results, or files in key-value store.
In Standby mode, an Actor provides a web server which can be used as a website, API, or an MCP server.
Actors are written with capital "A".

## How to integrate an Actor?

If asked about integration, you help developers integrate Actors into their projects.
You adapt to their stack and deliver integrations that are safe, well-documented, and production-ready.
The best way to integrate Actors is as follows.

- **AI agents and MCP clients** — the [Apify MCP server](https://docs.apify.com/integrations/mcp.md) at `https://mcp.apify.com` (remote, streamable HTTP, OAuth on first use).
- **Agentic workflows and local Actor development** — [Agent Skills](https://apify.com/.well-known/agent-skills/index.json) with the [Apify CLI](https://docs.apify.com/cli/docs.md): `npm install -g apify-cli`, then `apify login`.
- **JavaScript/TypeScript projects** — the official [JS/TS client](https://docs.apify.com/api/client/js/docs.md): `npm install apify-client`.
- **Python projects** — the official [Python client](https://docs.apify.com/api/client/python/docs.md): `pip install apify-client`.
- **Any other language** — the [REST API](https://docs.apify.com/api/v2.md).

For usage examples, see the [API](#api) section below.

For more details, see Apify documentation as [Markdown index](https://docs.apify.com/llms.txt) and [Markdown full-text](https://docs.apify.com/llms-full.txt).

# README

### What does Lidl do?

Lidl Scraper extracts structured Lidl grocery products and prices across Europe — Germany, France, the UK, Poland, Italy and 23 more markets (lidl.de, lidl.fr, lidl.it …). Every product row is tagged by country with the current price, the strikethrough normal price, per-unit pricing, brand, category, images and the product page. Pick one country or several in a single run.

**New to Apify?** [Sign up free](https://console.apify.com/sign-up?fpr=1h3gvi\&fp_sid=ctaplain) and use the included $5 monthly platform credit to test this actor.

### Key features

- **🌍 Germany, France, the UK, Poland, Italy + 23 more** — scrape one or several of 28 Lidl markets via `countries`; every row is tagged with its `country` for cross-border comparison.
- **🔍 Keyword search or full catalog** — search by `query`, or leave it empty to dump the entire national assortment per country.
- **💰 Current + normal price** — the live `price`, the strikethrough `priceNormal`, an `isOnOffer` flag and the on-label `discountText`.
- **⚖️ Per-unit comparison pricing** — `comparePrice` + `compareUnit` (per kg / l / stk), the shelf-label per-unit rate.
- **🏷️ Structured brand, category + product page** — `brand`, `category`, `imageUrl`, the canonical `portalUrl` and an `erpNumber` identity.
- **♻️ Incremental price tracking** — `incrementalMode` + `stateKey` returns only NEW / UPDATED / EXPIRED, tracked separately per country.
- **🔔 Notifications** — push each run to Telegram, Discord, Slack, WhatsApp or a generic webhook (n8n / Make / Zapier).
- **📦 Compact mode** — drop heavy fields and keep the essentials, for AI agents and MCP workflows.

### What data can you extract from lidl.de?

Each result includes Core grocery fields (`country`, `ean`, `erpNumber`, `productId`, `name`, `brand`, `categoryLvl0`, and `labels`, and more). In standard mode, all fields are always present — unavailable data points are returned as `null`, never omitted. In compact mode, only core fields are returned.

Enable detail enrichment in the input to get richer fields such as full descriptions where the source provides them.

### Input

The main inputs are a search keyword and a result limit. Additional filters and options are available in the input schema.

Key parameters:

- **`countries`** — Lidl country codes to scrape (e.g. \["DE", "FR", "IT"]). One or several. Covers Lidl's largest markets — Germany, France, the UK, Poland, Italy — and 23 more (28 in total). Defaults to Germany. Each product row is tagged with its country. (default: `["DE"]`)
- **`query`** — Keyword search across the Lidl catalog (e.g. "arla", "kaffe"). Searches product names and brands. Leave empty to scan the entire national assortment.
- **`maxResults`** — Maximum total products per country (0 = unlimited; a national catalog is typically several hundred to a few thousand). (default: `200`)
- **`incrementalMode`** — Compare against the previous run's state and emit only NEW / UPDATED / EXPIRED products (price changes, new SKUs, delistings). Requires 🔑 State Key. EXPIRED detection only fires for a full uncapped catalog scan (a keyword search can't tell delisted from out-of-scope). State is tracked per country. (default: `false`)
- **`compact`** — Keep only shopping essentials (identity, price, normal price, per-unit price, offer flags, image, product page) and drop heavier fields. Same row count, same billing. (default: `false`)
- **`inStockOnly`** — Drop products flagged as out of stock. (default: `false`)
- ...and 21 more parameters

### Input examples

**Search a brand in Germany** — Targeted run scoped to a keyword `query` in one market.

→ Matching products with current price, normal price and per-unit pricing.

```json
{
  "countries": [
    "DE"
  ],
  "query": "milch",
  "maxResults": 50
}
```

**Full national catalog (France)** — Leave `query` empty to dump the entire French assortment.

→ Every product with current + strikethrough normal price and product page.

```json
{
  "countries": [
    "FR"
  ],
  "maxResults": 0
}
```

**Incremental price monitor (Germany)** — Only emit products that changed since the previous run with this `stateKey`.

→ NEW / UPDATED / EXPIRED rows only; state tracked per country.

```json
{
  "countries": [
    "DE"
  ],
  "maxResults": 0,
  "incrementalMode": true,
  "stateKey": "lidl-tracker",
  "emitExpired": true
}
```

### Output

Each run produces a dataset of structured grocery records. Results can be downloaded as JSON, CSV, or Excel from the Dataset tab in Apify Console.

### Example grocery record

```json
{
  "country": "DE",
  "ean": "493775",
  "erpNumber": "100400529",
  "productId": "100400529",
  "name": "ESMARA® Herren Pantolette",
  "brand": "ESMARA®",
  "categoryLvl0": "Kategorien/Mode/Herrenmode/Schuhe/Sandalen",
  "labels": [
    "Basic",
    "Price"
  ],
  "price": 7.99,
  "priceNormal": 7.99,
  "isOnOffer": false,
  "imageUrl": "https://www.lidl.de/assets/gcpcd047f879b6b4d6698b2b26db7437732.jpg",
  "images": [
    "https://www.lidl.de/assets/gcpcd047f879b6b4d6698b2b26db7437732.jpg",
    "https://www.lidl.de/assets/gcpee2edf24b8ba488fa2c59cf918b068ed.jpg",
    "https://www.lidl.de/assets/gcpf229373a80f94fdc94d74c74f07c68d8.jpg"
  ],
  "portalUrl": "https://www.lidl.de/p/esmara-herren-pantolette/p100400529",
  "currency": "EUR",
  "source": "lidl",
  "scrapedAt": "2026-06-10T19:10:02.849Z"
}
```

### Incremental fields

When incremental mode is on, each record also carries:

- `changeType` — one of `NEW`, `UPDATED`, `UNCHANGED`, `REAPPEARED`, `EXPIRED`. Default output covers `NEW` / `UPDATED` / `REAPPEARED`; set `emitUnchanged: true` or `emitExpired: true` to opt into the others.
- `firstSeenAt`, `lastSeenAt` — ISO-8601 timestamps tracking the listing across runs.

### How to scrape lidl.de

1. Go to [Lidl](https://apify.com/blackfalcondata/lidl-scraper?fpr=1h3gvi) in Apify Console.
2. Enter a search keyword.
3. Set `maxResults` to control how many results you need.
4. Enable `includeDetails` if you need full descriptions.
5. Click **Start** and wait for the run to finish.
6. Export the dataset as JSON, CSV, or Excel.

### Use cases

- Extract grocery data from lidl.de for market research and competitive analysis.
- Track pricing trends across regions and categories over time.
- Monitor new and changed products on scheduled runs without processing the full dataset every time.
- Feed structured data into AI agents, MCP tools, and automated pipelines using compact mode.
- Export clean, structured data to dashboards, spreadsheets, or data warehouses.

### How much does it cost to scrape lidl.de?

Lidl uses [pay-per-event](https://docs.apify.com/platform/actors/paid-actors/pay-per-event) pricing. You pay a small fee when the run starts and then for each result that is actually produced.

- **Run start:** $0.01 per run
- **Per result:** $0.002 per grocery record

Example costs:

- 10 results: **$0.03**
- 25 results: **$0.06**
- 100 results: **$0.21**
- 200 results: **$0.41**
- 500 results: **$1.01**

#### Example: recurring monitoring savings

These examples compare full re-scrapes with incremental runs at different churn rates. Churn is the share of products that are new or whose tracked content changed since the previous run. Actual churn depends on your query breadth, source activity, and polling frequency — the scenarios below are examples, not predictions.

Example setup: 250 results per run, daily polling (30 runs/month). Event-pricing examples scale linearly with result count.

| Churn rate | Full re-scrape run cost | Incremental run cost | Savings vs full re-scrape | Monthly cost after baseline |
|---|---:|---:|---:|---:|
| 5% — stable niche query | $0.51 | $0.04 | $0.47 (93%) | $1.05 |
| 15% — moderate broad query | $0.51 | $0.08 | $0.43 (83%) | $2.55 |
| 30% — high-volume aggregator | $0.51 | $0.16 | $0.35 (69%) | $4.80 |

Full re-scrape monthly cost at daily polling: $15.30. First month with incremental costs $1.53 / $2.97 / $5.15 for the 5% / 15% / 30% scenarios because the first run builds baseline state at full cost before incremental savings apply.

Platform usage (compute and proxies) is billed separately by Apify based on actual consumption. Incremental runs consume less on result processing, though fixed per-run overhead stays the same.

### FAQ

#### How many results can I get from lidl.de?

The number of results depends on the search query and available products on lidl.de. Use the `maxResults` parameter to control how many results are returned per run.

#### Does Lidl support recurring monitoring?

Yes. Enable incremental mode to only receive new or changed products on subsequent runs. This is ideal for scheduled monitoring where you want to track changes over time without re-processing the full dataset.

#### Can I integrate Lidl with other apps?

Yes. Lidl works with Apify's [integrations](https://apify.com/integrations?fpr=1h3gvi) to connect with tools like Zapier, Make, Google Sheets, Slack, and more. You can also use webhooks to trigger actions when a run completes.

#### Can I use Lidl with the Apify API?

Yes. You can start runs, manage inputs, and retrieve results programmatically through the [Apify API](https://docs.apify.com/api/v2). Client libraries are available for JavaScript, Python, and other languages.

#### Can I use Lidl through an MCP Server?

Yes. Apify provides an [MCP Server](https://apify.com/apify/actors-mcp-server?fpr=1h3gvi) that lets AI assistants and agents call this actor directly. Use compact mode, a single `descriptionFormat`, and `excludeEmptyFields` to keep payloads manageable for LLM context windows.

#### Is it legal to scrape lidl.de?

This actor extracts publicly available data from lidl.de. Web scraping of public information is generally considered legal, but you should always review the target site's terms of service and ensure your use case complies with applicable laws and regulations, including GDPR where relevant.

#### Your feedback

If you have questions, need a feature, or found a bug, please [open an issue](https://apify.com/blackfalcondata/lidl-scraper/issues?fpr=1h3gvi) on the actor's page in Apify Console. Your feedback helps us improve.

### You might also like

- [Bilka \[Just 💰$2\] — Danish Grocery Prices](https://apify.com/blackfalcondata/bilka-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape bilka.dk — Salling Group's Danish hypermarket chain — full product.
- [Carrefour \[Just 💰$2\] — France Grocery Prices](https://apify.com/blackfalcondata/carrefour-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape carrefour.fr — Carrefour France groceries with current prices ·.
- [Carrefour MAF \[Just 💰$2\] — Groceries (7 Markets)](https://apify.com/blackfalcondata/carrefour-maf-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 items. Scrape Carrefour MAF groceries across 7 Majid Al Futtaim markets — UAE ·.
- [Coop365 \[Just 💰$2\] — Danish discount grocery](https://apify.com/blackfalcondata/coop365-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape 365discount.coop.dk — leaflet names & prices · unit quantities &.
- [Føtex \[Just 💰$2\] — Danish Grocery Prices](https://apify.com/blackfalcondata/foetex-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape foetex.dk — Salling Group's Danish supermarket chain — full.
- [Kvickly \[Just 💰$2\] — Danish grocery deals](https://apify.com/blackfalcondata/kvickly-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape kvickly.dk — leaflet names & prices · unit quantities & per-unit.
- [Nemlig \[Just 💰$2\] — Danish grocery prices](https://apify.com/blackfalcondata/nemlig-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape nemlig.com — shelf prices & current offers · per-unit comparison.
- [Netto \[Just 💰$2\] — Danish Grocery Prices](https://apify.com/blackfalcondata/netto-scraper?fpr=1h3gvi) — 💰 $2 per 1,000 products. Scrape netto.dk — Salling Group's Danish discount-grocery chain — full.

### Getting started with Apify

New to Apify? [Create a free account with $5 credit](https://console.apify.com/sign-up?fpr=1h3gvi\&fp_sid=ctaplain) — no credit card required.

1. Sign up — $5 platform credit included
2. Open this actor and configure your input
3. Click **Start** — export results as JSON, CSV, or Excel

Need more later? [See Apify pricing](https://apify.com/pricing?fpr=1h3gvi).

### Disclaimer

This actor accesses only publicly available data on lidl.de. You are responsible for how you use the extracted data — in particular any personal information such as names, phone numbers, or email addresses — and for complying with Lidl's terms of use, applicable data-protection law (including the GDPR where it applies), and the anti-spam rules of your jurisdiction.

This actor is not affiliated with, endorsed by, or connected to Lidl.

### Search keywords

lidl scraper, lidl api, apify lidl, lidl data extraction, lidl.de scraper, lidl.de data, lidl.de api, lidl prices, grocery prices europe, lidl products, supermarket scraper, lidl deals, european grocery data.

# Actor input Schema

## `countries` (type: `array`):

Lidl country codes to scrape (e.g. \["DE", "FR", "IT"]). One or several. Covers Lidl's largest markets — Germany, France, the UK, Poland, Italy — and 23 more (28 in total). Defaults to Germany. Each product row is tagged with its country.

## `query` (type: `string`):

Keyword search across the Lidl catalog (e.g. "arla", "kaffe"). Searches product names and brands. Leave empty to scan the entire national assortment.

## `categories` (type: `array`):

Limit to specific categories (e.g. \["Food"]). Leave empty for all. Accepts a comma-separated string or a JSON array.

## `maxResults` (type: `integer`):

Maximum total products per country (0 = unlimited; a national catalog is typically several hundred to a few thousand).

## `inStockOnly` (type: `boolean`):

Drop products flagged as out of stock.

## `compact` (type: `boolean`):

Keep only shopping essentials (identity, price, normal price, per-unit price, offer flags, image, product page) and drop heavier fields. Same row count, same billing.

## `excludeEmptyFields` (type: `boolean`):

Drop null, empty-string and empty-array fields from each record before push.

## `incrementalMode` (type: `boolean`):

Compare against the previous run's state and emit only NEW / UPDATED / EXPIRED products (price changes, new SKUs, delistings). Requires 🔑 State Key. EXPIRED detection only fires for a full uncapped catalog scan (a keyword search can't tell delisted from out-of-scope). State is tracked per country.

## `stateKey` (type: `string`):

Stable identifier for incremental tracking (e.g. "dk-weekly"). Required when Incremental Mode is on. Each country is namespaced under this key automatically.

## `emitUnchanged` (type: `boolean`):

Include products with no detected change in the output (default: skip — only changes are emitted).

## `emitExpired` (type: `boolean`):

Include products that disappeared since the prior run (delisted). Only meaningful for a full-catalog run.

## `telegramToken` (type: `string`):

Telegram bot token (from @BotFather). Required for Telegram notifications.

## `telegramChatId` (type: `string`):

Telegram chat or channel ID (e.g. "-100123456789"). Required when telegramToken is set.

## `discordWebhookUrl` (type: `string`):

Discord incoming webhook URL.

## `slackWebhookUrl` (type: `string`):

Slack incoming webhook URL.

## `whatsappAccessToken` (type: `string`):

WhatsApp Cloud API token. Recipient must have messaged the business number within the last 24h.

## `whatsappPhoneNumberId` (type: `string`):

Your WhatsApp Business phone-number ID.

## `whatsappTo` (type: `string`):

Recipient phone in E.164 format without + (e.g. "4512345678").

## `webhookUrl` (type: `string`):

Receives a JSON POST with {metadata, items} after each run — for n8n / Make / Zapier / custom backends.

## `webhookHeaders` (type: `object`):

Optional JSON object of custom headers (e.g. {"Authorization":"Bearer ..."}).

## `notificationLimit` (type: `integer`):

Maximum number of products included in each notification message (1–20).

## `notifyOnlyChanges` (type: `boolean`):

When Incremental Mode is on, only send notifications for products with a lifecycle event (NEW / UPDATED).

## `appConnector` (type: `string`):

Optional. Pick a connected app under Settings → API & Integrations to receive your results. Notion is supported today (a run-summary page); other MCP connectors are best-effort as Apify expands its catalog.

## `mcpIssueTeam` (type: `string`):

Only when the connected app is an issue tracker: the team (name or ID) the summary issue is created under, if that app requires one.

## `descriptionFormat` (type: `string`):

Choose which representation of the listing description to include. `all` keeps every variant; the others keep only the selected one.

## `startUrls` (type: `array`):

One or more direct search or listing detail URLs to process. When set, other search filters are ignored.

## `includeDetails` (type: `boolean`):

Fetch the detail page for each listing to retrieve the full description text and contact information. Increases run time and cost. Leave off for a fast, low-cost run.

## Actor input object example

```json
{
  "countries": [
    "DE"
  ],
  "categories": [],
  "maxResults": 50,
  "inStockOnly": false,
  "compact": false,
  "excludeEmptyFields": false,
  "incrementalMode": false,
  "emitUnchanged": false,
  "emitExpired": false,
  "notificationLimit": 5,
  "notifyOnlyChanges": false,
  "descriptionFormat": "all",
  "includeDetails": false
}
```

# Actor output Schema

## `results` (type: `string`):

No description

# API

You can run this Actor programmatically using our API. Below are code examples in JavaScript, Python, and CLI, as well as the OpenAPI specification and MCP server setup.

## JavaScript example

```javascript
import { ApifyClient } from 'apify-client';

// Initialize the ApifyClient with your Apify API token
// Replace the '<YOUR_API_TOKEN>' with your token
const client = new ApifyClient({
    token: '<YOUR_API_TOKEN>',
});

// Prepare Actor input
const input = {
    "countries": [
        "DE"
    ],
    "maxResults": 50,
    "compact": false,
    "excludeEmptyFields": false,
    "descriptionFormat": "all",
    "includeDetails": false
};

// Run the Actor and wait for it to finish
const run = await client.actor("blackfalcondata/lidl-scraper").call(input);

// Fetch and print Actor results from the run's dataset (if any)
console.log('Results from dataset');
console.log(`💾 Check your data here: https://console.apify.com/storage/datasets/${run.defaultDatasetId}`);
const { items } = await client.dataset(run.defaultDatasetId).listItems();
items.forEach((item) => {
    console.dir(item);
});

// 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/js/docs

```

## Python example

```python
from apify_client import ApifyClient

# Initialize the ApifyClient with your Apify API token
# Replace '<YOUR_API_TOKEN>' with your token.
client = ApifyClient("<YOUR_API_TOKEN>")

# Prepare the Actor input
run_input = {
    "countries": ["DE"],
    "maxResults": 50,
    "compact": False,
    "excludeEmptyFields": False,
    "descriptionFormat": "all",
    "includeDetails": False,
}

# Run the Actor and wait for it to finish
run = client.actor("blackfalcondata/lidl-scraper").call(run_input=run_input)

# Fetch and print Actor results from the run's dataset (if there are any)
print("💾 Check your data here: https://console.apify.com/storage/datasets/" + run["defaultDatasetId"])
for item in client.dataset(run["defaultDatasetId"]).iterate_items():
    print(item)

# 📚 Want to learn more 📖? Go to → https://docs.apify.com/api/client/python/docs/quick-start

```

## CLI example

```bash
echo '{
  "countries": [
    "DE"
  ],
  "maxResults": 50,
  "compact": false,
  "excludeEmptyFields": false,
  "descriptionFormat": "all",
  "includeDetails": false
}' |
apify call blackfalcondata/lidl-scraper --silent --output-dataset

```

## MCP server setup

```json
{
    "mcpServers": {
        "apify": {
            "command": "npx",
            "args": [
                "mcp-remote",
                "https://mcp.apify.com/?tools=blackfalcondata/lidl-scraper",
                "--header",
                "Authorization: Bearer <YOUR_API_TOKEN>"
            ]
        }
    }
}

```

## OpenAPI specification

Download the OpenAPI definition: https://api.apify.com/v2/acts/6cPO5hsIuYaCq7UoD/builds/HmKdLZpHzvic6yzXg/openapi.json