Guide · Pro
A list of URLs in, one spreadsheet out.
You have the addresses — twenty supplier pages, every branch of a directory, a category per country — and the same kind of list on each. Set it up once on the first page, paste the rest, and Magic Scraper runs that setup on every one and hands back a single table, with a column naming the page each row came from.
From a list of addresses to one sheet
Set it up on the first page
Open the first address and click the extension. The list is found and named; leave out the columns you don’t want, rename the rest. That setup is what every other page gets.
Paste the rest
On the Crawl tab, open List of pages, tick Run this on a list of pages and paste the addresses — one per line, straight from a spreadsheet column. + This page adds the one you are on.
Start, then merge
Press Start crawling. Each address opens in a tab of its own, one at a time, and is crawled there — Next buttons and all. Show all lists together puts every row in one table, with a List column naming its page.
Every page of every address
Each address is crawled the way the first one was: if its list runs over several pages, the extension follows Next, Load more or infinite scroll to the end before it moves on, with a pause between pages so no site is hammered.
Turn on drill-down as well and every row on every list gets the details from its own page added as columns. A list of ten category pages becomes every product in all ten, with its specs.
One sheet, and still each page on its own
Every list keeps its own tab with its own table, so you can open the extension on any of them and check it. Show all lists together merges them into one table in the tab you started from, and the List column tells you where each row came from — ready for a pivot table or a filter.
If a page in the middle asks you to prove you are human, the run stops there and brings that tab to the front. Clear it and press Resume; the lists already finished are kept.
When this is the right tool
It suits a list of pages that share a layout: a site’s category or search pages, a directory by city or state, the same marketplace in different countries, every exhibitor list from a series of trade shows. It runs in your own browser, signed in as you, so it reaches what you can reach.
It is not a crawler that discovers addresses for you, and it is not built for thousands of unrelated sites with different layouts — each address is read with the setup you made on the first.
Free and Pro
Free runs the first two addresses of the list, so you can see the result before paying. Pro is a one-time purchase: $19 at the founding price for the first 100 buyers, $25 after that, with every update included. It also adds saved setups, scheduled runs and the rest. Compare what is free.
Reasonable questions
Can I scrape data from multiple URLs at once into Excel?
Yes. Paste the addresses into List of pages on the Crawl tab and start the run; each page is crawled with the same setup, and Show all lists together merges the rows into one table you export to Excel, CSV or JSON.
Can I paste the URLs from a spreadsheet?
Yes. Copy the column of addresses and paste it into the box; each line becomes one address. You can also add the page you are on with + This page.
Does it follow pagination on each URL?
Yes. Each address is crawled the same way as the first page, following Next buttons, Load more or infinite scroll to the end of its list.
How do I know which page a row came from?
The merged table has a List column naming the page each row came from, and every page also keeps its own tab with its own table.
Is it free?
The first two addresses run free, so you can check the result. Running the whole list is part of Pro, a one-time purchase rather than a subscription.