SpiderFoot: how to use it, and when a simpler tool fits
SpiderFoot is an OSINT automation tool with more than 200 modules. You point it at a target and it queries a long list of data sources, then correlates what comes back. It does far more than username search, and this page explains where it fits.
OSINT automation framework. Project: github.com/smicallef/spiderfoot · License: MIT · Last reviewed 2026-10-13
What is SpiderFoot?
SpiderFoot is written in Python 3 and released under the MIT license by Steve Micallef. It has an embedded web server for a browser interface and can also run entirely from the command line. The README lists over 200 modules, a YAML-configurable correlation engine with 37 predefined rules, CSV, JSON and GEXF export, Tor support and a Dockerfile.
A scan starts from a target such as a domain, IP address, email address, name or username, and modules fan out from there. Many modules need API keys for third-party services. The open-source edition is self-hosted; the README also advertises SpiderFoot HX, a managed cloud edition, and the spiderfoot.net site now redirects to Intel 471.
How to use SpiderFoot
- Install Python 3.7 or newer and download a packaged release (the README recommends releases over the master branch).
- Install the requirements with pip.
- Start the web server on a local address and open it in your browser.
- Create a scan, choose a target and a module set, and add API keys for the sources you want.
Example commands from the project's README (check it for the current version):
pip3 install -r requirements.txt
python3 ./sf.py -l 127.0.0.1:5001SpiderFoot vs WhatsMyName Apps
| Feature | SpiderFoot | WhatsMyName Apps |
|---|---|---|
| Scope | Domains, IPs, emails, names, usernames and more | Usernames (plus seven domain endings) |
| Data sources | 200+ modules, many needing API keys | 3,166 sites, merged from the WhatsMyName, Sherlock and Maigret lists |
| Setup | Python or Docker, self-hosted | Nothing to install. It runs in the browser |
| Correlation | 37 predefined rules | No |
| Export | CSV, JSON, GEXF | JSON and CSV (no PDF) |
| Automation | CLI and web UI | No API and no CLI |
| Price | Free open-source edition; paid cloud edition | Free, no sign-up |
Based on SpiderFoot's own documentation as of 2026-10-13. Tools change; the project page is the final word.
Pros and cons of SpiderFoot
Pros
- Huge module library covering domains, IPs, people and more.
- Correlation rules surface links across sources.
- Web UI and CLI; CSV, JSON and GEXF export.
- Free and open source under MIT.
Cons
- Setup and API key management take time.
- Large scans are slow and noisy if you do not choose modules carefully.
- Overkill when all you need is a username check.
Who SpiderFoot is for
SpiderFoot suits security teams and investigators who run broad, repeatable reconnaissance on their own infrastructure. For checking where one handle appears, a dedicated username tool is quicker.
Try a username search in your browser
Free, no sign-up. Checks 3,166 sites; the username is not stored or logged.
Frequently asked questions
How do I install SpiderFoot?
Download a release, run pip3 install -r requirements.txt, then start it with python3 ./sf.py -l 127.0.0.1:5001 and open that address in a browser. A Dockerfile is included too.
Can SpiderFoot search usernames?
Yes, a username can be a scan target, but SpiderFoot is built for wide reconnaissance. For a username alone, a dedicated checker is faster.
Is there a SpiderFoot online version?
The open-source edition is self-hosted. The README mentions SpiderFoot HX, a managed cloud edition. For a free browser username search, our checker needs no setup.
SpiderFoot vs WhatsMyName Apps: which should I use?
Use SpiderFoot for broad automated recon across many data types. Use WhatsMyName Apps for a quick username search in the browser.
Related tools and guides
- Recon-ng: Web reconnaissance framework
- theHarvester: Domain reconnaissance
- OSINT Framework: Directory of OSINT tools
- Maigret: Username search (CLI and web UI)
- All OSINT tools compared
- OSINT username search · Reverse username lookup · Platform username checkers
- Username OSINT for beginners
Names and trademarks belong to their owners. WhatsMyName Apps is independent and not affiliated with or endorsed by SpiderFoot or its authors.