#1123723 RFP: wayparam -- Wayback CDX URL discovery and parameter normalization tool

#1123723#5
Date:
2025-12-20 13:24:44 UTC
From:
To:
* Package name    : wayparam
  Version         : 0.3.0
  Upstream Author : Aleff
* URL             : https://github.com/aleff-github/wayparam
* License         : GPL-3.0-or-later
  Programming Lang: Python 3
  Description     : Wayback CDX URL discovery and parameter normalization tool

wayparam is a cross-platform command-line tool written in Python that queries the Internet Archive Wayback Machine CDX API to retrieve historical URLs associated with a domain or a list of domains.

The tool filters out "boring" URLs (such as static assets), normalizes
parameterized URLs by sorting query parameters and replacing values with a placeholder, and outputs results in either plain text or JSONL format.
Diagnostics and logs are written to stderr, making it safe for use in Unix pipelines.

wayparam is inspired by ParamSpider, but is a complete rewrite with a more robust and maintainable architecture. Compared to ParamSpider, wayparam features async concurrency, rate limiting, retry and backoff logic, cleaner stdout/stderr separation, an included man page, and offline httpx-level integration tests using MockTransport.

The project is intended for OSINT and security research workflows and does not perform any active crawling; it only queries the public Wayback CDX API.

I am willing to help with maintenance and packaging if needed but honestly, I don't have much experience.

#1123723#10
Date:
2025-12-27 07:40:22 UTC
From:
To:
HI Alessandro Greco

It is very easy to package wayparam for Debian. you just need to say to debhelper that it is a python project.

see:

https://salsa.debian.org/amin_modaresi/vkbasalt-cli

create a salsa account and start packaging process on salsa.
I can't promise that I can help you for ever and I can't teach basic packaging steps to you, but I can help you to upload the first release. If you commit to maintaining the package for the long time, I'm ready to help.

Of course I don't have much experience too. Maybe just some experience more than you.

For it you need a Debian testing or unstable system.

Happy new year! Of course your new year! :/

#1123723#15
Date:
2025-12-28 16:05:45 UTC
From:
To:
Control: owner

1123723

Alessandro Greco <alessandro.greco.1@protonmail.com>

#1123723#20
Date:
2025-12-28 16:37:03 UTC
From:
To:
Control: owner 1123723 Alessandro Greco <alessandro.greco.1@protonmail.com>
#1123723#27
Date:
2025-12-28 16:44:38 UTC
From:
To:
control: owner 1123723 Alessandro Greco <alessandro.greco.1@protonmail.com>