CanonicalizeURL converts a URL to a consistent, comparable form for deduplication and storage. Canonicalization includes: lowercasing scheme and host, normalizing path, sorting query parameters, removing fragments, removing default ports, and decoding unnecessary percent-encoding.