NAS-129692 / 24.10 / rate limit methods that have @no_auth_required

[yocalebo]

For obvious reasons, we MUST protect public endpoints that are marked with @no_auth_required by rate limiting them. This implementation will rate limit all methods that are marked with @no_auth_required. These rate limits are implemented by hashing them by method name AND the origin IP address that is sending the request to us. This isn't a fool-proof way and won't cover every single scenario but it's significantly better than what we currently have.

Implementation details:

1. ignore the rate limit if the method is being called across the unix socket (internal)
2. ignore the rate limit if the method is being called via the heartbeat interface on HA systems
3. store the method name and ip address of the remote client making the request
4. if a method that doesn't require authentication has been called by the same origin IP address more than 20 times within a 1min period, the rate limit will kick in
5. if the rate limits are being enforced, we will sleep a random delay to provide some form of backpressure to the offending client
6. if the global cache limit has been reached (100 total entries), requests made by ANY remote caller to methods that don't require authentication will be blocked
7. the global rate limit cache will be cleared every 10mins

After adding this functionality and running it through our CI, I saw test failures for modules that use make_ws_request. This is for numerous reasons but the most important one is that it logged in every time it was called. This kicked in our rate limiting mechanism and so tests (specifically the FTP test) started to fail. After kicking the proverbial can down the road, I decided to go ahead and remove all uses of make_ws_request function since it was no longer needed.

[bugclerk]

Jira URL: https://ixsystems.atlassian.net/browse/NAS-129692

[william-gr]

We used to have a @throttle decorator for somethings.
Dunno if the intent was to handle that later or you could remove that as part of the PR, e.g. system.build_time

[bugclerk]

This PR has been merged and conversations have been locked.
If you would like to discuss more about this issue please use our forums or raise a Jira ticket.