Tests: Google Driver

[scottwernervt]

Google driver tests still randomly fail due to API rate limiting even after introducing delays. Need to rework how we use fixtures for containers and blobs.

• https://travis-ci.org/scottwernervt/cloudstorage/jobs/451507446
• https://travis-ci.org/scottwernervt/cloudstorage/jobs/451505041
• https://travis-ci.org/scottwernervt/cloudstorage/jobs/451492598
• https://travis-ci.org/scottwernervt/cloudstorage/jobs/451465886
• https://travis-ci.org/scottwernervt/cloudstorage/jobs/448997670
• https://travis-ci.org/scottwernervt/cloudstorage/jobs/448954816

Ideas:

• Use one container per module for uploading and deleting files from. File names would be randomized.
• Use retry decorator to catch API rate limit exception and pause.
• Perform all container and blob cleanup at the end of session.

[micimize]

This just a travis cli / testing issue, right? It shouldn't effect end users?

[scottwernervt]

Yes, it is only a testing issue and does NOT effect end users.

[habibutsu]

You can try make following improvements and it will useful not only for tests

--- a/src/cloudstorage/drivers/google.py
+++ b/src/cloudstorage/drivers/google.py
@@ -8,6 +8,9 @@ from datetime import datetime, timedelta
 from http import HTTPStatus
 from typing import Any, Dict, Iterable, List  # noqa: F401
 
+from urllib3.util.retry import Retry
+from requests.adapters import HTTPAdapter
+
 # noinspection PyPackageRequirements
 from google.auth.exceptions import GoogleAuthError
 
@@ -110,6 +113,13 @@ class GoogleStorageDriver(Driver):
 
         self._client = storage.Client()
 
+        retries_strategy = Retry(
+            total=5,
+            backoff_factor=0.1,
+            status_forcelist=[408, 429])
+        http = self._client._http
+        http.mount('https://', HTTPAdapter(max_retries=retries_strategy))
+
     def __iter__(self) -> Iterable[Container]:
         for bucket in self.client.list_buckets():
             yield self._make_container(bucket)