open_soma error: The bucket you are attempting to access must be addressed using the specified endpoint.

[ybukhman]

Describe the bug

Error message:
Error: [TileDB::Task] Error: Caught std::exception: S3: Error while listing with prefix 's3://cellxgene-census-public-us-west-2/cell-census/2024-07-01/soma/' and delimiter '/'[Error Type: 100] [HTTP Response Code: 301] [Exception: PermanentRedirect] [Remote IP: 52.216.136.170] [Request ID: BGT3JFBZQJA2M872] [Headers: 'content-type' = 'application/xml' 'date' = 'Fri, 20 Sep 2024 22:23:50 GMT' 'server' = 'AmazonS3' 'transfer-encoding' = 'chunked' 'x-amz-bucket-region' = 'us-west-2' 'x-amz-id-2' = 'eTN9+VDHjPY29cO/MYl4rIHXhYTlRyY2tEBwo6m1UXrYuEkQSJC5KeSOSi8Jw+mVGZDixp6f/LM=' 'x-amz-request-id' = 'BGT3JFBZQJA2M872'] : Unable to parse ExceptionName: PermanentRedirect Message: The bucket you are attempting to access must be addressed using the specified endpoint. Please send all future requests to this endpoint.

To Reproduce

R code:

library("cellxgene.census")
library("Seurat")

census <- open_soma(census_version = "2024-07-01")

Expected behavior

I was just trying to run the example code block from https://chanzuckerberg.github.io/cellxgene-census/r/index.html

Environment

Provide a description of your system and the software versions.

• Machine MacBook Pro, 16 inch. Processor 2.6 GHz 6-Core Intel Core i7. Graphics AMD Radeon Pro 5300M 4 GB
  Intel UHD Graphics 630 1536 MB. Memory 16 GB 2667 MHz DDR4.
• OS: macOS Sonoma 14.6.1 (23G93)
• Software versions:
  • Python user: pip list
  • R user: sessionInfo()

R version 4.4.1 (2024-06-14)
Platform: x86_64-apple-darwin20
Running under: macOS Sonoma 14.6.1

Matrix products: default
BLAS: /System/Library/Frameworks/Accelerate.framework/Versions/A/Frameworks/vecLib.framework/Versions/A/libBLAS.dylib
LAPACK: /Library/Frameworks/R.framework/Versions/4.4-x86_64/Resources/lib/libRlapack.dylib; LAPACK version 3.12.0

locale:
[1] en_US.UTF-8/en_US.UTF-8/en_US.UTF-8/C/en_US.UTF-8/en_US.UTF-8

time zone: America/Chicago
tzcode source: internal

attached base packages:
[1] stats graphics grDevices utils datasets methods base

other attached packages:
[1] RcppSpdlog_0.0.18 Seurat_5.1.0 SeuratObject_5.0.2 sp_2.1-4 cellxgene.census_1.16.1

loaded via a namespace (and not attached):
[1] RColorBrewer_1.1-3 rstudioapi_0.16.0 jsonlite_1.8.8 magrittr_2.0.3 spatstat.utils_3.1-0
[6] rmarkdown_2.27 fs_1.6.4 vctrs_0.6.5 ROCR_1.0-11 spatstat.explore_3.3-2
[11] base64enc_0.1-3 htmltools_0.5.8.1 curl_5.2.1 sass_0.4.9 sctransform_0.4.1
[16] parallelly_1.38.0 bslib_0.8.0 KernSmooth_2.23-24 htmlwidgets_1.6.4 ica_1.0-3
[21] plyr_1.8.9 cachem_1.1.0 plotly_4.10.4 zoo_1.8-12 igraph_2.0.3
[26] mime_0.12 lifecycle_1.0.4 pkgconfig_2.0.3 Matrix_1.7-0 R6_2.5.1
[31] fastmap_1.2.0 fitdistrplus_1.2-1 future_1.34.0 shiny_1.9.1 digest_0.6.36
[36] colorspace_2.1-1 tiledb_0.30.1 patchwork_1.2.0 tensor_1.5 RSpectra_0.16-2
[41] irlba_2.3.5.1 aws.signature_0.6.0 progressr_0.14.0 fansi_1.0.6 spatstat.sparse_3.1-0
[46] urltools_1.7.3 httr_1.4.7 polyclip_1.10-7 abind_1.4-5 compiler_4.4.1
[51] bit64_4.0.5 fastDummies_1.7.4 MASS_7.3-60.2 tiledbsoma_1.14.1 tools_4.4.1
[56] lmtest_0.9-40 httpuv_1.6.15 future.apply_1.11.2 goftest_1.2-3 glue_1.7.0
[61] nlme_3.1-164 promises_1.3.0 grid_4.4.1 Rtsne_0.17 cluster_2.1.6
[66] reshape2_1.4.4 generics_0.1.3 gtable_0.3.5 spatstat.data_3.1-2 tidyr_1.3.1
[71] data.table_1.15.4 xml2_1.3.6 utf8_1.2.4 spatstat.geom_3.3-2 RcppAnnoy_0.0.22
[76] ggrepel_0.9.5 RANN_2.6.2 pillar_1.9.0 stringr_1.5.1 spam_2.10-0
[81] nanoarrow_0.5.0.1 RcppHNSW_0.6.0 later_1.3.2 splines_4.4.1 dplyr_1.1.4
[86] lattice_0.22-6 survival_3.6-4 bit_4.0.5 deldir_2.0-4 tidyselect_1.2.1
[91] miniUI_0.1.1.1 pbapply_1.7-2 knitr_1.48 gridExtra_2.3 RcppCCTZ_0.2.12
[96] scattermore_1.2 xfun_0.46 matrixStats_1.3.0 stringi_1.8.4 yaml_2.3.10
[101] lazyeval_0.2.2 evaluate_0.24.0 codetools_0.2-20 tibble_3.2.1 cli_3.6.3
[106] uwot_0.2.2 arrow_17.0.0.1 xtable_1.8-4 reticulate_1.39.0 jquerylib_0.1.4
[111] munsell_0.5.1 Rcpp_1.0.13 globals_0.16.3 spatstat.random_3.3-1 triebeard_0.4.1
[116] png_0.1-8 spatstat.univar_3.0-1 parallel_4.4.1 ggplot2_3.5.1 assertthat_0.2.1
[121] dotCall64_1.1-1 aws.s3_0.3.21 listenv_0.9.1 spdl_0.0.5 viridisLite_0.4.2
[126] scales_1.3.0 ggridges_0.5.6 leiden_0.4.3.1 purrr_1.0.2 rlang_1.1.4
[131] cowplot_1.1.3 nanotime_0.3.9

Additional context

N/A

[ivirshup]

Hey, @ybukhman this looks very similar to #1261, so I'm going to close this as a duplicate. Please let us know if there is anything in that issue which solves your issue!

[ybukhman]

The following code seems to have solved my problem:
Sys.setenv(AWS_DEFAULT_REGION = "us-west-2")

Thanks!