v0.3.2

• Fixed minor issues to add support for GCP (#558)
• Fixed databricks_permissions for SQL Analytics Entities (#535)
• Fixed incorrect HTTP 404 handling on create (#564, #576)
• Fixed incorrect escaping of notebook names (#566)
• Fixed entitlements for databricks_group (#549)
• Fixed rate limiting to perform more than 1 request per second (#577)
• Added support for spot instances on Azure (#571)
• Added job schedules support for pause_status as a optional field. (#575)
• Fixed minor documentation issues.

Updated dependency versions:

• Bump github.com/aws/aws-sdk-go from 1.37.20 to 1.38.10
• Bump github.com/hashicorp/hcl/v2 from 2.9.0 to 2.9.1
• Bump github.com/zclconf/go-cty from 1.8.0 to 1.8.1
• Bump github.com/google/go-querystring from 1.0.0 to 1.1.0

v0.3.1

• Added databricks_global_init_script resource to configure global init scripts (#487).
• Added databricks_sql_endpoint resource (#498)
• Added experimental resource exporter to generate configuration for entire workspace.
• Improved user-facing documentaiton (#508, #516, #511, #504, [#492](Update docs in various places))
• Simplified authentication issues debugging (#490)
• Made cleaner error message for no config profile (#491)
• Allow tokens without comment or expiration (#495)
• Ensured consistent slashes in notebook paths for different OSes (#500)
• Fix error message panic in command result parsing (#502)
• Updated databricks_group data resource to allow non-alphanumeric characters in group name filter (#507)

Behavior changes

• Assigning any permission to admins would result in an error, so that behavior is consistent (#486).

Updated dependency versions:

• github.com/zclconf/go-cty from 1.2.1 to 1.7.1
• github.com/Azure/go-autorest/autorest/azure/auth from 0.5.6 to 0.5.7
• github.com/hashicorp/hcl/v2 from 2.3.0 to 2.8.2
• github.com/aws/aws-sdk-go from 1.37.1 to 1.37.11
• github.com/Azure/go-autorest/autorest from 0.11.17 to 0.11.18

v0.3.0

• Added configurable provisioning timeout for databricks_mws_workspaces, so that local DNS cache issues would be more tolerated.
• Added databricks_current_user to simplify applying the same Terraform configuration by different users in the shared workspace for testing purposes.
• Added client-side rate limiting to release the pressure on backend APIs and prevent client blocking (#465)
• Member usernames, group names and instance profile names in databricks_group data source are now sorted and providing consistent behavior between runs (#449)
• Fixed redundant multiple mounting clusters (#445)
• Added optional parameter azure_environment to provider config which defaults to public (#437).
• Added databricks_service_principal resource.
• skip_validation from databricks_instance_profile was removed and is always set to true.
• Added propagation of terraform version to User-Agent header, along with type of resource used.
• databricks_notebook & databricks_dbfs_file got new source field to specify location of a local file.
• databricks_notebook can have language field optional, as long as source is set to a file with .py, .scala, .sql, or .r extension.
• databricks_me data source was added to represent user_name, home & id of the caller user (or service principal).
• Added validation for secret scope name in databricks_secret, databricks_secret_scope and databricks_secret_acl. Non-compliant names may cause errors.
• Added databricks_spark_version data source.
• Fixed support for single node clusters support by allowing num_workers to be 0.
• Fixed bug in destruction of IP access lists (#426).
• All resource imports are now making call to corresponding Databricks API by default (#471).

Behavior changes

• Removed deprecated library_jar, library_egg, library_whl, library_pypi, library_cran, and library_maven from databricks_cluster and databricks_job in favor of more API-transparent library configuration block.
• Removed deprecated notebook_path and notebook_base_parameters from databricks_job in favor of notebook_task configuration block.
• Removed deprecated jar_uri, jar_main_class_name, and jar_parameters from databricks_job in favor of spark_jar_task configuration block.
• Removed deprecated python_file and python_parameters from databricks_job in favor of spark_python_task configuration block.
• Removed deprecated spark_submit_parameters from databricks_job in favor of spark_submit_task configuration block.
• Removed deprecated databricks_scim_user resource in favor of databricks_user.
• Removed deprecated databricks_scim_group resource in favor of databricks_group.
• Removed deprecated databricks_default_user_roles data source in favor of databricks_group data source.
• Removed deprecated basic_auth and azure_auth provider configuration blocks in favor of documented authentication methods.
• format, overwrite, and mkdirs were removed from databricks_notebook. To follow expected behavior of Terraform, notebooks are always overwritten.
• skip_validation from databricks_instance_profile was removed and is always set to true for subsequent requests.
• databricks_mws_workspace got verify_workspace_runnning removed and now validates all every deployment. In case deployment failed, it removes workspace that failed and returns error message with explanation.
• default_tags were removed from databricks_instance_pool. disk_spec got new attribute disk_type, that contains azure_disk_volume_type and ebs_volume_type. This change is made to closer reflect API structure.
• databricks_notebook & databricks_dbfs_file got content attribute renamed to content_base64 and now share the same logic to work with local files.

v0.2.9

• Fixed documentation issues.
• Added missing resource importers and test to cover it.
• Migrated build from TravisCI to GitHub Actions.
• Fixed custom config_file issue configuration handling (#420).

Deprecations

• databricks_notebook has got overwrite, mkdirs and format parameters, that always have to be set to certain values in order to follow expected behavior of terraform. These fields would be removed in 0.3 and always set to proper values.
• databricks_notebook & databricks_dbfs_file field content is deprecated and would be renamed to content_base64 to further increase clarity.
• databricks_dbfs_file has got content, content_b64_md5, overwrite, mkdirs, validate_remote_file fields deprecated and they will be removed in the next version, where critical code path will be shared with databricks_notebook.
• network_error_messages and verify_workspace_runnning from databricks_mws_workspaces is deprecated and going to be removed in 0.3.
• error_messages from databricks_mws_networks are deprecated and would be removed in 0.3.
• ebs_volume_type and azure_disk_volume_type from databricks_instance_pool is going to be moved to disk_type sub-block in 0.3, which means you'll slightly have to modify configuration while migrating to 0.3. Computed field default_tags is going to be removed from resource. This is done to further increase maintainability of provider in the future.

Updated dependency versions:

• github.com/aws/aws-sdk-go 35.36
• github.com/hashicorp/go-retryablehttp 0.6.8
• github.com/Azure/go-autorest/autorest 0.11.12

Behavior changes

• min_idle_instances for databricks_instance_pool is now optional.
• skip_validation for databricks_instance_profile is going to be removed in 0.3.

v0.2.8

• Added databricks_workspace_conf resource.
• Added databricks_mws_log_delivery resource for billable usage & audit logs consumption.
• Added databricks_node_type data source for simpler selection of node types across AWS & Azure.
• Added Azure Key Vault support for databricks_secret_scope for Azure CLI authenticated users.
• Added is_pinned support for databricks_cluster resource.
• Fixed restarting cluster on changes in cluster configuration aren't related to the cluster configuration (issue #379)
• Fixed issue #383 by cleaning up clusters that fail to start.
• Fixed issue #382 by ignoring any incoming changes to deployment name of databricks_mws_workspaces, as well as propagating the right error messages.
• Internal: API for retrieval of the cluster events.
• Increased code coverage to 71%.

Updated dependency versions:

• github.com/Azure/go-autorest/autorest v0.11.9
• github.com/Azure/go-autorest/autorest/adal v0.9.5
• github.com/Azure/go-autorest/autorest/azure/auth v0.5.3
• github.com/Azure/go-autorest/autorest/azure/cli v0.4.2
• gopkg.in/ini.v1 1.62.0

Deprecations

• network_error_messages from databricks_mws_workspaces is deprecated and going to be removed in 0.3

v0.2.7

Small fixes

v0.2.6

• Added support for customer managed keys for Accounts API.
• Added databricks_user resource.
• Added databricks_user_instance_profile resource.
• Added databricks_group data source.

Updated dependency versions:

• github.com/Azure/go-autorest/autorest v0.11.6
• github.com/Azure/go-autorest/autorest/adal v0.9.4
• github.com/Azure/go-autorest/autorest/azure/auth v0.5.2
• github.com/Azure/go-autorest/autorest/azure/cli v0.4.1
• gopkg.in/ini.v1 v1.61.0

Deprecations

• databricks_scim_user is no longer receiving fixes and will be removed in 0.3, please rewrite using the databricks_user resource, which has more consistent semantics with databricks_group and works better with identity provider SCIM sync.
• databricks_scim_group is no longer receiving fixes and will be removed in 0.3. Please rewrite using the databricks_group resource.
• databricks_default_user_roles is no longer receiving fixes and will be removed in 0.3, please rewrite using databricks_user & databricks_group resources.

Behavior changes

• State changes to legacy spark.databricks.delta.preview.enabled config option are now ignored by databricks_job & databricks_cluster
• Libraries, which are installed on all clusters and are not part of cluster resource definition, won't be waited for INSTALLED status
• Fixed "Secret scope ACL is MANAGE for all users by default" (issue 322). If you were relying on setting MANAGE permission to all users by default, you need to add initial_manage_principal = "users" to your resource "databricks_secret_scope" declaration.

v0.2.5

• Added support for local disk encryption
• Added more reliable indication about Azure environment and fixed azure auth issue for Terraform 0.13
• Updated databricks_aws_crossaccount_policy to latest rules
• Fixed missing importers for databricks_scim_* resources
• Updated Terraform Plugin SDK to latest version along with transitive dependencies.
• Added support disclaimers
• Increased code coverage to 65%

v0.2.4

• Added Azure CLI authentication to bridge the gap of local development workflows and let more people use the provider.
• All authentication is completely lazy-initialized, which makes it provider overall more stable.
• Significantly increased unit test coverage, which runs before every merge of a pull request.
• Introduced constantly running integration test suite environments: azsp, azcli & awsmt
• Numerous stability improvements for clusters, mounts, libraries, notebooks, files, authentication and TLS connectivity.
• Added ability to mount storage without explicitly defining a cluster, though it will still launch auto-terminating terraform-mount cluster to perform the mount.
• databricks_cluster & databricks_job now share significant portion of configuration wiring code, therefore increasing the stability of codebase.
• Added support for Terraform 0.13 local builds for those who develop or cannot wait for next release.
• Added AWS IAM Policy data helpers to simplify new deployments.
• Migrated all documentation to Terraform Registry format, therefore having a single always-accurate place for end-user guides.
• Internally, codebase has been split into multiple packages, which should make further contributions simpler.

Updated dependency versions:

• github.com/Azure/go-autorest/autorest v0.11.4
• github.com/Azure/go-autorest/autorest/adal v0.9.2
• github.com/Azure/go-autorest/autorest/azure/auth v0.5.1
• github.com/aws/aws-sdk-go v1.34.13
• gopkg.in/ini.v1 v1.60.2

Deprecations

• library_* is no longer receiving fixes and will be removed in 0.3, please rewrite cluster & job resources to use library configuration block.
• basic_auth provider block is no longer receiving fixesand will be removed in 0.3, please use username and password options
• azure_auth provider block is no longer receiving fixesand will be removed in 0.3, please use azure_* options

Behavior changes

• Previously, mounts code paths were different functions. This release unifies them to be a single testable codebase with different configuration options & re-use of the critical code paths. For maintainability reasons, there's no longer check performed on container & storage account names, but rather on high-level mount source uri.

v0.2.3

Changelog

9e3acaf AWS Go SDK update to 1.32.6 (#139)
6f50437 Add more readability for errors (#129)
259e467 Add pkg/errors
1ed8448 Add pkg/errors
cc6727a Add pkg/errors
0686299 Added cluster policy documentation
b1831ac Added databricks_cluster_policy resource
54d6893 Added databricks_permissions resource
e31e1b9 Added databricks_permissions resource
c7f2b3d Added databricks_permissions resource
fe7d72e Added databricks_permissions resource
ef4ed40 Added make install
91d8243 Added make install
7d09b9d Added more coverage for edge cases on permissions
598f87a Added more coverage for edge cases on permissions
78f8b72 Added real unit tests for resource
57b2267 Added real unit tests for resource
e7cec50 Added real unit tests for resource
25da4b1 Cleaned up schema definition
249cc8f Cluster instance pool fix (#174)
bcdef81 DBFS Refactor & Fixes to support larger files (#171)
baa9a38 Docs update (#177)
15b5505 Fix Azure SP Personal Access Token Duration (#110)
d16d18b Fix Notebook issues (#111)
9fd9e38 Fix code style violations
9b4cdf9 Fix code style violations
c343db6 Fix the godownloader script to support new changes to binaries required from hashicorp terraform registry (#125)
1cac210 Install from source fix & doc (#154)
4f5c730 Merge branch 'master' into permissions-api
5adeccc Merge branch 'permissions-api' of github.com:databrickslabs/terraform-provider-databricks into permissions-api
b1bc6c3 Merge branch 'permissions-api' of github.com:databrickslabs/terraform-provider-databricks into permissions-api
6a54e54 Merge pull request #132 from databrickslabs/permissions-api
e38a53f Minor commenting tweaks
dd79a2d Minor commenting tweaks
1dd443f Minor commenting tweaks
686b435 Minor commenting tweaks
cab737f Notebook fix (#175)
0088df4 Register permissions api in the client
732aeda Register permissions api in the client
4b15448 Register permissions api in the client
c23a1a6 Use new workspace_url format + fix azure test (#114)
20a38ae bump aws-sdk-go from 1.32.2 to 1.32.6; bump terraform-plugin-sdk from 1.13.1 to 1.14.0; added travisbuddy notification hooks for public repo (#133)
4239f78 bumped autorest from v0.11.0 to v0.11.2 (#178)
c15aa9e fix instance pool update recursive call (#155)
e10c164 fix sparkVersions list in databricks_instance_pool (#153)
ecd11ec format it back
239f2a9 format it back
6656e48 make build will also test now (provider + client)
47267fd make build will also test now (provider + client)
08a8b54 remove fmt from lint
70b1935 remove fmt from lint
ed678fe remove go get goimports
458b2cf test linter failing build
eeeb779 test linter failing build
391e80f trigger build
8865b03 trigger build
83dca55 trigger build
88da24f trigger build
9c9b589 trigger build
3fee89c trigger build
515d61e trigger build
f4a35e0 trigger build
6e69eb0 try fixing build
e8e85e1 try fixing build
05732ff used http.DefaultTransport to inherit system properties for proxy settings and etc. (#172)