Releases: databricks/terraform-provider-databricks
v0.2.2
v0.2.1
Changelog
464232f Added Databricks CLI config file fallback
528c074 Bump github.com/stretchr/testify from 1.5.1 to 1.6.1; Bump github.com/hashicorp/terraform-plugin-sdk from 1.13.0 to 1.13.1; Bump github.com/Azure/go-autorest/autorest from 0.10.1 to 0.10.2
f57c17d Made lint even more happy by adjusting naming conventions and having VSCode not complain at all
fdb9b3d Make linter happy & remove redundant &schema.Schema
39a808e Merge branch 'ds/adls2mountvalidation' of https://github.com/storey247/databricks-terraform into ds/adls2mountvalidation
164ea0b Merge branch 'ds/fix-mountclustermissing' of https://github.com/storey247/databricks-terraform into ds/fix-mountclustermissing
d020a93 Merge branch 'ds/fix-mountclustermissing' of https://github.com/storey247/databricks-terraform into ds/fix-mountclustermissing
3389d4e Merge branch 'master' into ds/adls2mountvalidation
5177ee4 Merge branch 'master' into ds/adls2mountvalidation
191aa0e Merge branch 'master' into ds/fix-mountclustermissing
d6b3504 Merge branch 'master' into ds/fix-mountclustermissing
09d8841 Merge branch 'master' into ds/fixmountdirectoryerror
e526941 Merge branch 'master' into fix-job-new-cluster
235b711 Merge branch 'master' into multiple-workspace-apis
4ea78e1 Merge branch 'master' into website-fix
2d1de58 Merge branch 'master' into website-fix
a74bb86 Merge branch 'master' of github.com:databrickslabs/databricks-terraform into fix-job-new-cluster
0f03f7b Merge branch 'master' of github.com:databrickslabs/databricks-terraform into group-role-member-feature
09ff551 Merge branch 'master' of github.com:databrickslabs/databricks-terraform into group-role-member-feature
0799650 Merge branches 'cluster-policies' and 'master' of github.com:databrickslabs/databricks-terraform into cluster-policies
95b6e0d Merge pull request #100 from databrickslabs/cleanup-and-tests
86f53be Merge pull request #101 from databrickslabs/group-role-member-feature
8998fb4 Merge pull request #102 from databrickslabs/cleanup-and-tests
8b42563 Merge pull request #104 from databrickslabs/website-fix
1ca9c22 Merge pull request #106 from storey247/ds/fixmountdirectoryerror
956d0ff Merge pull request #108 from databrickslabs/website-fix
bb63e4f Merge pull request #109 from databrickslabs/vendor
6137b83 Merge pull request #79 from databrickslabs/fix-job-new-cluster
a09eafc Merge pull request #85 from databrickslabs/cluster-policies
b8b4d86 Merge pull request #87 from storey247/ds/fix-mountclustermissing
8dd8c21 Merge pull request #90 from databrickslabs/multiple-workspace-apis
8eebc57 Merge pull request #91 from databrickslabs/vendor
3f56ba9 Merge pull request #95 from storey247/ds/adls2mountvalidation
34e68d5 Merge pull request #96 from databrickslabs/provider-auth-fix
f00e41b Sign releases and conform release artifacts naming to hashicorp tf provider requirements (#121)
67edef8 added databricks_group, databricks_group_member & databricks_group_role to manage the scim resources separately
e948e6a added extra tests and fixed linting issues
9fe788e added golanglintci file credits to the hashicorp azurerm provider, makefile is set to lint with the file, also added goimports and gofmt -s for simplifying code, and removed if else chains with switch
d3c6272 added logic to prevent mount point duplication
cf84787 added test run command PR feedback to verify interface
887efbe added test to demonstrate error for invalid config file path, and expanded the bit.ly links
54d5011 added vendoring for aws sdk
408036b adjusted old repo to new repo naming convention for aligning with terraform provider naming convention
a0ad67e fix issue causing mount to error on read
56e0c63 fix lint issues
b0f123a fixed ebs volume count issue of being 0 and added integration tests for both azure and aws
20af367 fixed function name ValidateInstanceProfileARN in the doc comments
aa1ab14 fixed line end
9df28e9 fixed merge conflicts
b312c13 fixed order of precedence for basic auth, and fixed user-agent configuration according to mdn webdocs
d830ec3 fixed the build status svg and docs link
fa5daa7 fixed vendor and added the required vendor files to successfully run the builds
f238972 fixes prefix missing the period
11885f2 fixing import statements
27a4030 fixing logic in blob mount
9c81f69 fixing typo and formatting issues
83f6e80 format and linting errors resolved
d56c8ed formatting and fixed typo
160e48d further updates
38e70d0 go mod tidy applied
fb4a680 go-fmt cleanup
babef36 mounts now handle deleted cluster correctly
ce716b9 patching up gen1 mount & blob creation error check
511d3c3 removed deprecation notice as it is invalid
51ead31 removed last bit.ly link, added docs and vendored the packages required
76afb2e renamed group_role to group_instance_profile
546bc56 reverting change to the test clientid
1c27629 small resource naming doc fix
85ac029 standardised the validate logic found azure mounts
f4e1d54 updated documentation
aaf8f89 updated to remove fmt from lint command so you will have to now run make fmt manually so build step in travis catches the error
e6700b9 vendor bump aws-sdk-go 1.32.1 -> 1.32.2
8628862 vendored the packages required for this build
v0.2.0
Changelog
7976e0f Add ARM_ env var fallbacks
60e0eb1 Add LiveShare extension for collaboration
bfb1075 Add devcontainer notes to README
d40c273 Add getenv.sh to load .env values
db9c54f Add gotestsum
db55499 Add initailize filesystem. Fix error swallow #37. Fix mount path diff error #38.
867ca55 Add links to docs
9cd9dd4 Add logging output from retry and acctest
d08e241 Add logging output from retry and acctest
2dc9afb Add missing bash-completion dependency
90f034f Add note re ADLS access
ffea781 Add readme and create passing test for mounts
e939af6 Add single_user_name
59364ae Added config for debugging. Removed destroy from test
7f59a5b Bump github.com/Azure/go-autorest/autorest from 0.10.0 to 0.10.1
b571f8f Bump github.com/hashicorp/terraform-plugin-sdk from 1.10.0 to 1.11.0
68f5938 Bump github.com/hashicorp/terraform-plugin-sdk from 1.11.0 to 1.12.0
c1377eb Bump github.com/hashicorp/terraform-plugin-sdk from 1.12.0 to 1.13.0
af8875e Bump github.com/stretchr/testify from 1.3.0 to 1.5.1
507d67f Configure the retry behaviour
f5925da Configure the retry behaviour
325963f Ensure config.Setup called in int tests
a6b5097 Fix Dockerfile compatibility with Alpine Linux
2d92de3 Fix jobs docs: schedule i.o. job_schedule
ab8c1de Fix not calling setup when creating config. Remove validateapi workaround.
44f1525 Fix not calling setup when creating config. Remove validateapi workaround.
fc395f4 Handle retry case when response is nil
6b229ee Initial devcontainer
62e1bc2 Initial work to move to retryablehttp.Client
9f135a1 Initial work to move to retryablehttp.Client
acd2aea Merge branch 'master' into dependabot/go_modules/github.com/Azure/go-autorest/autorest-0.10.1
74a22b9 Merge branch 'master' into dependabot/go_modules/github.com/hashicorp/terraform-plugin-sdk-1.11.0
7be2477 Merge branch 'master' into dependabot/go_modules/github.com/stretchr/testify-1.5.1
3a2fac1 Merge branch 'master' into fix-azure-workspace-creation-bug
d3515b9 Merge branch 'master' into issue-22
75bb693 Merge branch 'master' into master
55bd34f Merge branch 'master' into master
c7143ef Merge branch 'master' into sebastus/azureblobmount
c6428d2 Merge branch 'master' into sl/azurerm-env-vars
630fb0d Merge branch 'master' of github.com:databrickslabs/databricks-terraform into issue-21
4610ae4 Merge branch 'master' of github.com:databrickslabs/databricks-terraform into issue-21
f79e44a Merge branch 'master' of https://github.com/masoncusack/databricks-terraform Merge remote changes.
cc5156f Merge branches 'issue-21' and 'master' of github.com:databrickslabs/databricks-terraform into issue-21
381a417 Merge devcontainer tweaks
0d8edc4 Merge pull request #10 from databrickslabs/dependabot/go_modules/github.com/stretchr/testify-1.5.1
794158a Merge pull request #23 from databrickslabs/issue-22
1211055 Merge pull request #24 from sdebruyn/patch-1
4d89744 Merge pull request #26 from databrickslabs/dependabot/go_modules/github.com/hashicorp/terraform-plugin-sdk-1.11.0
6bce373 Merge pull request #27 from databrickslabs/issue-21
1bfb603 Merge pull request #35 from datarootsio/bugfix/linting-errors
694b808 Merge pull request #36 from datarootsio/bugfix/job-new-cluster
7552f91 Merge pull request #40 from stuartleeks/sl/devcontainer
d817cb4 Merge pull request #43 from databrickslabs/dependabot/go_modules/github.com/hashicorp/terraform-plugin-sdk-1.12.0
da0a178 Merge pull request #44 from databrickslabs/vendor
dc9e603 Merge pull request #46 from databrickslabs/dependabot/go_modules/github.com/Azure/go-autorest/autorest-0.10.1
9753cdd Merge pull request #48 from datarootsio/bugfix/content-state-validate
8d25e5e Merge pull request #51 from stuartleeks/sl/adls-mount-error
c72fd7e Merge pull request #53 from stuartleeks/sllglk/client-retry
02ce95a Merge pull request #59 from stuartleeks/sl/azurerm-env-vars
03ad4c6 Merge pull request #60 from databrickslabs/dependabot/go_modules/github.com/hashicorp/terraform-plugin-sdk-1.13.0
d45f583 Merge pull request #61 from databrickslabs/vendor
20e0acb Merge pull request #62 from stuartleeks/patch-1
3cb1004 Merge pull request #69 from sebastus/sebastus/azureblobmount
28b0fdf Merge pull request #70 from storey247/fix-secret-deletion
26ffb84 Merge pull request #72 from stuartleeks/sl/single-user-name
c5782d4 Merge pull request #74 from masoncusack/master
fba816f Merge pull request #78 from databrickslabs/fix-azure-workspace-creation-bug
6f6fc0b Merge pull request #80 from jordanjennings/fix-dockerfile-binary
fe1f43a Merge pull request #88 from databrickslabs/multiple-workspace-apis
518361c Remove devcontainer env. Check destroy on happy path
ddd509f Remove slash validation as mounting root of the datalake is allowed
923a2d1 Revert use of .env in devcontainer
a33a1a0 Switch to pointer functions
088ce22 Switch to pointer functions
24896c0 Travis CI integration as github actions do not really support builds from Forked PRs (#31)
0a30fe8 Travis ci update with codecov + comments (#32)
857088f Udpate ADLS access comment
368d318 Update docs
c330957 Update docs
0bb87b6 Update handling in getenv.sh
ea0cb5c Update handling in getenv.sh
a7d613a Update timeout to 35mins as cluster creation can take a while
e2882f5 WIP
8937b12 Wait on API health on provider start
2c133a1 Wait on API health on provider start
3e5d40d add Jupyter as a valid notebooks source, and revert relevant docs changes
3ee5d02 add environment variables for the entire azure auth to make the provider deployment much easier for the acceptance testing.
0226896 add eol at eof
bff7164 add sensitive attribute to key output
bec4702 add test
eb3d631 added comments to makefile for the acceptance tests and added more info to the make target's echo statement
a21b815 added documentation for mws resources
0f3a5d4 added the customer auth function to authenticate in provider.go during the configuration process, and altered the other resources to refer to the pointer of the client object rather than the value
2d21363 added the environment variables to the enduser provider docs
5a6ff5d added validateWorkspaceApis to time out after 30 minutes and poll every 10 seconds. This should resolve clusters api not starting properly after workspace creation. currently a hack for now till the near future.
67ce163 another issue with integration tests, the default should be "users". This should not be nil.
667a41e any branch should be able to comment for codecov
b916a33 check the mount exists in databricks workspace as well.
291b5d7 created the getOrCreateToken function and it will get or create the token if there is a custom authorizing function configured on the client config object. Altered all the client objects to be using pointers to the client object rather than values of the client.
1b2fb7e documentation updates
ab34a49 fetch the CLOUD_ENV environment variable and if it is azure just configure the azure provider to only fetch sp credentials from env. This makes testing much easier.
11501be finish up test for mount/delete/remount
685b224 fixed linting errors 1039 unnecessary fmt
97d0f9f fixed principal for secret acls to users and made everything a non parallel test because parallel tests were causing issues with consistent outcome.
5bb76d3 fixed the documentation, updated dockerfile and .dockerignore
c5a5060 fixed the script to fetch the binaries with tags
c206821 fixed useragent and moved to begining of config object creation
c1db8ba fixes to bugs and new test step
9ed1958 fixup remove golangci config
14cd666 formatted and added docs for linting and renamed from testing to just development
0c9410f further updates to docs
f9c76be increased client timeout duration to 60 seconds from 10 seconds
89af527 initial commit of the multiple workspaces api implementation
863e8d1 moved linting and acceptance testing documentation before project components.
4faa046 new job: only set new_cluster when set in schema
96789c0 notebook: restore statefunc with ignore err
98e9349 patch support for workspace to use customer managed key, mws_workspaces resource can now use customer managed key with a "" default, and updated the docs to reflect cmk
145b0da refactored the azure auth process removed pat token generation and using azure go adal library to fetch management token and platform token. Updated integration test to use new env variables
036596d removed commented import
9b3ea1b removed linebreak from fmt
5036c9a removed unused functions and tests for unused functions
5401977 removed usage of adb platform token and management token for sp based auth. Still using adal based auth but still generating databricks personal access token for SP for 1 hour and using that to provision resources. This is because AAD tokens have issues when dealing with secrets apis.
0dd0bc9 renamed e2 to MWS in service
2554ada replace state func in content for notebook with validate
35ddbdd reset env
9dcb4c7 reset environment
f62ee9c separated the scim into aws and azure tests as aws has instance profiles & roles where azure does not have that capability. Also when creating a scim user, there is a weird behavior that makes tests fail where some times the api accidentally creates entitlements of "allow-cluster-create" even though entitlements are empty. Thus the update was added right after to create a put/update request.
cebaa88 set branch to master
6f56bd4 set the cluster id as part of the read operation
09b3b50 suggested docs and code changes regarding node_type_id and instance_pool_id
2f21e0a test existence of cluster
398b3e1 update notebook doc to better explain JUPYTER option.
da03356 update notebook doc with relationships between format parameter and file extensions
4effdb7 update vendors files for terraform-sdk 0.12.0 -> 0.13.0 and go-autorest 0.10.0 -> 0.10.1
9485eae updated makefile to lint different tags, to avoid function conflicts, added terraform-acc-azure and aws targets. Added readme for integration testing
7ca5fb3 updated modules.txt
827d374 updated vendor and gosum
3b5e083 updated vendor files
v0.1.0
Changelog
1924541 Added ClusterStateUnknown as a possible scenario in which the cluster is in a non terminable state.
11c1bc9 Added unit test coverage for commands. Refactored commands to return when waiting for context and command to reach finish state.
0529414 Added unit test coverage for dbfs api. Added better logic for recursive adding of paths.
eeeec1c Added unit test coverage for groups. Removed print statement in groups GetAdminGroup method.
8339194 Added unit test coverage for instance pools.
efe3bfa Added unit test coverage for instance profiles.
cd3dcfe Added unit test coverage for jobs.
bcdfe87 Added unit test coverage for libraries installations.
1499ec2 Added unit test coverage for notebooks. Added better error logic for fetching recursive paths. Errors will fail the recursive call.
d248ea1 Added unit test coverage for tokens
55c4000 Changed license from Databricks to Apache
0bbf3e4 Fixed & refactored linting issues in client/model package
67dca86 Fixed & refactored linting issues in client/service package
08e3eb7 Fixed & refactored linting issues in databricks package
9d8741c Fixed typo
790ac8f Initial commit
0020d9d Merge branch 'master' into github-workflows
a55ff60 Merge branch 'master' of github.com:databrickslabs/databricks-terraform
858aba7 Merge branch 'master' of github.com:databrickslabs/databricks-terraform
0988340 Merge pull request #1 from databrickslabs/develop
dd825ec Merge pull request #1 from databrickslabs/master
0262da4 Merge pull request #2 from databrickslabs/master
51be033 Merge pull request #2 from databrickslabs/master
82c3ca0 Merge pull request #3 from databrickslabs/develop
b42116f Merge pull request #3 from databrickslabs/master
acbbeb0 Merge pull request #4 from databrickslabs/develop
4b59bc6 Merge pull request #4 from databrickslabs/master
e486c68 Merge pull request #5 from databrickslabs/master
c2714a4 Merge pull request #6 from databrickslabs/develop
524321c Merge pull request #7 from stikkireddy/private/hugo-docs
712a922 Merge pull request #8 from databrickslabs/github-workflows
b629b86 Update issue templates
9dd4863 Update issue templates with feedback template
752ea2d Updated documentation and added more sphinx docs for each resource and provider.
f92091f added a resource description
cfa660b added aws attributes doc to instance pool and added databricks job and notebook to documentation
a73b99b added cluster to the toc and added libaries to cluster docs
f5d1464 added clusters resource, notebook resource, notebook data source and notebook_paths data source
4ee4200 added dbfs datasource and resource objects for uploading files
6280e32 added dbfs file sync documentation and to the table of contents
ea5dbfe added doc issue
e6a7fc6 added documentation for db_dbfs_file resource and updated toc
c49cf30 added documentation for instance pools and fixed example for azure to use premium_lrs instead of ebs option
c1dd375 added feedback link directly into main page
55cd215 added go formatting
755327c added golangci-lint
dee5bdb added gotestsum
037c675 added id fields to cluster, dbfs_file, job and notebook. Also created new docs for instance profile and added to the toc
e547e93 added instance profile support, library support, commands support, mount support (s3 iam, adls gen1, adls gen2 and blob) added a few acceptance tests for TF and a Dockerfile.
36022ef added linting to the build target and fmt target
948f404 added logging and masking to the azure auth init component, updated provider to include useragent, updated makefile to include coverage for full tests, with integration. added bck files for gitignore. Added useragent to the dbfs file sync.
2bd262b added masking to secrets.go & notebooks create, removed version.go, and added fixed up the integration tests
50f83fa added more to the unit testing framework for the client to make stub webserver and assert logic for multiple requests in sequence for a method
1630d37 added notice to the artifact
2fc5e54 added publish dir into the config.toml for hugo
c37644d added relURL shortcodes into favicon and logo html files
e167467 added secrets masking for auditing the api calls into the logger. For now the logging functionality is very basic. Using the standard logger. Refactored client.go and moved it into service. Added custom error capability. Added AuthType (Basic & Token) and UserAgent as config options into DBApiClientConfig. Added auditing capabilities and masking capabilties for the audit to remove secrets using the struct tag mask:"true".
c1ce491 added singlehtmldocs for make file and better naming conventions for the downloads in the releases
320cdf2 added singlehtmldocs for make file and better naming conventions for the downloads in the releases
16719f0 added status badge, verbose testing and fixed cleanup in the hugo command
ae824d3 added support for jobs resource
7613305 added table of contents
c91b8f7 added templates to gitignore
fd14435 added the mounts to documentation. aws s3, adls gen 1, adls gen 2 and azure blob
1db3bda added windows as a possible os to goreleaser
a9f0e32 added workflows
9caf621 changed author to databricks labs
bb2baec changed binary name from version number to tag which will allow terraform provider to work appropriately
1a19d61 changed fetch for gotestsum via curl
627b8df changed godownloader-db-provider.sh's permissions to execute
44e5081 changed to fixed favicon path and logo path
cf9a21b consolidated issue templates
1ddfec5 created documentation for db_cluster resource
be8aaa5 disable deployment to gh-pages for now till opensource
0457302 emptied notebook test
f7c9005 enable docs for gh-pages
855a680 fixed godownloader script to remove the replace command
a2b668b fixed mounts string formatting when removing ls mounts, added todos for db_job and renamed new_cluster name to cluster_name. Also added provider version into the gorelease file
0c8b000 fixed nil value issue when readmethod gets invoked and docker image ptr is nil, if job email settings are nil api still sends back empty struct so if all values are reflected to "zero" set email notifications to nil in the TF state
20d14d6 fixed packaging template
f13841e fixed path and content links
c162e50 fixed relative path issue using shortcode for relURL for favicon and logo
a059e41 fixed test object and added linting to the test make command
f70185a fixed the go get command to fetch and removed the $
ea99640 fixed waitforterminating and waitforrunning methods to add return statements so additional requests are not made when the state machine hits a terminal state. Added unit test coverage for clusters.
3675481 formatted all the code, refactored all the resources to be databricks_ rather than db_
03b3def goreleaser and godownloader script to quickly install provider via curl statement
352e794 ignored website paths for go build when website links change, and added gh pages deployment when websites change
a400b87 initial commit from private repository
b006aa8 injected version into user agent and refactored config to be public and accessible outside of service package
880e800 kept lint and test separate commands
8807226 manually fetched gotestsum
15f17c5 migrated docs from sphinx to hugo static site with the learn theme. fixed goreleaser to push up artifacts, injected commit and date into the providers
bbb9797 moved images to img folder and replaced with relative paths
cf3792d moved mounts to the provider code base as it is not native to the client and requires calling the service.
9543320 notebook object id should be int64 and not int32
a6d6632 package full docs with html
dbbf8c9 publish to gh-pages branch and also removed the explicit publishDir
fdfe046 push generated website and fix env variables in docs and added docker installation docs
877da45 push goreleaser action
4a1572c pushing up terraform-plugin-sdk/helper/customdiff
93c319e refactoed based of golangci-lint
b8b2013 refactored User read around into a private method and public method to do additional components for a proper read for inherited roles. Added unit test coverage for users
05bac73 refactored and removed pointer receivers when not needed. Removed unused constants and replaced with strings. Terraform will not be using strict type checking. Applied formatting. Fully fleshed out support for scim users and groups with inheritance managed to avoid updates, and support for scim groups to have entitlements and roles.
d6ea5e4 refactored unit test coverage for secrets, scopes and acls
90cbd31 reformatted code after linting
17cface removed commented out code
986fe9c removed db from the file names
e1f6f16 removed newlines from readme
048323d removed some docs that are not relevant
03a909a removed the :ref: on sublists, and added the binary to gitignore and added db_job and db_notebook into the toc tree for the resource_index
7dbb2f3 removed the notebooks api call as that still has not been built
f930bb3 removed unneeded curly braces in cluster.md and job.md
09504f4 renamed darwin to macOS a name more people are familiar with
f298f5f separated snapshot hugo and sync
14db625 updaded status of the documentation for the databricks resource objects
7a877ad updated dependancies and fixed dependancies to point to databricks labs, and added quickstart tutorial to install the provider
3dad715 updated descriptions for all the issue templates
2eec3cc updated instructions for private repository
172d463 updated logo to the new logo
b5550b8 updated readme to include mounts
3d777be updated readme to include the latest status of the terraform resources and data sources.
1afe31a updated readme to reflect work done so far
1a33f42 updated the base url and regenerated the docs
764a87e updated to plugin 1.10, added acceptance tests for groups and users. Added support for default roles and a data source to fetch the default all_user roles via creating a dummy user. Changed environment variable to include databricks prefix and databricks_azure for the azure components. Restructured storage types to...