Configure provider client

15min
|
Terraform

In this tutorial, you will configure the HashiCups API client via Terraform provider configuration or environment variables. A configured client will then be available for any data source or resource to use. To do this, you will:

Define the provider schema.
This prepares the provider to accept Terraform configuration for client authentication and host information.
Define the provider data model.
This models the provider schema as a Go type so the data is accessible for other Go code.
Define the provider configure method.
This reads the Terraform configuration using the data model or checks environment variables if data is missing from the configuration. It raises errors if any necessary client configuration is missing. The configured client is then created and made available for data sources and resources.
Verify configuration behaviors.
This ensures the expected provider configuration behaviors.

Prerequisites

To follow this tutorial, you need:

Go 1.21+ installed and configured.
Terraform v1.8+ installed locally.
Docker and Docker Compose to run an instance of HashiCups locally.

Navigate to your terraform-provider-hashicups directory.

Your code should match the 01-provider directory from the example repository.

If you haven't already done so, clone the Terraform HashiCups Provider repository.

$ git clone https://github.com/hashicorp/terraform-provider-hashicups

Change into the 01-provider directory of cloned repository.

$ cd terraform-provider-hashicups/01-provider

Then, install all the provider's dependencies.

$ go mod tidy

Build the provider

Terraform installs providers and verifies their versions and checksums when you run terraform init. Terraform will download your providers from either the provider registry or a local registry. However, while building your provider you will want to test Terraform configuration against a local development build of the provider. The development build will not have an associated version number or an official set of checksums listed in a provider registry.

Terraform allows you to use local provider builds by setting a dev_overrides block in a configuration file called .terraformrc. This block overrides all other configured installation methods.

Terraform searches for the .terraformrc file in your home directory and applies any configuration settings you set.

First, find the GOBIN path where Go installs your binaries. Your path may vary depending on how your Go environment variables are configured.

$ go env GOBIN/Users/<Username>/go/bin

If the GOBIN go environment variable is not set, use the default path, /Users/<Username>/go/bin.

Create a new file called .terraformrc in the root directory (~), then add the dev_overrides block below. Change the <PATH> to the value returned from the echo $GOBIN command above.

provider_installation {   dev_overrides {      "hashicorp.com/edu/hashicups" = "<PATH>"  }   # For all other providers, install them directly from their origin provider  # registries as normal. If you omit this, Terraform will _only_ use  # the dev_overrides block, and so no other providers will be available.  direct {}}

You must create your CLI configuration file in your user %APPDATA% root directory. The physical location of this directory depends on your Windows version and system configuration.

Search for the user environment variables in PowerShell to find its location on your system.

$ $env:APPDATA

In another terminal, change into the directory returned from the command above.

Find the GOBIN path where go installs your binaries. Your path may vary depending on how your Go environment variables are configured.

$ go env GOBIN/Users/<Username>/go/bin

If the GOBIN go environment variable is not set, use the default path, /Users/<Username>/go/bin.

Create a new file called terraform.rc and add the dev_overrides block below. Change the <PATH> to the value returned from the go env GOBIN command above.

provider_installation {   dev_overrides {      "hashicorp.com/edu/hashicups" = "<PATH>"      }   # For all other providers, install them directly from their origin provider  # registries as normal. If you omit this, Terraform will _only_ use  # the dev_overrides block, and so no other providers will be available.  direct {}}

Implement provider schema

The Plugin Framework uses a provider's Schema method to define the acceptable configuration attribute names and types. The HashiCups client needs a host, username, and password to be properly configured. The Terraform Plugin Framework types package contains schema and data model types that can work with Terraform's null, unknown, or known values.

Open the internal/provider/provider.go file.

Replace your Schema method with the following.

// Schema defines the provider-level schema for configuration data.func (p *hashicupsProvider) Schema(_ context.Context, _ provider.SchemaRequest, resp *provider.SchemaResponse) {    resp.Schema = schema.Schema{        Attributes: map[string]schema.Attribute{            "host": schema.StringAttribute{                Optional: true,            },            "username": schema.StringAttribute{                Optional: true,            },            "password": schema.StringAttribute{                Optional:  true,                Sensitive: true,            },        },    }}

Implement provider data model

The Terraform Plugin Framework uses Go struct types with tfsdk struct field tags to map schema definitions into Go types with the actual data. The types within the struct must align with the types in the schema.

Add your provider data model type definition to internal/provider/provider.go with the following.

// hashicupsProviderModel maps provider schema data to a Go type.type hashicupsProviderModel struct {    Host     types.String `tfsdk:"host"`    Username types.String `tfsdk:"username"`    Password types.String `tfsdk:"password"`}

Implement client configuration functionality

The provider uses the Configure method to read API client configuration values from the Terraform configuration or environment variables. After verifying the values should be acceptable, the API client is created and made available for data source and resource usage.

The configure method follows these steps:

Retrieves values from the configuration. The method will attempt to retrieve values from the provider configuration and convert it to an providerModel struct.
Checks for unknown configuration values. The method prevents an unexpectedly misconfigured client, if Terraform configuration values are only known after another resource is applied.
Retrieves values from environment variables. The method retrieves values from environment variables, then overrides them with any set Terraform configuration values.
Creates API client. The method invokes the HashiCups API client's NewClient function.
Stores configured client for data source and resource usage. The method sets the DataSourceData and ResourceData fields of the response, so the client is available for usage by data source and resource implementations.

Replace your Configure method in internal/provider/provider.go with the following.

func (p *hashicupsProvider) Configure(ctx context.Context, req provider.ConfigureRequest, resp *provider.ConfigureResponse) {    // Retrieve provider data from configuration    var config hashicupsProviderModel    diags := req.Config.Get(ctx, &config)    resp.Diagnostics.Append(diags...)    if resp.Diagnostics.HasError() {        return    }     // If practitioner provided a configuration value for any of the    // attributes, it must be a known value.     if config.Host.IsUnknown() {        resp.Diagnostics.AddAttributeError(            path.Root("host"),            "Unknown HashiCups API Host",            "The provider cannot create the HashiCups API client as there is an unknown configuration value for the HashiCups API host. "+                "Either target apply the source of the value first, set the value statically in the configuration, or use the HASHICUPS_HOST environment variable.",        )    }     if config.Username.IsUnknown() {        resp.Diagnostics.AddAttributeError(            path.Root("username"),            "Unknown HashiCups API Username",            "The provider cannot create the HashiCups API client as there is an unknown configuration value for the HashiCups API username. "+                "Either target apply the source of the value first, set the value statically in the configuration, or use the HASHICUPS_USERNAME environment variable.",        )    }     if config.Password.IsUnknown() {        resp.Diagnostics.AddAttributeError(            path.Root("password"),            "Unknown HashiCups API Password",            "The provider cannot create the HashiCups API client as there is an unknown configuration value for the HashiCups API password. "+                "Either target apply the source of the value first, set the value statically in the configuration, or use the HASHICUPS_PASSWORD environment variable.",        )    }     if resp.Diagnostics.HasError() {        return    }     // Default values to environment variables, but override    // with Terraform configuration value if set.     host := os.Getenv("HASHICUPS_HOST")    username := os.Getenv("HASHICUPS_USERNAME")    password := os.Getenv("HASHICUPS_PASSWORD")     if !config.Host.IsNull() {        host = config.Host.ValueString()    }     if !config.Username.IsNull() {        username = config.Username.ValueString()    }     if !config.Password.IsNull() {        password = config.Password.ValueString()    }     // If any of the expected configurations are missing, return    // errors with provider-specific guidance.     if host == "" {        resp.Diagnostics.AddAttributeError(            path.Root("host"),            "Missing HashiCups API Host",            "The provider cannot create the HashiCups API client as there is a missing or empty value for the HashiCups API host. "+                "Set the host value in the configuration or use the HASHICUPS_HOST environment variable. "+                "If either is already set, ensure the value is not empty.",        )    }     if username == "" {        resp.Diagnostics.AddAttributeError(            path.Root("username"),            "Missing HashiCups API Username",            "The provider cannot create the HashiCups API client as there is a missing or empty value for the HashiCups API username. "+                "Set the username value in the configuration or use the HASHICUPS_USERNAME environment variable. "+                "If either is already set, ensure the value is not empty.",        )    }     if password == "" {        resp.Diagnostics.AddAttributeError(            path.Root("password"),            "Missing HashiCups API Password",            "The provider cannot create the HashiCups API client as there is a missing or empty value for the HashiCups API password. "+                "Set the password value in the configuration or use the HASHICUPS_PASSWORD environment variable. "+                "If either is already set, ensure the value is not empty.",        )    }     if resp.Diagnostics.HasError() {        return    }     // Create a new HashiCups client using the configuration values    client, err := hashicups.NewClient(&host, &username, &password)    if err != nil {        resp.Diagnostics.AddError(            "Unable to Create HashiCups API Client",            "An unexpected error occurred when creating the HashiCups API client. "+                "If the error is not clear, please contact the provider developers.\n\n"+                "HashiCups Client Error: "+err.Error(),        )        return    }     // Make the HashiCups client available during DataSource and Resource    // type Configure methods.    resp.DataSourceData = client    resp.ResourceData = client}

Replace the import statement at the top of the provider/provider.go file with the following.

import (  "context"  "os"   "github.com/hashicorp-demoapp/hashicups-client-go"  "github.com/hashicorp/terraform-plugin-framework/datasource"  "github.com/hashicorp/terraform-plugin-framework/path"  "github.com/hashicorp/terraform-plugin-framework/provider"  "github.com/hashicorp/terraform-plugin-framework/provider/schema"  "github.com/hashicorp/terraform-plugin-framework/resource"  "github.com/hashicorp/terraform-plugin-framework/types")

Download the new HashiCups client dependency.

$ go get github.com/hashicorp-demoapp/hashicups-client-go@v0.1.0go: downloading github.com/hashicorp-demoapp/hashicups-client-go v0.1.0go: added github.com/hashicorp-demoapp/hashicups-client-go v0.1.0

Ensure all dependencies are correctly updated.

$ go mod tidy

Build and install the updated provider.

$ go install .

Start HashiCups locally

Your HashiCups provider requires a running instance of HashiCups.

In another terminal window, navigate to the docker_compose directory.

$ cd docker_compose

Run docker-compose up to spin up a local instance of HashiCups on port 19090.

$ docker-compose up

Leave this process running in your terminal window. The HashiCups service will print out log messages in this terminal.

In the original terminal window, verify that HashiCups is running by sending a request to its health check endpoint. The HashiCups service will respond with ok.

$ curl localhost:19090/health/readyzok

Create a HashiCups user

HashiCups requires a username and password to generate a JSON web token (JWT) which is used to authenticate against protected endpoints. You will use this user to authenticate to the HashiCups provider to manage your orders.

Create a user on HashiCups named education with the password test123.

$ curl -X POST localhost:19090/signup -d '{"username":"education", "password":"test123"}'{"UserID":1,"Username":"education","token":"eyJhbGciOiJIUzI1NiIsInR5cCI6IkpXVCJ9.eyJleHAiOjE1OTEwNzgwODUsInVzZXJfaWQiOjIsInVzZXJuYW1lIjoiZWR1Y2F0aW9uIn0.CguceCNILKdjOQ7Gx0u4UAMlOTaH3Dw-fsll2iXDrYU"}

Set the HASHICUPS_TOKEN environment variable to the token you retrieved from invoking the /signup endpoint. You will use this in later tutorials.

$ export HASHICUPS_TOKEN=ey...

The terminal containing your HashiCups logs will record the sign up operation.

api_1  | 2020-12-10T09:19:50.601Z [INFO]  Handle User | signup

Now that the HashiCups app is running, you are ready to start verifying the Terraform provider configuration behaviors.

Implement temporary data source

Provider configuration only occurs if there is a valid data source or resource supported by the provider and used in a Terraform configuration. For now, create a temporary data source implementation so you can verify the provider configuration behaviors. Later tutorials will guide you through the concepts and implementation details of real data sources and resources.

Add the temporary data source by creating a file named internal/provider/coffees_data_source.go with the following.

package provider import (    "context"     "github.com/hashicorp/terraform-plugin-framework/datasource"    "github.com/hashicorp/terraform-plugin-framework/datasource/schema") func NewCoffeesDataSource() datasource.DataSource {    return &coffeesDataSource{}} type coffeesDataSource struct{} func (d *coffeesDataSource) Metadata(_ context.Context, req datasource.MetadataRequest, resp *datasource.MetadataResponse) {    resp.TypeName = req.ProviderTypeName + "_coffees"} func (d *coffeesDataSource) Schema(_ context.Context, _ datasource.SchemaRequest, resp *datasource.SchemaResponse) {    resp.Schema = schema.Schema{}} func (d *coffeesDataSource) Read(ctx context.Context, req datasource.ReadRequest, resp *datasource.ReadResponse) {}

Open the internal/provider/provider.go file.

Add the temporary data source to your provider by replacing the DataSources method with the following.

// DataSources defines the data sources implemented in the provider.func (p *hashicupsProvider) DataSources(_ context.Context) []func() datasource.DataSource {    return []func() datasource.DataSource {        NewCoffeesDataSource,    }}

Build and install the updated provider from within your terraform-provider-hashicups directory.

$ go install .

Verify provider configuration

Navigate to the examples/provider-install-verification directory.

$ cd examples/provider-install-verification

The main.tf Terraform configuration file in this directory has no provider configuration values in the Terraform configuration.

terraform {  required_providers {    hashicups = {      source = "hashicorp.com/edu/hashicups"    }  }} provider "hashicups" {} data "hashicups_coffees" "example" {}

Run a Terraform plan with missing provider configuration. Terraform will report errors for the missing provider configuration values.

$ terraform plan##...╷│ Error: Missing HashiCups API Host│ │   with provider["hashicorp.com/edu/hashicups"],│   on main.tf line 9, in provider "hashicups":│    9: provider "hashicups" {}│ │ The provider cannot create the HashiCups API client as there is a missing or│ empty value for the HashiCups API host. Set the host value in the│ configuration or use the HASHICUPS_HOST environment variable. If either is│ already set, ensure the value is not empty.╵╷│ Error: Missing HashiCups API Username│ │   with provider["hashicorp.com/edu/hashicups"],│   on main.tf line 9, in provider "hashicups":│    9: provider "hashicups" {}│ │ The provider cannot create the HashiCups API client as there is a missing or│ empty value for the HashiCups API username. Set the username value in the│ configuration or use the HASHICUPS_USERNAME environment variable. If either│ is already set, ensure the value is not empty.╵╷│ Error: Missing HashiCups API Password│ │   with provider["hashicorp.com/edu/hashicups"],│   on main.tf line 9, in provider "hashicups":│    9: provider "hashicups" {}│ │ The provider cannot create the HashiCups API client as there is a missing or│ empty value for the HashiCups API password. Set the password value in the│ configuration or use the HASHICUPS_PASSWORD environment variable. If either│ is already set, ensure the value is not empty.╵

The provider configuration method you added earlier in this tutorial loads configuration data either from environment variables, or from the provider block in Terraform configuration. Verify the environment variable behavior by setting the provider-defined HASHICUPS_HOST, HASHICUPS_USERNAME, and HASHICUPS_PASSWORD environment variables when executing a Terraform plan. Terraform will configure the HashiCups client via these environment variables.

Run a Terraform plan with environment variables.

$ HASHICUPS_HOST=http://localhost:19090 \  HASHICUPS_USERNAME=education \  HASHICUPS_PASSWORD=test123 \  terraform plan

Terraform will report that it is able to read from the hashicups_coffees.example data source and that the configuration does not include any changes to your infrastructure.

## ...data.hashicups_coffees.example: Reading...data.hashicups_coffees.example: Read complete after 0sNo changes. Your infrastructure matches the configuration.Terraform has compared your real infrastructure against your configuration andfound no differences, so no changes are needed.

The terminal containing your HashiCups logs will record the sign in operation.

api_1  | 2020-12-10T09:19:50.601Z [INFO]  Handle User | signin

Verify the Terraform configuration behavior by setting the provider schema-defined host, username, and password values in a Terraform configuration.

Create an examples/coffees directory and navigate to it.

$ mkdir ../coffees && cd "$_"

Create a main.tf Terraform configuration file in this directory that sets provider configuration values in the Terraform configuration.

terraform {  required_providers {    hashicups = {      source = "hashicorp.com/edu/hashicups"    }  }} provider "hashicups" {  host     = "http://localhost:19090"  username = "education"  password = "test123"} data "hashicups_coffees" "edu" {}

Run a Terraform plan. Terraform will authenticate with your HashiCups instance using the values from the provider block and once again report that it is able to read from the hashicups_coffees.example data source.

$ terraform plan##...data.hashicups_coffees.edu: Reading...data.hashicups_coffees.edu: Read complete after 0s##...

Navigate to the terraform-provider-hashicups directory.

$ cd ../..

Remove temporary data source

Before you move on to the next tutorial, remove the code for the temporary data source.

Remove the internal/provider/coffees_data_source.go file.

$ rm internal/provider/coffees_data_source.go

Open the internal/provider/provider.go file.

Remove the data source from your provider's schema by replacing the DataSources method with the following.

// DataSources defines the data sources implemented in the provider.func (p *hashicupsProvider) DataSources(_ context.Context) []func() datasource.DataSource {    return nil}

Build and install the updated provider.

$ go install .

Next steps

Congratulations! You have prepared the provider to communicate with an API client. Later tutorials will show you how to implement data source and resource functionality.

If you were stuck during this tutorial, checkout the 02-provider-configure directory in the example repository to see the code implemented in this tutorial.

To learn more about the Terraform Plugin Framework, refer to the Terraform Plugin Framework documentation.
For a full capability comparison between the SDKv2 and the Plugin Framework, refer to the Which SDK Should I Use? documentation.
The example repository contains directories corresponding to each tutorial in this collection.
Submit any Terraform Plugin Framework bug reports or feature requests to the development team in the Terraform Plugin Framework Github repository.
Submit any Terraform Plugin Framework questions in the Terraform Plugin Framework Discuss forum.

Introduction

Data sources