Google Cloud SQL Chef Cookbook

This cookbook provides the built-in types and services for Chef to manage Google Cloud Compute resources, as native Chef types.

Requirements

Platforms

Supported Operating Systems

This cookbook was tested on the following operating systems:

• RedHat 6, 7
• CentOS 6, 7
• Debian 7, 8
• Ubuntu 12.04, 14.04, 16.04, 16.10
• SLES 11-sp4, 12-sp2
• openSUSE 13
• Windows Server 2008 R2, 2012 R2, 2012 R2 Core, 2016 R2, 2016 R2 Core

Example

gauth_credential 'mycred' do
  action :serviceaccount
  path ENV['CRED_PATH'] # e.g. '/path/to/my_account.json'
  scopes [
    'https://www.googleapis.com/auth/sqlservice.admin'
  ]
end

gsql_instance  "sql-test-#{ENV['sql_instance_suffix']}" do
  action :create
  project 'google.com:graphite-playground'
  credential 'mycred'
end

gsql_database 'webstore' do
  action :create
  charset 'utf8'
  instance "sql-test-#{ENV['sql_instance_suffix']}"
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Credentials

All Google Cloud Platform cookbooks use an unified authentication mechanism, provided by the google-gauth cookbook. Don't worry, it is automatically installed when you install this module.

Example

gauth_credential 'mycred' do
  action :serviceaccount
  path ENV['CRED_PATH'] # e.g. '/path/to/my_account.json'
  scopes [
    'https://www.googleapis.com/auth/sqlservice.admin'
  ]
end

For complete details of the authentication cookbook, visit the google-gauth cookbook documentation.

Resources

• gsql_instance - Represents a Cloud SQL instance. Cloud SQL instances are SQL databases hosted in Google's cloud. The Instances resource provides methods for common configuration and management tasks.
• gsql_database - Represents a SQL database inside the Cloud SQL instance, hosted in Google's cloud.
• gsql_user - The Users resource represents a database user in a Cloud SQL instance.
• gsql_ssl_cert - Represents an SSL certificate created for a Cloud SQL instance. To use the SSL certificate you must have the SSL Client Certificate and the associated SSL Client Key. The Client Key can be downloaded only when the SSL certificate is created with the insert method.
• gsql_flag - Represents a flag that can be configured for a Cloud SQL instance.
• gsql_tier - The Tiers resource represents a service configuration that can be used to define a Cloud SQL instance. Each tier has an associated RAM, maximum storage, and list of regions in which the tier can be used. Available tiers vary depending on whether you use PostgreSQL, MySQL Second Generation, or MySQL First Generation instances.

gsql_instance

Represents a Cloud SQL instance. Cloud SQL instances are SQL databases hosted in Google's cloud. The Instances resource provides methods for common configuration and management tasks.

Example

gsql_instance "sql-test-#{ENV['sql_instance_suffix']}" do
  action :create
  database_version 'MYSQL_5_7'
  settings({
    tier: 'db-n1-standard-1',
    ip_configuration:  {
      authorized_networks: [
        # The ACL below is for example only. (do NOT use in production as-is)
        {
          name: 'google dns server',
          value: '8.8.8.8/32'
        }
      ]
    }
  })
  region 'us-central1'
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_instance 'id-for-resource' do
  backend_type          'FIRST_GEN', 'SECOND_GEN' or 'EXTERNAL'
  connection_name       string
  database_version      'MYSQL_5_5', 'MYSQL_5_6' or 'MYSQL_5_7'
  failover_replica      {
    available boolean,
    name      string,
  }
  instance_type         'CLOUD_SQL_INSTANCE', 'ON_PREMISES_INSTANCE' or 'READ_REPLICA_INSTANCE'
  ip_addresses          [
    {
      ip_address     string,
      time_to_retire time,
      type           'PRIMARY' or 'OUTGOING',
    },
    ...
  ]
  ipv6_address          string
  master_instance_name  string
  max_disk_size         integer
  name                  string
  region                string
  replica_configuration {
    failover_target               boolean,
    mysql_replica_configuration   {
      ca_certificate            string,
      client_certificate        string,
      client_key                string,
      connect_retry_interval    integer,
      dump_file_path            string,
      master_heartbeat_period   integer,
      password                  string,
      ssl_cipher                string,
      username                  string,
      verify_server_certificate boolean,
    },
    replica_names                 [
      string,
      ...
    ],
    service_account_email_address string,
  }
  settings              {
    ip_configuration {
      authorized_networks [
        {
          expiration_time time,
          name            string,
          value           string,
        },
        ...
      ],
      ipv4_enabled        boolean,
      require_ssl         boolean,
    },
    tier             string,
  }
  project               string
  credential            reference to gauth_credential
end

Actions

• create - Converges the gsql_instance resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_instance resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• backend_type -

  • FIRST_GEN: First Generation instance. MySQL only.
  • SECOND_GEN: Second Generation instance or PostgreSQL instance.
  • EXTERNAL: A database server that is not managed by Google.

• connection_name - Connection name of the Cloud SQL instance used in connection strings.

• database_version - The database engine type and version. For First Generation instances, can be MYSQL_5_5, or MYSQL_5_6. For Second Generation instances, can be MYSQL_5_6 or MYSQL_5_7. Defaults to MYSQL_5_6. The databaseVersion property can not be changed after instance creation.

• failover_replica - The name and status of the failover replica. This property is applicable only to Second Generation instances.

• failover_replica/available Output only. The availability status of the failover replica. A false status indicates that the failover replica is out of sync. The master can only failover to the falover replica when the status is true.

• failover_replica/name The name of the failover replica. If specified at instance creation, a failover replica is created for the instance. The name doesn't include the project ID. This property is applicable only to Second Generation instances.

• instance_type - The instance type. This can be one of the following.

  • CLOUD_SQL_INSTANCE: A Cloud SQL instance that is not replicating from a master.
  • ON_PREMISES_INSTANCE: An instance running on the customer's premises.
  • READ_REPLICA_INSTANCE: A Cloud SQL instance configured as a read-replica.

• ip_addresses - Output only. The assigned IP addresses for the instance.

• ip_addresses[]/ip_address The IP address assigned.

• ip_addresses[]/time_to_retire The due time for this IP to be retired in RFC 3339 format, for example 2012-11-15T16:19:00.094Z. This field is only available when the IP is scheduled to be retired.

• ip_addresses[]/type The type of this IP address. A PRIMARY address is an address that can accept incoming connections. An OUTGOING address is the source address of connections originating from the instance, if supported.

• ipv6_address - The IPv6 address assigned to the instance. This property is applicable only to First Generation instances.

• master_instance_name - The name of the instance which will act as master in the replication setup.

• max_disk_size - The maximum disk size of the instance in bytes.

• name - Required. Name of the Cloud SQL instance. This does not include the project ID.

• region - The geographical region. Defaults to us-central or us-central1 depending on the instance type (First Generation or Second Generation/PostgreSQL).

• replica_configuration - Configuration specific to failover replicas and read replicas.

• replica_configuration/failover_target Specifies if the replica is the failover target. If the field is set to true the replica will be designated as a failover replica. In case the master instance fails, the replica instance will be promoted as the new master instance. Only one replica can be specified as failover target, and the replica has to be in different zone with the master instance.

• replica_configuration/mysql_replica_configuration MySQL specific configuration when replicating from a MySQL on-premises master. Replication configuration information such as the username, password, certificates, and keys are not stored in the instance metadata. The configuration information is used only to set up the replication connection and is stored by MySQL in a file named master.info in the data directory.

• replica_configuration/mysql_replica_configuration/ca_certificate PEM representation of the trusted CA's x509 certificate.

• replica_configuration/mysql_replica_configuration/client_certificate PEM representation of the slave's x509 certificate

• replica_configuration/mysql_replica_configuration/client_key PEM representation of the slave's private key. The corresponsing public key is encoded in the client's asf asd certificate.

• replica_configuration/mysql_replica_configuration/connect_retry_interval Seconds to wait between connect retries. MySQL's default is 60 seconds.

• replica_configuration/mysql_replica_configuration/dump_file_path Path to a SQL dump file in Google Cloud Storage from which the slave instance is to be created. The URI is in the form gs://bucketName/fileName. Compressed gzip files (.gz) are also supported. Dumps should have the binlog co-ordinates from which replication should begin. This can be accomplished by setting --master-data to 1 when using mysqldump.

• replica_configuration/mysql_replica_configuration/master_heartbeat_period Interval in milliseconds between replication heartbeats.

• replica_configuration/mysql_replica_configuration/password The password for the replication connection.

• replica_configuration/mysql_replica_configuration/ssl_cipher A list of permissible ciphers to use for SSL encryption.

• replica_configuration/mysql_replica_configuration/username The username for the replication connection.

• replica_configuration/mysql_replica_configuration/verify_server_certificate Whether or not to check the master's Common Name value in the certificate that it sends during the SSL handshake.

• replica_configuration/replica_names The replicas of the instance.

• replica_configuration/service_account_email_address The service account email address assigned to the instance. This property is applicable only to Second Generation instances.

• settings - The user settings.

• settings/ip_configuration The settings for IP Management. This allows to enable or disable the instance IP and manage which external networks can connect to the instance. The IPv4 address cannot be disabled for Second Generation instances.

• settings/ip_configuration/ipv4_enabled Whether the instance should be assigned an IP address or not.

• settings/ip_configuration/authorized_networks The list of external networks that are allowed to connect to the instance using the IP. In CIDR notation, also known as 'slash' notation (e.g. 192.168.100.0/24).

• settings/ip_configuration/authorized_networks[]/expiration_time The time when this access control entry expires in RFC 3339 format, for example 2012-11-15T16:19:00.094Z.

• settings/ip_configuration/authorized_networks[]/name An optional label to identify this entry.

• settings/ip_configuration/authorized_networks[]/value The whitelisted value for the access control list. For example, to grant access to a client from an external IP (IPv4 or IPv6) address or subnet, use that address or subnet here.

• settings/ip_configuration/require_ssl Whether the mysqld should default to 'REQUIRE X509' for users connecting over IP.

• settings/tier The tier or machine type for this instance, for example db-n1-standard-1. For MySQL instances, this field determines whether the instance is Second Generation (recommended) or First Generation.

Label

Set the i_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"

gsql_database

Represents a SQL database inside the Cloud SQL instance, hosted in Google's cloud.

Example

# Tip: Remember to define gsql_instance to match the 'instance' property.
gsql_database 'webstore' do
  action :create
  charset 'utf8'
  instance "sql-test-#{ENV['sql_instance_suffix']}"
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_database 'id-for-resource' do
  charset    string
  collation  string
  instance   reference to gsql_instance
  name       string
  project    string
  credential reference to gauth_credential
end

Actions

• create - Converges the gsql_database resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_database resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• charset - The MySQL charset value.

• collation - The MySQL collation value.

• name - The name of the database in the Cloud SQL instance. This does not include the project ID or instance name.

• instance - Required. A reference to Instance resource

Label

Set the d_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"

gsql_user

The Users resource represents a database user in a Cloud SQL instance.

Example

# Tip: Remember to define gsql_instance to match the 'instance' property.
gsql_user 'john.doe' do
  action :create
  password 'secret-password'
  host '10.1.2.3'
  instance "sql-test-#{ENV['sql_instance_suffix']}"
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_user 'id-for-resource' do
  host       string
  instance   reference to gsql_instance
  name       string
  password   string
  project    string
  credential reference to gauth_credential
end

Actions

• create - Converges the gsql_user resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_user resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• host - Required. The host name from which the user can connect. For insert operations, host defaults to an empty string. For update operations, host is specified as part of the request URL. The host name cannot be updated after insertion.

• name - Required. The name of the user in the Cloud SQL instance.

• instance - Required. A reference to Instance resource

• password - The password for the user.

Label

Set the u_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"

gsql_ssl_cert

Represents an SSL certificate created for a Cloud SQL instance. To use the SSL certificate you must have the SSL Client Certificate and the associated SSL Client Key. The Client Key can be downloaded only when the SSL certificate is created with the insert method.

Example

# Tip: Remember to define gsql_instance to match the 'instance' property.
gsql_ssl_cert 'server-certificate' do
  cert_serial_number '729335786'
  common_name 'CN=www.mydb.com,O=Acme'
  sha1_fingerprint '8fc295bf77a002db5182e04d92c48258cbc1117a'
  instance "sql-test-#{ENV['sql_instance_suffix']}"
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_ssl_cert 'id-for-resource' do
  cert               string
  cert_serial_number string
  common_name        string
  create_time        time
  expiration_time    time
  instance           reference to gsql_instance
  sha1_fingerprint   string
  project            string
  credential         reference to gauth_credential
end

Actions

• create - Converges the gsql_ssl_cert resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_ssl_cert resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• cert - PEM representation of the X.509 certificate.

• cert_serial_number - Serial number, as extracted from the certificate.

• common_name - User supplied name. Constrained to [a-zA-Z.-_ ]+.

• create_time - The time when the certificate was created in RFC 3339 format, for example 2012-11-15T16:19:00.094Z.

• expiration_time - The time when the certificate expires in RFC 3339 format, for example 2012-11-15T16:19:00.094Z.

• instance - Required. A reference to Instance resource

• sha1_fingerprint - Required. The SHA-1 of the certificate.

Label

Set the sc_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"

gsql_flag

Represents a flag that can be configured for a Cloud SQL instance.

Example

gsql_flag 'group_concat_max_len' do
  min_value 4
  max_value 4294967295
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_flag 'id-for-resource' do
  allowed_string_values [
    string,
    ...
  ]
  applies_to            [
    string,
    ...
  ]
  max_value             integer
  min_value             integer
  name                  string
  requires_restart      boolean
  type                  string
  project               string
  credential            reference to gauth_credential
end

Actions

• create - Converges the gsql_flag resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_flag resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• allowed_string_values - Output only. For STRING flags, List of strings that the value can be set to.

• applies_to - Output only. The database versions this flag is supported for.

• max_value - Output only. For INTEGER flags, the maximum allowed value.

• min_value - Output only. For INTEGER flags, the minimum allowed value.

• name - This is the name of the flag. Flag names always use underscores, not hyphens, e.g. max_allowed_packet

• requires_restart - Output only. Indicates whether changing this flag will trigger a database restart. Only applicable to Second Generation instances.

• type - Output only. The type of the flag. Flags are typed to being BOOLEAN, STRING, INTEGER or NONE. NONE is used for flags which do not take a value, such as skip_grant_tables.

Label

Set the f_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"

gsql_tier

The Tiers resource represents a service configuration that can be used to define a Cloud SQL instance. Each tier has an associated RAM, maximum storage, and list of regions in which the tier can be used. Available tiers vary depending on whether you use PostgreSQL, MySQL Second Generation, or MySQL First Generation instances.

Example

gsql_tier 'D0' do
  ram 134217728 # we'll confirm that tier has enough RAM for us
  project 'google.com:graphite-playground'
  credential 'mycred'
end

Reference

gsql_tier 'id-for-resource' do
  disk_quota integer
  ram        integer
  region     [
    string,
    ...
  ]
  tier       string
  project    string
  credential reference to gauth_credential
end

Actions

• create - Converges the gsql_tier resource into the final state described within the block. If the resource does not exist, Chef will attempt to create it.
• delete - Ensures the gsql_tier resource is not present. If the resource already exists Chef will attempt to delete it.

Properties

• disk_quota - Output only. The maximum disk size of this tier in bytes.

• ram - Output only. The maximum RAM usage of this tier in bytes.

• region - Output only. The applicable regions for this tier.

• tier - Required. An identifier for the service tier or machine type, for example, db-n1-standard-1. For related information.

Label

Set the t_label property when attempting to set primary key of this object. The primary key will always be referred to by the initials of the resource followed by "_label"