graylog cookbook

This cookbook sets up Graylog2, version >= 0.20.x (not the old rails graylog2).

Including the following support services:

• Elasticsearch
• MongoDB

Quickstart

To quickly setup a working Graylog2 installation on a single node, do the following:

1. Setup application secrets

This is required, as it would leave your Graylog2 installation insecure. Therefore the cookbook
will fail with an error message if you do not set them!

  # Set this to a random string, generated e.g. with "pwgen 96"
  node['graylog']['server']['graylog2.conf']['password_secret'] = 'CHANGE ME!'

  # Generate with "echo -n yourpassword | shasum -a 256"
  node['graylog']['server']['graylog2.conf']['root_password_sha2'] = '...'

  # This also should be a random string, generated e.g. with "pwgen 96"
  node['graylog']['web_interface']['graylog2-web-interface.conf']['application.secret'] = 'CHANGE ME!'

1. Add default recipe to your run_list

  {
    "run_list": [
      "recipe[graylog::default]"
    ]
  }

Supported Platforms

Currently tested on Ubuntu-14.04 LTS.

Dependencies

• Chef >= 0.11
• MongoDB cookbook
• Ark cookbook
• Apt cookbook

Notes

Please do not expose the Graylog2 service directly in production. Instead, you
should use a reverse proxy (e.g. nginx).
This also adds the capability to use SSL to secure your logins.

You can easily setup nginx using the official nginx cookbook.
Here's an example nginx site configuration you can use:

# Upstream to Graylog frontend
proxy_next_upstream error timeout;
upstream graylog2_web_interface {
    server localhost:9000 fail_timeout=0;
}

# Redirect everything to https
server {
    listen 80;

    return 301 https://graylog.example.com$request_uri;
}

server {
    listen 443 ssl;

    # SSL certificate
    ssl_certificate /etc/nginx/certs/graylog.example.com.crt;
    ssl_certificate_key /etc/nginx/certs/graylog.example.com.key;

    location / {
        root /usr/share/nginx/html;

        proxy_pass_header Date;
        proxy_set_header X-Real-IP $remote_addr;
        proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        proxy_set_header Host $http_host:$server_port;
        proxy_redirect off;
        proxy_set_header X_FORWARDED_PROTO $scheme;

        chunked_transfer_encoding off;

        proxy_pass http://graylog2_web_interface;
    }
}

Attributes

graylog2 server

Attributes to adjust installation details (defaults should "just work")

# Graylog2 version to install (check http://graylog2.org/download for current version)
node['graylog']['server']['version'] = '0.20.3'

# User graylog2 runs as (will be created)
node['graylog']['server']['user'] = 'graylog2'

# URL to graylog2 tar.gz package (Github is the default)
node['graylog']['server']['url'] = 'https://example.com/graylog.tar.gz'

Attributes to configure Graylog2.
The password_secret and root_password_sha2 attributes NEED to be changed!

# You MUST set a secret to secure/pepper the stored user passwords here. Use at least 64 characters.
# Generate one by using for example: pwgen -s 96
node['graylog']['server']['graylog2.conf']['password_secret'] = 'CHANGE ME!'

# the default root user is named 'admin'
# You MUST specify a hash password for the root user (which you only need to initially set up the
# system and in case you lose connectivity to your authentication backend)
# This password cannot be changed using the API or via the web interface.
# Create one by using for example: "echo -n yourpassword | shasum -a 256"
#
# For testing purposes (only!) you can use the password "insecure" with the following hash
node['graylog']['server']['graylog2.conf']['root_password_sha2'] = '1d92dae504a70fbcae6d3721a55d7eacaf94d3133ea5f0394b7d203d64841110'

This recipe disables multicast to learn about Elasticsearch. This is recommended for production.

# The default unicast host used and configured by this recipe is automatically retrieved from the Elasticsearch attributes
# (See below, node['graylog']['elasticsearch']['host'] and node['graylog']['elasticsearch']['port'])
node['graylog']['server']['graylog2.conf']['elasticsearch_discovery_zen_ping_multicast_enabled'] = false
node['graylog']['server']['graylog2.conf']['elasticsearch_discovery_zen_ping_unicast_hosts'] = '127.0.0.1:1234'

The cookbook accepts every possible configuration option supported by graylog2.conf:

node['graylog']['server']['graylog2.conf']['key'] = 'value'

Web-Interface

Attributes to adjust installation details (defaults should "just work")

# Graylog2 web-interface version to install (check http://graylog2.org/download for current version)
node['graylog']['web_interface']['version'] = '0.20.3'

# User graylog2 runs as (will be created)
node['graylog']['web_interface']['user'] = 'graylog2'

# URL to graylog2 tar.gz package (Github is the default)
node['graylog']['web_interface']['url'] = 'https://example.com/webinterface.tar.gz'

Configure application secret. You NEED to change this, otherwise your installation will be insecure!

# If you deploy your application to several instances be sure to use the same key!
# Generate for example with: pwgen -s 96
node['graylog']['web_interface']['graylog2-web-interface.conf']['application.secret'] = 'CHANGE ME!'

Configure timezone

node['graylog']['web_interface']['graylog2-web-interface.conf']['timezone'] = 'Europe/Berlin'

The cookbook accepts every possible configuration option supported by graylog2-web-interface.conf:

node['graylog']['web_interface']['graylog2-web-interface.conf']['key'] = 'value'

Elasticsearch

The elasticsearch recipe installs Elasticsearch using the official PPA repository.
You can finetune the installation here, although the defaults should "just work".

The settings below are the defaults

# Elasticsearch version to use. Currently 0.90.x and 1.0.x versions are available
# See: http://www.elasticsearch.org/blog/apt-and-yum-repositories/
node['graylog']['elasticsearch']['version'] = '0.90'

# Assign half of the systems memory to elasticsearch heap (recommended setting)
# See: http://support.torch.sh/help/kb/graylog2-server/configuring-and-tuning-elasticsearch-for-graylog2-v0200
node['graylog']['elasticsearch']['heap_size'] = "#{(node['memory']['total'].to_i / 1024 / 2).to_i}m"
node['graylog']['elasticsearch']['cluster_name'] = 'graylog2'

# Elasticsearch ip:port to use
node['graylog']['elasticsearch']['host'] = '127.0.0.1'
node['graylog']['elasticsearch']['port'] = 9300

MongoDB

The default recipe installs MongoDB, using the MongoDB cookbook.

As MongoDB is only used to store small amounts of data, it's usually sufficient to use a small data partition. Therefore, smallfile is enabled by default.
You can override the setting if needed, like so

node['mongodb']['config']['smallfiles'] = false

Recipes

graylog::default

Installs and configures Elasticsearch, MongoDB, Graylog2 server and The Graylog2 web-interface.

graylog::elasticsearch

Installs Elasticsearch from the official PPA, and configures it for Graylog2 use.

graylog::server

Installs and configures Graylog2 server.

graylog::web_interface

Installs and configures Graylog2 web-interface.

Contributing

1. Fork the repository on Github
2. Create a named feature branch (i.e. add-new-recipe)
3. Write your change
4. Write tests for your change (if applicable)
5. Run the tests, ensuring they all pass
6. Submit a Pull Request

License and Authors

Author:: Chris Aumann (me@chr4.org)