How to enable COS Alert Rules

This guide will show how to set up Pushover to receive alert notifications from the COS Alert Manager with Awesome Alert Rules.

Charmed MySQL K8s ships a pre-configured and pre-enabled list of Awesome Alert Rules.

Screenshot of alert rules in the Grafana web interface

For information about accessing and managing COS Alert Rules, refer to the COS documentation.

Prerequisites

• A deployed Charmed MySQL K8s operator
• A deployed cos-lite bundle in a Kubernetes environment
• Fully configured COS Monitoring

Enable COS alerts for Pushover

The following section is an example of the Pushover alerts aggregator.

The first step is to create a new account on Pushover (or use an existing one). The goal is to have the ‘user key’ and ‘token’ to authorize alerts for the Pushover application. Follow this straightforward Pushover guide.

Next, create a new COS Alert Manager config (replace user_key and token with yours):

cat > myalert.yaml << EOF

global:
  resolve_timeout: 5m
  http_config:
    follow_redirects: true
    enable_http2: true
route:
  receiver: placeholder
  group_by:
  - juju_model_uuid
  - juju_application
  - juju_model
  continue: false
  group_wait: 30s
  group_interval: 5m
  repeat_interval: 1h
receivers:
- name: placeholder
  pushover_configs:
    - user_key: <relace_with_your_user_key>
      token: <relace_with_your_token>
      url: http://<relace_with_grafana_public_ip>/cos-grafana/alerting/list
      title: "{{ range .Alerts }}{{ .Labels.severity }} - {{ if .Labels.juju_unit }}{{ .Labels.juju_unit }}{{ else }}{{ .Labels.juju_application }}{{ end }} in model {{ .Labels.juju_model }}: {{ .Labels.alertname }} {{ end }}"
      message: "{{ range .Alerts }} Job: {{ .Labels.job }} Instance: {{ .Labels.instance }} {{ end }}"
templates: []
EOF

Upload and apply newly the created alert manager config:

juju switch <k8s_cos_controller>:<cos_model_name>
juju config alertmanager config_file=@myalert.yaml

At this stage, the COS Alert Manager will start sending alert notifications to Pushover. Users can receive them on all supported Pushover clients/apps.

The image below shows an example of the Pushover web client:

Alert receivers

The similar way as above, COS alerts can be send to the long list of supported receivers.

Do you have questions? Contact us!