Skip to main content
Version: 0.36

Kibana logging on Astronomer Software

All Airflow logs from your Astronomer logs will flow to Elasticsearch and can be visualized on Kibana. Like Grafana, this view is only available to system admins.

Setup​

  1. Open a browser and go to kibana.BASEDOMAIN.

  2. Click Menu in the upper left, click Stack Management, and then click Index Patterns.

  3. In the Name field enter fluentd.* or enter vector.* if using sidecar logging, and then click Create index pattern.

    Elasticsearch uses index patterns to organize how you explore data. Setting fluentd.*, or vector.* if using sidecar logging, as the index means that Kibana displays all logs from all deployments.

  4. Enter @timestamp as the Time Filter.

Discover​

After the index pattern is confirmed, the Discover tab displays logs as they become available.

Elastic Add Fields screen

From this view, you can add filters to see logs as they come in from all Airflow deployments. You can also add field filters.

Dashboards​

Custom dashboards can be created in the Dashboard view.

Was this page helpful?