Microsoft Azure Stream Analytics is a cloud-based event processing platform that allows to analyze and transform large volumes of events from different sources in real-time.


This step-by-step guide explains how to setup and monitor Azure Stream Analytics using CloudMonix.




In this article


1. Monitoring setup

2. Collect, understand and use your data

    2.1 Metrics

    2.2 Alerts

    2.3 Actions

3. Setup verification and troubleshooting



Did you know?

CloudMonix extends native Azure Stream Analytics monitoring with advanced metrics and features. Noteworthy:

  • CloudMonix receives data from the Azure Management API and Azure Monitor API
  • pre-configured metrics: data ingress per minute, data conversion errors per minute, runtime errors per minute, input events per minute, late input events per minute, out-of-order events per minute, output events per minute, function events per minute, failed function requests per minute, function requests per minute, state of ASA job inputs / outputs / status, Azure management operations, recommended actions, resource status and streaming units utilization
  • alerts on conversion errors detected, failed function requests detected, high utilization, resource outages and runtime errors detected
  • ability to resize, start and stop Azure Stream Analytics resource based on conditions or schedule




Setup


a. Run the Setup Wizard in the portal (preferred way):


CloudMonix setup wizard

This article explains how to add resources to CloudMonix via the Setup Wizard.




b. Tweak settings in the Definition tab (optional):


Definition tab for an existing resource can be accessed by clicking the resource's monitoring settings in the performance dashboard:


Resource monitoring settings



Definition tab provides optional settings for the resource name, Azure management token, Azure resource group, Azure resource name, scale-down and scale-up cooling periods, configuration template and categories:



Definition settings



Best Practices

Configuration Template setting provides pre-defined configuration templates available in CloudMonix by default as well as previously stored custom templates. See predefined templates for Azure Stream Analytics for reference.




c. Manual setup (optional instead of the Setup Wizard route):



Click the Add New button in the top right corner of your dashboard:


Add new resource


Fill in required information in the Definition tab as described in the previous step.




d. Advanced configuration:


Advanced configuration


Advanced configuration tab provides additional monitoring settings, which are already set as default for most use-cases.




e. Scale Ranges and Scale Adjustments:


Auto-scaling and scale adjustments provide powerful reactive, proactive and scheduled auto-scaling rules. These settings can be accessed via the Scale Ranges and Scale Adjustments tabs:


Scale ranges & scale adjustments




Read the full article on how to use auto-scaling and scale adjustments features in CloudMonix.




Collect, understand and use your data


Specific Metrics, Templates, Alerts and Automation Actions for Azure Stream Analytics:


Azure Stream Analytics Settings




a. Metrics:


Diagnostic data points retrieved from the monitored resource are referred to as metrics . CloudMonix provides default templates for the metrics recommended for common configurations. Metrics can be further added, removed or customized in the Metrics tab of the Azure Stream Analytics resource configuration dialog:


CloudMonix Azure Stream Analytics monitoring metrics




b. Alerts:


CloudMonix features a sophisticated alert engine that allows alerts to be published for very particular conditions pre-defined by a template configuration or custom based on any of the available metrics. Alerts can be further added, removed or customized in the Alerts tab of the Azure Stream Analytics resource configuration dialog:


CloudMonix alerts for Azure Stream Analytics




c. Actions:


Actions are automation features that can be configured to fire based on specific conditions or schedule. Actions can be added and configured in the Actions tab of the Azure Stream Analytics resource configuration dialog:


Available actions include the ability to resize, start and stop Azure Stream Analytics resource based on conditions or schedule and execute custom WebRequest to a specified URL.



CloudMonix Azure Stream Analytics actions





Setup verification and troubleshooting


a. Setup verification:


Successful resource setup can be verified by clicking Test button in the resource configuration dialog and visiting the Test Results tab:


Monitoring setup test results




b. Troubleshooting monitoring issues:


CloudMonix provides deep insights into resource monitoring issues via the Status Dashboard screen. The screen allows to overview resources that have raised alerts and troubleshoot them by diving into the monitoring logs.


Status dashboard


Read the full article on how to use Status Dashboard to diagnose resource monitoring issues.