Processing compressed event streams with Azure Stream Analytics
Did you know that Azure Stream Analytics now supports input data with compression data formats such as GZIP and Deflate streams? This is especially critical in scenarios where either bandwidth is...
View Article8 reasons to choose Azure Stream Analytics for real-time data processing
Processing big data in real-time is now an operational necessity for many businesses. Azure Stream Analytics is Microsoft’s serverless real-time analytics offering for complex event processing. It...
View ArticleNow in Public Preview: Visual Studio tools for Azure Stream Analytics on IoT...
Azure Stream Analytics (ASA) on IoT Edge empowers developers to deploy real-time analytical intelligence closer to IoT devices so that they can unlock the full value of device-generated data. Today we...
View ArticleImproved Stream Analytics output support in Visual Studio
Power BI and Azure Data Lake Store outputs are now supported in Visual Studio tools. Previously users can only create or view jobs with these types of outputs in the Azure portal. Now all these actions...
View ArticleEvent Processing Ordering Design Choices for Azure Stream Analytics
In this blog, I would like to explain the design choices we made with Azure Stream Analytics for: ‘When’ in processing-time results are materialized, and ‘How’ the results are materialized. These...
View ArticleSU Utilization Metric
In order to achieve low latency streaming processing, Azure Stream Analytics jobs perform all processing in memory. When running out of memory, the streaming job fails. As a result, for a production...
View ArticleUsing Azure Stream Analytics JavaScript UDF to lookup values in JSON array
JavaScript UDF (User-Defined Function) allows you to handle complex JSON schema and keep your query clean. In this blog you will learn how to handle nested JSON arrays with a JavaScript UDF. Below is...
View ArticleProcessing Configurable Threshold Based Rules in Azure Stream Analytics
This post covers the usage of Azure Stream Analytics to process configurable threshold based rules. Canonical scenarios where an alert is to be generated when an event with a certain value occurs or...
View ArticleHow to achieve exactly-once delivery for SQL output
Azure Stream Analytics guarantees exactly-once processing within the processing pipeline. However, it currently doesn’t ensure end to end exactly-once delivery to output sink. Instead, it guarantees...
View ArticleOutput to Azure Data Lake Store is Generally Available
We are excited to announce that the capability to output to Azure Data Lake Store, a hyper-scale repository for big data analytics workloads from Azure Stream Analytics is now Generally Available. This...
View ArticleSpark Streaming and Azure Stream Analytics
As Microsoft adds support for both proprietary and open source technologies for processing and analytics of streaming data, customers have been asking us how to choose between Spark Streaming and Azure...
View ArticleTroubleshooting Azure Stream Analytics jobs with SELECT INTO
Azure Stream Analytics is a fully managed service to do real time processing of data with a flexible SQL-like language. You can easily construct queries to complete complex analysis. However, it also...
View ArticleTroubleshooting Azure Stream Analytics jobs on New Portal
We are working hard to bring you an end-to-end Stream Analytics experience in the new Azure portal and we are almost there! Now you can perform more troubleshooting tasks on portal.azure.com. Input and...
View ArticleSQL Data Warehouse as output of Azure Stream Analytics
Several of our customers have asked whether we support Azure SQL Data Warehouse an output sink for of an Azure Steam Analytics job. The answer is we do: it can be configured by choosing “SQL DATABASE”...
View ArticleIntegration with Azure Data Lake Store
We are excited to announce that Azure Stream Analytics can output to Azure Data Lake Store, a hyper-scale repository for big data analytics workloads. This integration further advances the ease of...
View ArticleHow to configure Azure Stream Analytics outputs to skip events that cannot be...
By default, when output events cannot be written to the external storage due to being non-conforming data (null columns when destination column is non-nullable, longer strings than the destination...
View ArticleHow to deal with missing events in streaming data?
Streaming data is often not perfect – some of the events can be missing and some can be generated or received with delay. At the same time downstream applications may require input data within regular...
View ArticleHandling Json array in Stream Analytics Query
This week, I am sharing a query question asked in stackoverflow to illustrate how to handle json array in Stream Analytics Query: Problem I retrieve some weatherdata from an external API. This is...
View ArticlePulling data from either public or private sources to Azure Event Hub where...
In typical Internet of Things (IoT) scenarios, you have devices that you can program to push data to Azure, either to an Azure Event Hub or an IoT hub. Both of those hubs are entry points into Azure...
View ArticlePulling data from either public or private sources to Azure Event Hub where...
In typical Internet of Things (IoT) scenarios, you have devices that you can program to push data to Azure, either to an Azure Event Hub or an IoT hub. Both of those hubs are entry points into Azure...
View Article