Skip to content
Open Source blog

How to process streams of data with Apache Kafka and Spark

Data is produced every second, it comes from millions of sources and is constantly growing. Have you ever thought how much data you personally are generating every day? Data: direct result of our actions There’s data generated as a direct result of our actions and activities: Browsing twitter Using mobile apps Performing financial transactions Using...

Read more

quantum screenshot

Open Source Weekly: Updated Quantum SDK, deep learning for autonomous driving, and more

4-minute read + demos This week Microsoft released updates to our Quantum Development Kit, including support for macOS and Linux, additional open source libraries, and interoperability with Python. Learn more about what’s new with Microsoft Quantum, plus new docs, demos, and more, in this edition of the Open Source Weekly. TODO Open Source Program Guides:...

Read more

Open Source Weekly: New Go SDK and Azure Go Dev Center

2-minute read + demos Lots of good news for “gophers” this week, with a new Go SDK for Azure and updated documentation to help Go fans get started with Azure. This and more community news, product announcements, and demos from around Microsoft below.   Azure SDK for Go: The Azure SDK for Go is now...

Read more

Open Source Weekly: new Ansible on Azure improvements and more

For fans of Ansible’s automation capabilities, the Azure team announced significant improvements to the Ansible on Azure experience, including a new VS Code extension. Learn more about what’s new with Ansible on Azure, plus new docs, demos, and more, in this edition of the Open Source Weekly. Updated Jenkins offer in Azure Marketplace: The Azure...

Read more

Azure HDInsight 3.6, now generally available

This week at the DataWorks Summit, Microsoft announced the general availability of Azure HDInsight 3.6, backed by Microsoft’s enterprise-grade SLA. HDInsight 3.6 brings updates to various open source components in the Apache Hadoop and Spark ecosystem to the cloud, allowing customers to deploy them easily and run them reliably on an enterprise-grade platform. “HDInsight 3.6...

Read more

A winning cloud strategy for your Hadoop environment

Microsoft and Hortonworks are collaborating to bring you a series of live webinars on Hadoop!  The first one, Accelerating Big Data Collection for Azure Cloud, was held in February 2017. The second webinar is A Winning Cloud Strategy For Your Hadoop Environment, which will be held on 29 March 2017, 10AM SGT (Singapore Time). This...

Read more

Protecting innovation in the cloud with Azure IP Advantage

This month Microsoft announced the Microsoft Azure IP Advantage program. This new program is the industry’s most comprehensive protection against intellectual property (IP) risks, using Microsoft’s patent portfolio to help protect our cloud customers. “Our goal is to help foster a community that values and protects innovation and investments in the cloud,” wrote Brad Smith,...

Read more

Accelerating Big Data Collection for Azure Cloud – Live Webinar By Hortonworks and Microsoft

Microsoft and Hortonworks are collaborating on a series of live webinars. The series will feature four different webinars, with the first one to be held on 21 February 2017, 10AM (Singapore Time). The first of the series of webinars is on Accelerating Big Data Collection for Azure Cloud, presented by Sean Roberts (from Hortonworks) and...

Read more

Updates to HDInsight tools for IntelliJ and Eclipse now available

HDInsight is Microsoft Azure’s managed Hadoop-as-a-service. It is the only fully-managed cloud Hadoop offering that provides optimized open source analytic clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and R Server – all backed by a 99.9% SLA. Each of these big data technologies and ISV applications are easily deployable as managed clusters with enterprise-level...

Read more

Now available: Microsoft R Server 9.0 with support for Spark 2.0

This week Microsoft released Microsoft R Server (MRS) version 9.0, built on top of the latest open source R engine. This release has several exciting new capabilities, best-of-breed machine learning algorithms, simplified operationalization of R models, and support for Spark 2.0, to name a few. “I am proud of the many MRS enhancements that our...

Read more