5-minute read + demos
Check out the below recap of this week’s top open source related product announcements, popular docs, and demos from around Microsoft.
Anything else you’d like to hear about? Let us know in the comments.
Azure Databricks, analytics platform powered by Apache Spark: Azure Databricks, a fast, easy, and collaborative Apache Spark-based analytics platform, is now generally available. Azure Databricks is designed in collaboration with Databricks, whose founders started the Spark research project at UC Berkeley, which later became Apache Spark. Microsoft’s goal with Azure Databricks is to help customers accelerate innovation and simplify the process of building Big Data & AI solutions by combining the best of Databricks and Azure. Check out the announcement.
HashiCorp Terraform in the Azure Marketplace: In addition to Terraform being integrated to the Azure Cloud Shell, the new Terraform solution is now in the Azure Marketplace. This solution will enable teams to use shared identity, using Managed Service Identity (MSI), and shared state using Azure Storage. These features will allow you to use a consistent hosted instance of Terraform for DevOps Automation and production scenarios. Learn more on the Azure blog.
Software for Open Networking in the Cloud (SONiC) community update: This week at OCP Summit 2018 Microsoft gave an update on SONiC, which is a container based, open-sourced switch OS architecture, built for cloud-scale performance and resiliency. It currently powers Azure and many other parts of the Microsoft Cloud, including Microsoft’s AI platform. Developers across the world are contributing to SONiC, refining and adding new capabilities. In the past 12 months, the SONiC community has delivered three official releases, which have greatly enriched and increased SONiC use-cases. Read more about the SONiC community here.
Microsoft joins effort to help advance open source licensing: Microsoft joined RedHat, Facebook, Google, IBM, CA Technologies, Cisco, HPE, SAP, and SUSE, to announce that it is making an open source license commitment designed to help licensees overcome common mistakes in using open source software. Specifically, the commitment offers licensees of GPLv2 code a reasonable period of time to correct license compliance issues, building on emerging community norms already in place in the Linux kernel community. Read the complete announcement here.
Here is this week’s sampling of recently updated open source related docs:
Azure Cosmos DB data migration tool: This tutorial provides instructions on using the Azure Cosmos DB Data Migration tool, which can import data from various sources into Azure Cosmos DB collections and tables. You can import from JSON files, CSV files, SQL, MongoDB, Azure Table storage, Amazon DynamoDB, and even Azure Cosmos DB SQL API collections, and you migrate that data to collections and tables for use with Azure Cosmos DB. The Data Migration tool can also be used when migrating from a single partition collection to a multi-partition collection for the SQL API.
Running Apache Spark jobs on AKS: Apache Spark is a fast engine for large-scale data processing. As of the Spark 2.3.0 release, Apache Spark supports native integration with Kubernetes clusters. Azure Container Service (AKS) is a managed Kubernetes environment running in Azure. This document details preparing and running Apache Spark jobs on an Azure Container Service (AKS) cluster.
If you like these weekly updates, follow us @OpenAtMicrosoft to stay in touch daily.