How to process streams of data with Apache Kafka and Spark 

23 min read

Data is produced every second, it comes from millions of sources and is constantly growing. Have you ever thought how much data you personally are generating every day? Data: direct result of our actions There’s data generated as a direct result of our actions and activities: Browsing twitter Using mobile apps Performing financial transactions Using…Read more

3 Comments

Open Source Weekly: Updated Quantum SDK, deep learning for autonomous driving, and more 

3 min read

4-minute read + demos This week Microsoft released updates to our Quantum Development Kit, including support for macOS and Linux, additional open source libraries, and interoperability with Python. Learn more about what’s new with Microsoft Quantum, plus new docs, demos, and more, in this edition of the Open Source Weekly. TODO Open Source Program Guides:…Read more

Azure HDInsight 3.6, now generally available 

1 min read

This week at the DataWorks Summit, Microsoft announced the general availability of Azure HDInsight 3.6, backed by Microsoft’s enterprise-grade SLA. HDInsight 3.6 brings updates to various open source components in the Apache Hadoop and Spark ecosystem to the cloud, allowing customers to deploy them easily and run them reliably on an enterprise-grade platform. “HDInsight 3.6…Read more

A winning cloud strategy for your Hadoop environment 

<1 min read

Microsoft and Hortonworks are collaborating to bring you a series of live webinars on Hadoop!  The first one, Accelerating Big Data Collection for Azure Cloud, was held in February 2017. The second webinar is A Winning Cloud Strategy For Your Hadoop Environment, which will be held on 29 March 2017, 10AM SGT (Singapore Time). This…Read more

Protecting innovation in the cloud with Azure IP Advantage 

1 min read

This month Microsoft announced the Microsoft Azure IP Advantage program. This new program is the industry’s most comprehensive protection against intellectual property (IP) risks, using Microsoft’s patent portfolio to help protect our cloud customers. “Our goal is to help foster a community that values and protects innovation and investments in the cloud,” wrote Brad Smith,…Read more

Updates to HDInsight tools for IntelliJ and Eclipse now available 

1 min read

HDInsight is Microsoft Azure’s managed Hadoop-as-a-service. It is the only fully-managed cloud Hadoop offering that provides optimized open source analytic clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and R Server – all backed by a 99.9% SLA. Each of these big data technologies and ISV applications are easily deployable as managed clusters with enterprise-level…Read more

Microsoft Ignite in Atlanta 

1 min read

From high-level strategy to deep product insights, you’ll hear about new technologies and explore real-world solutions to today’s challenges. Customize your schedule to go deep on the topics that matter most to you and your organization including: cloud infrastructure and management, big data, analytics, productivity, communications, operating systems, mobile devices, and more. 1,000+ hours of…Read more