Skip to content
Open Source blog

How to process streams of data with Apache Kafka and Spark

Data is produced every second, it comes from millions of sources and is constantly growing. Have you ever thought how much data you personally are generating every day? Data: direct result of our actions There’s data generated as a direct result of our actions and activities: Browsing twitter Using mobile apps Performing financial transactions Using...

Read more

Azure HDInsight 3.6, now generally available

This week at the DataWorks Summit, Microsoft announced the general availability of Azure HDInsight 3.6, backed by Microsoft’s enterprise-grade SLA. HDInsight 3.6 brings updates to various open source components in the Apache Hadoop and Spark ecosystem to the cloud, allowing customers to deploy them easily and run them reliably on an enterprise-grade platform. “HDInsight 3.6...

Read more

Updates to HDInsight tools for IntelliJ and Eclipse now available

HDInsight is Microsoft Azure’s managed Hadoop-as-a-service. It is the only fully-managed cloud Hadoop offering that provides optimized open source analytic clusters for Spark, Hive, MapReduce, HBase, Storm, Kafka, and R Server – all backed by a 99.9% SLA. Each of these big data technologies and ISV applications are easily deployable as managed clusters with enterprise-level...

Read more

Webinar - Azure and big data

Free webinar: Run your big data and analytics workloads at cloud scale

Power your innovation and grow your business by uncovering hidden patterns and correlations in your data with the least ramp-up time using a metered hyperscale cloud computing platform—Microsoft Azure. Register today for this free webinar that aims to share you can run your big data and analytics workloads at cloud scale. Date: January 17, 2017...

Read more

Zoom on the InfoQ week, featuring BizSpark Plus startups!

Four BizSpark Plus startups were interviewed by IT publication InfoQ France, following their participation at Microsoft Experiences conference last October. These startups have chosen Microsoft Azure for their technical architecture and to support their open source technologies. Discover their stories and their technological choices in the following articles (note: links are in French): Realytics.io: Hadoop,...

Read more

Now available: Microsoft R Server 9.0 with support for Spark 2.0

This week Microsoft released Microsoft R Server (MRS) version 9.0, built on top of the latest open source R engine. This release has several exciting new capabilities, best-of-breed machine learning algorithms, simplified operationalization of R models, and support for Spark 2.0, to name a few. “I am proud of the many MRS enhancements that our...

Read more

Hadoop magic quadrant

Forrester names Microsoft Azure a leader in big data Hadoop cloud solutions

Earlier this week, Forrester recognized Microsoft Azure as a leader in their “Big Data Hadoop Cloud Solutions” report. Apache Hadoop has become popular among organizations to quickly unlock insights from data of all size and shape, and is supported by an ecosystem of popular open source projects, including Spark, R, Giraph, and Solr. “We’re excited...

Read more

Now available in preview: R Server inside Azure HDInsight

This week at Strata + Hadoop World, Microsoft announced the availability of R Server inside Azure HDInsight, Microsoft’s managed Hadoop-as-a-service part of Azure Data Lake. R is a very popular programming language that helps millions of data scientists solve their most challenging problems in fields ranging from computational biology to quantitative marketing. R Server for...

Read more

SocialDice: Revolutionizing talent recruitment in the the Middle East

For rapidly-growing, Middle Eastern small- to medium-sized businesses, hiring the best employees is a challenge. Both busy employers and ambitious talent find the existing job boards slow and cumbersome. In response, start-up SocialDice has made the process easy, intelligent, and fun by aggregating regional job boards in one place and using a proprietary smart algorithm...

Read more