Microsoft Open Source Blog
Microsoft Open Source Blog > Rahul Potharaju

Posts by Rahul Potharaju, Principal Engineering Manager, Microsoft Azure Data Group

.NET for Apache Spark hits v1.0 

2 min read
  • Rahul Potharaju bio picture
    By Principal Engineering Manager, Microsoft Azure Data Group

About two years ago, we heard an increasing demand from the .NET community for an easier way to build big data applications with .NET, outside of needing to learn Scala or Python. Thus, in a collaboration between Azure Data and .NET teams, we started the .NET for Apache® Spark™ open source project. Today, we are Read more

Hyperspace, an indexing subsystem for Apache Spark™, is now open source 

1 min read
  • Rahul Potharaju bio picture
    By Principal Engineering Manager, Microsoft Azure Data Group

For Microsoft’s internal teams and external customers, we store datasets that span from a few GBs to 100s of PBs in our data lake. The scope of analytics on these datasets ranges from traditional batch-style queries (e.g., OLAP) to explorative ”finding the needle in a haystack” type of queries (e.g., point-lookups, summarization). Resorting to linear Read more