Level: Introductory
Are you being asked to store and analyze log files you used to throw away? Are Twitter feeds becoming a part of your core business data? Are devices that used to be silent sending you lots of little bits of data about how they're doing? Big data has probably already found its way into your life and the trend isn't slowing down.
You might know some of the technologies in this space like Hadoop or Spark, but what if you could reuse your SQL and .NET expertise to quickly get your Big Data platform off the ground? Azure Data Lake and the U-SQL language let you do just that. In this session, you'll see how the ADL service takes the complexity out of getting a distributed computing environment up and running with unbounded storage. Then you'll realize you already know enough SQL to start writing massively parallel analytics programs to crunch petabyte sized logs and aggregate countless small events. You'll learn how to add .NET libraries you already like to use; all with the power of Visual Studio tools.
You will learn:
- How Azure Data Lake provides distributed, parallel computing as a service
- How ADL provides unlimited storage for unstructured and semi-structured data
- About U-SQL syntax and C# custom code to transform and process your data
- How to bootstrap with VS tools for ADL