This is a working script I use to create various HDInsight clusters. For a really reproducible, automated environment you would want to put this into a .ps1 script that accepts parameters (see here for an example). However, you may find the method below good for learning and experimenting. Replace all the “YOURxyz” sections with yourContinue reading “Sample PowerShell Script: HDInsight Custom Create”
Tag Archives: Hadoop
Your First HDInsight Cluster–Step by Step
Small Bites of Big Data from AZURECAT Big Data Tech Training Series #1 Cindy Gross | Murshed Zaman Sometimes it is just hard to get started. Have you been putting off your first foray into Hadoop? Are you not sure where to begin? Let’s get really basic. Prerequisites: Azure subscription (free trials available) Install AzureContinue reading “Your First HDInsight Cluster–Step by Step”
Share this:
PowerShell for Azure cmdlets: Subscription was all Wacky
I was working on some HDInsight scripts in PowerShell and doing lots of experimenting. I’m not sure what exactly I did but all of a sudden everything stopped working. With lots of interruptions from meetings and chats and lunch…. I couldn’t retrace my steps. Everything seemed to fail on the Azure subscription information so IContinue reading “PowerShell for Azure cmdlets: Subscription was all Wacky”
Share this:
HDInsight Big Data Talks from #SQLPASS
SQL PASS Summit 2013 was another great data geek week! I chatted with many of you about Big Data, Hadoop, HDInsight, architecting solutions, SQL Server, data, BI, analytics, and general geekiness – great fun! This time around I delivered two talks on Hadoop and HDInsight – the slides from both are attached. Zero to 60Continue reading “HDInsight Big Data Talks from #SQLPASS”
Share this:
Big Data Twitter Demo
Real-time. Social Sentiment Analysis. Twitter. Cloud. Insights. We have your Big Data buzzwords here! Everyone seems to want to incorporate social sentiment into their business analysis. Well we have the demo for you! Use it for a quick demonstration of what can be done and when the excitement goes through the roof, use it toContinue reading “Big Data Twitter Demo”
Share this:
Access Azure Blob Stores from HDInsight
Small Bites of Big Data Edit Mar 6, 2014: This is no longer necessary for HDInsight – you specify the storage accounts when you create the cluster and the rest happens auto-magically. See http://blogs.msdn.com/b/cindygross/archive/2013/11/25/your-first-hdinsight-cluster-step-by-step.aspx or http://blogs.msdn.com/b/cindygross/archive/2013/12/06/sample-powershell-script-hdinsight-custom-create.aspx. One of the great enhancements in Microsoft’s HDInsight distribution of Hadoop is the ability to store and access HadoopContinue reading “Access Azure Blob Stores from HDInsight”
Share this:
HDInsight: Jiving about Hadoop and Hive with CAT
Tomorrow I will be talking about Hive as part of Pragmatic Work’s Women in Technology (WIT) month of webcasts. I am proud to be part of this lineup with all these stellar WITs! I encourage my fellow WITs to get more involved in your data community and if you don’t already do so start tweeting,Continue reading “HDInsight: Jiving about Hadoop and Hive with CAT”
Share this:
HDInsight: Hive Internal and External Tables Intro
Small Bites of Big Data Cindy Gross, SQLCAT PM HDInsight is Microsoft’s distribution, in partnership with Hortonworks, of Hadoop. Hive is the component of the Hadoop ecosystem that imposes structure on Hadoop data in a way that makes it usable from BI tools that expect rows and columns with defined data types. Hive tables canContinue reading “HDInsight: Hive Internal and External Tables Intro”
Share this:
Hurricane Sandy Mash-Up: Hive, SQL Server, PowerPivot, Power View
Small Bites of Big Data Authors: Cindy Gross Microsoft SQLCAT PM, Ed Katibah Microsoft SQLCAT PM Tech Reviewers: Bob Beauchemin Developer Skills Partner at SQLSkills, Jeannine Nelson-Takaki Microsoft Technical Writer, John Sirmon Microsoft SQLCAT PM, Lara Rubbelke Microsoft Technical Architect, Murshed Zaman Microsoft SQLCAT PM For my #SQLPASS Summit 2012 talk SQLCAT: Big Data –Continue reading “Hurricane Sandy Mash-Up: Hive, SQL Server, PowerPivot, Power View”
Share this:
Big Data – All Abuzz About Hive at #SQLPASS Summit 2012
Big Data – All Abuzz About Hive Small Bites of Big Data Cindy Gross, SQLCAT PM I hope to see you at the #SQLPASS Summit 2012 this week! There are many reasons people come to the PASS Summit – SQL friends, SQL family, networking, great content in 190 sessions, the SQL clinic, the product team,Continue reading “Big Data – All Abuzz About Hive at #SQLPASS Summit 2012”
