Top "Azure-hdinsight" questions

Questions about Azure HDInsight, is a managed Apache Hadoop service that lets you run Apache Spark, Apache Hive, Apache Kafka, Apache HBase, and more in the Microsoft Azure cloud.

Differences between Azure Block Blob and Page Blob?

As I recently started mingling around with Windows Azure, I've came up to a situation where, which one to go …

azure azure-storage azure-storage-blobs azure-hdinsight
Create external table with select from other table

I am using HDInsight and need to delete my clusters when I am finished running queries. However, I need the …

hive azure-hdinsight
how to connect to HBase / Hadoop Database using C#

Recently, Exploring Microsoft HDInsight Hadoop for Windows.But don't know where to began and start using apache hadoop with c# / …

c# hadoop hbase hive azure-hdinsight
Spark SQL: How to consume json data from a REST service as DataFrame

I need to read some JSON data from a web service thats providing REST interfaces to query the data from …

apache-spark-sql spark-dataframe azure-hdinsight
What does %{ $_.Key1 } mean?

While programming for HDInsight I came across lines like $storageAccountKey = Get-AzureRmStorageAccountKey -ResourceGroupName $resourceGroupName -Name $storageAccountName | %{ $_.Key1 } I understand $_ refers to …

powershell azure-hdinsight
How to load CSVs with timestamps in custom format?

I have a timestamp field in a csv file that I load to a dataframe using spark csv library. The …

apache-spark apache-spark-sql hortonworks-data-platform azure-hdinsight
Is there a Spark SQL jdbc driver?

I'm looking for a client jdbc driver that supports Spark SQL. I have been using Jupyter so far to run …

apache-spark jdbc apache-spark-sql azure-hdinsight
spark-shell error : No FileSystem for scheme: wasb

We have HDInsight cluster in Azure running, but it doesn't allow to spin up edge/gateway node at the time …

azure hadoop azure-hdinsight hdpi
Create hive external table from partitioned parquet files in Azure HDInsights

I have data saved as parquet files in Azure blob storage. Data is partitioned by year, month, day and hour …

azure hive parquet azure-hdinsight