Hortonworks Data Platform (HDP) is a distribution of an open-source Apache Hadoop data platform containing a set of projects on top of the HDFS and YARN as core layer of Hadoop.
Trying to read a file located in S3 using spark-shell: scala> val myRdd = sc.textFile("s3n://myBucket/myFile1.…
java scala apache-spark rdd hortonworks-data-platformI just downloaded Hortonworks sandbox VM, inside it there are Hadoop with the version 2.7.1. I adding some files by using …
hadoop hdfs hortonworks-data-platformI have a table: key product_code cost 1 UK 20 1 US 10 1 EU 5 2 UK 3 2 EU 6 I would like to find the sum …
hadoop hive hiveql hortonworks-data-platformHow to find Hadoop HDFS directory on my system? I need this to run following command - hadoop dfs -copyFromLocal &…
linux azure hadoop hdfs hortonworks-data-platformI want to access hdfs with fully qualified names such as : hadoop fs -ls hdfs://machine-name:8020/user I could also …
hadoop hdfs cloudera hortonworks-data-platform maprI am using HDP 2.5, running spark-submit as yarn cluster mode. I have tried to generate data using dataframe cross join. …
apache-spark hive yarn hortonworks-data-platformI have hdp cluster configured with kerberos with AD. All HDP service accounts have principals and keytabs generated including spark. …
hadoop apache-spark active-directory kerberos hortonworks-data-platformGetting error while sending message to kafka topic in kerberosed enviornment. We have cluster on hdp 2.3 I followed this http://…
java apache-kafka kerberos jaas hortonworks-data-platformI am setting up an ambari cluster with 3 virtualbox VMs running Ubuntu 16.04LTS. However I get the below warning: The …
ubuntu ubuntu-16.04 hortonworks-data-platform ambarii have a problem in setting hadoop file permissions in hortonworks and cloudera. My requirement is: 1. create a new user …
hadoop permissions hdfs cloudera hortonworks-data-platform