Questions tagged [ambari]

1

votes
2

answer
1.1k

Views

Hive View Not Opening

In the Ambari UI of the hortonworks sandbox, I was trying to open Hive View through the account of maria_dev. But however, I was getting the following error: Service Hive check failed: Cannot open a hive connection with connect string jdbc:hive2://sandbox-hdp.hortonworks.com:2181/;serviceDiscovery...
Witty Counsel
1

votes
1

answer
772

Views

hive is not working with HDP with Ambari

I have installed the HDP with Ambari 2.6.1. It mostly did everything automatically but Hive is unable to start properly. I saw a post somewhere and I deleted the pid and killed the process as well in hope that I would restart it and it would work but now it's showing heartbeat lost on the machine. P...
Nikita Patil
1

votes
0

answer
168

Views

How to set yarn.nodemanager.resource.cpu-vcores (number of virtual cores)

I am little confuse What is the yarn.nodemanager.resource.cpu-vcores value that should be ? ( based on the picture down ...) real total CPU CORE on worker machine? OR set the value to 80% of real total CPU CORE on worker machine? ( as some sites recommended ) for now I set it to 8 ( on each worker...
enodmilvado
1

votes
0

answer
340

Views

Remove and fresh install of grafana package

I am using ambari to install ambari-metrics-grafana on a centos7 host. Eventually, I lost admin password for grafana. I tried uninstalling, from ambari and host, then re-install. While installation ambari asks for grafana username password. Somehow the new password I provide is failing. What shall I...
Aso'K
1

votes
1

answer
90

Views

How to create a script that stops Hive service on my cluster?

I need to create a script shell that stops the Hive Metastore and HiveServer2 service from any node of cluster and I need to know where Hive services are hosted in my cluster in order to run this command: ssh nodename:ps aux | awk '{print $1,$2}' | grep hive | awk '{print $2}' | xargs kill >/dev/nul...
HISI
1

votes
1

answer
181

Views

Hiveserver2 does not start after installing HDP 2.6.4.0-91 using cloudbreak on AWS

Hiveserver2 does not start after installing HDP 2.6.4.0-91 using cloudbreak on AWS. Start the hiveserver2 in the Ambari UI and check the contents of /var/log/hive/hiveserver2.log. Below is the error log. Any help would be appreciated. Contents of hiveserver2.log 2018-03-08 04:41:53,345 WARN [main-Ev...
Soungno Kim
1

votes
1

answer
41

Views

Domain joined HdInsight cluster hdfs user permissions

I have created a domain joined HdInsight cluster. This is working great at allowing users from my active director login to the cluster using their AD credentials. However, there doesn't appear to be anyway to limit user access to various files/directories. user1 has full access to user2's files and...
rb21220689
1

votes
1

answer
204

Views

Unable to register AWS host to Ambari server

While registering a host to the cluster of Ambari-server, I am getting the following error. 'Host checks were skipped on 1 hosts that failed to register.' I'm trying to install HDP 2.5 version on the instance of AWS. I have tried to follow the documentation of Hortonworks. https://docs.hortonworks.c...
Deya
1

votes
1

answer
119

Views

Accumulo Tracer hangs on startup

I am using Apache Ambari to manage HDFS, Zookeeper and Accumulo. I am having issues with Accumulo Tracer starting up. Ambari starts Accumulo Tracer using this command. Execute['cat /var/lib/ambari-agent/tmp/pass | ACCUMULO_CONF_DIR=/usr/hdp/current/accumulo-tracer/conf/server /usr/hdp/current/accum...
Cody Adams
1

votes
0

answer
28

Views

It does not pass from Web UI to Select Version

I can not proceed to the next state. /var/log/ambari-server/ambari-server.log INFO [ambari-client-thread-37] AmbariMetaInfo:1430 - Stack HDP-2.0.6 is not active, skipping VDF INFO [ambari-client-thread-37] AmbariMetaInfo:1430 - Stack HDP-2.0.6 is not active, skipping VDF INFO [ambari-client-thread-3...
K.k
1

votes
1

answer
97

Views

Ambari only server gzip encoded resources, which my proxy blocks

I am using Ambari behind an old corporate proxy server which does not allow Accept-Encoding headers to be passed through. As a result, Ambari can't serve up javascript or css files. How can I get it to support plain encoding?
Simon Elliston Ball
1

votes
1

answer
724

Views

Existing Cluster monitoring by Hortonworks Ambari

I have a 10 node existing cluster in RHEL 6.6 which was prepared by plain apache Hadoop configuration XMLs. Now I wanted to check the cluster status by Ambari. Would it be possible to install Hortonworks Ambari just to monitor only not to install Hadoop.
user234202
1

votes
3

answer
330

Views

Ambari - Hive view F080 Error

I've installed HDP 2.2.0 on a 3 machine cluster running CentOS6 with the help of Ambari, and got no errors during the install process. I then installed the Hive view, as described here, and the necessary Tez view, but whenever I try to use the view for a query (even a simple SHOW TABLES;), I get thi...
1

votes
1

answer
393

Views

Zeppelin Cluster Mode not working on spark 1.2 Ambari, Hortonworks CLuster

I am trying to deploy a cluster and run some sample Spark/scala code on it and while everything works fine when I use zeppelin in standalone mode with default parameters, I cannot get it working in cluster mode. I tried to manually create spark cluster using spark-class and start-master standard she...
ngalstyan
1

votes
1

answer
334

Views

HDP 2.1 to 2.2 upgrade RHEL6

I have a cluster with 1 NameNode and 4 DataNodes on Red Hat Linux Enterprise 6. My HDP version is 2.1. Ambari version was 1.7 but I upgraded it to 2.1. I want to upgrade HDP to version 2.2. I read that if I want to upgrade HDP from 2.1 to 2.2 I have to do it before I upgrade Ambari to 2.1. When I am...
Edgar
1

votes
2

answer
933

Views

Configuring hosts throws error

While doing a confim hosts step in Ambari hosts setup, the following error is thrown. Any ideas on how I could resolve it? ERROR 2015-09-18 14:32:43,574 main.py:137 - Ambari agent machine hostname (INLL50901688A.xxx) does not match expected ambari server hostname (inll50901688a.xxx). Aborting regist...
Siva
1

votes
1

answer
1.2k

Views

“500 status code received on GET method for API” error in Ambari - Hive Service instllation

I have ambari 2.1.2 installed on CentOS 6.4. I have the following two questions related to Hive service installation through ambari. Question 1: On the Ambari Dashboard, what is “MySQL Server / Hive”?. When Ambari was installed, wasn’t MySQL server already installed initally?. Will installing...
KurioZ7
1

votes
3

answer
586

Views

How do I add additional hosts to HDP cluster

I have installed a HDP 2.2.4.2 cluster with 2 nodes both having CentOS 6.6 OS. I need to add one more host to this cluster but i didnt find any option to do this on the the ambari console (ambari version is 2.0) . Is there any way I can add more hosts to this cluster?
Ravikiran Bhat
1

votes
1

answer
129

Views

Integrate Storm with Ambari in Ubuntu 14

I install Storm and Ambari UI in a Ubuntu machine. But now I want to join the Storm with ambari UI. Is there any tutorial? anyone have tips? Note: I have just installed on the virtual machine the Storm, Kafka and Ambari server (default). I know that there is a VM NortonWorks with these pre-installed...
RookieSpark
1

votes
1

answer
280

Views

How do I get job counters in Hadoop 2.7.1?

Im trying to get all counters from specific job using java... I've wrote working code for Hadoop 0.23.1: JobClient client = new JobClient(new JobConf(createConfiguration())); RunningJob job; system.out.print('Looking for job with title containing the string '' + jobName + '''); List jobStatusList =...
EliranA
1

votes
1

answer
410

Views

Ambari plugin development

I would like to develop Ambari plugin for deploying some services (something like this https://github.com/tzolov/elasticsearch-yarn-ambari-plugin). I would like to ask for good practices for developing/debugging. Currently we do delete and copy new files to AMBARI_SERVER_SERVICE_PATH/services/ and...
Babu
1

votes
1

answer
658

Views

Configuring NodeManager memory and vcores in a heterogenous YARN cluster?

I am aware to set the memory and vcores in YARN using the following properties: yarn.nodemanager.resource.memory-mb yarn.nodemanager.resource.cpu-vcores I have a heterogenous YARN cluster with nodes having following configuration: Node1 (8cores, 16GB RAM) Node2 (8cores, 16GB RAM) Node3 (32cores, 64G...
Rakesh Rakshit
1

votes
1

answer
167

Views

Ambari Custom Hadoop installation

I've downloaded and builded some BigData services (Hadoop, Hive, Spark,...) and I want to deploy it using Ambari. Ambari has set some versions (HDP Stacks) and I would like to configure it with my own compiled binaries. Is there someone who could help me with this task? Some kind of guide or tutoria...
sartions
1

votes
1

answer
514

Views

Ranger user sync with kerberos

I have setup Kerberos following below document http://docs.hortonworks.com/HDPDocuments/Ambari-2.2.0.0/bk_Ambari_Security_Guide/content/ch_configuring_amb_hdp_for_kerberos.html Further, I would like to configure ranger to sync all Kerberos principals to create ACLS. There is an option to sync users...
Mkt281001
1

votes
1

answer
105

Views

Add a combo box for custom service in Ambari UI

I'm implementing a custom service that is configured via Ambari UI and I want to add property to specify Authentication tyupe that could be either LDAP or KERBEROS. In my service-config.xml I have the following lines: serviceAuthType KERBEROS attribute-list KERBEROS KERBEROS LDAP LDAP 1 but I still...
Akceptor
1

votes
1

answer
871

Views

Ambari Hive UTF-8 problems

Have a problem with cyrillic symbols at hive tables. Installed versions: ambari-server 2.4.2.0-136 hive-2-5-3-0-37 1.2.1000.2.5.3.0-37 Ubuntu 14.04 Whats the problem: Set locale to ru_RU.UTF-8: [email protected]:~$ locale LANG=ru_RU.UTF-8 LANGUAGE=ru_RU:ru LC_CTYPE='ru_RU.UTF-8' LC_NUMERIC='ru_RU.UTF-8'...
canavar
1

votes
2

answer
298

Views

SPARK individual upgrade to 2.1.0 in Ambari HDP 2.5.0

I want to upgrade my SPark component to 2.1.0 from its default 2.0.x.2.5 in Ambari. I am using HDP 2.5.0 with Ambari 2.4.2. Appreciate any idea to achieve this.
Ranjan Swain
1

votes
1

answer
51

Views

Should I need to use same configration all hosts for Hadoop cluster?

I want to create multi hosts cluster for Hadoop. I want to install Apache Ambari on server with multi hosts but I have one confusion regarding hosts. Should I need to use same configuration on all hosts like (RAM, Processor, Hard Disk). I have one hosts have 64 GB ram and other two have 4GB RAM. Can...
Jain Hemant
1

votes
1

answer
107

Views

How to reconfigure Ambari services values with blueprint.json file

we have many Ambari LAB clusters - Apache Ambari Version 2.5.0.3 , while ambari agent installed on Linux redhat machines my target is to find a way to update the values of services , on all the Ambari clusters , by automate the process what we do until now , is take each ambari cluster and change t...
King David
1

votes
1

answer
60

Views

Which is the correct way to install a service in Hortonworks?

I'm a bit confused about which is the correct way to install Oozie in a cluster (2 masters or namenodes, 2 workers or datanodes). 1) So basically, in the documentation you have a set of command line instructions that you can follow. I don't really know in which machine should I execute this shell in...
JaviOverflow
1

votes
1

answer
132

Views

Spark with yarn-client on HDP multi nodes cluster only starts executors on the same single node

I have installed a multi nodes HDP Cluster with Spark and Yarn on EC2 Every nodes are DataNodes. Node3 is the only Spark Client node. Every time I run spark jobs with yarn-client or yarn-cluster mode, it always initializes spark executors on the node3. Whereas I want the job to use every nodes. What...
tricky
1

votes
1

answer
457

Views

Spark web UI doesn't update as app runs (on Yarn)

Our Spark web UI (when accessed from the Yarn UI or the Spark History Server) no longer updates when I reload the browser window when viewing a running Spark app (our apps run on a Hadoop/Yarn cluster in client mode). This used to work with Spark 1.5.2, but after we upgraded to HDP 2.6.4 (hence Spa...
Mark Rajcok
1

votes
2

answer
202

Views

hive log4j:WARN No such property [maxFileSize] in org.apache.log4j.DailyRollingFileAppender

Hello how to fixe this issues? When I try to launch hive in my commande line(I'm using amazone aws instance and ambari is well started only 3 CRIT in YARN).
Abdoulaye Diallo
1

votes
1

answer
0

Views

Ambari installation with the rest of hadoop ecosystems

I am new in Hadoop and all related topics. i have a cluster of 3 nodes (1 master and 2 Slaves) running hadoop on Ubuntu. My question is, what should i install first, Ambari then hadoop then the rest of all ecosystems? or should i install multi nodes cluster then a bunch of ecosystems then ambari? Am...
Mohad B.Masadeh
1

votes
1

answer
0

Views

how to reduce the number of containers in the query

I have a query using to much containers and to much memory. (97% of the memory used). Is there a way to set the number of containers used in the query and limit the max memory? The query is running on Tez. Thanks in advance
macieira
0

votes
1

answer
0

Views

Ambari metrics Thrift Server

I installed Apache Ambari 2.6.2.2 and I deployed two services: Hbase and AMS. For Hbase I started thrift server, from UI I can see metrics for this server (http://localhost:9095/jmx), but it seems that AMS it does not collect them. In AMS I can see only Hbase metrics. My question is how can I collec...
banuj
1

votes
1

answer
371

Views

Ambari + HDP licensing

I'm experiencing a deployment and management of a Hadoop cluster and I found out that, for the purpose, Ambari is a very useful and convenient tool. Now I'm trying to figure out if all the licenses of the HDP stack allow to deploy a Hadoop installation also in a production environment. Does anyone h...
Mauro Scarpa
1

votes
2

answer
4.6k

Views

DataNodes can't talk to NameNode

Set up a Hadoop cluster of 3 nodes. One of them got both NameNode and DataNode roles while other two are just DataNodes. I started all nodes and services but in summary it shows only one of DataNodes's status is live. Status of other nodes are not even showing. My question is what is the difference...
gunererd
1

votes
1

answer
147

Views

Resource usage from Ambari

I have few Hive jobs and Mapreduce programs running in my cluster. I am able to check in Ambari about general resource utilization. But I want to see the resources utilized by individual applications. Is it possible through Ambari API? Can you provide some clues?
passionate
1

votes
2

answer
1.1k

Views

Flume Metrics through REST API

I'm running hortonworks 2.3 and currently hooking into the REST API through ambari to start/stop the flume service and also submit configurations. This is all working fine, My issue is how do I get the metrics? Previously I used to run an agent with the parameters to produce the metrics to a http po...
Colman

View additional questions