Hi everyone, recently I installed Oracle Virtual box and Sandbox on my Windows 7 64 bit. I am getting the IP address for the tutorial, but the videos there are not getting played completely. I am using Google Chrome as the browser. After a certain period of time, it stops and doesn’t go further. Is there any link to watch it on YouTube or by any other means ? Please help me with this, am trying it from past four days. Initially, I though it was due to network issue but it’s not that.

Hi ,
I am trying to install Ambari over a 3 node cluster. After 1st Logging in to Ambari I mentioned the list of Hostnames for the 3 nodes & proceeding further the Registration of these Hosts FAILS for the 2 Slave nodes.
When i check the Error Log it appears that certain features are Unavailable.
Following is the Log for one of the Slaves :

STDOUT

STDERR
STDOUT

STDERR
STDOUT
Verifying Python version compatibility…
Using python /usr/bin/python2.6
Checking for previously running Ambari Agent…
Starting ambari-agent
Verifying ambari-agent process status…
Ambari Agent successfully started
Agent PID at: /var/run/ambari-agent/ambari-agent.pid
Agent log at: /var/log/ambari-agent/ambari-agent.out
(‘hostname: ok slave2.tpbidw.com
ip: ok 10.6.120.206
cpu: ok Intel(R) Core(TM)2 Duo CPU E7500 @ 2.93GHz
Intel(R) Core(TM)2 Duo CPU E7500 @ 2.93GHz
memory: ok 3.76519 GB
disks: ok
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_slave2-lv_root
50G 5.9G 41G 13% /
tmpfs 1.9G 260K 1.9G 1% /dev/shm
/dev/sda1 485M 38M 423M 9% /boot
/dev/mapper/vg_slave2-lv_home
241G 189M 228G 1% /home
os: ok CentOS release 6.3 (Final)
iptables: ok
Chain INPUT (policy ACCEPT 0 packets, 0 bytes)
pkts bytes target prot opt in out source destination

Chain FORWARD (policy ACCEPT 0 packets, 0 bytes)
pkts bytes target prot opt in out source destination

Chain OUTPUT (policy ACCEPT 0 packets, 0 bytes)
pkts bytes target prot opt in out source destination
selinux: ok SELINUX=disabled
SELINUXTYPE=targeted
yum: ok yum-3.2.29-30.el6.centos.noarch
rpm: ok rpm-4.8.0-27.el6.x86_64
openssl: ok openssl-1.0.0-20.el6_2.5.x86_64
curl: ok curl-7.19.7-26.el6_2.4.x86_64
wget: ok wget-1.12-1.4.el6.x86_64
net-snmp: ok net-snmp-5.5-44.el6.x86_64
net-snmp-utils: ok net-snmp-utils-5.5-44.el6.x86_64
ntpd: UNAVAILABLE
ruby: UNAVAILABLE
puppet: UNAVAILABLE
nagios: UNAVAILABLE
ganglia: UNAVAILABLE
passenger: UNAVAILABLE
hadoop: ok hadoop-1.1.2.21-1.el6.x86_64
yum_repos: ok
HDP-1.2.0 HDP 53
HDP-UTILS-1.1.0.15 Hortonworks Data Platform Utils Version – HDP-UTILS-1. 52
HDP-epel HDP-epel 8,555
zypper_repos: UNAVAILABLE
‘, None)
(‘INFO 2013-04-02 16:19:07,281 security.py:49 – SSL Connect being called.. connecting to the server
INFO 2013-04-02 16:19:07,352 Controller.py:103 – Unable to connect to: https://master.tpbidw.com:8441/agent/v1/register/slave2.tpbidw.com
Traceback (most recent call last):
File “/usr/lib/python2.6/site-packages/ambari_agent/Controller.py”, line 88, in registerWithServer
response = self.sendRequest(self.registerUrl, data)
File “/usr/lib/python2.6/site-packages/ambari_agent/Controller.py”, line 237, in sendRequest
self.cachedconnect = secur

One more, another issue is swedish å, ä and ö – where do I decide what character set to use?

regards
thomas

While I’m at it, here’s another question about loading data into HCatalog.
If I need to specify start- and stop point (as in mid(string, 4,7) – how would I do that?

Right now I got the feel that there is a lot of work to be done to the infile before I actually can load it.
I’m used to tell customers that they can send me any kind of file – and I like to keep it that way

regards
thomas

Hello, just recently downloaded and installed the sandbox (deployed on VirtualBox) on my laptop and am at the Pig tutorial. I have created the script, syntax check is ok, explain plan shows no issues, and I am executing the job.

The blue progress bar gets to about 5-10% and does not continue.

I noticed in Windows task manager that my disk I/O is pegged at 100% so i decided to reduce the data set from the default amount to only about 200 “IBM” records equaling 15kb. However, the issue persists…disk is pegged at 100%.

Also, I’ve observed via Ambari that various host components will restart. Specifically I’ve seen TaskTracker and the HBase RegionServer.

Hardware: Lenovo T410 with 8gb of RAM. i5 CPU @ 2.4 ghz.

Any ideas on what may be occurring that’s keeping my Pig process from completing? The Hive query tutorial worked fine even on the larger data set.

Thanks in advance for any feedback or ideas.

Hi!
Loading a, comma delimited, file into HCatalog. I run into problems when a row contain un unintended comma;
1005475-7 ,HÄGG,KARL-HENRIK ,0000000000,000000001,000000000014900,P

It’s the comma after HÄGG that I want to ignore.
In QlikView I use fixed length to sort this issue. How solve this in HCatalog?
Running Oracle VirtualBox and Sandbox.

regards
thomas

Another question is why would the screen say “All host checks were successful.”, but also say that one host failed? Isnt this contradictory?

http://prestonca.blogspot.com/

I am trying to setup a HDP cluster on two CentOS 6.4 servers: server1 & server2.
I followed every step in the manual on both boxes.
For the server setup steps at the end such as “ambari-server setup” etc, I ran those on server1.

On step 3.4. Confirm Hosts, it says
server1 Failed
server2 Success

Since I cant post images in this forum, here are the images of what I see: http://prestonca.blogspot.com/

I click on “Failed” and get this text:
STDERR
Permission denied (publickey,gssapi-keyex,gssapi-with-mic,password).
lost connection
I dont understand how server1 can have trouble connecting to server1, which is itself?

During deployment getting following errors and entire deployment failed . Any help or insight really appreciated
ERROR 2013-05-21 04:52:47,545 PuppetExecutor.py:189 – Error running puppet
‘undef’ from left operand of ‘in’ expression is not a string at /var/lib/ambari-agent/puppet/modules/hdp/manifests/params.pp:655 on node onet

Hi, I’ve been looking at the features of Tez.
1. From this blog, http://hortonworks.com/blog/introducing-tez-faster-hadoop-processing/ , it seems that Tez is a non-MR framework enabling the execution of a DAG in ONE job. This is not feasible in the MapReduce framework since a MR job can only consist of two steps, i.e., map and reduce. So you cannot do map-map-reduce or map-reduce-map-reduce, in a single job.

2. However, when I look at the manual of Tex here: http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.0.2/bk_installing_manually_book/content/rpm-chap-tez.html , it says: “The Tez AMPoolService or Tez Service is a service that launches and makes available a pool of pre-launched MapReduce AMs ( Tez AMs ). These AMs in the pool can, in turn, be configured to pre-allocate a number of containers to allow jobs to be launched and completed faster. To use the Tez Service, the clients must submit the jobs to this service instead of the ResourceManager.”

It seems that Tez is still conceptually under MR framework. Performance is improved compared to out-of-box MR framework by (1) pre-launching AM for MapReduce jobs (2)container reuse for MR tasks.

So which understanding is true, 1 or 2?
Thanks for the clarification in advance!
Wei