Hi Snoot, So you are using S3 rather than HDFS correct for your data storage? Regards, Robert ...
So you are using S3 rather than HDFS correct for your data storage?
I’m not sure if this is the right forum but the question relates to FS counters.
I’m running HDP 1.3 on AWS and I don’t see the job counters for S3_bytes_read and S3_bytes_written when I’m accessing (reading,writing) data that resides in S3. I had the counters when I used CDH (3 and 4) and I also see them in HDP 2.0 but for some reason they’re not there in HDP 1.3.
Any ideas on where they are and how to get these counters to work?
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world