Using HIVE Corr gives erroneous results

to create new topics or reply. | New User Registration

This topic contains 0 replies, has 1 voice, and was last updated by  Lars Christoffersen 1 year, 10 months ago.

  • Creator
    Topic
  • #36077

    Lars Christoffersen
    Participant

    HI
    I am trying to correlate some temperatures and power consumption.
    When I use HIVE Corr on a small number of values in the Sandbox I get the correct result.
    When I use PIG COR which is slow, I get also the right results.When I use HIVE CORR, which is fast the results are complete wrong on a scale of up to a factor of 10. Both values are double. Does any body have similar experiences? Could CORR be incorrectly implemented on HDInsight?

You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.