BEESWAX: json_tuple UDTF cannot handle $ (dollar sign) in JSON object key name

This topic contains 0 replies, has 1 voice, and was last updated by  Pasha F 1 year, 6 months ago.

  • Creator
    Topic
  • #28803

    Pasha F
    Member

    MongoDB JSON exports might include $ (dollar sing) in the object, making it impossible to run the query when ‘Enable Parameterization’ option is enabled. Key is treated as a parameter when specified in the query. I have tried escape character ‘\’ or ‘\\’ (without quotes) to no avail.

    Runs fine when the ‘Enable Parameterization’ option is disabled. Furthermore, SerDe has an option to map, i.e. WITH SERDEPROPERTIES ( “mapping.myentities” = “my$entities” )

    JSON extract:
    { “_id” : { “$oid” : “51d1d21de75dbf00050000b4″ } }
    { “date_modified” : { “$date” : 1372705189474 } }

    Query extract:
    lateral view json_tuple(b.id, “$oid”) e as id
    lateral view json_tuple(b.date_created, “$date”) d as date_created

    Thanks,

    Pasha

You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.