Will the most recent version of DSS run against HDP 2.3

Options
UserBird
UserBird Dataiker, Alpha Tester Posts: 535 Dataiker
Just curious if DSS 2.0.2 will function with Hadoop Hortonworks Data Platform version 2.3 (most recent)? Compatibility doesn't have to be perfect, but would need to be able to execute normal read/writes to HDFS and execute Hive queries.



Also, is one able to connect to a Hadoop cluster in general using the Community Edition of DSS, or is that an Enterprise feature only?
Tagged:

Answers

  • Clément_Stenac
    Clément_Stenac Dataiker, Dataiku DSS Core Designer Posts: 753 Dataiker
    Options
    Hi Matt,

    We haven't yet had the opportunity to qualify DSS on HDP 2.3

    There are a few known issues starting with HDP 2.2.4, related to the switch to Tez as the default execution engine. The main issue is that many interactions with Hive become extremely slow. This is related to the fact that a simple query like "show tables" on a new Hive instance now spins up a Tez context, which in turn starts up a YARN container.

    We have some plans to improve this but they are not yet implemented as of DSS 2.0.2
Setup Info
    Tags
      Help me…