Replies: 0
Hi All, Ajay
We are working on a YARN based product and about to release – however the YARN API went through a few changes (new exceptions, package changes, features, etc) between minor versions of 2.x. Due to the nature of the size, frequency and types of jobs we use GPB, not the REST API.
Currently the HDP 2.0 is coming with the 2.1 version, those who use Spring YARN they have to use 2.0.5, those who are using Continuuity Weave they have to go against 2.0.2 onwards and those who use Storm-YARN they have to use 2.0.3.
We are an advocate of Hortonwork’s approach to Hadoop and most of the time we recommend our customers to try out our products on HDP – however right now our product is using Spring Data and Storm as well and it can not be run on HDP 2.0.
My question is – can you let us now whether future releases of HDP 2.0 will use the current API version or you plan to move forward – in Nexus there are already 2.x and 3.x snapshots available for the YARN API.
We are about to contribute the upgrade(s) back for those who’d like to use Spring Data/Hadoop, however we’d like to know which version(s) to support – and how stable is the current YARN API?
Thanks,
Janos/ITegration