Forrester Research’s big data analysts recently stated in a new research report, Forrester Wave™: Big Data Hadoop Distributions, Q1 2016, that adopting Hadoop is “mandatory” for any organization that wishes to do advanced analytics and get actionable insights on their data. Yet Forrester also estimates that between 60% and 73% of data that enterprises have access to goes unused for business intelligence and analytics.
With application developer and delivery professionals adopting Hadoop “en masse,” the analyst firm predicts that 100% of all large enterprises will adopt Hadoop and related technologies such as Spark for big data analytics within the next two years.
With such industry need for Hadoop, ODPi is looking forward to helping make adoption and interoperability easy for enterprises in the Hadoop ecosystem. We just announced our first release and have a strong release schedule and roadmap for 2016.
ODPi Release Schedule
- March 31: The first release of the ODPi Runtime specification and test suite, which will ensure applications work across multiple Apache Hadoop® distributions.
- June/July: The first release of the ODPi Operational specification, run on Ambari 18.104.22.168, to help enterprises improve installation and management of Hadoop and Hadoop-based applications.
- September: The second release of the ODPi Runtime specification and test suite.
- Establish user advisory council with six end user members.
- Ensure that three Hadoop vendor members ship an ODPi Runtime compliant distributions.
- Enable ISVs to indicate their compatibility with the ODPi reference implementation.
- Include member-confirmed projects in next release.
- Plan certification programs to avoid splintering the code. A roadmap beyond one-size-fits-all certification and solving future customer challenges today.
We look forward to Hadoop distribution vendors becoming become ODPi Runtime Compliant. Here’s how the process works.
Runtime Spec Compliance and Certification
- ODPi Runtime Compliance is achieved through self-certification by Hadoop Distro vendors, which takes a few days tops.
- The ODPi Test Framework is based on Apache Bigtop.
- Bigtop is an Apache Software Foundation project for Infrastructure Engineers and Data Scientists looking for comprehensive packaging, testing, and configuration of the leading open source big data components. Bigtop supports a wide range of components/projects, including, but not limited to, Hadoop, HBase and Spark.
- BONUS: Over half the code in the latest Bigtop release originated in ODPi.
- All ODPi Runtime Compliance tests are linked directly to lines in the ODPi Runtime Specification.
- To assist with compliance, in addition to the test suite, ODPi also provides a reference build.
Become a member of ODPi; Visit www.odpi.org/members and scroll to the bottom or get involved with the ODPi project on GitHub by signing up for our mailing list or sending pull requests. Membership is not a requirement to become involved with ODPi’s technology and all development is done in the open. Visit www.github.com/odpi/specs.