All Posts By


Apache™ Hadoop® Distributions Now ODPi Runtime Compliant

By Announcements

Altiscale, ArenaData, Hortonworks, IBM, and Infosys first to comply with industry standard for big data applications

SAN FRANCISCO, June 27, 2016ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced that the Apache™ Hadoop® distributions products from Altiscale, ArenaData, Hortonworks, IBM, and Infosys are now ODPi Runtime Compliant. This ensures that their distributions provide big data application vendors a consistent set of base level expectations as defined by ODPi Runtime specification.

“Our members represent all key roles in the big data ecosystem – Apache Hadoop distros, ISVs, system integrators, solution providers and end users – and have brought their real-world experience in helping to align enterprise demands with the developer community,” said John Mertic, director of program management for ODPi. “Having Altiscale, ArenaData, Hortonworks, IBM, and Infosys declare compliance with the ODPi Runtime Specification is a strong step toward simplifying and standardizing the big data ecosystem to accelerate the delivery of business outcomes.”

ODPi’s work complements the Apache Software Foundation and helps companies use Apache Hadoop more effectively. The organization’s aim is to develop a cross-industry standard that enables developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems.

ODPi Compliant Guidelines and Testing

Descending from Apache Hadoop 2.7, the Runtime Specification covers HDFS, YARN, and MapReduce components. It specifies how Apache components should be installed and configured and provides a set of tests for validation to make it easier to create big data solutions and data-driven applications.

To become ODPi compliant, the Apache Hadoop distributions submitted test results through a GitHub repository for specific products. To assist with compliance, ODPi provides a test suite and a reference build. The ODPi validation test suite guarantees that a distribution of Apache Hadoop from a compliant vendor or an end-user deployment of Apache Hadoop complies with the ODPi-defined specifications. The test framework and self-certification aligns closely with the Apache Software Foundation by leveraging Apache BigTop for comprehensive packaging, testing, and configuration.

Participation in the ODPi is open to anyone, with all work being done is public on GitHub. Developers can join the conversation on the mailing lists or Slack channel, as well as give feedback on the spec or provide tests for validating ODPi compliance.

What’s Next for ODPi

The ODPi Operations Specification to help enterprises improve installation and management of Apache Hadoop and Apache Hadoop-based applications will be available later this year. The Operations Specification leverages Apache Ambari as a reference project. Apache Ambari is an ASF project for provisioning, managing, and monitoring Apache Hadoop clusters.

Comments from Members


“The Apache Hadoop ecosystem is both expanding and evolving rapidly, which not only makes it hard for app developers to keep up with the wide variety of projects, it also makes it challenging for enterprise customers to commit to a Hadoop platform and agree on the capabilities that they need. The ODPi standard specification addresses these issues, providing a solid foundation and peace of mind to developers and enterprise customers. At Altiscale, we are excited to announce that the Altiscale Data Cloud is now officially ODPi Runtime compliant.” – Mike Maciag, COO at Altiscale


“As a small company running Apache Hadoop distributions and looking to expand in the Russian market, becoming ODPi Runtime compliant will help us provide current and future customers reassurance that their developing and testing applications will work across multiple platform providers.” – Dmitry Komarov, head of sales and marketing at ArenaData

EMC Corporation

“The compliance of various distributions and application vendors on the ODPi runtime is a milestone. It provides standardization and portability for developers as well as ISVs and cloud administrators. Ultimately the goal is to provide increased efficiency and lower maintenance impact. Our customers can expect much more flexibility in their deployments and choice of solutions.” – Smiti Sharma,  Product Lead, Virtustream Cloud Services, EMC


“With Apache Hadoop distributions becoming ODPi Runtime compliant, we are able to focus on developing innovative applications and solutions for our customers that are compatible with the Hadoop ecosystem.” – Craig Rubendall, vice president of platform R&D, SAS


“We are proud to become ODPi Runtime compliant, which aligns with our Hortonworks Data Platform certification program. The ODPi common reference specs should lower the investment for application builders and increase the number of applications in the ecosystem, allowing us to provide greater value to our customers.” – Alan Gates, co-founder, Hortonworks


“ODPi is providing a common specification to develop big data apps, opening up choices for developers by enabling interoperability across different distribution and application offerings. Having this platform to count on, starting with a small, specific and consistent packaging model that lives within the ecosystem, is extremely valuable to application developers. This will be a key differentiator for IBM to serve customers, which is why we have become ODPi Runtime compliant.” – Ritika Gunnar, Vice President of Offerings, IBM Analytics


“Infosys is focused on growing the adoption of big data technologies in the enterprise by making significant improvements in areas like development and deployment tools, performance and security. By becoming ODPi Runtime compliant, we are providing a compatible solution to our enterprise clients in Banking, Aeronautics and Retail.” – Navin Budhiraja, SVP, Head of Architecture and Technology at Infosys Limited

Additional Resources

About ODPi

ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference specification. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit:


Media Contact:

Natasha Woods
(415) 312-5289 “ODPi: Test Less, Build More Applications With Hadoop”

By News

Testing applications against Hadoop distributions is not fun, either for application developers or end users, and it takes up too much precious time. According to Alan Gates, co-founder of Hortonworks and ODPi member, that’s the issue the Open Data Platform initiative (ODPi) is here to solve: create a single test specification that works across all Hadoop distributions so developers can get back to creating innovative applications and end users can get back to making money, or curing cancer, or sending people into space. READ MORE.

Channel Insider “Playing Nice Within the Hadoop Ecosystem”

By News

Although interest in all things relating to Hadoop is running high, there’s a lot of contention these days behind the scenes between Cloudera, Hortonworks and MapR Technologies concerning when and where they can add value to the open-source platform. To mitigate some of that contention, a large number of independent software vendors banded together to form ODPi, a non-profit consortium that focuses on, among other things, how to make sure the run-time environments surrounding Hadoop remain consistent across multiple distributions of an open-source platform. READ MORE.

ODPi Becomes Gold Sponsor of The Apache Software Foundation

By Announcements


Sponsorship cements ODPi’s support for the upstream Apache® Hadoop® development community

Vancouver, B.C. – Apache: Big Data, May 11, 2016 — ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced it is a gold sponsor of The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 open source projects and initiatives. ODPi joins existing ASF sponsors: Hortonworks, IBM, Pivotal, and WANDisco, who are also ODPi members, in the industry effort to advance open source projects for the big data ecosystem.

Founded in February 2015, ODPi has always strived to build upon the innovative work of the ASF to help create a thriving and expanding Big Data ecosystem built around the success of Apache® Hadoop®. ODPi is committed on simplifying this growing ecosystem through the integration and standardization of a common reference platform called the ODPi Core, hence focusing on how to bring and deploy the different Apache projects together.

“We are pleased to welcome ODPi to the ASF Sponsorship program and their support of Apache big data projects,” said ASF Vice Chairman Greg Stein. “As analysts project that enterprises will fully embrace the Apache Hadoop ecosystem, Sponsor support is even more vital to our success in spearheading industry-leading innovations that are developed in a trusted, community-driven environment.”

ODPi has followed Apache big data projects, included Apache Hadoop in its Runtime Spec and Apache Bigtop in its test suite out this past March, as well as Apache Ambari in its Operation Spec due out this summer. Additionally, we are evaluating for future specs several other projects critical to advancing big data applications or providing the greatest impact on the greatest number of big data deployments. Guided by community and industry input, as a new crop of big data projects developed at the ASF mature, ODPi plans to incorporate additional upstream projects into ODPi Core.

“We are excited to sponsor the Apache Software Foundation to ensure ODPi is supporting development of the many projects in the Hadoop ecosystem,” said John Mertic, director of ODPi. “ODPi complements the work done in the Apache projects by focusing on easing integration and standardization for downstream application vendors and end-users that build upon Apache Hadoop. We believe our focus on the downstream Hadoop ecosystem helps oxygenate the big data market and stimulate growth.”

Additional Resources

About ODPi

ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference platform called ODPi Core. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit:

“Apache”, “Ambari”, “Apache Ambari”, “Bigtop”, “Apache Bigtop”, “Hadoop”, and “Apache Hadoop” are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.


Media Contact:

Natasha Woods
(415) 312-5289

Social Media Auto Publish Powered By :