The mood of this week’s Hadoop Summit has felt wonderfully diverse. There is a cognitive disconnect between the incremental progress of dot release feature sets and the revolutionary new business and societal applications of the technology. READ MORE.
It was a big week for Big Data, with multiple vendors making announcements at this week’s Hadoop Summit in San Jose. Among the big multi-vendor announcements in the Hadoop ecosystem was one from Linux Foundation ODPi (Open Data Platform Initiative). READ MORE.
Altiscale, ArenaData, Hortonworks, IBM, and Infosys first to comply with industry standard for big data applications
SAN FRANCISCO, June 27, 2016 — ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced that the Apache™ Hadoop® distributions products from Altiscale, ArenaData, Hortonworks, IBM, and Infosys are now ODPi Runtime Compliant. This ensures that their distributions provide big data application vendors a consistent set of base level expectations as defined by ODPi Runtime specification.
“Our members represent all key roles in the big data ecosystem – Apache Hadoop distros, ISVs, system integrators, solution providers and end users – and have brought their real-world experience in helping to align enterprise demands with the developer community,” said John Mertic, director of program management for ODPi. “Having Altiscale, ArenaData, Hortonworks, IBM, and Infosys declare compliance with the ODPi Runtime Specification is a strong step toward simplifying and standardizing the big data ecosystem to accelerate the delivery of business outcomes.”
ODPi’s work complements the Apache Software Foundation and helps companies use Apache Hadoop more effectively. The organization’s aim is to develop a cross-industry standard that enables developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems.
ODPi Compliant Guidelines and Testing
Descending from Apache Hadoop 2.7, the Runtime Specification covers HDFS, YARN, and MapReduce components. It specifies how Apache components should be installed and configured and provides a set of tests for validation to make it easier to create big data solutions and data-driven applications.
To become ODPi compliant, the Apache Hadoop distributions submitted test results through a GitHub repository for specific products. To assist with compliance, ODPi provides a test suite and a reference build. The ODPi validation test suite guarantees that a distribution of Apache Hadoop from a compliant vendor or an end-user deployment of Apache Hadoop complies with the ODPi-defined specifications. The test framework and self-certification aligns closely with the Apache Software Foundation by leveraging Apache BigTop for comprehensive packaging, testing, and configuration.
Participation in the ODPi is open to anyone, with all work being done is public on GitHub. Developers can join the conversation on the mailing lists or Slack channel, as well as give feedback on the spec or provide tests for validating ODPi compliance.
What’s Next for ODPi
The ODPi Operations Specification to help enterprises improve installation and management of Apache Hadoop and Apache Hadoop-based applications will be available later this year. The Operations Specification leverages Apache Ambari as a reference project. Apache Ambari is an ASF project for provisioning, managing, and monitoring Apache Hadoop clusters.
Comments from Members
“The Apache Hadoop ecosystem is both expanding and evolving rapidly, which not only makes it hard for app developers to keep up with the wide variety of projects, it also makes it challenging for enterprise customers to commit to a Hadoop platform and agree on the capabilities that they need. The ODPi standard specification addresses these issues, providing a solid foundation and peace of mind to developers and enterprise customers. At Altiscale, we are excited to announce that the Altiscale Data Cloud is now officially ODPi Runtime compliant.” – Mike Maciag, COO at Altiscale
“As a small company running Apache Hadoop distributions and looking to expand in the Russian market, becoming ODPi Runtime compliant will help us provide current and future customers reassurance that their developing and testing applications will work across multiple platform providers.” – Dmitry Komarov, head of sales and marketing at ArenaData
“The compliance of various distributions and application vendors on the ODPi runtime is a milestone. It provides standardization and portability for developers as well as ISVs and cloud administrators. Ultimately the goal is to provide increased efficiency and lower maintenance impact. Our customers can expect much more flexibility in their deployments and choice of solutions.” – Smiti Sharma, Product Lead, Virtustream Cloud Services, EMC
“With Apache Hadoop distributions becoming ODPi Runtime compliant, we are able to focus on developing innovative applications and solutions for our customers that are compatible with the Hadoop ecosystem.” – Craig Rubendall, vice president of platform R&D, SAS
“We are proud to become ODPi Runtime compliant, which aligns with our Hortonworks Data Platform certification program. The ODPi common reference specs should lower the investment for application builders and increase the number of applications in the ecosystem, allowing us to provide greater value to our customers.” – Alan Gates, co-founder, Hortonworks
“ODPi is providing a common specification to develop big data apps, opening up choices for developers by enabling interoperability across different distribution and application offerings. Having this platform to count on, starting with a small, specific and consistent packaging model that lives within the ecosystem, is extremely valuable to application developers. This will be a key differentiator for IBM to serve customers, which is why we have become ODPi Runtime compliant.” – Ritika Gunnar, Vice President of Offerings, IBM Analytics
“Infosys is focused on growing the adoption of big data technologies in the enterprise by making significant improvements in areas like development and deployment tools, performance and security. By becoming ODPi Runtime compliant, we are providing a compatible solution to our enterprise clients in Banking, Aeronautics and Retail.” – Navin Budhiraja, SVP, Head of Architecture and Technology at Infosys Limited
ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference specification. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit: http://www.odpi.org.
Testing applications against Hadoop distributions is not fun, either for application developers or end users, and it takes up too much precious time. According to Alan Gates, co-founder of Hortonworks and ODPi member, that’s the issue the Open Data Platform initiative (ODPi) is here to solve: create a single test specification that works across all Hadoop distributions so developers can get back to creating innovative applications and end users can get back to making money, or curing cancer, or sending people into space. READ MORE.
Although interest in all things relating to Hadoop is running high, there’s a lot of contention these days behind the scenes between Cloudera, Hortonworks and MapR Technologies concerning when and where they can add value to the open-source platform. To mitigate some of that contention, a large number of independent software vendors banded together to form ODPi, a non-profit consortium that focuses on, among other things, how to make sure the run-time environments surrounding Hadoop remain consistent across multiple distributions of an open-source platform. READ MORE.
The Apache Software Foundation oversees more than 350 open source projects and initiatives, supported by a diverse global community of committers. This thriving open source community was in full force this week at Apache: Big Data and ApacheCon North America in Vancouver. READ MORE.
Today at Apache Big Data North America 2016, the Open Data Platform initiative (ODPi) announced that it has become a gold sponsor of the Apache Software Foundation (ASF). READ MORE.
Sponsorship cements ODPi’s support for the upstream Apache® Hadoop® development community
Vancouver, B.C. – Apache: Big Data, May 11, 2016 — ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced it is a gold sponsor of The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 open source projects and initiatives. ODPi joins existing ASF sponsors: Hortonworks, IBM, Pivotal, and WANDisco, who are also ODPi members, in the industry effort to advance open source projects for the big data ecosystem.
Founded in February 2015, ODPi has always strived to build upon the innovative work of the ASF to help create a thriving and expanding Big Data ecosystem built around the success of Apache® Hadoop®. ODPi is committed on simplifying this growing ecosystem through the integration and standardization of a common reference platform called the ODPi Core, hence focusing on how to bring and deploy the different Apache projects together.
“We are pleased to welcome ODPi to the ASF Sponsorship program and their support of Apache big data projects,” said ASF Vice Chairman Greg Stein. “As analysts project that enterprises will fully embrace the Apache Hadoop ecosystem, Sponsor support is even more vital to our success in spearheading industry-leading innovations that are developed in a trusted, community-driven environment.”
ODPi has followed Apache big data projects, included Apache Hadoop in its Runtime Spec and Apache Bigtop in its test suite out this past March, as well as Apache Ambari in its Operation Spec due out this summer. Additionally, we are evaluating for future specs several other projects critical to advancing big data applications or providing the greatest impact on the greatest number of big data deployments. Guided by community and industry input, as a new crop of big data projects developed at the ASF mature, ODPi plans to incorporate additional upstream projects into ODPi Core.
“We are excited to sponsor the Apache Software Foundation to ensure ODPi is supporting development of the many projects in the Hadoop ecosystem,” said John Mertic, director of ODPi. “ODPi complements the work done in the Apache projects by focusing on easing integration and standardization for downstream application vendors and end-users that build upon Apache Hadoop. We believe our focus on the downstream Hadoop ecosystem helps oxygenate the big data market and stimulate growth.”
- View The Runtime Specification
- Obtain Images to Get Started with Testing
- Learn About ODPi Membership
- ODPi Blog
ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference platform called ODPi Core. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit: http://www.odpi.org.
“Apache”, “Ambari”, “Apache Ambari”, “Bigtop”, “Apache Bigtop”, “Hadoop”, and “Apache Hadoop” are registered trademarks or trademarks of the Apache Software Foundation in the United States and/or other countries. All other brands and trademarks are the property of their respective owners.
At Apache: Big Data North America in Vancouver next week — alongside a huge array of keynotes, panels and tutorials — the ASF and ODPi will host a Q&A session about their collaboration and address concerns about project independence. READ MORE