We recently sat down with Ben Markham, Big Data Architect, Xiilab and ODPi member about developing sensor data solutions, working with Hadoop, what the big data market looks like in South Korea, and how it is to develop for a South Korean company? READ MORE.
We feature speakers at 4th Annual Global Big Data Conference Aug 30 – Sep 1 2016 to catch up and find out what he or she is working on now and what’s coming next. This week we’re talking to John Mertic, ODPi Director, The Linux Foundation. READ MORE.
In this episode we have an interview with John Mertic about ODPi. There has been plenty of mystery and even some controversy about ODPi which we attempt to resolve for you. READ MORE.
As summertime rolls on, we can enjoy a little sun, a little rest, and a big opportunity to reflect on the key trends to watch in the second half of 2016. Here are a few of my predictions of what comes next: READ MORE.
What if you could open your market up with considerably little engineering effort? It’s happening with ODPi (Open Data Platform initiative) compliance, according to John Mertic, director of Program Management for ODPi and Open Mainframe Project at The Linux Foundation. READ MORE.
The mood of this week’s Hadoop Summit has felt wonderfully diverse. There is a cognitive disconnect between the incremental progress of dot release feature sets and the revolutionary new business and societal applications of the technology. READ MORE.
It was a big week for Big Data, with multiple vendors making announcements at this week’s Hadoop Summit in San Jose. Among the big multi-vendor announcements in the Hadoop ecosystem was one from Linux Foundation ODPi (Open Data Platform Initiative). READ MORE.
Altiscale, ArenaData, Hortonworks, IBM, and Infosys first to comply with industry standard for big data applications
SAN FRANCISCO, June 27, 2016 — ODPi, a nonprofit organization accelerating the open ecosystem of big data solutions, today announced that the Apache™ Hadoop® distributions products from Altiscale, ArenaData, Hortonworks, IBM, and Infosys are now ODPi Runtime Compliant. This ensures that their distributions provide big data application vendors a consistent set of base level expectations as defined by ODPi Runtime specification.
“Our members represent all key roles in the big data ecosystem – Apache Hadoop distros, ISVs, system integrators, solution providers and end users – and have brought their real-world experience in helping to align enterprise demands with the developer community,” said John Mertic, director of program management for ODPi. “Having Altiscale, ArenaData, Hortonworks, IBM, and Infosys declare compliance with the ODPi Runtime Specification is a strong step toward simplifying and standardizing the big data ecosystem to accelerate the delivery of business outcomes.”
ODPi’s work complements the Apache Software Foundation and helps companies use Apache Hadoop more effectively. The organization’s aim is to develop a cross-industry standard that enables developers to easily write applications that sit on top of big data stacks, lowering the costs of interoperability across systems.
ODPi Compliant Guidelines and Testing
Descending from Apache Hadoop 2.7, the Runtime Specification covers HDFS, YARN, and MapReduce components. It specifies how Apache components should be installed and configured and provides a set of tests for validation to make it easier to create big data solutions and data-driven applications.
To become ODPi compliant, the Apache Hadoop distributions submitted test results through a GitHub repository for specific products. To assist with compliance, ODPi provides a test suite and a reference build. The ODPi validation test suite guarantees that a distribution of Apache Hadoop from a compliant vendor or an end-user deployment of Apache Hadoop complies with the ODPi-defined specifications. The test framework and self-certification aligns closely with the Apache Software Foundation by leveraging Apache BigTop for comprehensive packaging, testing, and configuration.
Participation in the ODPi is open to anyone, with all work being done is public on GitHub. Developers can join the conversation on the mailing lists or Slack channel, as well as give feedback on the spec or provide tests for validating ODPi compliance.
What’s Next for ODPi
The ODPi Operations Specification to help enterprises improve installation and management of Apache Hadoop and Apache Hadoop-based applications will be available later this year. The Operations Specification leverages Apache Ambari as a reference project. Apache Ambari is an ASF project for provisioning, managing, and monitoring Apache Hadoop clusters.
Comments from Members
“The Apache Hadoop ecosystem is both expanding and evolving rapidly, which not only makes it hard for app developers to keep up with the wide variety of projects, it also makes it challenging for enterprise customers to commit to a Hadoop platform and agree on the capabilities that they need. The ODPi standard specification addresses these issues, providing a solid foundation and peace of mind to developers and enterprise customers. At Altiscale, we are excited to announce that the Altiscale Data Cloud is now officially ODPi Runtime compliant.” – Mike Maciag, COO at Altiscale
“As a small company running Apache Hadoop distributions and looking to expand in the Russian market, becoming ODPi Runtime compliant will help us provide current and future customers reassurance that their developing and testing applications will work across multiple platform providers.” – Dmitry Komarov, head of sales and marketing at ArenaData
“The compliance of various distributions and application vendors on the ODPi runtime is a milestone. It provides standardization and portability for developers as well as ISVs and cloud administrators. Ultimately the goal is to provide increased efficiency and lower maintenance impact. Our customers can expect much more flexibility in their deployments and choice of solutions.” – Smiti Sharma, Product Lead, Virtustream Cloud Services, EMC
“With Apache Hadoop distributions becoming ODPi Runtime compliant, we are able to focus on developing innovative applications and solutions for our customers that are compatible with the Hadoop ecosystem.” – Craig Rubendall, vice president of platform R&D, SAS
“We are proud to become ODPi Runtime compliant, which aligns with our Hortonworks Data Platform certification program. The ODPi common reference specs should lower the investment for application builders and increase the number of applications in the ecosystem, allowing us to provide greater value to our customers.” – Alan Gates, co-founder, Hortonworks
“ODPi is providing a common specification to develop big data apps, opening up choices for developers by enabling interoperability across different distribution and application offerings. Having this platform to count on, starting with a small, specific and consistent packaging model that lives within the ecosystem, is extremely valuable to application developers. This will be a key differentiator for IBM to serve customers, which is why we have become ODPi Runtime compliant.” – Ritika Gunnar, Vice President of Offerings, IBM Analytics
“Infosys is focused on growing the adoption of big data technologies in the enterprise by making significant improvements in areas like development and deployment tools, performance and security. By becoming ODPi Runtime compliant, we are providing a compatible solution to our enterprise clients in Banking, Aeronautics and Retail.” – Navin Budhiraja, SVP, Head of Architecture and Technology at Infosys Limited
ODPi is a nonprofit organization committed to simplification and standardization of the big data ecosystem with a common reference specification. As a shared industry effort, ODPi members represent big data technology, solution provider and end user organizations focused on promoting and advancing the state of Apache Hadoop® and big data technologies for the enterprise. For more information about ODPi, please visit: http://www.odpi.org.
Testing applications against Hadoop distributions is not fun, either for application developers or end users, and it takes up too much precious time. According to Alan Gates, co-founder of Hortonworks and ODPi member, that’s the issue the Open Data Platform initiative (ODPi) is here to solve: create a single test specification that works across all Hadoop distributions so developers can get back to creating innovative applications and end users can get back to making money, or curing cancer, or sending people into space. READ MORE.