Chicken & waffles for data scientists, hello DataOps

It had to happen.

DevOps consolidated the developer and operations functions into one ‘workplace culture’ and so came together the previously separately plated chicken & waffles of the software engineering world into a new (apparently harmonious) union.

Some even talk of DevSecOps, with security as the special sauce… such has been the apparent industry acceptance of the DevOps term.

But this is the age of data analytics, big data, data governance, data compliance, data deduplication, log data, machine data (Ed – we get the point) and so on… shouldn’t data itself get a departmentally unifying portmanteau all of its own?

The answer is yes, it should… and when you add operational excellence to data you (obviously) get DataOps.

DataOps is here

Data convergence player MapR has come forward with its DataOps Governance Framework.

The ‘framework’ (well, company initiative with custom-tuned software services relating to the core MapR stack) will integrate the MapR Converged Data Platform with selected partner technologies.

It aims is to help companies meet compliance requirements for data governance beyond traditional big data environments such as Apache Hadoop.

According to a MapR press statement, this technology is tailored for organisational data transformation and data lineage requirements — further, it focuses on data quality and integrity to help meet obligatory compliance, including data privacy requirements.  

“By providing a comprehensive open approach to data governance, organisations can operate a DataOps-first methodology where teams of data scientists, developers and other data-focused roles can train machine learning models and deploy them to production. DataOps development environments foster agile, cross-functional collaboration and fast time-to-value that benefits the entire enterprise,” said Mitesh Shah, senior technologist at MapR.  

Shah finishes by claiming that the MapR DataOps Governance Framework lets organisations extend required data lineage and other governance needs across clouds, on-premises and to the edge with all data in any application – even those considered outside of the big data realm.

Join the conversation


Send me notifications when other members comment.

Please create a username to comment.

How would you rate your interest in Microsoft Azure, given recent updates?
I like Windows Azure layer of abstraction to the cloud, it provides the foundation to write scalable apps if you create them from the ground up as 'pure' Windows Azure apps. Microsoft still needs to address SQL Azure limitations when it comes to storage capacity per DB
Still not certain we're ready to go the Public Cloud route. Data integrity and security are concerns. So is reliability and HA. Azure Appliance appears to be the only way to take Azure private, and the appliance doesn't appear to be fully baked either. And there's the issue of Linux support.
There has to be a combination of private and public clouds in the future computing.
I am waiting with anticipation IaaS VM in the cloud capabilities.
Sure! Actually Amazon Cloud Services are the best services in Cloud. Only must be mandatory improve in Data Protection and Privacy.
Azure will come out on top
PAAS = another Microsoft lock-in.

Amazon has a track record of lowering prices, Microsoft starts low, and then increases.
Virtualization and security need to be the focus.
They have a pretty compelling offering, especially for folks that have stacks running on Windows. I'm working on an application that's currently Linux-based, but I'm considering deploying on Azure. The change shouldn't be too hard; after all, that's the advantage of all of this cross-platform technology created over the past 10-15 years!
Will sytill wait for the finer details on migration
Microsoft alone can afford to tackle challenges and come up as the leader.
I could care less. Way to many innovative folks coming. MCSFT is older than Jesus. What the hell can they bring?
Azure is a big-time player in the cloud and every time they make major moves - which is becoming more frequent - they attract more customers and more workloads.
I was not aware of this "reintrudction"....