What is DataOps?

We’re so done with DevOps. Today, it’s a case of DevOps + DataOps, but what does this latter term mean?

What is DataOps?

DataOps describes the creation & curation of a central data hub, repository and management zone designed to collect, collate and then onwardly distribute data such that data analytics can be more widely democratised across an entire organisation and, subsequently, more sophisticated layers of analytics can be brought to bear such as built-for-purpose analytics engines.

As more users start to demand data in more combinations in more locations in more use cases at more definable parts of the application and data analytics lifecycles, DataOps is there with its approach to distributed data architecture to serve this need.

As tamr database guru Andy Palmer puts it, “DataOps acknowledges the interconnected nature of data engineering, data integration, data quality and data security/privacy —  and aims to help an organization rapidly deliver data that accelerates analytics and enables previously impossible analytics.”

For more here, let’s focus on TechTargets existing definition here and remind ourselves that as with DevOps, there are no DataOps software tools as such; there are only frameworks and related tool sets that support a DataOps approach to collaboration and increased agility.

“Such tools include include ETL/ELT tools, data curation and cataloging tools, and log analyzers and systems monitors,” notes the site.

What’s new in DataOps?

Why the back to school DataOps 101 you ask? Easy… firms are starting to use this ‘discipline’ (or approach) to drive new platform enhancements.

DataOps company Centiq has announced CenSQL, an open source contribution aimed at SAP HANA developers.

As a Command Line Interface developed in-house for its own needs, CenSQL is now offered free as part of Centiq’s effort to establish its innovations at the centre of the SAP HANA development community.

As HANA proves its worth in UK organisations, with some 74% of projects coming in on time and to budget, its developer community is growing strongly. These developers are increasingly spanning two different skillsets, that of development and those of operations, in what has become known as DevOps.

According to Centiq, “As the use of DevOps techniques increases amongst SAP HANA users, developers are struggling to meet continuously more exacting productivity targets. This constant battle to stay ahead of business demands can make the lives of IT professionals increasingly time-constrained. Basic processes, such as checking memory allocations, balancing workloads and avoiding any impact on production systems, cannot be neglected despite the constant demand for more efficient code production.”

CenSQL claims to makes life easier for DevOps teams as it:

  • Provides a user interface with easily accessible system insights, allowing them to visually monitor key metrics during the coding process.
  • Gives its users the ability to investigate and troubleshoot possible issues with data or system health and be more productive.
  • Has many built-in commands useful for exploring/researching SAP HANA features.

Glyn Heath, CEO of Centiq has commented to say that his firm often has to break new ground, whether this means cutting new custom code, configuring new systems or creating from scratch new capabilities, like CenSQL.

“It became apparent that, CenSQL, just like Optiq, our state-of-the art monitoring and visualisation platform, was too good to keep to ourselves. The right thing to do was to offer it to the world as an open source download and share its ability to speed up HANA development,” confirmed Heath.

< class="wp-caption-text">multipurpose businessman