cherezoff -

Top 10 information management stories of 2018

Ethics was the leading theme of data analytics in 2018, especially allied with AI. The Cambridge Analytica controversy represented that, and the idea that the UK could specialise in AI ethics emerged

In the field of information management, 2018 brought to the fore artificial intelligence (AI) and the ethics of data exploitation, both together and separately. This was dramatically made manifest in the notorious Cambridge Analytica controversy, where that company used Facebook data to, allegedly, influence the 2016 US presidential election and, possibly, the UK EU referendum.

Advanced analytics is increasingly melding with that machine learning sub-set of AI, with the rise, and now consolidation, of big data environments, such as data lakes, in organisations. Often, when people say “AI”, they really mean machine learning, which then feeds into the analytical work done by data scientists, using a plethora of data preparation and visualisation tools, as well as statistical analysis tools from SAS, the R programming language, Python, and so on.

The Cambridge Analytica case raised an ethical issue of particularly keen concern to early-career data scientists. Should they take a job with any company that seems to be capitalising on personal data in areas that regulation did not yet reach? “Just because you can does not mean you should” was a commonly expressed idea in the data science community. But what does it mean in practical terms? And can it win out over massive pay cheques?

That the UK could find an ethics niche in the global AI economy was one prominent idea that emerged from a House of Lords select committee report. Nigel Shadbolt, principal of Jesus College, Oxford and co-founder of the Open Data Institute, sat down with Computer Weekly in the summer to discuss this and other data matters.

Earlier in the year, Computer Weekly also looked at the work of the Data Lab in Scotland, which is supported by the national government there. And we found Dominic Raab, the then secretary of state for exiting the European Union, telling an audience of technology business people, in November, that the UK AI sector would be positively boosted by Brexit “done right”.

On the industry side of big data, we saw Hadoop (the open source distributed processing framework that manages data processing and storage) continue to diminish as two of the companies to which it gave birth – Cloudera and Hortonworks – decided to sink their differences and overcome their rivalry by becoming one entity. That will play out in 2019.

The gaining of business value from all the technology and people investments companies and organisations have made in big data over the past decade was a big theme in 2018 – as it was in 2016 and 2017. Some Silicon Valley startups and early-stage companies homed in on that, on the supply side. But we also saw, on the user side, practical demonstrations of value from data – including at Rome’s Fiumicino Airport, and at Kone and ThyssenKrupp.

But it was the ethics of data analytics and AI that was the leading information management theme of 2018, as Computer Weekly’s interview at the end of the year with Roger Taylor, chair of the new Centre for Data Ethics and Innovation, demonstrated.

1. The Cambridge Analytica case: What’s a data scientist to do?

How the Cambridge Analytica controversy highlighted data ethics issues especially dear to early career stage data scientists.

2.  Nigel Shadbolt on why the UK is well placed to lead on the ethics of AI

Nigel Shadbolt, principal of Jesus College, Oxford and co-founder of the Open Data Institute, underscored the ethics of artificial intelligence, and said it will shape the “naked ape” as tools always have

3. Data Lab CEO Gillian Docherty on how data can boost Scottish economy

Gillian Docherty, CEO of The Data Lab, outlined the organisation’s mission to turn analytics and artificial intelligence to benefit Scotland’s economy.

4. Dominic Raab: UK AI sector will get boost from EU exit ‘done right’

How the then Brexit secretary told a Tech Nation audience that leaving the EU could create opportunities for the UK technology sector.

5. Hortonworks Cloudera merger proposal stirs market pot

Read how the proposed merger between Hadoop distributors Cloudera and Hortonworks stung their rival MapR, and elicited analyst comment pointing up the threat from cloud players AWS, Google, and Microsoft.

6. Silicon Valley startups home in on pressing value from data

How a slew of California-based startup and early-stage data analytics companies promise CIOs better ways to get value from their investments in databases and analytics.

7. How artificial intelligence can aid and replace higher order human creativity

Much is made of AI augmenting human intelligence with simple automation, but might higher order human creativity go the same way?

8. Data analytics cuts queues and flight delays at Rome’s Fiumicino Airport

Aeroporti di Roma’s CIO, Emiliano Sorrenti, describes how the city’s main airport is using data analytics technology to reduce delays and queue times.

9. AI elevates predictive maintenance for Kone and ThyssenKrupp

How Kone and ThyssenKrupp are using artificial intelligence to improve predictive maintenance of their lifts and escalators.

10. Interview: Roger Taylor, chair, Centre for Data Ethics and Innovation

Chair of the new Centre for Data Ethics and Innovation says collaboration is vital for developing effective frameworks to manage the proliferation of AI and data-driven technologies.

Read more on Big data analytics

Data Center
Data Management