The University of Dundee is adding a data engineering MSc degree to its business intelligence and data science...
The course begins in October and consists of six modules covering Nosql, large-scale data handling, programming for data science, data mining and machine learning, computer vision and research methods. There are five fully-funded places, supported by the Scottish Funding Council.
Mark Whitehorn, emeritus professor, analytics, at the University of Dundee, said: “Data scientists develop new analytical solutions that turn raw data – often big data – into information. In doing so, they create a working prototype. Data engineers have the software and hardware engineering skills to take that prototype and develop it into a robust, scalable and deployable system.
“For example, a data scientist might develop an algorithmic solution to a big data problem in [the] R [programming language] which works for a single user and can analyse 20 million data points overnight.
"The data engineer will take that and design a hardware and software system to capture and store the data as it is acquired and a parallel processing version of the algorithm that can produce the answers in near-real time.”
More on IT education
The course content will include such elements as lambda architecture; cassandra, neo4j and other Nosql databases; and data engineering languages such as python, erlang, R and matlab.
Students will undertake a six-month research project that can be carried out in conjunction with an industrial partner.
“There is a lot of hype in this area. There won’t be as many jobs as there are in, say, web design, but then there are far fewer qualified people. And the job is fascinating and it won’t go away," Whitehorn added.
“But you do need to be genuinely fascinated by numbers. Only go into it if you find patterns in data fascinating.”