Auto Trader UK cuts IT resource use through Google Cloud, Kubernetes and Istio adoption

Multi-cloud moves with Google Cloud

As part of that process, Warman is currently overseeing the migration of a sizeable chunk of Auto Trader’s customer-facing application estate to the Google Cloud Platform (GCP).

These applications have, to date, been hosted within a private cloud environment in Auto Trader’s two datacentres. The decision to switch up its hosting arrangements is part of a wider push by the company to embrace cloud-native application development principles, microservices and container-based technologies, said Warman.

A total of 250 applications need moving, and more than 160 have already been migrated across. The organisation is confident this process will be wrapped up within the next 12 months.

By the middle of 2019, it is also on course to have the crown jewels of its online estate, the Auto Trader website, running on the GCP too.

“We still have our datacentres, and we are in the process of moving our applications to a multi-cloud environment, and we will be across three cloud providers,” said Warman.

“The majority of the applications we use for our customer-facing websites and the applications that support that will all sit on Google Cloud, though.”

Another major motivating factor was the fact that the company wanted to retroactively add end-to-end encryption capabilities to its application estate, in response to customer demand. The problem was trying to achieve this within its existing, virtual machine-based infrastructure setup.

In particular, the organisation wanted to upgrade the security layers between its applications by implementing mutual transport layer security authentication, said Warman.

“We operate the UK’s largest automotive marketplace, and part of that is connecting buyers and sellers together,” he said. “We literally provide a platform for people to indicate an interest in buying a car, and we pass that lead on to the retailer.

“A customer we were talking to wanted us to be able to do that and send that message in a secure way, so the message is encrypted while in transit and at rest.”

Combining Google Kubernetes Engine with Istio

Following some abortive attempts to address that issue on-premise, the organisation decided to move its applications over to GCP, where it could tap into some of Google’s emerging Kubernetes management and service mesh technology, in the form of Istio.  

“It was a problem we spent weeks and then months trying to fix on-premise and then we managed to fix it with Google Kubernetes Engine (GKE) and Istio in less than a fortnight,” said Warman.

Auto Trader is known to be one of the first Google reference customers for Istio, following its launch at the technology giant’s Google Cloud Next Conference in July 2018, where it was hailed as an important component of the firm’s wider hybrid cloud proposition for enterprises.

It is essentially an open source service mesh that Google claims can help enterprises connect and secure the microservices that make up their application estates in a uniform way by managing traffic flows between them, and enforcing security and access policies without needing to alter any code.

Istio and GKE are marketed by Google as complementary technologies, with the latter providing enterprises with a managed environment in which to deploy containerised applications.

As well as enabling Auto Trader to solve its end-user encryption conundrum, the adoption of Istio and GKE has allowed the firm to gain a much more in-depth view of how IT resources are used within its infrastructure, and has cut down on previously unknown amounts of over-provisioning.

“We had a basic model of two CPUs and 2GB of RAM [allocated] for every application, and using Istio and GKE, we’ve been able to get quite granular into what the absolute resource requirements are for our applications,” said Warman.

“In a lot of cases, we’ve been able to give it just a quarter of a core, instead of two cores, or half a core or something. And then we’ve been able to drop the amount of memory down from 2GB to 512MB.

“We run something like 4,000 virtual machines across our datacentre, so, when you extrapolate that data, it is easy to appreciate how extraordinary the benefits of that could go on to be.”

Within four months of Istio making its debut at Google Cloud Next 2018, it was already becoming part of Auto Trader’s multi-cloud technology stack, which, said Warman, is a good indication of the early adopter attitude Auto Trader has pervading throughout the organisation.

“We are not frightened about adopting technology early,” said Warman. “We’ve done it consistently with a lot of technologies through the lifecycle of Auto Trader, in that we’ve been online since 1996, so slightly ahead of when Google was first born. We’ve adopted new technologies very quickly in that time.”

Some organisations might have a tendency to wait to adopt new technologies until others have proved the use case for it, but that is not how Auto Trader works, said Warman.

“We were really early into virtualisation, deploying things like VMware ahead of other people, and we’re not frightened to make bold decisions when it comes to technology if it allows us to achieve some of our goals – and that was definitely the case with Istio,” he said.

It was also useful that one of Warman’s colleagues already had experience of an early incarnation of Istio in a previous role and could see the potential for it to transform the security posture of Auto Trader in its customer-facing applications, while drastically reducing the IT resources they use.

The fact that the company essentially had a direct line into Google Cloud’s Istio team, who were on hand to help fix any bugs they encountered during the roll-out, is another reason why the firm had no qualms about getting involved with it, said Warman.

“One of the people in my team worked very closely with Istio, and they were having regular calls feeding back on problems they had found and fixing those as they went through alpha and beta,” he said.

“That’s why we had the confidence to push ahead because we really had a strong partnership with Google.”