Serving over 15 million customers, with more than 2,000 branches in the UK and Ireland, the bank will use WebSphere as its strategic Web application serving and middleware environment, and was chosen ahead of similar products from rivals BEA and Oracle.
Steve North, head of strategy and architecture at Royal Bank of Scotland Group Technology says: "This choice was based on IBM and WebSphere's superior ability to meet a specific set of requirements.
"This included a proven commitment to open standards and hardware platform independence; the strongest capability to leverage and integrate with our existing IT infrastructure; and the enhanced development productivity we can achieve through its closely integrated Visual Age and WebSphere Studio tools.'
IBM would not reveal the value of the deal.
Read more on Web software
RBS gets down with the youth as digital bank invests in fintech Loot
Why do UK banks suffer more software failures than those in other countries?
RBS, Barclays and NatWest customers suffer more mobile banking outages
RBS announces branch closures as part of cancelled project to create challenger bank