RDMA is Turing complete, we just did not know it yet!

Waleed Reda, Marco Canini, Dejan Kostic, Simon Peter

Research output: Chapter in Book/Report/Conference proceedingConference contribution

13 Scopus citations

Abstract

It is becoming increasingly popular for distributed systems to exploit offload to reduce load on the CPU. Remote Direct Memory Access (RDMA) offload, in particular, has become popular. However, RDMA still requires CPU intervention for complex offloads that go beyond simple remote memory access. As such, the offload potential is limited and RDMAbased systems usually have to work around such limitations. We present RedN, a principled, practical approach to implementing complex RDMA offloads, without requiring any hardware modifications. Using self-modifying RDMA chains, we lift the existing RDMA verbs interface to a Turing complete set of programming abstractions. We explore what is possible in terms of offload complexity and performance with a commodity RDMA NIC. We show how to integrate these RDMA chains into applications, such as the Memcached keyvalue store, allowing us to offload complex tasks such as key lookups. RedN can reduce the latency of key-value get operations by up to 2.6x compared to state-of-the-art KV designs that use one-sided RDMA primitives (e.g., FaRM-KV), as well as traditional RPC-over-RDMA approaches. Moreover, compared to these baselines, RedN provides performance isolation and, in the presence of contention, can reduce latency by up to 35x while providing applications with failure resiliency to OS and process crashes.
Original languageEnglish (US)
Title of host publication19th USENIX Symposium on Networked Systems Design and Implementation (NSDI)
PublisherarXiv
Pages71-85
Number of pages15
StatePublished - 2022

Fingerprint

Dive into the research topics of 'RDMA is Turing complete, we just did not know it yet!'. Together they form a unique fingerprint.

Cite this