DatArcs Turns Up Performance Heat for Networking Giant Mellanox

When we think about top datacenter network performance, no name comes to mind faster than Mellanox—the undisputed leader in HPC and large-scale datacenter connectivity.

With so much sophistication built into its network cards to help end users realize blazing fast speed and reliability, Mellanox customers want to take the fastest path to optimization. As we know, fine-tuning system components takes time and expertise, and an advanced Mellanox network card is no exception.

This is why a technical partnership between Mellanox and DatArcs—a fast-growing provider of automatic tuning and optimization software for a wide range of datacenter applications—makes practical, time-saving, performance-boosting sense. For Mellanox, as well as for the company’s diverse range of customer applications that require the best application performance: lowest latency, bandwidth maximization and CPU demand optimization.

Under the collaboration, the DatArcs development team will take its own expertise in creating auto-tuning and optimization software for CPU performance and adapt that to Mellanox networking gear. This means that instead of sending legions of performance engineers to help users get the most out of their applications by manually tuning the many available knobs and dials, Mellanox can get their end users up and running at the top of their game—out of the gate, and without long hours spent looping through options and optimizations.

“This partnership will allow Mellanox to ship highly-tuned products with lower effort. With their large number of customers with an incredible range of applications that require high performance network performance, we think this is a win-win for both Mellanox and their user base,” says Dr. Tomer Morad, CEO of DatArcs.

“Given the wide range of applications our customers are running and Mellanox’s highly configurable and flexible networking gear, using the automatic tuning tool DatArcs Optimizer to reduce or even eliminate manual tuning time makes a lot of sense.”, says Dror Goldenberg, VP of Software Architecture at Mellanox, “With DatArcs technology we can enable optimal tuning to different networking workloads varying from HPC to cloud, storage, NFV and artificial intelligence.”

DatArcs Optimizer is automatic and tunes without any user input; it is adaptive in its ability to detect the phase of the application and workload characteristics; it is extensible, which allows Mellanox and its end users to add their own tunable parameters and knobs based on application needs and perhaps most important, it is flexible. This means Optimizer can tune for speed, energy, power consumption—and now on Mellanox network cards, for maximum network throughput, performance, and efficiency.

The two companies have been answering questions and presenting their automatic optimization work across the country as well as listening to user stories about the long wait times to get to final optimal configurations manually.

Ultimately, the partnership means ditching the manual tuning and freeing up those network and datacenter experts to focus more on the systems and codes that keep their organizations on top—and in front of the competition.

Why Leading Bare Metal Cloud Provider Packet Partnered with DatArcs to Help Users Maximize Hardware Infrastructure

Despite all the abstractions, servers are complex. Add to that raw hardware complexity the vast multitude of possibilities to manually tune and adapt to even just one singular application, and that complexity increases by orders of magnitude.

For some, manual tuning is an art and a science, but even for the rare few who take great pleasure in endless knob-tuning, it is ultimately a massive drain on time and energy. Even with expert tuning that accounts for all the vagaries of the various CPU, operating system, framework, application, and other parameters, we are all just humans after all—and there are limits to what we can see.

This is the case for small node-count deployments, but imagine tuning across much larger fleets of machines, each of which has been acquired at different times, requiring a different knob rotation for every performance aspect.

The tunability spins quickly out of control, leaving progressively larger gaps in performance and efficiency—and eating into costs. Human insight is at its limits, but as customers like Packet (a bare metal cloud based in NYC) are quickly realizing, there is huge value in enabling end users to maximize performance without tedious manual tuning.

Extracting More Value from Hardware
As a provider of high performance cloud resources, Packet is constantly looking for new ways to deliver more value from the physical servers provisioned on its platform. No matter what applications or technologies users end up putting on top of their Packet servers, extracting extra performance and efficiency from the hardware was an important and missing part of their story.

They understand that to stand out as a unique provider in a crowded – and mainly virtualized – cloud industry, Packet needs to invest in tools like automatic tuning and any “easy” resource that helps customers extract more value from their infrastructure. This constant desire for value / optimization is what brought them to DatArcs.

Cloud Portability Makes Manual Tuning Impractical
While Packet’s Dell, SuperMicro, Quanta and Foxconn servers are designed with performance characteristics on a broad spectrum of applications, at the end of the day, Packet’s nearly 8,000 users take that commodity hardware and do all kinds of things with it.

From databases and serverless functions, to big data and storage, the use cases are endless. Additionally, due to Packet’s focus on automation and “cloud native” workloads, the environments are constantly being refreshed as users swap out servers, add new hardware, or auto-scale to handle peaks and valleys.

This makes the long, slow process of manual hardware tuning impractical, requiring a move beyond human level adjustments toward software-driven optimization that can see the application, recognize its needs relative to the hardware, quickly learn its ins and outs, and implement the ideal setup for that environment and workload automatically.

How the Magic Happens – And Why it Needs to Feel Like Magic!
These are all high-level features of DatArcs, but under the hood, a complex set of learning algorithms snaps together a complete profile of the application and sets it on its best path to energy efficient performance.

And with no manual tuning for either Packet or its customers and at a low cost for users at provisioning time for pennies on the hour, the choice was clear—dynamic, adaptive, automatic tuning without the headache or budget hit.

DatArcs understands that Packet is just one of many companies, researchers, or enterprise data analysts that need results as fast as possible and within a power-aware envelope. They also know that time-constrained pros have no time to waste endlessly changing knobs, only to find that one subtle change can cascade into a whole new wave of needed post-tuning.

What smart developers, engineers, scientists, and data-driven analysts need is a tool that outsmarts even the smartest system administrator with a deep inside view into the system, application, and parameters for adaptive tuning.

DatArcs Awarded with PowerBridgeNY Ignition Grant

DatArcs Optimizer is a great tool for improving performance of servers with minimum engineering effort. In addition to boosting performance, DatArcs Optimizer is also able to improve the energy efficiency of servers by optimizing for performance per Joule. We believe data centers could be much more efficient than they are today with the help of automatic and dynamic tuning. We’re happy that others share our vision – we’ve just became awardees of the PowerBridgeNY Ignition Grant!

PowerBridgeNY is a state/university initiative that leverages clean energy innovations emerging from institutional research labs to create more and stronger energy businesses in New York State. With the help of PowerBridgeNY, our vision is now one step closer.

We’re lucky to have met our mentor David Levine through the program, and are thankful for his guidance and support. Thanks David!