Set the Speed Dial for Pavilion Data

NVMe SSDs are the most expensive non-volatile storage in today’s data centers. But optimizing your ROI on NVMe can be tricky. Conventional wisdom says the highest performance with the lowest latency is achieved by installing the SSD directly into the server and scaling throughput or IOPS in a parallel fashion by adding more servers, each with its own NVMe SSD. However, increasing IOPS or throughput to match your workload is directly proportional to the amount of NAND Flash and power settings on the SSD. If your workload requires a small amount of storage, as most databases do, but your need…

Supercomputing Architecture for Any Data Center

Mapping the Human Genome was just the beginning for the life sciences discipline of bioinformatics.  Now, the goal is to apply every map of every person against a perfectly healthy baseline to identify sequences of DNA that carry diseases like diabetes, asthma, migraine, and schizophrenia.  However, even with the most powerful compute, network and storage resources on our planet, full genomic map comparisons are not possible.   The International HapMap Project is a more efficient method to isolate genetic mutations using massively parallel processing with Hadoop® MapReduce and Spark® analytics to obtain statistically significant comparisons.  HapMap would not exist without…

Disaggregation for Less Aggravation

NVMe SSDs ushered in an era of standards-based access to Solid State storage.  Previous protocols like SCSI and SAS were designed for spinning disk media and carried severe overhead that squelched the performance that can be delivered by NAND.  It’s no coincidence that IDC forecasts NVMe will make up more than 50% of all enterprise SSD shipments by 2020[1].   One step forward, two steps back While significant increases in IOPS and throughput can be delivered with today’s NVMe SSDs.  The deployment model is arcane.  By implementing NVMe inside of the server, we are back to the problems of direct-attached…

Are Storage Systems Designed for NVMe?

Pavilion Data is glad to see established vendors such as Dell-EMC and Pure Storage entering the NVMe-based storage bandwagon. There are two categories of storage devices leveraging NVMe:   Traditional Shared Storage Composable/Disaggregated Storage   Traditional Shared Storage is used for scale-up workloads and usually a replacement for existing SATA or SAS-based All Flash Arrays (AFA) utilizing Fiber Channel or iSCSI protocols. To leverage NVMe, these systems are retrofitted in two ways:  1) media replacement with NVMe, and 2) replace the internal controller-to-drive interconnect bus from SAS/SATA to NVMe.  No other change in architecture is usually done. This provides a…