Dell and Cloudera Roll Out Spark-Powered In-Memory Processing Appliance for Big Data
A Dell manufacturing plant in Xiamen, China

Dell and Cloudera Roll Out Spark-Powered In-Memory Processing Appliance for Big Data

Cloudera Enterprise hardware-software bundle enables clusters scalable to 48 nodes

Dell, Intel and Cloudera have co-engineered an in-memory processing appliance to run Apache Spark, a stream processing framework for real-time big data analytics. It runs much faster than Hadoop MapReduce runs in-memory, according to Dell.

Pitched as a quick way to deploy a Hadoop cluter, the solution scales up to 48 nodes.

Its roots stemming from a project at University of California Berkeley, Spark is built on top of the Hadoop Distributed File System but isn't limited to MapReduce, which was designed for batch processing. Spark was made for cluster computing and storing data in memory of the cluster nodes for quick access.

Dell's new appliance combines Spark with Cloudera Enterprise, essentially a Hadoop distribution, but one that comes with features like Spark, as well as cluster management and support.

TAGS: DevOps
Hide comments

Comments

  • Allowed HTML tags: <em> <strong> <blockquote> <br> <p>

Plain text

  • No HTML tags allowed.
  • Web page addresses and e-mail addresses turn into links automatically.
  • Lines and paragraphs break automatically.
Publish