Big data software and tools provider Revelytix announced early access availability of Loom Dataset Management for Hadoop which makes it easier for data scientists to work with Hadoop and easier for their organizations to manage the huge challenges of big data files created with Hadoop. Loom tracks the lineage and provenance of all registered HDFS data and offers query execution using SQL, SPARQL or HiveQL, as well as integration with R.
Dataset Management for Hadoop
“Loom makes it easy for data scientists and IT to build more analytics faster with easy-to-use interfaces that simplify getting the right data for the job quickly and managing datasets efficiently over time with proper tracking and data auditing,” said Revelytix CEO
Mike Lang. Loom includes dataset lineage so you know where a dataset came from, Active Scan to dynamically profile datasets, Lab Bench for finding, transforming, and analyzing data in Hadoop and Hive; data suitability, and open APIs.
Based on nearly a decade of designing and building big data fabrics and solutions for the U.S. Department of Defense, the leading intelligence organizations in the United States and major pharmaceutical, financial services and life sciences companies, Loom is the product of deep big data experience. Because Hadoop makes practical so many new analytics and datasets, Loom’s tracking and management capabilities are fundamental to managing datasets in Hadoop.
Relationship with U.S. DoD Expanded
Revelytix also announced that it will provide big data software and services for the U.S. Department of Defense (DOD) during 2013, deepening the multi-year big data relationship already in place. The DOD has relied on Revelytix for three years to create its data architecture and provide support to allow it to establish common architecture and semantics across all military service branches.
“The management team at Revelytix has been working on complex data processing and data management problems for the federal government for the past 12 years,” Lang said. ”Our first company, Metamatrix, now part of Red Hat, produced data processing software used in the intelligence community and the DOD. Revelytix has been working for the DOD for the past four years specifically on the problem of processing and managing highly distributed sets of data. The resulting Revelytix technology is now in full production.”