Tuesday, March 11, 2014

Teradata’s SNAP Framework !

Teradata’s Seamless Network Analytic Processing Framework is one of the great ideas inside Aster 6 database. It allows user to query different analytical engines and multiple type of storage using a SQL-like programming interface. It is composed by a query optimizer, a layer that integrates and manages resources, an execution engine and the unified SQL interface. These are the main components and their goals :
  • SQL-GR & Graph Engine : provide functions to work with edge, vertex, [un|bi|]directed or cyclic graph
  • SQL-MR : library (Machine Learning, Statistics, Search behaviour, Pattern matching, Time series, Text analysis, Geo-spatial, Parsing) to process data using MapReduce framework
  • SQL-H : easy to use connection to HDFS for loading data from Hadoop
  • SQL : join, filter, aggregation, OLAP, insert, update, delete, CASE WHEN, table
  • AFS connector : SQL-MR function to map AFS file to table
  • Teradata connector : SQL-MR function to load data from / to Teradata RDBMS
  • Stream API : plug your Python, Ruby, Perl, C[|++|#] scripts and use Aster CPU workers node to process it

No comments: