Tagged: Changes Toggle Comment Threads | Keyboard Shortcuts

  • admin 9:51 am on July 27, 2016 Permalink
    Tags: , , Changes, , , , , , ,   

    Data Changes Everything: Teradata PARTNERS Conference Will Showcase the Business Impact of Big Data Analytics 

    Data Changes Everything: Teradata PARTNERS Conference Will Showcase the Business Impact of Big Data Analytics. ‘Prepare to be inspired,’ says conference committee president, by disruptive innovations, influencers, insights.
    Teradata United States

     
  • admin 9:52 am on October 26, 2015 Permalink
    Tags: , Changes, , paradigm, ,   

    Teradata QueryGrid Changes the Data Access Paradigm 

    Q3-15_Applied Solutions_QueryGridby Dirk Anderson

    There has been a lot of recent industry buzz about Teradata® QueryGrid™, and for good reason. It is one of those rare products that fundamentally changes the way organizations work.

    The access layer allows queries that run on the Teradata Database to seamlessly access information on external servers such as Apache™ Hadoop®, Oracle Database and MongoDB, which offers a huge time savings. This ability opens up vast opportunities for data scientists and power users who spend a lot of time gathering and assembling data for analysis.

    For example, data scientists conducting research with information from the Teradata Database and other data sources often spend a significant amount of time extracting data from disparate sources. Additional time is spent moving the data into SAS or another location for analysis. Plus, when dozens of users load information into data stores, enterprise data is often duplicated on various departmental or personal platforms. Not only is this a capacity concern, but having multiple copies of the data on individual machines also poses a security risk. Teradata QueryGrid solves the problem.

    Simplify a Complex Process

    With Teradata QueryGrid, data scientists can develop a single script using SQL syntax that runs on the Teradata Database to join all the data sources together. This removes the complexities of connecting to external servers, writing extraction scripts, transferring data, allocating storage space, translating data types into formats recognized by the local machine, compressing the local data and remembering to encrypt sensitive information.

    When data scientists need to run SAS or R analytics, they can run a rich set of in-database functions within the massively parallel architecture of the Teradata Database to achieve extreme performance. The results can be saved and shared securely among colleagues with Teradata Data Lab. This process simplifies coding by reducing (or eliminating) the amount of data that needs to be stored locally and dramatically increases the speed-to-market for analytics.

    Remove the Bottlenecks

    Each new generation of processing nodes brings faster CPUs and increased I/O bandwidth for processing and moving data. Still, the biggest performance challenge in the current era of big data is channeling information into and out of the Teradata platform.

    Single-channel data movement is not effective for handling large volumes of data, and can cause bottlenecks. Teradata QueryGrid solves that by facilitating high-volume, multi-channel data movement between Teradata, Teradata Aster and Hadoop platforms. Ideally, the Hadoop and Teradata platforms should be connected using BYNET® over InfiniBand.

    Another bottleneck stems from the expense and time-to-market required for a new ETL project. Developing traditional ETL to load the data warehouse can be so prohibitive that it is cost-effective only for high-value data. With the access layer, scripts can be rapidly developed to select data directly from source tables and insert or upsert them directly into target tables. This process can often be completed with just a few simple SQL statements. Since coding is reduced and simplified, maintenance and support are easier, which greatly reduces costs and accelerates speed-to-market.

    Although Teradata QueryGrid is not a replacement for ETL tools, the capability gap is narrowing. Teradata has been adding ETL-like capabilities with each release of the Teradata Database. For example, Teradata Database 15.0 includes the ability for SQL to invoke non-SQL languages such as Ruby, Python and Perl. These enhancements dramatically shift the balance in determining which ETL processes can be reasonably performed in-database with Teradata QueryGrid and which should be done using traditional methods.

    From Hours to Minutes

    The access layer can move data to and from an external server. This bi-directional capability opens up options for users. For instance, a single script can extract data from a source system, run referential integrity checks on the Teradata Database and send any data that failed the checks back to the source system for review.

    Bi-directional data movement is beneficial when information needs to be loaded in both the enterprise-class Teradata server for general users and also in a Teradata Aster server for data scientists. A single script loads the data onto the enterprise server, at which point the data is integrated with other information, and the result is pushed over to the Teradata Aster Database. This process used to take hours. With Teradata QueryGrid, it now takes just minutes.

    Leverage the Solution’s Full Potential

    Teradata QueryGrid is causing a paradigm shift in the way organizations work with and benefit from the Teradata Database. By understanding the potential of the access layer and how to better leverage the solution, companies are better positioned for their future data warehousing and big data analytics projects.

    Dirk Anderson is a senior vice president of a major financial institution and a Teradata Certified Master. He has worked hands-on with Teradata solutions for more than 20 years. 

    For this article as well as more technical solutions and insights visit TeradataMagazine.com.

     

     

    The post Teradata QueryGrid Changes the Data Access Paradigm appeared first on Magazine Blog.

    Teradata Blogs Feed

     
  • admin 9:50 am on February 21, 2015 Permalink
    Tags: , Changes, , , ,   

    Opportunity Cost How Cloud Changes the TCO of Data Analytics 


    Teradata Web Casts

     
  • admin 10:33 am on January 30, 2015 Permalink
    Tags: , Changes, ,   

    Cloud Changes the TCO of Data Analytics 

    Register for this episode of Hot Technologies to learn from veteran analysts Lyndsay Wise and Dr. Robin Bloor, along with Marc Clark of Teradata, as they discuss cost analysis and benefits of moving to the cloud.
    Teradata Events

     
c
Compose new post
j
Next post/Next comment
k
Previous post/Previous comment
r
Reply
e
Edit
o
Show/Hide comments
t
Go to top
l
Go to login
h
Show/Hide help
shift + esc
Cancel