Big Data Training Courses in the AE

Advances in technologies and the increasing amount of information are transforming how business is conducted in many industries, including government. Government data generation and digital archiving rates are on the rise due to the rapid growth of mobile devices and applications, smart sensors and devices, cloud computing solutions, and citizen-facing portals. As digital information expands and becomes more complex, information management, processing, storage, security, and disposition become more complex as well. New capture, search, discovery, and analysis tools are helping organizations gain insights from their unstructured data. The government market is at a tipping point, realizing that information is a strategic asset, and government needs to protect, leverage, and analyze both structured and unstructured information to better serve and meet mission requirements. As government leaders strive to evolve data-driven organizations to successfully accomplish mission, they are laying the groundwork to correlate dependencies across events, people, processes, and information.

High-value government solutions will be created from a mashup of the most disruptive technologies:

• Mobile devices and applications
• Cloud services
• Social business technologies and networking
• Big Data and analytics

IDC predicts that by 2020, the IT industry will reach $5 trillion, approximately $1.7 trillion larger than today, and that 80% of the industry's growth will be driven by these 3rd Platform technologies. In the long term, these technologies will be key tools for dealing with the complexity of increased digital information. Big Data is one of the intelligent industry solutions and allows government to make better decisions by taking action based on patterns revealed by analyzing large volumes of data — related and unrelated, structured and unstructured.

But accomplishing these feats takes far more than simply accumulating massive quantities of data.“Making sense of thesevolumes of Big Datarequires cutting-edge tools and technologies that can analyze and extract useful knowledge from vast and diverse streams of information,” Tom Kalil and Fen Zhao of the White House Office of Science and Technology Policy wrote in a post on the OSTP Blog.

The White House took a step toward helping agencies find these technologies when it established the National Big Data Research and Development Initiative in 2012. The initiative included more than $200 million to make the most of the explosion of Big Data and the tools needed to analyze it.

The challenges that Big Data poses are nearly as daunting as its promise is encouraging. Storing data efficiently is one of these challenges. As always, budgets are tight, so agencies must minimize the per-megabyte price of storage and keep the data within easy access so that users can get it when they want it and how they need it. Backing up massive quantities of data heightens the challenge.

Analyzing the data effectively is another major challenge. Many agencies employ commercial tools that enable them to sift through the mountains of data, spotting trends that can help them operate more efficiently. (A recent study by MeriTalk found that federal IT executives think Big Data could help agencies save more than $500 billion while also fulfilling mission objectives.).

Custom-developed Big Data tools also are allowing agencies to address the need to analyze their data. For example, the Oak Ridge National Laboratory’s Computational Data Analytics Group has made its Piranha data analytics system available to other agencies. The system has helped medical researchers find a link that can alert doctors to aortic aneurysms before they strike. It’s also used for more mundane tasks, such as sifting through résumés to connect job candidates with hiring managers.

Audience

If you try to make sense out of the data you have access to or want to analyse unstructured data available on the net (like Twitter, Linked in, etc...) this course is for you.

It is mostly aimed at decision makers and people who need to choose what data is worth collecting and what is worth analyzing.

It is not aimed at people configuring the solution, those people will benefit from the big picture though.

Delivery Mode

During the course delegates will be presented with working examples of mostly open source technologies.

Short lectures will be followed by presentation and simple exercises by the participants

Content and Software used

All software used is updated each time the course is run, so we check the newest versions possible.

It covers the process from obtaining, formatting, processing and analysing the data, to explain how to automate decision making process with machine learning.

Advances in technologies and the increasing amount of information are transforming how law enforcement is conducted. The challenges that Big Data pose are nearly as daunting as Big Data's promise. Storing data efficiently is one of these challenges; effectively analyzing it is another.

In this instructor-led, live training, participants will learn the mindset with which to approach Big Data technologies, assess their impact on existing processes and policies, and implement these technologies for the purpose of identifying criminal activity and preventing crime. Case studies from law enforcement organizations around the world will be examined to gain insights on their adoption approaches, challenges and results.

By the end of this training, participants will be able to:

• Combine Big Data technology with traditional data gathering processes to piece together a story during an investigation
• Implement industrial big data storage and processing solutions for data analysis
• Prepare a proposal for the adoption of the most adequate tools and processes for enabling a data-driven approach to criminal investigation

Audience

• Law Enforcement specialists with a technical background

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Day 1 - provides a high-level overview of essential Big Data topic areas. The module is divided into a series of sections, each of which is accompanied by a hands-on exercise.

Day 2 - explores a range of topics that relate analysis practices and tools for Big Data environments. It does not get into implementation or programming details, but instead keeps coverage at a conceptual level, focusing on topics that enable participants to develop a comprehensive understanding of the common analysis functions and features offered by Big Data solutions.

Day 3 - provides an overview of the fundamental and essential topic areas relating to Big Data solution platform architecture. It covers Big Data mechanisms required for the development of a Big Data solution platform and architectural options for assembling a data processing platform. Common scenarios are also presented to provide a basic understanding of how a Big Data solution platform is generally used. 

Day 4 - builds upon Day 3 by exploring advanced topics relatng to Big Data solution platform architecture. In particular, different architectural layers that make up the Big Data solution platform are introduced and discussed, including data sources, data ingress, data storage, data processing and security. 

Day 5 - covers a number of exercises and problems designed to test the delegates ability to apply knowledge of topics covered Day 3 and 4. 

Vespa is an open-source big data processing and serving engine created by Yahoo.  It is used to respond to user queries, make recommendations, and provide personalized content and advertisements in real-time.

This instructor-led, live training introduces the challenges of serving large-scale data and walks participants through the creation of an application that can compute responses to user requests, over large datasets in real-time.

By the end of this training, participants will be able to:

• Use Vespa to quickly compute data (store, search, rank, organize) at serving time while a user waits
• Implement Vespa into existing applications involving feature search, recommendations, and personalization
• Integrate and deploy Vespa with existing big data systems such as Hadoop and Storm.

Audience

• Developers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

To meet compliance of the regulators, CSPs (Communication service providers) can tap into Big Data Analytics which not only help them to meet compliance but within the scope of same project they can increase customer satisfaction and thus reduce the churn. In fact since compliance is related to Quality of service tied to a contract, any initiative towards meeting the compliance, will improve the “competitive edge” of the CSPs. Therefore, it is important that Regulators should be able to advise/guide a set of Big Data analytic practice for CSPs that will be of mutual benefit between the regulators and CSPs.

The course consists of 8 modules (4 on day 1, and 4 on day 2)

This classroom based training session will explore Big Data. Delegates will have computer based examples and case study exercises to undertake with relevant big data tools

Objective : This training course aims at helping attendees understand why Big Data is changing our lives and how it is altering the way businesses see us as consumers. Indeed, users of big data in businesses find that big data unleashes a wealth of information and insights which translate to higher profits, reduced costs, and less risk. However, the downside was frustration sometimes when putting too much emphasis on individual technologies and not enough focus on the pillars of big data management.

Attendees will learn during this course how to manage the big data using its three pillars of data integration, data governance and data security in order to turn big data into real business value. Different exercices conducted on a case study of customer management will help attendees to better understand the underlying processes.

This instructor-led, live training in UAE (online or onsite) is aimed at software engineers who wish to use Sqoop and Flume for big data.

By the end of this training, participants will be able to:

• Ingest big data with Sqoop and Flume.
• Ingest data from multiple data sources.
• Move data from relational databases to HDFS and Hive.
• Export data from HDFS to a relational database.

Big Data is a term that refers to solutions destined for storing and processing large data sets. Developed by Google initially, these Big Data solutions have evolved and inspired other similar projects, many of which are available as open-source. R is a popular programming language in the financial industry.

When traditional storage technologies don't handle the amount of data you need to store there are hundereds of alternatives. This course try to guide the participants what are alternatives for storing and analyzing Big Data and what are theirs pros and cons.

This course is mostly focused on discussion and presentation of solutions, though hands-on exercises are available on demand.

This course introduces HBase – a NoSQL store on top of Hadoop.  The course is intended for developers who will be using HBase to develop applications,  and administrators who will manage HBase clusters.

We will walk a developer through HBase architecture and data modelling and application development on HBase. It will also discuss using MapReduce with HBase, and some administration topics, related to performance optimization. The course  is very  hands-on with lots of lab exercises.

Duration : 3 days

Audience : Developers  & Administrators

The course is part of the Data Scientist skill set (Domain: Data and Technology).

This instructor-led, live training in UAE (online or onsite) is aimed at developers who wish to set up a multi-node Greenplum database.

By the end of this training, participants will be able to:

• Install and configure Pivotal Greenplum.
• Model data in accordance to current needs and future expansion plans.
• Carry out different techniques for distribute data across multiple nodes.
• Improve database performance through tuning.
• Monitor and troubleshoot a Greenplum database.

MemSQL is an in-memory, distributed, SQL database management system for cloud and on-premises. It's a real-time data warehouse that immediately delivers insights from live and historical data.

In this instructor-led, live training, participants will learn the essentials of MemSQL for development and administration.

By the end of this training, participants will be able to:

• Understand the key concepts and characteristics of MemSQL
• Install, design, maintain, and operate MemSQL
• Optimize schemas in MemSQL
• Improve queries in MemSQL
• Benchmark performance in MemSQL
• Build real-time data applications using MemSQL

Audience

• Developers
• Administrators
• Operation Engineers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Amazon Redshift is a petabyte-scale cloud-based data warehouse service in AWS.

In this instructor-led, live training, participants will learn the fundamentals of Amazon Redshift.

By the end of this training, participants will be able to:

• Install and configure Amazon Redshift
• Load, configure, deploy, query, and visualize data with Amazon Redshift

Audience

• Developers
• IT Professionals

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• To request a customized training for this course, please contact us to arrange.

This instructor-led, live training in UAE (online or onsite) is aimed at administrators who wish to set up Greenplum Database for business intelligence and data warehousing solutions.

By the end of this training, participants will be able to:

• Address processing needs with Greenplum.
• Perform ETL operations for data processing.
• Leverage existing query processing infrastructures.

Big data is data sets that are so voluminous and complex that traditional data processing application software are inadequate to deal with them. Big data challenges include capturing data, data storage, data analysis, search, sharing, transfer, visualization, querying, updating and information privacy.

This instructor-led, live training in UAE (online or onsite) is aimed at data scientists who wish to use the SMACK stack to build data processing platforms for big data solutions.

By the end of this training, participants will be able to:

• Implement a data pipeline architecture for processing big data.
• Develop a cluster infrastructure with Apache Mesos and Docker.
• Analyze data with Spark and Scala.
• Manage unstructured data with Apache Cassandra.

Participants who complete this instructor-led, live training in UAE will gain a practical, real-world understanding of Big Data and its related technologies, methodologies and tools.

Participants will have the opportunity to put this knowledge into practice through hands-on exercises. Group interaction and instructor feedback make up an important component of the class.

The course starts with an introduction to elemental concepts of Big Data, then progresses into the programming languages and methodologies used to perform Data Analysis. Finally, we discuss the tools and infrastructure that enable Big Data storage, Distributed Processing, and Scalability.

This instructor-led, live training (online or onsite) is aimed at software developers, managers, and business analyst who wish to use big data systems to store and retrieve large amounts of data.

By the end of this training, participants will be able to:

• Query large amounts of data efficiently.
• Understand how Big Data system store and retrieve data
• Use the latest big data systems available
• Wrangle data from data systems into reporting systems
• Learn to write SQL queries in:
  • MySQL
  • Postgres
  • Hive Query Language (HiveQL/HQL)
  • Redshift 

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Datameer is a business intelligence and analytics platform built on Hadoop. It allows end-users to access, explore and correlate large-scale, structured, semi-structured and unstructured data in an easy-to-use fashion.

In this instructor-led, live training, participants will learn how to use Datameer to overcome Hadoop's steep learning curve as they step through the setup and analysis of a series of big data sources.

By the end of this training, participants will be able to:

• Create, curate, and interactively explore an enterprise data lake
• Access business intelligence data warehouses, transactional databases and other analytic stores
• Use a spreadsheet user-interface to design end-to-end data processing pipelines
• Access pre-built functions to explore complex data relationships
• Use drag-and-drop wizards to visualize data and create dashboards
• Use tables, charts, graphs, and maps to analyze query results

Audience

• Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

This course covers how to use Hive SQL language (AKA: Hive HQL, SQL on Hive, HiveQL) for people who extract data from Hive

This instructor-led, live training in UAE (online or onsite) is aimed at technical persons who wish to learn how to implement a machine learning strategy while maximizing the use of big data.

By the end of this training, participants will:

• Understand the evolution and trends for machine learning.
• Know how machine learning is being used across different industries.
• Become familiar with the tools, skills and services available to implement machine learning within an organization.
• Understand how machine learning can be used to enhance data mining and analysis.
• Learn what a data middle backend is, and how it is being used by businesses.
• Understand the role that big data and intelligent applications are playing across industries.

R is an open-source free programming language for statistical computing, data analysis, and graphics. R is used by a growing number of managers and data analysts inside corporations and academia. R has a wide variety of packages for data mining.

This instructor-led, live training in UAE (online or onsite) is aimed at technical persons who wish to deploy Talend Open Studio for Big Data to simplifying the process of reading and crunching through Big Data.

By the end of this training, participants will be able to:

• Install and configure Talend Open Studio for Big Data.
• Connect with Big Data systems such as Cloudera, HortonWorks, MapR, Amazon EMR and Apache.
• Understand and set up Open Studio's big data components and connectors.
• Configure parameters to automatically generate MapReduce code.
• Use Open Studio's drag-and-drop interface to run Hadoop jobs.
• Prototype big data pipelines.
• Automate big data integration projects.

Objective:

Delegates be able to analyse big data sets, extract patterns, choose the right variable impacting the results so that a new model is forecasted with predictive results.

This instructor-led, live training in UAE (online or onsite) is aimed at data scientists who wish to use Excel for data mining.

• By the end of this training, participants will be able to:
• Explore data with Excel to perform data mining and analysis.
• Use Microsoft algorithms for data mining.
• Understand concepts in Excel data mining.

The objective of the course is to enable participants to gain a mastery of how to work with the SQL language in Oracle database for data extraction at intermediate level.

This instructor-led, live training (online or onsite) is aimed at data analysts and data scientists who wish to implement more advanced data analytics techniques for data mining using Python.

By the end of this training, participants will be able to:

• Understand important areas of data mining, including association rule mining, text sentiment analysis, automatic text summarization, and data anomaly detection.
• Compare and implement various strategies for solving real-world data mining problems.
• Understand and interpret the results. 

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

R is an open-source free programming language for statistical computing, data analysis, and graphics. R is used by a growing number of managers and data analysts inside corporations and academia. R has a wide variety of packages for data mining.

R is an open-source free programming language for statistical computing, data analysis, and graphics. R is used by a growing number of managers and data analysts inside corporations and academia. R has also found followers among statisticians, engineers and scientists without computer programming skills who find it easy to use. Its popularity is due to the increasing use of data mining for various goals such as set ad prices, find new drugs more quickly or fine-tune financial models. R has a wide variety of packages for data mining.

Goal:

Learning to work with SPSS at the level of independence

The addressees:

Analysts, researchers, scientists, students and all those who want to acquire the ability to use SPSS package and learn popular data mining techniques.

Course can be provided with any tools, including free open-source data mining software and applications

MonetDB is an open-source database that pioneered the column-store technology approach.

In this instructor-led, live training, participants will learn how to use MonetDB and how to get the most value out of it.

By the end of this training, participants will be able to:

• Understand MonetDB and its features
• Install and get started with MonetDB
• Explore and perform different functions and tasks in MonetDB
• Accelerate the delivery of their project by maximizing MonetDB capabilities

Audience

• Developers
• Technical experts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Apache Hadoop is the most popular framework for processing Big Data. Hadoop provides rich and deep analytics capability, and it is making in-roads in to tradional BI analytics world. This course will introduce an analyst to the core components of Hadoop eco system and its analytics

Audience

Business Analysts

Duration

three days

Format

Lectures and hands on labs.

The course is dedicated to IT specialists that are looking for a solution to store and process large data sets in distributed system environment

Course goal:

Getting knowledge regarding Hadoop cluster administration

Audience:

This course is intended to demystify big data/hadoop technology and to show it is not difficult to understand.

Apache Hadoop is the most popular framework for processing Big Data on clusters of servers. This course will introduce a developer to various components (HDFS, MapReduce, Pig, Hive and HBase) Hadoop ecosystem.

Apache Hadoop is one of the most popular frameworks for processing Big Data on clusters of servers. This course delves into data management in HDFS, advanced Pig, Hive, and HBase.  These advanced programming techniques will be beneficial to experienced Hadoop developers.

Audience: developers

Duration: three days

Format: lectures (50%) and hands-on labs (50%).

Apache Hadoop is the most popular framework for processing Big Data on clusters of servers. In this three (optionally, four) days course, attendees will learn about the business benefits and use cases for Hadoop and its ecosystem, how to plan cluster deployment and growth, how to install, maintain, monitor, troubleshoot and optimize Hadoop. They will also practice cluster bulk data load, get familiar with various Hadoop distributions, and practice installing and managing Hadoop ecosystem tools. The course finishes off with discussion of securing cluster with Kerberos.

“…The materials were very well prepared and covered thoroughly. The Lab was very helpful and well organized”
— Andrew Nguyen, Principal Integration DW Engineer, Microsoft Online Advertising

Audience

Hadoop administrators

Format

Lectures and hands-on labs, approximate balance 60% lectures, 40% labs.

Hadoop is the most popular Big Data processing framework.

This course is intended for developers, architects, data scientists or any profile that requires access to data either intensively or on a regular basis.

The major focus of the course is data manipulation and transformation.

Among the tools in the Hadoop ecosystem this course includes the use of Pig and Hive both of which are heavily used for data transformation and manipulation.

This training also addresses performance metrics and performance optimisation.

The course is entirely hands on and is punctuated by presentations of the theoretical aspects.

In this instructor-led training in UAE, participants will learn the core components of the Hadoop ecosystem and how these technologies can be used to solve large-scale problems. By learning these foundations, participants will  improve their ability to communicate with the developers and implementers of these systems as well as the data scientists and analysts that many IT projects involve.

Audience

• Project Managers wishing to implement Hadoop into their existing development or IT infrastructure
• Project Managers needing to communicate with cross-functional teams that include big data engineers, data scientists and business analysts

Hadoop is a popular Big Data processing framework. Python is a high-level programming language famous for its clear syntax and code readibility.

In this instructor-led, live training, participants will learn how to work with Hadoop, MapReduce, Pig, and Spark using Python as they step through multiple examples and use cases.

By the end of this training, participants will be able to:

• Understand the basic concepts behind Hadoop, MapReduce, Pig, and Spark
• Use Python with Hadoop Distributed File System (HDFS), MapReduce, Pig, and Spark
• Use Snakebite to programmatically access HDFS within Python
• Use mrjob to write MapReduce jobs in Python
• Write Spark programs with Python
• Extend the functionality of pig using Python UDFs
• Manage MapReduce jobs and Pig scripts using Luigi

Audience

• Developers
• IT Professionals

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Sqoop is an open source software tool for transfering data between Hadoop and relational databases or mainframes. It can be used to import data from a relational database management system (RDBMS) such as MySQL or Oracle or a mainframe into the Hadoop Distributed File System (HDFS). Thereafter, the data can be transformed in Hadoop MapReduce, and then re-exported back into an RDBMS.

In this instructor-led, live training, participants will learn how to use Sqoop to import data from a traditional relational database to Hadoop storage such HDFS or Hive and vice versa.

By the end of this training, participants will be able to:

• Install and configure Sqoop
• Import data from MySQL to HDFS and Hive
• Import data from HDFS and Hive to MySQL

Audience

• System administrators
• Data engineers

Format of the Course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• To request a customized training for this course, please contact us to arrange.

Process mining, or Automated Business Process Discovery (ABPD), is a technique that applies algorithms to event logs for the purpose of analyzing business processes. Process mining goes beyond data storage and data analysis; it bridges data with processes and provides insights into the trends and patterns that affect process efficiency. 

Format of the Course

• The course starts with an overview of the most commonly used techniques for process mining. We discuss the various process discovery algorithms and tools used for discovering and modeling processes based on raw event data. Real-life case studies are examined and data sets are analyzed using the ProM open-source framework.

Audience:

The course is intended for IT specialists looking for a solution to store and process large data sets in a distributed system environment

Goal:

Deep knowledge on Hadoop cluster administration.

Audience

• Developers

Format of the Course

• Lectures, hands-on practice, small tests along the way to gauge understanding

Apache Samza is an open-source near-realtime, asynchronous computational framework for stream processing.  It uses Apache Kafka for messaging, and Apache Hadoop YARN for fault tolerance, processor isolation, security, and resource management.

This instructor-led, live training introduces the principles behind messaging systems and distributed stream processing, while walking participants through the creation of a sample Samza-based project and job execution.

By the end of this training, participants will be able to:

• Use Samza to simplify the code needed to produce and consume messages.
• Decouple the handling of messages from an application.
• Use Samza to implement near-realtime asynchronous computation.
• Use stream processing to provide a higher level of abstraction over messaging systems.

Audience

• Developers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Tigon is an open-source, real-time, low-latency, high-throughput, native YARN, stream processing framework that sits on top of HDFS and HBase for persistence. Tigon applications address use cases such as network intrusion detection and analytics, social media market analysis, location analytics, and real-time recommendations to users.

This instructor-led, live training introduces Tigon's approach to blending real-time and batch processing as it walks participants through the creation a sample application.

By the end of this training, participants will be able to:

• Create powerful, stream processing applications for handling large volumes of data
• Process stream sources such as Twitter and Webserver Logs
• Use Tigon for rapid joining, filtering, and aggregating of streams

Audience

• Developers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

This instructor-led, live training in UAE (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Apache Kafka features in data streaming with Python.

By the end of this training, participants will be able to use Apache Kafka to monitor and manage conditions in continuous data streams using Python programming.

In this instructor-led, live training in UAE (onsite or remote), participants will learn how to set up and integrate different Stream Processing frameworks with existing big data storage systems and related software applications and microservices.

By the end of this training, participants will be able to:

• Install and configure different Stream Processing frameworks, such as Spark Streaming and Kafka Streaming.
• Understand and select the most appropriate framework for the job.
• Process of data continuously, concurrently, and in a record-by-record fashion.
• Integrate Stream Processing solutions with existing databases, data warehouses, data lakes, etc.
• Integrate the most appropriate stream processing library with enterprise applications and microservices.

Kafka Streams is a client-side library for building applications and microservices whose data is passed to and from a Kafka messaging system. Traditionally, Apache Kafka has relied on Apache Spark or Apache Storm to process data between message producers and consumers. By calling the Kafka Streams API from within an application, data can be processed directly within Kafka, bypassing the need for sending the data to a separate cluster for processing.

In this instructor-led, live training, participants will learn how to integrate Kafka Streams into a set of sample Java applications that pass data to and from Apache Kafka for stream processing.

By the end of this training, participants will be able to:

• Understand Kafka Streams features and advantages over other stream processing frameworks
• Process stream data directly within a Kafka cluster
• Write a Java or Scala application or microservice that integrates with Kafka and Kafka Streams
• Write concise code that transforms input Kafka topics into output Kafka topics
• Build, package and deploy the application

Audience

• Developers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Notes

• To request a customized training for this course, please contact us to arrange

This instructor-led, live training (online or onsite) is aimed at engineers who wish to use Confluent (a distribution of Kafka) to build and manage a real-time data processing platform for their applications.

By the end of this training, participants will be able to:

• Install and configure Confluent Platform.
• Use Confluent's management tools and services to run Kafka more easily.
• Store and process incoming stream data.
• Optimize and manage Kafka clusters.
• Secure data streams.

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• This course is based on the open source version of Confluent: Confluent Open Source.
• To request a customized training for this course, please contact us to arrange.

In this instructor-led, live training, participants will learn the core concepts behind MapR Stream Architecture as they develop a real-time streaming application.

By the end of this training, participants will be able to build producer and consumer applications for real-time stream data procesing.

Audience

• Developers
• Administrators

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• To request a customized training for this course, please contact us to arrange.

Alluxio is an open-source virtual distributed storage system that unifies disparate storage systems and enables applications to interact with data at memory speed. It is used by companies such as Intel, Baidu and Alibaba.

In this instructor-led, live training, participants will learn how to use Alluxio to bridge different computation frameworks with storage systems and efficiently manage multi-petabyte scale data as they step through the creation of an application with Alluxio.

By the end of this training, participants will be able to:

• Develop an application with Alluxio
• Connect big data systems and applications while preserving one namespace
• Efficiently extract value from big data in any storage format
• Improve workload performance
• Deploy and manage Alluxio standalone or clustered

Audience

• Data scientist
• Developer
• System administrator

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

In this instructor-led, live training in UAE (onsite or remote), participants will learn how to deploy and manage Apache NiFi in a live lab environment.

By the end of this training, participants will be able to:

• Install and configure Apachi NiFi.
• Source, transform and manage data from disparate, distributed data sources, including databases and big data lakes.
• Automate dataflows.
• Enable streaming analytics.
• Apply various approaches for data ingestion.
• Transform Big Data and into business insights.

In this instructor-led, live training in UAE, participants will learn the fundamentals of flow-based programming as they develop a number of demo extensions, components and processors using Apache NiFi.

By the end of this training, participants will be able to:

• Understand NiFi's architecture and dataflow concepts.
• Develop extensions using NiFi and third-party APIs.
• Custom develop their own Apache Nifi processor.
• Ingest and process real-time data from disparate and uncommon file formats and data sources.

Big data analytics involves the process of examining large amounts of varied data sets in order to uncover correlations, hidden patterns, and other useful insights.

The health industry has massive amounts of complex heterogeneous medical and clinical data. Applying big data analytics on health data presents huge potential in deriving insights for improving delivery of healthcare. However, the enormity of these datasets poses great challenges in analyses and practical applications to a clinical environment.

In this instructor-led, live training (remote), participants will learn how to perform big data analytics in health as they step through a series of hands-on live-lab exercises.

By the end of this training, participants will be able to:

• Install and configure big data analytics tools such as Hadoop MapReduce and Spark
• Understand the characteristics of medical data
• Apply big data techniques to deal with medical data
• Study big data systems and algorithms in the context of health applications

Audience

• Developers
• Data Scientists

Format of the Course

• Part lecture, part discussion, exercises and heavy hands-on practice.

Note

• To request a customized training for this course, please contact us to arrange.

This instructor-led, live training in UAE (online or onsite) is aimed at system administrators who wish to learn how to set up, deploy and manage Hadoop clusters within their organization.

By the end of this training, participants will be able to:

• Install and configure Apache Hadoop.
• Understand the four major components in the Hadoop ecoystem: HDFS, MapReduce, YARN, and Hadoop Common.
• Use Hadoop Distributed File System (HDFS) to scale a cluster to hundreds or thousands of nodes.  
• Set up HDFS to operate as storage engine for on-premise Spark deployments.
• Set up Spark to access alternative storage solutions such as Amazon S3 and NoSQL database systems such as Redis, Elasticsearch, Couchbase, Aerospike, etc.
• Carry out administrative tasks such as provisioning, management, monitoring and securing an Apache Hadoop cluster.

This instructor-led, live training in UAE (online or onsite) is aimed at developers who wish to use and integrate Spark, Hadoop, and Python to process, analyze, and transform large and complex data sets.

By the end of this training, participants will be able to:

• Set up the necessary environment to start processing big data with Spark, Hadoop, and Python.
• Understand the features, core components, and architecture of Spark and Hadoop.
• Learn how to integrate Spark, Hadoop, and Python for big data processing.
• Explore the tools in the Spark ecosystem (Spark MlLib, Spark Streaming, Kafka, Sqoop, Kafka, and Flume).
• Build collaborative filtering recommendation systems similar to Netflix, YouTube, Amazon, Spotify, and Google.
• Use Apache Mahout to scale machine learning algorithms.

This instructor-led, live training in UAE (online or onsite) is aimed at developers who wish to carry out big data analysis using Apache Spark in their .NET applications.

By the end of this training, participants will be able to:

• Install and configure Apache Spark.
• Understand how .NET implements Spark APIs so that they can be accessed from a .NET application.
• Develop data processing applications using C# or F#, capable of handling data sets whose size is measured in terabytes and pedabytes.
• Develop machine learning features for a .NET application using Apache Spark capabilities.
• Carry out exploratory analysis using SQL queries on big data sets.

OBJECTIVE:

This course will introduce Apache Spark. The students will learn how  Spark fits  into the Big Data ecosystem, and how to use Spark for data analysis.  The course covers Spark shell for interactive data analysis, Spark internals, Spark APIs, Spark SQL, Spark streaming, and machine learning and graphX.

AUDIENCE :

Developers / Data Analysts

Spark SQL is Apache Spark's module for working with structured and unstructured data. Spark SQL provides information about the structure of the data as well as the computation being performed. This information can be used to perform optimizations. Two common uses for Spark SQL are:
- to execute SQL queries.
- to read data from an existing Hive installation.

In this instructor-led, live training (onsite or remote), participants will learn how to analyze various types of data sets using Spark SQL.

By the end of this training, participants will be able to:

• Install and configure Spark SQL.
• Perform data analysis using Spark SQL.
• Query data sets in different formats.
• Visualize data and query results.

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Apache Spark's learning curve is slowly increasing at the begining, it needs a lot of effort to get the first return. This course aims to jump through the first tough part. After taking this course the participants will understand the basics of Apache Spark , they will clearly differentiate RDD from DataFrame, they will learn Python and Scala API, they will understand executors and tasks, etc.  Also following the best practices, this course strongly focuses on cloud deployment, Databricks and AWS. The students will also understand the differences between AWS EMR and AWS Glue, one of the lastest Spark service of AWS.  

AUDIENCE:

Data Engineer, DevOps, Data Scientist

This instructor-led, live training in UAE (online or onsite) is aimed at engineers who wish to set up and deploy Apache Spark system for processing very large amounts of data.

By the end of this training, participants will be able to:

• Install and configure Apache Spark.
• Quickly process and analyze very large data sets.
• Understand the difference between Apache Spark and Hadoop MapReduce and when to use which.
• Integrate Apache Spark with other machine learning tools.

This course is aimed at developers and data scientists who wish to understand and implement AI within their applications. Special focus is given to Data Analysis, Distributed AI and NLP.

MLlib is Spark’s machine learning (ML) library. Its goal is to make practical machine learning scalable and easy. It consists of common learning algorithms and utilities, including classification, regression, clustering, collaborative filtering, dimensionality reduction, as well as lower-level optimization primitives and higher-level pipeline APIs.

It divides into two packages:

• spark.mllib contains the original API built on top of RDDs.

• spark.ml provides higher-level API built on top of DataFrames for constructing ML pipelines.

Audience

This course is directed at engineers and developers seeking to utilize a built in Machine Library for Apache Spark

In this instructor-led, live training in UAE, participants will learn how to use Python and Spark together to analyze big data as they work on hands-on exercises.

By the end of this training, participants will be able to:

• Learn how to use Spark with Python to analyze Big Data.
• Work on exercises that mimic real world cases.
• Use different tools and techniques for big data analysis using PySpark.

This instructor-led, live training in UAE (online or onsite) is aimed at data engineers, data scientists, and programmers who wish to use Spark Streaming features in processing and analyzing real-time data.

By the end of this training, participants will be able to use Spark Streaming to process live data streams for use in databases, filesystems, and live dashboards.

The objective of the course is to enable participants to gain a mastery of the fundamentals of R and how to work with data.

This course is intended for engineers and decision makers working in data mining and knoweldge discovery.

You will learn how to create effective plots and ways to present and represent your data in a way that will appeal to the decision makers and help them to understand hidden information.

This instructor-led, live training in UAE (online or onsite) is aimed at data analysts who wish to program with R in SAS for cluster analysis.

By the end of this training, participants will be able to:

• Use cluster analysis for data mining
• Master R syntax for clustering solutions.
• Implement hierarchical and non-hierarchical clustering.
• Make data-driven decisions to help to improve business operations.

In this instructor-led, live training in UAE, participants will learn how to build a Data Vault.

By the end of this training, participants will be able to:

• Understand the architecture and design concepts behind Data Vault 2.0, and its interaction with Big Data, NoSQL and AI.
• Use data vaulting techniques to enable auditing, tracing, and inspection of historical data in a data warehouse.
• Develop a consistent and repeatable ETL (Extract, Transform, Load) process.
• Build and deploy highly scalable and repeatable warehouses.

KNIME Analytics Platform is a leading open source option for data-driven innovation, helping you discover the potential hidden in your data, mine for fresh insights, or predict new futures. With more than 1000 modules, hundreds of ready-to-run examples, a comprehensive range of integrated tools, and the widest choice of advanced algorithms available, KNIME Analytics Platform is the perfect toolbox for any data scientist and business analyst.

This course for KNIME Analytics Platform is an ideal opportunity for beginners, advanced users and KNIME experts to be introduced to KNIME, to learn how to use it more effectively, and how to create clear, comprehensive reports based on KNIME workflows

This instructor-led, live training in UAE (online or onsite) is aimed at data analysts and data scientists who wish to use Weka to perform data mining tasks.

By the end of this training, participants will be able to:

• Install and configure Weka.
• Understand the Weka environment and workbench.
• Perform data mining tasks using Weka.

This instructor-led, live training in UAE (online or onsite) is aimed at data analysts or anyone who wishes to use SPSS Modeler to perform data mining activities.

By the end of this training, participants will be able to:

• Understand the fundamentals of data mining.
• Learn how to import and assess data quality with the Modeler.
• Develop, deploy, and evaluate data models efficiently.

Apache SolrCloud is a distributed data processing engine that facilitates the searching and indexing of files on a distributed network.

In this instructor-led, live training, participants will learn how to set up a SolrCloud instance on Amazon AWS.

By the end of this training, participants will be able to:

• Understand SolCloud's features and how they compare to those of conventional master-slave clusters
• Configure a SolCloud centralized cluster
• Automate processes such as communicating with shards, adding documents to the shards, etc.
• Use Zookeeper in conjunction with SolrCloud to further automate processes
• Use the interface to manage error reporting
• Load balance a SolrCloud installation
• Configure SolrCloud for continuous processing and fail-over

Audience

• Solr Developers
• Project Managers
• System Administrators
• Search Analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

ZooKeeper is a centralized service for maintaining configuration information, naming, providing distributed synchronization, and providing group services.

This instructor-led, live training in UAE (online or onsite) introduces Hortonworks Data Platform (HDP) and walks participants through the deployment of Spark + Hadoop solution.

By the end of this training, participants will be able to:

• Use Hortonworks to reliably run Hadoop at a large scale.
• Unify Hadoop's security, governance, and operations capabilities with Spark's agile analytic workflows.
• Use Hortonworks to investigate, validate, certify and support each of the components in a Spark project.
• Process different types of data, including structured, unstructured, in-motion, and at-rest.

Magellan is an open-source distributed execution engine for geospatial analytics on big data. Implemented on top of Apache Spark, it extends Spark SQL and provides a relational abstraction for geospatial analytics.

This instructor-led, live training introduces the concepts and approaches for implementing geospacial analytics and walks participants through the creation of a predictive analysis application using Magellan on Spark.

By the end of this training, participants will be able to:

• Efficiently query, parse and join geospatial datasets at scale
• Implement geospatial data in business intelligence and predictive analytics applications
• Use spatial context to extend the capabilities of mobile devices, sensors, logs, and wearables

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

This instructor-led, live training in UAE (online or onsite) is aimed at software engineers who wish to stream big data with Spark Streaming and Scala.

By the end of this training, participants will be able to:

• Create Spark applications with the Scala programming language.
• Use Spark Streaming to process continuous streams of data.
• Process streams of real-time data with Spark Streaming.

This instructor-led, live training in UAE (online or onsite) is aimed at data scientists and developers who wish to use Spark NLP, built on top of Apache Spark, to develop, implement, and scale natural language text processing models and pipelines.

By the end of this training, participants will be able to:

• Set up the necessary development environment to start building NLP pipelines with Spark NLP.
• Understand the features, architecture, and benefits of using Spark NLP.
• Use the pre-trained models available in Spark NLP to implement text processing.
• Learn how to build, train, and scale Spark NLP models for production-grade projects.
• Apply classification, inference, and sentiment analysis on real-world use cases (clinical data, customer behavior insights, etc.).

This instructor-led, live training in UAE (online or onsite) is aimed at developers who wish to implement Apache Kafka stream processing without writing code.

By the end of this training, participants will be able to:

• Install and configure Confluent KSQL.
• Set up a stream processing pipeline using only SQL commands (no Java or Python coding).
• Carry out data filtering, transformations, aggregations, joins, windowing, and sessionization entirely in SQL.
• Design and deploy interactive, continuous queries for streaming ETL and real-time analytics.

Cloudera Impala is an open source massively parallel processing (MPP) SQL query engine for Apache Hadoop clusters.

Impala enables users to issue low-latency SQL queries to data stored in Hadoop Distributed File System and Apache Hbase without requiring data movement or transformation.

Audience

This course is aimed at analysts and data scientists performing analysis on data stored in Hadoop via Business Intelligence or SQL tools.

After this course delegates will be able to

• Extract meaningful information from Hadoop clusters with Impala.
• Write specific programs to facilitate Business Intelligence in Impala SQL Dialect.
• Troubleshoot Impala.

Apache Druid is an open-source, column-oriented, distributed data store written in Java. It was designed to quickly ingest massive quantities of event data and execute low-latency OLAP queries on that data. Druid is commonly used in business intelligence applications to analyze high volumes of real-time and historical data. It is also well suited for powering fast, interactive, analytic dashboards for end-users. Druid is used by companies such as Alibaba, Airbnb, Cisco, eBay, Netflix, Paypal, and Yahoo.

In this instructor-led, live course we explore some of the limitations of data warehouse solutions and discuss how Druid can compliment those technologies to form a flexible and scalable streaming analytics stack. We walk through many examples, offering participants the chance to implement and test Druid-based solutions in a lab environment.

Format of the Course

• Part lecture, part discussion, heavy hands-on practice, occasional tests to gauge understanding

This instructor-led, live training introduces the concepts behind interactive data analytics and walks participants through the deployment and usage of Zeppelin in a single-user or multi-user environment.

By the end of this training, participants will be able to:

• Install and configure Zeppelin
• Develop, organize, execute and share data in a browser-based interface
• Visualize results without referring to the command line or cluster details
• Execute and collaborate on long workflows
• Work with any of a number of plug-in language/data-processing-backends, such as Scala (with Apache Spark), Python (with Apache Spark), Spark SQL, JDBC, Markdown and Shell.
• Integrate Zeppelin with Spark, Flink and Map Reduce
• Secure multi-user instances of Zeppelin with Apache Shiro

Knowledge discovery in databases (KDD) is the process of discovering useful knowledge from a collection of data. Real-life applications for this data mining technique include marketing, fraud detection, telecommunication and manufacturing.

In this instructor-led, live course, we introduce the processes involved in KDD and carry out a series of exercises to practice the implementation of those processes.

Audience

• Data analysts or anyone interested in learning how to interpret data to solve problems

Format of the Course

• After a theoretical discussion of KDD, the instructor will present real-life cases which call for the application of KDD to solve a problem. Participants will prepare, select and cleanse sample data sets and use their prior knowledge about the data to propose solutions based on the results of their observations.

Apache Kylin is an extreme, distributed analytics engine for big data.

In this instructor-led live training, participants will learn how to use Apache Kylin to set up a real-time data warehouse.

By the end of this training, participants will be able to:

• Consume real-time streaming data using Kylin
• Utilize Apache Kylin's powerful features, rich SQL interface, spark cubing and subsecond query latency

Note

• We use the latest version of Kylin (as of this writing, Apache Kylin v2.0)

Audience

• Big data engineers
• Big Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Apache Drill is a schema-free, distributed, in-memory columnar SQL query engine for Hadoop, NoSQL and other Cloud and file storage systems. The power of Apache Drill lies in its ability to join data from multiple data stores using a single query. Apache Drill supports numerous NoSQL databases and file systems, including HBase, MongoDB, MapR-DB, HDFS, MapR-FS, Amazon S3, Azure Blob Storage, Google Cloud Storage, Swift, NAS and local files. Apache Drill is the open source version of Google's Dremel system which is available as an infrastructure service called Google BigQuery.

In this instructor-led, live training, participants will learn the fundamentals of Apache Drill, then leverage the power and convenience of SQL to interactively query big data across multiple data sources, without writing code. Participants will also learn how to optimize their Drill queries for distributed SQL execution.

By the end of this training, participants will be able to:

• Perform "self-service" exploration on structured and semi-structured data on Hadoop
• Query known as well as unknown data using SQL queries
• Understand how Apache Drills receives and executes queries
• Write SQL queries to analyze different types of data, including structured data in Hive, semi-structured data in HBase or MapR-DB tables, and data saved in files such as Parquet and JSON.
• Use Apache Drill to perform on-the-fly schema discovery, bypassing the need for complex ETL and schema operations
• Integrate Apache Drill with BI (Business Intelligence) tools such as Tableau, Qlikview, MicroStrategy and Excel

Audience

• Data analysts
• Data scientists
• SQL programmers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Apache Drill is a schema-free, distributed, in-memory columnar SQL query engine for Hadoop, NoSQL and and other Cloud and file storage systems. The power of Apache Drill lies in its ability to join data from multiple data stores using a single query. Apache Drill supports numerous NoSQL databases and file systems, including HBase, MongoDB, MapR-DB, HDFS, MapR-FS, Amazon S3, Azure Blob Storage, Google Cloud Storage, Swift, NAS and local files. Drill is the open source version of Google's Dremel system which is available as an infrastructure service called Google BigQuery.

In this instructor-led, live training, participants will learn how to optimize and debug Apache Drill to improve the performance of queries on very large data sets. The course begins with an architectural overview and feature comparison between Apache Drill and other interactive data analysis tools. Participants then step through a series of interactive, hands-on practice sessions that include installation, configuration, performance evaluation, tuning, and debugging of an Apache Drill instance in a live lab environment.

By the end of this training, participants will be able to:

• Install and configure Apache Drill
• Understand Apache Drill's architecture and features
• Understand the services involved during query execution
• Optimize Drill queries for distributed SQL execution
• Debug Apache Drill

Audience

• Developers
• Systems administrators
• Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Notes

• To request a customized training for this course, please contact us to arrange.

Apache Drill is a schema-free, distributed, in-memory columnar SQL query engine for Hadoop, NoSQL and other Cloud and file storage systems. The power of Apache Drill lies in its ability to join data from multiple data stores using a single query. Apache Drill supports numerous NoSQL databases and file systems, including HBase, MongoDB, MapR-DB, HDFS, MapR-FS, Amazon S3, Azure Blob Storage, Google Cloud Storage, Swift, NAS and local files. Apache Drill is the open source version of Google's Dremel system which is available as an infrastructure service called Google BigQuery.

In this instructor-led, live training, participants will learn how to optimize and debug Apache Drill to improve the performance of queries on very large data sets. The course begins with an architectural overview and feature comparison between Apache Drill and other interactive data analysis tools. Participants then step through a series of interactive, hands-on practice sessions that include installation, configuration, performance evaluation, query optimization, data partitioning, and debugging of an Apache Drill instance in a live lab environment.

By the end of this training, participants will be able to:

• Install and configure Apache Drill
• Understand Apache Drill's architecture and features
• Understand how Apache Drills receives and executes queries
• Optimize Drill queries for distributed SQL execution
• Debug Apache Drill

Audience

• Developers
• Systems administrators
• Data analysts

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Notes

• To request a customized training for this course, please contact us to arrange.

Dremio is an open-source "self-service data platform" that accelerates the querying of different types of data sources. Dremio integrates with relational databases, Apache Hadoop, MongoDB, Amazon S3, ElasticSearch, and other data sources. It supports SQL and provides a web UI for building queries.

In this instructor-led, live training, participants will learn how to install, configure and use Dremio as a unifying layer for data analysis tools and the underlying data repositories.

By the end of this training, participants will be able to:

• Install and configure Dremio
• Execute queries against multiple data sources, regardless of location, size, or structure
• Integrate Dremio with BI and data sources such as Tableau and Elasticsearch

Audience

• Data scientists
• Business analysts
• Data engineers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Notes

• To request a customized training for this course, please contact us to arrange.

Apache Arrow is an open-source in-memory data processing framework. It is often used together with other data science tools for accessing disparate data stores for analysis. It integrates well with other technologies such as GPU databases, machine learning libraries and tools, execution engines, and data visualization frameworks.

In this onsite instructor-led, live training, participants will learn how to integrate Apache Arrow with various Data Science frameworks to access data from disparate data sources.

By the end of this training, participants will be able to:

• Install and configure Apache Arrow in a distributed clustered environment
• Use Apache Arrow to access data from disparate data sources
• Use Apache Arrow to bypass the need for constructing and maintaining complex ETL pipelines
• Analyze data across disparate data sources without having to consolidate it into a centralized repository

Audience

• Data scientists
• Data engineers

Format of the Course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• To request a customized training for this course, please contact us to arrange.

Apache ActiveMQ is an open source message broker written in Java.

Teradata is one of the popular Relational Database Management System. It is mainly suitable for building large scale data warehousing applications. Teradata achieves this by the concept of parallelism. 

This course introduces the delegates to Teradata.

This instructor-led, live training in UAE (online or onsite) is aimed at application developers and engineers who wish to master more sophisticated usages of the Teradata database.

By the end of this training, participants will be able to:

• Manage Teradata space.
• Protect and distribute data in Teradata.
• Read Explain Plan.
• Improve SQL proficiency.
• Use main utilities of Teradata.

In this instructor-led, live training in UAE, participants will learn about the technology offerings and implementation approaches for processing graph data. The aim is to identify real-world objects, their characteristics and relationships, then model these relationships and process them as data using a Graph Computing (also known as Graph Analytics) approach. We start with a broad overview and narrow in on specific tools as we step through a series of case studies, hands-on exercises and live deployments.

By the end of this training, participants will be able to:

• Understand how graph data is persisted and traversed.
• Select the best framework for a given task (from graph databases to batch processing frameworks.)
• Implement Hadoop, Spark, GraphX and Pregel to carry out graph computing across many machines in parallel.
• View real-world big data problems in terms of graphs, processes and traversals.

This instructor-led, live training in UAE introduces the principles and approaches behind distributed stream and batch data processing, and walks participants through the creation of a real-time, data streaming application in Apache Flink.

Apache Storm is a distributed, real-time computation engine used for enabling real-time business intelligence. It does so by enabling applications to reliably process unbounded streams of data (a.k.a. stream processing).

"Storm is for real-time processing what Hadoop is for batch processing!"

In this instructor-led live training, participants will learn how to install and configure Apache Storm, then develop and deploy an Apache Storm application for processing big data in real-time.

Some of the topics included in this training include:

• Apache Storm in the context of Hadoop
• Working with unbounded data
• Continuous computation
• Real-time analytics
• Distributed RPC and ETL processing

Request this course now!

Audience

• Software and ETL developers
• Mainframe professionals
• Data scientists
• Big data analysts
• Hadoop professionals

Format of the course

•     Part lecture, part discussion, exercises and heavy hands-on practice

Apache Apex is a YARN-native platform that unifies stream and batch processing. It processes big data-in-motion in a way that is scalable, performant, fault-tolerant, stateful, secure, distributed, and easily operable.

This instructor-led, live training introduces Apache Apex's unified stream processing architecture, and walks participants through the creation of a distributed application using Apex on Hadoop.

By the end of this training, participants will be able to:

• Understand data processing pipeline concepts such as connectors for sources and sinks, common data transformations, etc.
• Build, scale and optimize an Apex application
• Process real-time data streams reliably and with minimum latency
• Use Apex Core and the Apex Malhar library to enable rapid application development
• Use the Apex API to write and re-use existing Java code
• Integrate Apex into other applications as a processing engine
• Tune, test and scale Apex applications

Format of the Course

• Interactive lecture and discussion.
• Lots of exercises and practice.
• Hands-on implementation in a live-lab environment.

Course Customization Options

• To request a customized training for this course, please contact us to arrange.

Apache Accumulo is a sorted, distributed key/value store that provides robust, scalable data storage and retrieval. It is based on the design of Google's BigTable and is powered by Apache Hadoop, Apache Zookeeper, and Apache Thrift.

This instructor-led, live courses covers the working principles behind Accumulo and walks participants through the development of a sample application on Apache Accumulo.

Format of the Course

• Part lecture, part discussion, hands-on development and implementation, occasional tests to gauge understanding

Apache Beam is an open source, unified programming model for defining and executing parallel data processing pipelines. It's power lies in its ability to run both batch and streaming pipelines, with execution being carried out by one of Beam's supported distributed processing back-ends: Apache Apex, Apache Flink, Apache Spark, and Google Cloud Dataflow. Apache Beam is useful for ETL (Extract, Transform, and Load) tasks such as moving data between different storage media and data sources, transforming data into a more desirable format, and loading data onto a new system.

In this instructor-led, live training (onsite or remote), participants will learn how to implement the Apache Beam SDKs in a Java or Python application that defines a data processing pipeline for decomposing a big data set into smaller chunks for independent, parallel processing.

By the end of this training, participants will be able to:

• Install and configure Apache Beam.
• Use a single programming model to carry out both batch and stream processing from withing their Java or Python application.
• Execute pipelines across multiple environments.

Format of the Course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• This course will be available Scala in the future. Please contact us to arrange.

In this instructor-led, live training in UAE, participants will learn the principles behind persistent and pure in-memory storage as they step through the creation of a sample in-memory computing project.

By the end of this training, participants will be able to:

• Use Ignite for in-memory, on-disk persistence as well as a purely distributed in-memory database.
• Achieve persistence without syncing data back to a relational database.
• Use Ignite to carry out SQL and distributed joins.
• Improve performance by moving data closer to the CPU, using RAM as a storage.
• Spread data sets across a cluster to achieve horizontal scalability.
• Integrate Ignite with RDBMS, NoSQL, Hadoop and machine learning processors.

Apache Hama is a framework based on the Bulk Synchronous Parallel (BSP) computing model and is primarily used for Big Data analytics.

In this instructor-led, live training, participants will learn the fundamentals of Apache Hama as they step through the creation of a BSP-based application and a vertex-centric program using the Apache Hama frameworks.

By the end of this training, participants will be able to:

• Install and configure Apache Hama
• Understand the fundamentals of Apache Hama and the Bulk Synchronous Parallel (BSP) programming model
• Build a BSP-based program using Apache Hama BSP framework
• Build a vertex-centric program using Apache Hama Graph Framework
• Build, test, and debug their own Apache Hama applications

Audience

• Developers

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

Note

• To request a customized training for this course, please contact us to arrange.

Apache Ambari is an open-source management platform for provisioning, managing, monitoring and securing Apache Hadoop clusters.

In this instructor-led live training participants will learn the management tools and practices provided by Ambari to successfully manage Hadoop clusters.

By the end of this training, participants will be able to:

• Set up a live Big Data cluster using Ambari
• Apply Ambari's advanced features and functionalities to various use cases
• Seamlessly add and remove nodes as needed
• Improve a Hadoop cluster's performance through tuning and tweaking

Audience

• DevOps
• System Administrators
• DBAs
• Hadoop testing professionals

Format of the course

• Part lecture, part discussion, exercises and heavy hands-on practice

This instructor-led, live training in UAE (online or onsite) is aimed at data scientists who wish to use Apache Airflow to build and manage end-to-end data pipelines.

By the end of this training, participants will be able to:

• Install and configure Apache Airflow.
• Author, schedule and monitor complex data pipelines
• Manage many ETLs (Extract, extract, Transform, Load).
• Scale and secure Apache Airflow.

This instructor-led, live training in UAE (online or onsite) is aimed at architects, developers, and administrators who wish to use Denodo Platform to optimize and accelerate data management through data virtualization.

By the end of this training, participants will be able to:

• Install and configure Denodo Platform.
• Understand the features and architecture of Denodo Platform.
• Understand the key concepts, benefits, and use cases for data virtualization.
• Learn how to configure and manage the Denodo Platform server.
• Implement data security, user access, and services authentication.
• Apply the tools and techniques for operations monitoring and performance optimization.