Data and Services in the Cloud

Goals

The era of Big Data, in which petabytes of information are accumulating at an accelerating rate calls to the massive use of techniques to manage (store, index, shard, duplicate), query, and analyse them. Processing billions of web pages, photos, log entries calls for the development of new tools and the proposal of new programming paradigms.
Cloud computing is emerging as a relatively new approach for dealing and facilitating unlimited access to computing and storage resources for building applications. The very basic principle of cloud computing is to assume that applications, accessible through a network, are built upon a service oriented infrastructure dedicated to provide them with the necessary (not more not less) computing, storage and network resources. Instead of having one for all computer or server, the computing context is configured according to the characteristics of the application. Instead of buying one computer/server resources are provided (and bought) on demand.
This course will focus on data integration and management on cloud service oriented architectures. Therefore, the course will briefly introduce cloud computing fundamental concepts and will address data and services management on Cloud using practical examples based on cloud existing environments and execution models like (i) ETL and federation tools; (ii) Mapreduce and its implementation Hadoop, the most prominent open-source ecosystem of tools for working with exciting new large-scale datasets and, (iii) “No SQL databases”.

Objectives

• Understand the emerging area of "cloud computing" and how it relates to traditional models of computing.
• To gain competence in
  o ETL approaches for collecting large data collections
  o MapReduce as a programming model for distributed processing of datasets
  o NoSQL databases systems for the management and querying of data collections according to applications requirements
• To have an experience in building, accessing, and using cloud services by adopting a service oriented approach.