CSC 5003 – Semantic Web And Big Data Architecture

Portail informatique

Liens utiles
Supports
- CM1
  
  Introduction to Big Data Tools And Concepts
  - Slides
    – 3h
  - Big Data
  - Use cases
- CI1
  
  Introduction to Scala
  - Lecture Presentation
    – 10min
  - Slides
    – 1h30
  - Exercices
    – 1h20
  - Scala
  - Functional programming
- CI2
  
  Hadoop And MapReduce
  - Slides
    – 1h30
  - Exercices
    – 1h20
  - Optional Exercices (Part 1, 2, 3, Hadoop setup and Docker)
    – 3h
  - Map Reduce Framework
  - HDFS
- CI3
  
  Spark
  - Slides
    – 1h30
  - Exercices
    – 1h30
  - YARN
  - RDD, DataFrame, Dataset
  - Spark high-order functions
  - Persistance
  - Shared variables
- CI4
  
  Kafka
  - Slides
    – 1h30
  - Exercices
    – 1h30
  - Producer/Consumer
  - Kafka topics and partitioning
- CI5
  
  Spark Streaming
  - Slides
    – 1h30
  - Exercices
    – 1h30
  - XXX
- Presentations
  
  Hadoop Ecosytem Student Presentations
  - Slides
    – 3h
  - Discover the tools of the Hadoop Ecosystem
- CF
  
  Final Exam - Project Start
  - Written Exam
    – 1h30
  - Slides
    – 3h
  - Test your knowledge
  - Start the projects

Synthèse des heures enseignées

Enseignant	Cours (séances de 3h)	CI (séances de 1.5h)	CF (séances de 1h)
All