Table of Contents


  • November 8th: The review session for the exam sheets (Einsicht) will take place on 11 November in Wittgenstein at DFKI between 3pm - 5pm
  • November 8th: Results of the second MDM Exam are now online. Please find the published results here
  • September 16th: The review session for the exam sheets (Einsicht) will take place on 21st September in Bayes (2.04) at DFKI between 3pm - 6pm
  • September 16th: Results of the first MDM Exam are now online. Please find the published results here
  • September 5th: The date of the second exam is finalized. It will take place on Monday, October 10th at 10am in 46-110. Please note that the room is reserved for a longer time period in its KIS entry.
  • July 20th: Slides for lecture 13 are online
  • July 10th: The exercise for Sheet 5 will take place one week later on Wednesday July 20th. There is no exercise on Wednesday July 13th. This means also that submission deadline for the exercise will be extended to Tuesday July 19th.
  • July 7th: slides for lecture 12 are online
  • July 5th: There was an interview at the WDR Leornardo show about our AI research Link to Radio Interview. They did also cover a special about Multimedia Opinion Mining Project
  • June 29th: slides for lecture 11 are online
  • June 23rd: slides for lecture 10 are online
  • June 6th: There are still slots available for the eye-tracking experiment. If you do want to do the experiment and did not yet have a slot selected please do so following this Doodle
  • June 1st: We want to clarify that the currently running eye-tracking experiment is considered to be counted as one exercise in context of all exercises. This means that participation in the experiment will be counting together with your other exercise contributions towards the 50% that you want to reach to be prepared for the exam.
  • May 31st: Due to a conference travel (ACM ICMR 2016), the next exercise will take place on Wednesday June 15th.
  • May 24th: The written exam is scheduled for the Aug. 15th: 10am-11am, please see: KIS Entry
  • May 19th: Please note that in order to take the exam, successful participation in the exercises is important. This includes obtaining at least 50% of the points in the exercises to be prepared for the exam.
  • May 9th: Tomorrow's lecture (May 10th) will take place. It looks like for some reasons the KIS entry is missing.
  • May 4th: Exercise are taking place each second week i.e. next exercise is on Wednesday 11th May
  • May 3rd: Slides for the first lectures are online.
  • April 28th: Live TV Show about AI and Ethik: Scobel 3Sat
  • April 21st: The first exercise on April 27th will cover the first exercise sheet (basic maths).
  • April 21st: Lecture starts today! Please note that our fixed lecture slot is usually Tuesday.


  • Lecture: Tuesdays, 15:30-17:00, 48-453
  • Tutorials: Wednesdays, 8:15-9:45, 36-265


  • Damian Borth
  • Contact email (all requests)
  • Registration for the class to help us organizing the class
    • please register with an email to providing the following information:
      • Name
      • email
      • field of study
      • do want to take the exam?


Lecture schedule:

block date lecturer content details slides & demos exercise sheets & materials
1 21.04.16 Damian Borth Introduction course formalities, history, definitions, introduction slides -
2 26.04.16 Multimedia Information Systems setup, labels, benchmarking slides sheet
3 03.05.16 Pattern Recognition (supervised) basic decision theory, classification, classifier combination slides Ipython/Jupyter Installation link Ex2IPythonNotebook(right-click and save as ipynb)
4 10.05.16 Pattern Recognition (unsupervised) clustering, dimensionality reduction slides sheet material NumPy Website NumPy Tutorial
5 17.05.16 Text Retrieval document retrieval, retrieval models, relevance feedback, data structures slides -
6 24.05.16 Image Representation 1 definitions, features and their properties, invariance slides live exercise: eye-tracking experiment
7 31.05.16 No lecture - - -
8 07.06.16 Image Representation 2 eye-tracking experiment, global features, local features slides sheet, URL list Caffe Framework Caffe MNIST Tutorial Ex3IPythonNotebook
9 13.06.16 Christian Schulze Similarity Search applications, prototypical architecture, distance measures, object search slides -
10 21.06.16 Damian Borth Visual Recognition and Image Classification 1 applications, challenges, face detection, face recognition, object recognition, visual words slides sheet, material Ex4IPythonNotebook
11 28.06.16 Visual Recognition and Image Classification 2 visual recognition tasks: classification detection, segmentation, Bag-of-Words, SVM slides -
12 05.07.16 Visual Recognition and Image Classification 3 - Deep Learning 1 concept vocabularies, Visual Sentiment Ontology (VSO), SentiBank, CNN Architectures slides sheet, material
13 12.07.16 Deep Learning 2 Neural Networks, End-to-end Learning, AlexNet, Convolutions, Activation, Pooling slides -
14 19.07.16 Christian Schulze Video Analysis Shot Boundary Detection, Keyframe Extraction, Motion, Audio slides -

Last modified:: 08.11.2016