CS Talk - David Janin

Event time: 
Tuesday, October 28, 2014 - 4:00pm
Location: 
AKW 200 See map
51 Prospect Street
New Haven, CT 06511
Event description: 

CS Talk
David Janin

Host: Paul Hudak

Title: Tiled Programming of Temporal Media

Abstract: Nowadays, one can develop incredibly rich and clever interactive realtime multimedia systems that handle temporal media of various types: audio streams, musical streams, video, motion captures, animations, etc. However, designing these systems remains a difficult task. At the technical level, their lack of structure may be the cause of lack of reliability and robustness. At the creative level, the amount of technicalities to be mastered may kill the artistic intentions of the designers.

A possible remedy to both problems is to develop models and tools that provide abstract and homogeneous views of the way these heterogeneous temporal media can be synchronized, transformed, combined etc. The notion of polymorphic temporal media (PTM) developed by Paul Hudak is a first step to answer the needs. The notion of tiled polymorphic temporal media (TPTM), presented in this talk, offers an additional abstraction layer on top of PTMs. It could well be the second step.

In this talk, I will describe the notion of TPTM by showing how it naturally arrises when modeling musical structure. I will describe the rich algebraic structure it induces: namely, inverse semigroups. Then I will detail the current implementation of polymorphic tiled temporal media in Haskell/Euterpea. If time permits, I will also illustrate the notion of tiled modeling by the demo of a simple realtime music software prototype based on a “tiled representation” of cyclic rhythmic structures.

This presentation is based on a joint work with many colleagues, especially from LaBRI/SCRIME (Bordeaux), GRAME (Lyon) and IRCAM (Paris) in France. It has also greatly benefited from an ongoing collaboration with Paul Hudak, Yale (New Haven).