BEGIN:VCALENDAR
VERSION:2.0
METHOD:PUBLISH
CALSCALE:GREGORIAN
PRODID:-//WordPress - MECv6.5.6//EN
X-ORIGINAL-URL:https://cmc.deusto.eus/
X-WR-CALNAME:cmc.deusto.eus
X-WR-CALDESC:DeustoCCM - Chair of Computational Mathematics at University of Deusto
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-PUBLISHED-TTL:PT1H
X-MS-OLK-FORCEINSPECTOROPEN:TRUE
BEGIN:VEVENT
CLASS:PUBLIC
UID:MEC-9d72602ab51415fbc2fad50252666445@cmc.deusto.eus
DTSTART:20240718T120000Z
DTEND:20240718T130000Z
DTSTAMP:20251031T212700Z
CREATED:20251031
LAST-MODIFIED:20251031
PRIORITY:5
TRANSP:OPAQUE
SUMMARY:FAU DCN-AvH Seminar: Generalization bounds for neural ODEs and Clustering in discrete-time self-attention
DESCRIPTION:Next Thursday July 18, 2024:\nOrganized by: FAU DCN-AvH, Chair for Dynamics, Control, Machine Learning and Numerics – Alexander von Humboldt Professorship at FAU, Friedrich-Alexander-Universität Erlangen-Nürnberg (Germany)\nTitle: Generalization bounds for neural ODEs and Clustering in discrete-time self-attention\nSpeaker: Lucas Versini\nAffiliation: Visiting student at FAU DCN-AvH from École Polytechnique\nAbstract. This presentation details the findings from two machine learning research projects.\nThe first project focuses on neural Ordinary Differential Equations (neural ODEs), which serve as continuous-time analogs to traditional neural networks. By establishing generalization bounds, the study aims to elucidate the predictive performance of neural ODEs on unseen data. Theoretical results were corroborated through numerical experiments conducted on synthetic datasets.\nThe second project examines the long-time behavior of discrete-time self-attention mechanisms commonly employed in language and vision tasks. We demonstrate that iterative application of self-attention mechanisms can lead to convergence towards a single cluster. Numerical experiments support these findings, leading to conjectures that suggest possible directions for future research, despite not being fully proven during the course of this internship.\nWHEN\nThu. July 18, 2024 at 14:00H\nWHERE\nRoom H13\nFriedrich-Alexander-Universität Erlangen-Nürnberg\n_\nSee all Seminars at FAU DCN-AvH\nDon’t miss out our last news and connect with us!\nLinkedIn | Twitter | Instagram\n
URL:https://cmc.deusto.eus/events-calendar/fau-dcn-avh-seminar-generalization-bounds-for-neural-odes-and-clustering-in-discrete-time-self-attention/
ORGANIZER;CN=FAU DCN-AvH:MAILTO:
CATEGORIES:FAU DCN-AvH Jr. Seminar,FAU DCN-AvH Seminar
LOCATION:FAU - Faculty of Sciences
ATTACH;FMTTYPE=image/png:https://cmc.deusto.eus/wp-content/uploads/FAUDCNAvHJrSeminar_lVersini_18jul2024.png
END:VEVENT
END:VCALENDAR