discoverconferences
SPEAKERS/LEONARD MATTHIAS EBERDING
Leonard Matthias Eberding

Leonard Matthias Eberding

Reykjavik University, Leibniz University Hanover

Leonard Matthias' lectures

lecture cover

Leonard Matthias Eberding · AGI-20

SAGE: Task-Environment Platform for Evaluating a Broad Range of AI Learners

While several tools exist for training and evaluating narrow machine learning (ML) algorithms, their design generally does not follow a particular or explicit evaluation methodology or theory. Inversely so for more general learners, where many evaluation methodologies and frameworks have been suggested, but few specific tools exist. In this paper we introduce a new framework for broad evaluation of artificial intelligence (AI) learners, and a new tool that builds on this methodology. The platform, called SAGE (Simulator for Autonomy \& Generality Evaluation), works for training and evaluation of a broad range of systems and allows detailed comparison between narrow and general ML and AI. It provides a variety of tuning and task construction options, allowing isolation of single parameters across complexity dimensions. SAGE is aimed at helping AI researchers map out and compare strengths and weaknesses of divergent approaches. Our hope is that it can help deepen understanding of the various tasks we want AI systems to do and the relationship between their composition, complexity, and difficulty for various AI systems, as well as contribute to building a clearer research road map for the field. This paper provides an overview of the framework and presents results of an early use case.

lecture cover

Multiple speakers · AGI-20

AGI-20 Main Conference - Livestream Day 1

lecture cover

Multiple speakers · AGI-20

Panel Session 2: Intelligence measures, AGI Benchmarks and Evaluations

Panel discussion with authors of papers about 'Intelligence measures, AGI Benchmarks and Evaluations' at AGI-20 conference. Held live on Underline, 06/24/2020