ICArUS: Phase 1 Challenge Problem Design and Test Specification describes the Phase 1 challenge problem and outlines the T&E approach for evaluating models.
ICArUS: Phase 1 Challenge Problem Design and Test Specification
Download Resources
PDF Accessibility
One or more of the PDF files on this page fall under E202.2 Legacy Exceptions and may not be completely accessible. You may request an accessible version of a PDF using the form on the Contact Us page.
Phase 1 of the IARPA program ICArUS (Integrated Cognitive-neuroscience Architectures for Understanding Sensemaking) requires a challenge problem that poses cognitive challenges of geospatial sensemaking. The problem serves as a modeling challenge for performers and enables assessment in T&E (Test and Evaluation) per BAA guidelines. This document describes the Phase 1 challenge problem and outlines the T&E approach for evaluating models in Neural Fidelity Assessment, Cognitive Fidelity Assessment, and Comparative Performance Assessment.