Foveated Neural Computation - Laboratoire d'Informatique, Signaux et Systèmes de Sophia-Antipolis Accéder directement au contenu
Communication Dans Un Congrès Année : 2022

Foveated Neural Computation

Résumé

The classic computational scheme of convolutional layers leverages filter banks that are shared over all the spatial coordinates of the input, independently on external information on what is specifically under observation and without any distinctions between what is closer to the observed area and what is peripheral. In this paper we propose to go beyond such a scheme, introducing the notion of Foveated Convolutional Layer (FCL), that formalizes the idea of location-dependent convolutions with foveated processing, i.e., fine-grained processing in a given-focused area and coarser processing in the peripheral regions. We show how the idea of foveated computations can be exploited not only as a filtering mechanism, but also as a mean to speed-up inference with respect to classic convolutional layers, allowing the user to select the appropriate trade-off between level of detail and computational burden. FCLs can be stacked into neural architectures and we evaluate them in several tasks, showing how they efficiently handle the information in the peripheral regions, eventually avoiding the development of misleading biases. When integrated with a model of human attention, FCL-based networks naturally implement a foveated visual system that guides the attention toward the locations of interest, as we experimentally analyze on a stream of visual stimuli.
Fichier principal
Vignette du fichier
_2022__Foveated_Networks___ecml_camera_ready.pdf (1.47 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-03881258 , version 1 (01-12-2022)

Identifiants

  • HAL Id : hal-03881258 , version 1

Citer

Matteo Tiezzi, Simone Marullo, Alessandro Betti, Enrico Meloni, Lapo Faggi, et al.. Foveated Neural Computation. ECML PKDD 2022 - European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases, Sep 2022, Grenoble, France. ⟨hal-03881258⟩
61 Consultations
109 Téléchargements

Partager

Gmail Facebook X LinkedIn More