Now showing items 1-3 of 3

    • Exact and Soft Successive Refinement of the Information Bottleneck 

      Charvin, Hippolyte; Catenacci Volpi, Nicola; Polani, Daniel (2023-09-19)
      The information bottleneck (IB) framework formalises the essential requirement for efficient information processing systems to achieve an optimal balance between the complexity of their representation and the amount of ...
    • Successive Refinement and Coarsening of the Information Bottleneck 

      Charvin, Hippolyte; Catenacci Volpi, Nicola; Polani, Daniel (2022-11-21)
      We study two central aspects of information processing in cognitive systems: one is the ability to incorporate fresh information to already learnt models; the other is the “trickling” of information through the many layers ...
    • Towards Information Theory-Based Discovery of Equivariances 

      Charvin, Hippolyte; Catenacci Volpi, Nicola; Polani, Daniel (2023-11-29)
      The presence of symmetries imposes a stringent set of constraints on a system. This constrained structure allows intelligent agents interacting with such a system to drasti- cally improve the efficiency of learning and ...