March, 2022 - ML cube

07 Mar 22

Artificial intelligence in everyday life

Whenever Artificial Intelligence is mentioned, many imagine a dystopian future in which every single activity is carried out by machines. Furthermore, a widespread misconception is the fact that Artificial Intelligence is about the future and that it is not yet part of our lives. Artificial Intelligence, on the other hand, is applied in the most […]

07 Mar 22

Federated Learning To Predict Oxygen Needs

Cambridge’s Addenbrooke’s Hospital in collaboration with NVIDIA and 20 other hospitals around the world has used an Artificial Intelligence algorithm and Federated Learning to predict the oxygen needs of Covid-19 patients in the first days of therapy. FEDERATED LEARNING: FEDERATED LEARNING FOR ALGORITHMIC TRAINING The AI algorithm employed by Addenbrooke’s Hospital in Cambridge was […]

07 Mar 22

Deepfake: typologies and reflections, deep learning and GANs

This article wants to propose some examples of Deepfake with typologies and reflections on deep learning and GANs. Try to imagine a speech by an extremely vulgar political candidate of hate speech that is spread online and made viral by online communities on social media. A fictional but realistic scenario thanks to AI and Synthetic […]

07 Mar 22

Artificial Neural Networks to Understand the Functioning of the Mind

Until a few decades ago, the study of the mind and human behavior were essentially the prerogative of psychology and philosophy. Although it is possible to identify the birth of neuroscience around the 5th century BC, the modern discipline flourished in the 1960s making a great contribution to understanding the biological basis of learning and […]

07 Mar 22

AI algorithm for diagnosing Covid-19 and other pathologies

The diagnosis of Covid-19 and other diseases has been accelerated thanks to an AI algorithm. Thanks to a technique called Federated Learning, the University of Cambridge International Team has developed an AI algorithm that can be trained using the datasets of other hospitals and foreign facilities. In this way, the diagnostics of Covid-19 and other […]

07 Mar 22

Online Planning for F1 Race Strategy Identification

Authors Diego Piccinotti, Amarildo Likmeta, Nicolò Brunello, Marcello Restelli Abstract Formula 1 (F1) racing is one of the most competitive racing competitions involving high-performance single-seater racing vehicles. The result of a race is determined by vehicle and driver performance, as well as by the tire and pit-stop strategy employed in the race. In this work, […]

07 Mar 22

Subgaussian Importance Sampling for Off-Policy Evaluation and Learning

Authors Alberto Maria Metelli, Alessio Russo, Marcello Restelli Abstract Importance Sampling (IS) is a widely used building block for a large variety of off-policy estimation and learning algorithms. However, empirical and theoretical studies have progressively shown that vanilla IS leads to poor estimations whenever the behavioral and target policies are too dissimilar. In this paper, […]

07 Mar 22

Safe Policy Iteration: A Monotonically Improving Approximate Policy Iteration Approach

Authors Alberto Maria Metelli, Matteo Pirotta, Daniele Calandriello, Marcello Restelli Abstract This paper presents a study of the policy improvement step that can be usefully exploited by approximate policy–iteration algorithms. When either the policy evaluation step or the policy improvement step returns an approximated result, the sequence of policies produced by policy iteration may not […]

07 Mar 22

MushroomRL: Simplifying Reinforcement Learning Research

Authors Carlo D’Eramo, Davide Tateo, Andrea Bonarini, Marcello Restelli, Jan Peters Abstract MushroomRL is an open-source Python library developed to simplify the process of implementing and running Reinforcement Learning (RL) experiments. Compared to other available libraries, MushroomRL has been created with the purpose of providing a comprehensive and flexible framework to minimize the effort in […]

07 Mar 22

Exploiting Opponents under Utility Constraints in Extensive-Form Games

Authors Martino Bernasconi, Federico Cacciamani, Simone Fioravanti, Nicola Gatti, Alberto Marchesi, Francesco Trovò Abstract Recently, game-playing agents based on AI techniques have demonstrated super-human performance in several sequential games, such as chess, Go, and poker. Surprisingly, the multi-agent learning techniques that allowed to reach these achievements do not take into account the actual behavior of […]