Learning Attentional Communication for Multi-Agent Cooperation (NIPS 2018)

Introduction

Communication can help multiagents learn to cooperate with each other. However, when the size of agents is large, there may exist some useless information that may impair the learning of cooperation. For this reason, this work proposes an attentional communication model that can filter out the unnecessary shared information for cooperative decision making. Inspired by the recurrent models of visual attention, this work delivers an attention unit that receives encoded local observation and action intention of an agent to determine whether it is needed to cooperate with others in its observable field. In other words, each agent called initiator, selects collaborators to form a communication group.

Read More

LEARNING WHEN TO COMMUNICATE AT SCALE IN MULTIAGENT COOPERATIVE AND COMPETITIVE TASKS (ICLR 2019)

Introduction

Recent works shows that the continuous communication can produce the efficient learning with backpropagation in multiagent scenarios, but restricted to the fully cooperative tasks (with the global reward). This work produce a model namely IC3Net that controls continuous communication with a gating mechanism and uses individualized rewards for each agent to acquire better performance and scalability while fixing credit assignment issues.

Read More

Learning Multiagent Communication with Backpropagation (NIPS 2016)

Introduction

This paper delivers a neural network called CommNet to deal with the fully cooperative tasks by using continuous communication. According to the demonstration of the experiments, this network architecture shows the capability to enable agents to learn to communicate amongst themselves before taking actions.

Read More

Strictly Competitive Games

In short words, strictly competitive games are a special type of strategic games whose preferences are completely opposed. The formal definition is shown as following.

Read More

Strategic Games

Definitions

A strategic games is a model of interactive decision-making in which each decision-maker selects his plan of action once and for all, and these choices are made simultaneously. The formal definition of a strategic game is shown as following.

Read More

A Brief Overview on Game Theory

What is Game Theory?

Game theory is a subject that helps us to realize the phenomena caused by the interaction of decision-makers. The fundamental assumption of game theory is that every decision-maker persues an exogenous objective while considers other decision-makers’ behaviours. Actually, game theory does nothing but constructs some abstract models that can reflect the real-life situations.

Read More