This book focuses on information theoretic aspects of and cooperative control techniques in networked multi-agent systems (NMAS) with communication constraints. In the first part of the research, information theoretic limitations of tracking problems in networked control systems, especially leader-follower systems with communication constraints, are studied. In the second part, we propose an easily scalable hierarchical decision-making and control architecture for smart grid with communication constraints in which distributed customers equipped with renewable distributed generation (RDG) interact and trade energy in the grid. In the third part, we consider the disturbance attenuation and stabilization problem in a large group of inter-connected systems over a communication network. In the fourth part, we consider distributed tracking and consensus in wireless sensor networks with noisy time-varying graphs and incomplete data.