One for Many: Transfer Learning for Building HVAC Control

by   Shichao Xu, et al.

The design of building heating, ventilation, and air conditioning (HVAC) system is critically important, as it accounts for around half of building energy consumption and directly affects occupant comfort, productivity, and health. Traditional HVAC control methods are typically based on creating explicit physical models for building thermal dynamics, which often require significant effort to develop and are difficult to achieve sufficient accuracy and efficiency for runtime building control and scalability for field implementations. Recently, deep reinforcement learning (DRL) has emerged as a promising data-driven method that provides good control performance without analyzing physical models at runtime. However, a major challenge to DRL (and many other data-driven learning methods) is the long training time it takes to reach the desired performance. In this work, we present a novel transfer learning based approach to overcome this challenge. Our approach can effectively transfer a DRL-based HVAC controller trained for the source building to a controller for the target building with minimal effort and improved performance, by decomposing the design of neural network controller into a transferable front-end network that captures building-agnostic behavior and a back-end network that can be efficiently trained for each specific building. We conducted experiments on a variety of transfer scenarios between buildings with different sizes, numbers of thermal zones, materials and layouts, air conditioner types, and ambient weather conditions. The experimental results demonstrated the effectiveness of our approach in significantly reducing the training time, energy cost, and temperature violations.


Distributed Multi-Agent Deep Reinforcement Learning Framework for Whole-building HVAC Control

It is estimated that about 40 commercial buildings can be attributed to ...

Transfer Learning for Thermal Comfort Prediction in Multiple Cities

HVAC (Heating, Ventilation and Air Conditioning) system is an important ...

Co-designing Intelligent Control of Building HVACs and Microgrids

Building loads consume roughly 40 countries, a significant part of which...

Exploring Deep Reinforcement Learning for Holistic Smart Building Control

In this paper, we take a holistic approach to deal with the tradeoffs be...

End-to-end deep metamodeling to calibrate and optimize energy loads

In this paper, we propose a new end-to-end methodology to optimize the e...

Energy Optimization for HVAC Systems in Multi-VAV Open Offices: A Deep Reinforcement Learning Approach

With more than 32 buildings, there is an urgent need to revisit traditio...

Window Opening Model using Deep Learning Methods

Occupant behavior (OB) and in particular window openings need to be cons...

Please sign up or login with your details

Forgot password? Click here to reset