Colorectal cancer (CRC) is one of the major forms of cancer and one of the leading causes of death in adults. Although the sequence of events of the mutational activation of oncogenes and mutational loss of tumor suppressors is rather well characterized in human CRC, it is clear that the progression of the disease is not only a cell autonomous process. Progression is also affected by extrinsic factors such as the tumor microenvironment, including the tumor infiltrating immune cells. In this context, it has been shown that CRC patients with high T cell infiltration have a rather good prognosis and a better overall survival compared to patients with low T cell infiltration, suggesting that immune-surveillance might be an important component of CRC progression. This led to clinical trials administering immune checkpoint inhibitors aiming to initiate anti-tumor T cell responses. Unfortunately, they were largely unsuccessful. This unresponsiveness of the vast majority of CRC patients to immune checkpoint inhibitors suggests that additional and currently unknown factors contribute to the inhibition of efficient anti-tumor T cell responses.