The recent developments of large language models (LLMs) and their extension in multimodal foundation models have introduced new perspectives in AI. An LLM is basically a very large neural net trained as a statistical predictor of the likely continuation of a sequence of words. LLMs have excellent competencies over a broad set of NLP tasks. Additionally, LLMs demonstrate the emergence of deliberation capabilities for reasoning, common sense, problem solving, code writing, and planning. These abilities have not been designed for in LLMs. They are unexpected and remain to a large extent poorly understood. Although error-prone and imperfect, they open up promising perspectives for acting, planning, and learning, which are presented in this chapter.