Multi-hop retrieval is a process where information is gathered through several interconnected steps or 'hops.' Each hop fetches data based on the previous step, effectively drilling down to relevant information across multiple sources. This is crucial in tasks requiring complex information synthesis, like answering detailed questions where facts are scattered across various documents. It's closely associated with approaches like chain-of-thought reasoning and compositionality in answers.