A semi-join is a relational database operation that retrieves rows from one table where there is a matching row in another table, but only returns columns from the first table. It is used to optimize queries by reducing the amount of data that needs to be processed and transferred, especially in distributed databases.