Here is a very good example to follow. It will resolve your issue very well.
https://trumpexcel.com/select-multiple-items-drop-down-list-excel/
To set it up for the whole column, look for the below question in the above link.
Q: I need to create multiple drop-downs in a row. How can I do this?