Manager a multivalued attribute?

In the traditional example of a COMPANY database in database design textbooks, we are told that a DEPARTMENT can have only one manager hence Manager should be a single-valued attribute. However, shouldn't it be multivalued since one department can have different managers at different times? Shouldn't we create a table with managers and start and end dates?

Thanks in advance.