Store Repeated Data

I have a table (Key tinyint, Value bigint). There are a billion rows for each distinct Key value and only about 100 distinct Key values.

Is there a way to not have to store Key in the every row without breaking this up into multiple tables?