Return a map instead of a list of frames

Creating a new list with map.values() is very expensive, and not
necessary in the places where the we iterate over the frames,
because we can directly iterate on a map and get the values.