Keep short cut number in window list

It seems that every time the window list is displayed the short cut numbers are reassigned to the windows, likely dependend on the window stack order. Is it somehow possible to keep a once assigned short cut number/character (like e.g. the buffer number in vim)? I have a lot of (full size) windows open and every time I request the window list I need to read through the list to search for a specific window. If I change for example often between xterm, gvim, and gv and I would know their fixed assigned short cuts I would only need to display the window list and hit the short cut number without reading the list (just like a “:b” in vim without doing “:ls”).