http://etf2l.org/forum/customise/topic-29385/
Give this a go, might have to adjust it to what you want.
Let me know
For the numbers keys part, maybe something like:
Bind 1 "num1"
Bind 2 "num2" etc

If ^ doesn't work I found an all in one. http://pastebin.com/Q5BSsBy9
It should work for every class except spy and engineer
Credit goes to HR

i have one at home that works with quickswitch (not sure about scrollwheel), ill post it when i get home if no one else gets you by then

[spoiler]bind mouse2 +attack2

alias wep1 "slot1; wep1com; alias mouseup wep-3; alias mousedown wep2; alias quickswap wep-3; alias lastwep wep1; keybind1"
alias wep2 "slot2; wep2com; alias mouseup wep-1; alias mousedown wep3; alias quickswap wep-1; alias lastwep wep2; keybind2"
alias wep3 "slot3; wep3com; alias mouseup wep-2; alias mousedown wep1; alias quickswap wep-2; alias lastwep wep3; keybind3"
alias wep-1 "slot1; wep1com; alias mouseup wep-3; alias mousedown wep2; alias quickswap wep2; alias lastwep wep-1; keybind-1"
alias wep-2 "slot2; wep2com; alias mouseup wep-1; alias mousedown wep3; alias quickswap wep3; alias lastwep wep-2; keybind-2"
alias wep-3 "slot3; wep3com; alias mouseup wep-2; alias mousedown wep1; alias quickswap wep1; alias lastwep wep-3; keybind-3"
alias keybind1 "alias key1 wep1; alias key2 mousedown; alias key3 mouseup"
alias keybind2 "alias key1 mouseup; alias key2 wep2; alias key3 mousedown"
alias keybind3 "alias key1 mousedown; alias key2 mouseup; alias key3 wep3"
alias keybind-1 "alias key1 wep-1; alias key2 mousedown; alias key3 mouseup"
alias keybind-2 "alias key1 mouseup; alias key2 wep-2; alias key3 mousedown"
alias keybind-3 "alias key1 mousedown; alias key2 mouseup; alias key3 wep-3"
alias mouseup "wep-3"
alias mousedown "wep2"
alias quickswap "lastwep"
alias lastwep "wep2"
alias key1 "wep1"
alias key2 "mousedown"
alias key3 "mouseup"
alias key4 "slot4; extrakey"
alias key5 "slot5; extrakey"
alias extrakey "alias mouseup wep-3; alias mousedown wep1; alias quickswap lastwep; alias lastwep wep3"

// DO NOT MESS WITH THE ABOVE STUFF

// EDIT THE FOLLOWING ALIASES, SEE DESCRIPTION BELOW
alias wep1com "r_drawviewmodel 0;viewmodel_fov 0;bind e key2"
alias wep2com "r_drawviewmodel 0;viewmodel_fov 85;bind e key1"
alias wep3com "r_drawviewmodel 1;viewmodel_fov 85;"

//BACKUP
bind MWHEELUP mouseup
bind MWHEELDOWN mousedown
bind 1 key1
bind 2 key2
bind 3 key3
bind 4 key4
bind 5 key5[/spoiler]

my buddy ls gave this script to me. it works with the scroll wheel, primary/secondary are hidden, e is a toggle
u can edit it but idk if people can have a more compact script. that would be cool
the bind mouse2 +attack2 just rebinds my stuff cuz i have a medic script too

Broesel's crosshair switcher can do this.

Also there was a thread about this like 3 days ago where Kairu posted a really well formatted config. You might try looking that up.

edit found it:
http://www.teamfortress.tv/31631/r-drawviewlmodel-problem#5

you would just have to change it so 1 and 2 were off not just 1

delete this, missed part in OP about working with scroll wheel

Thanks for the help guys, I'll try out the scripts later and see how it goes.

just use broesel's crosshair switcher:
http://etf2l.org/forum/customise/topic-11110/

you can set a custom crosshair for each weapon slot for each specific class, and whether you want viewmodels on for that slot or not.

i've used it for around a year now and it's pretty much the best you will get

[quote=drifta]just use broesel's crosshair switcher:
http://etf2l.org/forum/customise/topic-11110/

you can set a custom crosshair for each weapon slot for each specific class, and whether you want viewmodels on for that slot or not.

i've used it for around a year now and it's pretty much the best you will get[/quote]
Does it work with quickswitch key and mousewheel switching too?

Allow me to introduce you to this configuration generator, please check this out:
clugu.com/tf2mate/