Or to just do it on the fly...
ssh -L8080:$IP:443 username@ubuntuhost
Then open a browser, go to https://localhost:8080
and you should get it
Replace $IP of the ddwrt box you are connecting to.
You can do the same with the "tunneling" dialog in putty from a windows machine.