Port Renfrew is a great place to come fishing if you don't want to travel very far up Vancouver Island.
Being at the south end of Vancouver Island, Port Renfrew is only a few hours away from Victoria. Here you can be in some very good fishing on the open water. The one disadvantage to Port Renfrew is the distance travel on open water to reach the Swiftsure Bank. Also, there is not place to fish if the waters are rough.
If you do get out on some calm water though and you live near the Victoria area and don't want the long drive, then you can be into some good fishing that Victoria doesn't get to enjoy.