Looks like you should have
An excellent fishing stream that consistently produces trophy size brown trout. Access at El Vado lake and near Ghost Ranch. Section from El Vado Reservoir has been designated as a wild and scenic river. Fish species include brown trout, rainbow trout and kokanee salmon. A 34 mile stretch of river. Best trout fishing is within several miles of El Vado Dam.
I have only driven down below El Vado dam once and did see people fishing along there, just not above the reservoir.