There are 2 yellow wires in the bundle in the dash....one is the switched 12v, the other is the left rear speaker (-).

Is it possible you have them switched, since you didn't have the factory harness? Easiest way to check would be with a meter.

 

if u used a adater harness the orange i never use that is a dimmer wire...