You can also get a one-day temporary registration to drive the vehicle out of California.
What you can’t avoid is paying California sales tax for the first month, if you pick up the vehicle there. This may not apply on a vehicle that’s never driven by the lessor on a California road. I didn’t ask, since this wouldn’t have applied to my situation.