Performance of Clojure lazy structures vs hashes/sets/vectors?

I am using Clojure data structures all over the place but I am not using any lazy evaluation. Is there a performance penalty for using lazy structures everywhere?